Face registration method and device based on 3D structured light camera
A face registration method using a 3D structured light camera with liveness and image quality detection, integrated with an industrial computer system, addresses the lack of 3D cameras in the Kirin system, ensuring fast and accurate face registration and real-person verification.
Patent Information
- Application Number
- CN202411287419.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2024-09-13
- Publication Date
- 2024-12-27
- Estimated Expiration
- 2044-09-13
AI Technical Summary
The existing facial recognition systems for subway ticket machines, such as the Kirin system, lack 3D structured light cameras, requiring significant manpower for adaptation and face registration, and mobile phone-based registration poses data leakage risks without real-person verification.
A face registration method using a 3D structured light camera integrated with an industrial computer system, performing liveness detection and image quality checks, and cloud-based registration to adapt to the Kirin system for fast and accurate face recognition.
Enables the 3D structured light camera to be adapted to the Kirin system, and solve the problem of data leakage and the lack of 3D structured light cameras in the Kirin system, achieving fast and accurate face registration with real-person verification.
Smart Images

Figure CN119206878A_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the technical field of face recognition registration, and in particular to a face registration method and device based on a 3D structured light camera. Background Art
[0002] At present, there is an increasing demand for the subway to use facial recognition to pass through gates, and the facial registration function is generally implemented on self-service or semi-self-service ticket machines. Since self-service or semi-self-service ticket machines are generally domestically produced Kirin systems, there is a lack of 3D structured light cameras adapted to the Kirin system on the market. Adapting to the Kirin system requires a lot of manpower to develop drivers and recognition algorithms, which is inefficient and cost-effective.
[0003] In addition, face-related information registered with traditional mobile phones needs to be transmitted through the Internet, which poses a risk of data leakage. At the same time, it is impossible to detect whether the person is a real person when registering with a mobile phone.
[0004] Therefore, how to invent a face registration method that can adapt the 3D structured light camera to the Kirin system and achieve fast and accurate face registration has become an urgent problem to be solved. Summary of the invention
[0005] To this end, the present invention provides a face registration method and device based on a 3D structured light camera, which can adapt the 3D structured light camera to the Kirin system to achieve fast and accurate face registration.
[0006] In order to achieve the above object, the present invention provides the following technical solution: a face registration method based on a 3D structured light camera, comprising:
[0007] Start the 3D structured light camera through the industrial computer system; capture the video stream data of the user's face through the 3D structured light camera;
[0008] The industrial computer system starts the RTMP service, and pushes the captured video stream data of the user's face to the server of the industrial computer system through the RTMP service;
[0009] When the video stream data of the user's face captured by the 3D structured light camera meets the set requirements, the host computer system obtains the video stream data of the user's face through the server of the industrial computer system; the host computer system scans and recognizes the user's face according to the video stream data of the user's face to complete the user's face registration;
[0010] The industrial computer system performs liveness detection and image quality detection on the registered user's face through a set program to ensure that the registered user's face information is authentic and valid;
[0011] The industrial computer system takes a screenshot of the user's face picture that has completed the liveness detection and the picture quality detection, and sends the screenshot to the host computer system;
[0012] The host computer system performs preliminary processing on the received screenshots, and sends the screenshots that have completed the preliminary processing to the cloud server;
[0013] The cloud server performs user face registration based on the screenshots received after preliminary processing, completing user face registration and cloud backup.
[0014] As a preferred solution of a face registration method based on a 3D structured light camera, in the process of capturing the video stream data of the user's face through the 3D structured light camera, the video stream data includes color stream, infrared stream and depth information stream data.
[0015] As a preferred solution for a face registration method based on a 3D structured light camera, in the process of the industrial computer system performing liveness detection and image quality detection on the registered user's face through a setting program, the setting program is the liveness detection and image quality detection program of Baidu Face Recognition SDK.
[0016] As a preferred solution of the face registration method based on a 3D structured light camera, in the process of the industrial computer system taking screenshots of the user's face picture that has completed the liveness detection and the picture quality detection, the screenshot processing is to capture a frame of color stream image data after the liveness detection and the picture quality detection are completed.
[0017] As a preferred solution of a face registration method based on a 3D structured light camera, in the process of the host computer system performing preliminary processing on the received screenshot, the preliminary processing includes image cropping and image correction processing on the screenshot.
[0018] The present invention also provides a face registration device based on a 3D structured light camera, based on the above face registration method based on a 3D structured light camera, comprising:
[0019] A face video data stream acquisition module is used to start a 3D structured light camera through an industrial computer system; and to capture video stream data of a user's face through the 3D structured light camera;
[0020] The video data stream push module is used for the industrial computer system to start the RTMP service and push the captured video stream data of the user's face to the server of the industrial computer system through the RTMP service;
[0021] The host computer system face registration module is used for, when the video stream data of the user's face captured by the 3D structured light camera meets the set requirements, the host computer system obtains the video stream data of the user's face through the server of the industrial computer system; the host computer system scans and recognizes the user's face according to the video stream data of the user's face, and completes the user's face registration;
[0022] The face registration information detection module is used in the industrial computer system to perform liveness detection and image quality detection on the registered user's face through a set program to ensure that the registered user's face information is authentic and valid;
[0023] A user face screenshot processing module is used for the industrial computer system to take a screenshot of the user face picture that has completed the liveness detection and the picture quality detection, and send the screenshot to the host computer system;
[0024] The screenshot preliminary processing module is used for the host computer system to perform preliminary processing on the received screenshots and send the screenshots that have completed the preliminary processing to the cloud server;
[0025] The cloud face registration module is used for the cloud server to register the user's face according to the screenshot after preliminary processing, and complete the user's face registration and cloud backup.
[0026] As a preferred solution of a face registration device based on a 3D structured light camera, in the face video data stream acquisition module, in the process of capturing the video stream data of the user's face through the 3D structured light camera, the video stream data includes color stream, infrared stream and depth information stream data.
[0027] As a preferred solution for a face registration device based on a 3D structured light camera, in the face registration information detection module, during the process in which the industrial computer system performs liveness detection and image quality detection on the registered user's face through a setting program, the setting program is the liveness detection and image quality detection program of Baidu face recognition SDK.
[0028] As a preferred solution of a face registration device based on a 3D structured light camera, in the user face screenshot processing module, during the process of the industrial computer system performing screenshot processing on the user face picture that has completed the liveness detection and the picture quality detection, the screenshot processing is to capture a frame of color stream image data after completing the liveness detection and the picture quality detection.
[0029] As a preferred solution of a face registration device based on a 3D structured light camera, in the screenshot preliminary processing module, when the host computer system performs preliminary processing on the received screenshot, the preliminary processing includes image cropping and image correction processing on the screenshot.
[0030] The present invention has the following advantages: starting a 3D structured light camera through an industrial computer system; capturing video stream data of a user's face through the 3D structured light camera; starting an RTMP service through the industrial computer system, and pushing the captured video stream data of the user's face to a server of the industrial computer system through the RTMP service; when the video stream data of the user's face captured by the 3D structured light camera meets the set requirements, the host computer system obtains the video stream data of the user's face through the server of the industrial computer system; the host computer system scans the user's face according to the video stream data of the user's face The industrial computer system performs liveness detection and image quality detection on the registered user's face through a set program to ensure that the registered user's face information is authentic and valid; the industrial computer system takes a screenshot of the user's face image that has completed the liveness detection and image quality detection, and sends the screenshot to the host computer system; the host computer system performs preliminary processing on the received screenshot, and sends the screenshot that has completed the preliminary processing to the cloud server; the cloud server performs user face registration based on the screenshot after receiving the preliminary processing, and completes user face registration and cloud backup. The present invention enables the 3D structured light camera to adapt to the Kirin system, realizes fast and accurate face registration, and solves the problem that the existing technology requires a lot of manpower to develop driving and recognition algorithms for the adaptation of the Kirin system. BRIEF DESCRIPTION OF THE DRAWINGS
[0031] In order to more clearly illustrate the implementation methods of the present invention or the technical solutions in the prior art, the following briefly introduces the drawings required for the implementation methods or the description of the prior art. Obviously, the drawings in the following description are only exemplary, and for ordinary technicians in this field, other implementation drawings can be derived from the provided drawings without creative work.
[0032] The structures, proportions, sizes, etc. illustrated in this specification are only used to match the contents disclosed in the specification so as to facilitate understanding and reading by persons familiar with the technology. They are not used to limit the conditions under which the present invention can be implemented, and therefore have no substantial technical significance. Any structural modification, change in proportion or adjustment of size shall still fall within the scope of the technical contents disclosed in the present invention without affecting the effects and purposes that can be achieved by the present invention.
[0033] Figure 1 This is a flow chart of a face registration method based on a 3D structured light camera provided in Embodiment 1 of the present invention;
[0034] Figure 2 This is a schematic diagram of a specific implementation process of a face registration method based on a 3D structured light camera provided in Embodiment 1 of the present invention;
[0035] Figure 3 This is a schematic diagram of the architecture of a face registration device based on a 3D structured light camera provided in Example 2 of the present invention. DETAILED DESCRIPTION
[0036] The following is a description of the implementation of the present invention by specific embodiments. People familiar with the art can easily understand other advantages and effects of the present invention from the contents disclosed in this specification. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0037] Example 1
[0038] See also Figure 1 and Figure 2 Embodiment 1 of the present invention provides a face registration method based on a 3D structured light camera, comprising the following steps:
[0039] S1. Start a 3D structured light camera through an industrial computer system; capture video stream data of a user's face through the 3D structured light camera;
[0040] S2, the industrial computer system starts the RTMP service, and pushes the captured video stream data of the user's face to the server of the industrial computer system through the RTMP service;
[0041] S3. When the video stream data of the user's face captured by the 3D structured light camera meets the set requirements, the host computer system obtains the video stream data of the user's face through the server of the industrial computer system; the host computer system scans and recognizes the user's face according to the video stream data of the user's face to complete the user's face registration;
[0042] S4. The industrial computer system performs liveness detection and image quality detection on the registered user's face through a set program to ensure that the registered user's face information is authentic and valid;
[0043] S5. The industrial computer system takes a screenshot of the user's face image that has completed the liveness detection and the image quality detection, and sends the screenshot to the host computer system;
[0044] S6, the host computer system performs preliminary processing on the received screenshots, and sends the screenshots that have completed the preliminary processing to the cloud server;
[0045] S7. The cloud server performs user face registration based on the screenshot after receiving the preliminary processing, and completes user face registration and cloud backup.
[0046] In this embodiment, in step S1, a 3D structured light camera is started by an industrial computer system; video stream data of a user's face is captured by the 3D structured light camera;
[0047] The video stream data includes RGB (color) stream, IR (infrared) stream and Deep (depth information) stream. The video stream data provides a rich and accurate data basis for subsequent face recognition and liveness detection.
[0048] In this embodiment, in step S2, the industrial computer system starts the RTMP service, and pushes the captured video stream data of the user's face to the server of the industrial computer system through the RTMP service;
[0049] Specifically, the industrial computer system starts the RTMP (Real-time Messaging Protocol) service and pushes the captured RGB stream to the server started by the local computer itself, so that remote users or systems can pull and preview the video stream in real time, enhancing the system's remote monitoring and interaction capabilities.
[0050] In this embodiment, in step S3, when the video stream data of the user's face captured by the 3D structured light camera meets the set requirements, the host computer system obtains the video stream data of the user's face through the server of the industrial computer system; the host computer system scans and recognizes the user's face according to the video stream data of the user's face, and completes the user's face registration;
[0051] In this embodiment, in step S4, the industrial computer system performs liveness detection and image quality detection on the registered user's face through a set program to ensure that the registered user's face information is authentic and valid;
[0052] Specifically, the industrial computer system performs liveness detection and image quality detection on the registered user's face through the liveness detection and image quality detection programs of Baidu face recognition SDK.
[0053] Specifically, the core program code for liveness detection is as follows:
[0054] " / **
[0055] *Detection-Liveness-Face Retrieval Process
[0056] *OparambdFaceImageConfig / / Visible light YUV data stream
[0057] *@parambaNirFaceImageConfig / / Infrared YUV data stream
[0058] *@parambdDepthFaceImageConfig / / depth data stream
[0059] *@parambaFaceCheckConfig identification parameters
[0060] * @param faceDetectCallBacK
[0061] * /
[0062] public void onDetectcheck(finatBDFaceImageconfigbaFaceImageconfig,
[0063] final BDFaceInageconfigbaNirFaceImageconfig,
[0064] finatBDFaceImageConfigbdDepthFaceImageConfig,
[0065] final BDFacecheckConfigbdFaceCheckConfig,
[0066] final FaceDetectCalLBack faceDetectCallBack)".
[0067] Among them, faceDetectCallBack will call back the scores of RGB, NIR and Depth detection results;
[0068] Specifically, the core program code for image quality detection is as follows:
[0069] "void initQuality(final Context context,final StringblurModel,finalString occlurModel,final Callback callback)".
[0070] Among them, blurModel is the blur detection model path, occlurModel is the occlusion detection model path, and callback is the detection result callback.
[0071] In this embodiment, in step S5, the industrial computer system takes a screenshot of the user's face picture that has completed the liveness detection and the picture quality detection, and sends the screenshot to the host computer system;
[0072] The screenshot processing is to capture a frame of color stream image data after the living body detection and the image quality detection are completed.
[0073] Specifically, the captured object in the screenshot processing is a frame of RGB image data after passing liveness detection (including RGB liveness, NIR liveness and Depth liveness) and RGB image quality detection.
[0074] Among them, the principle of liveness detection is to determine whether the collected face is a real face by performing feature analysis on the collected facial information, and filter out photos or videos that are deceptive to a certain extent.
[0075] Specifically, RGB liveness detection is achieved by analyzing the flaws in the captured portrait, such as moiré, imaging deformity, image quality, reflectivity, etc., and combining the analysis of global features and local micro-texture information to effectively filter out prostheses.
[0076] NIR liveness detection is the detection of biological tissues using the characteristics of near-infrared spectroscopy. The structure and function information of biological tissues are obtained by irradiating biological tissues with near-infrared light (NIR) and analyzing the reflected or transmitted light signals.
[0077] Depth liveness detection achieves high-precision 3D face liveness detection by eliminating the influence of strong external interference factors (such as face occlusion, poor lighting, etc.) and multi-posture changes of the face (such as side face, expression, etc.).
[0078] In this embodiment, in step S6, the host computer system performs preliminary processing on the received screenshots, and sends the screenshots that have completed the preliminary processing to the cloud server;
[0079] The preliminary processing includes cropping the screenshot and performing image correction processing.
[0080] Specifically, the preliminary processing is to perform image cropping (highlighting face data) and image correction (rotation, translation, scaling, flipping, etc.) on the RGB data obtained by the screenshot. Image cropping and image correction themselves use existing technologies and will not be described in detail here.
[0081] In this embodiment, in step S7, the cloud server performs user face registration based on the screenshot after receiving the preliminary processing, and completes the user face registration and cloud backup.
[0082] Specifically, when the cloud server successfully receives and processes all the registration information, it marks the end of the face registration process. This process not only completes the digital storage of user face information, but also achieves deep integration with the cloud system, providing strong technical support and data protection for subsequent face recognition, identity verification and other applications.
[0083] In summary, the present invention starts a 3D structured light camera through an industrial computer system; captures video stream data of a user's face through the 3D structured light camera; the industrial computer system starts an RTMP service, and pushes the captured video stream data of the user's face to a server of the industrial computer system through the RTMP service; when the video stream data of the user's face captured by the 3D structured light camera meets the set requirements, the host computer system obtains the video stream data of the user's face through the server of the industrial computer system; the host computer system scans and processes the user's face according to the video stream data of the user's face Identification processing, complete user face registration; the industrial computer system performs liveness detection and image quality detection on the registered user face through a set program to ensure that the registered user face information is true and valid; the industrial computer system takes a screenshot of the user face picture that has completed the liveness detection and the image quality detection, and sends the screenshot to the host computer system; the host computer system performs preliminary processing on the received screenshot, and sends the screenshot that has completed the preliminary processing to the cloud server; the cloud server performs user face registration based on the screenshot after receiving the preliminary processing, and completes user face registration and cloud backup. The present invention can make the 3D structured light camera adapt to the Kirin system, realize fast and accurate face registration, and solve the problem that the existing technology requires a lot of manpower to develop driving and recognition algorithms for adapting the Kirin system.
[0084] It should be noted that the method of the embodiment of the present disclosure can be performed by a single device, such as a computer or a server. The method of the present embodiment can also be applied in a distributed scenario and completed by multiple devices cooperating with each other. In the case of such a distributed scenario, one of the multiple devices can only perform one or more steps in the method of the embodiment of the present disclosure, and the multiple devices will interact with each other to complete the described method.
[0085] It should be noted that some embodiments of the present disclosure are described above. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps recorded in the claims can be performed in an order different from that in the above embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or continuous order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
[0086] Example 2
[0087] See also Figure 3 Embodiment 2 of the present invention further provides a face registration device based on a 3D structured light camera, comprising:
[0088] The face video data stream acquisition module 001 is used to start the 3D structured light camera through the industrial computer system; and to capture the video stream data of the user's face through the 3D structured light camera;
[0089] The video data stream push module 002 is used for the industrial computer system to start the RTMP service and push the captured video stream data of the user's face to the server of the industrial computer system through the RTMP service;
[0090] The host computer system face registration module 003 is used for, when the video stream data of the user's face captured by the 3D structured light camera meets the set requirements, the host computer system obtains the video stream data of the user's face through the server of the industrial computer system; the host computer system scans and recognizes the user's face according to the video stream data of the user's face, and completes the user's face registration;
[0091] The face registration information detection module 004 is used for the industrial computer system to perform liveness detection and image quality detection on the registered user's face through a set program to ensure that the registered user's face information is authentic and valid;
[0092] The user face screenshot processing module 005 is used for the industrial computer system to take a screenshot of the user face picture that has completed the liveness detection and the picture quality detection, and send the screenshot to the host computer system;
[0093] The screenshot preliminary processing module 006 is used for the host computer system to perform preliminary processing on the received screenshots and send the screenshots that have completed the preliminary processing to the cloud server;
[0094] The cloud face registration module 007 is used for the cloud server to register the user's face according to the screenshot after preliminary processing, and complete the user's face registration and cloud backup.
[0095] In this embodiment, in the face video data stream acquisition module 001, in the process of capturing the video stream data of the user's face through the 3D structured light camera, the video stream data includes color stream, infrared stream and depth information stream data.
[0096] In this embodiment, in the face registration information detection module 004, during the process of the industrial computer system performing liveness detection and image quality detection on the registered user face through a setting program, the setting program is the liveness detection and image quality detection program of Baidu face recognition SDK.
[0097] In this embodiment, in the user face screenshot processing module 005, during the process of the industrial computer system performing screenshot processing on the user face image that has completed the liveness detection and the image quality detection, the screenshot processing is to capture a frame of color stream image data after completing the liveness detection and the image quality detection.
[0098] In this embodiment, in the screenshot preliminary processing module 006, when the host computer system performs preliminary processing on the received screenshot, the preliminary processing includes image cropping and image correction processing on the screenshot.
[0099] It should be noted that the information interaction, execution process and other contents between the modules of the above-mentioned system are based on the same concept as the method embodiment in Example 1 of the present application, and the technical effects they bring are the same as those of the method embodiment of the present application. For specific contents, please refer to the description in the method embodiment shown above in the present application, and will not be repeated here.
[0100] Example 3
[0101] Embodiment 3 of the present invention provides a non-transitory computer-readable storage medium, in which a program code for a face registration method based on a 3D structured light camera is stored. The program code includes instructions for executing embodiment 1 or any possible implementation method of a face registration method based on a 3D structured light camera.
[0102] The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device such as a server or a data center that includes one or more available media. The available medium may be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid-state drive (SSD)).
[0103] Example 4
[0104] Embodiment 4 of the present invention provides an electronic device, including: a memory and a processor;
[0105] The processor and the memory communicate with each other via a bus; the memory stores program instructions that can be executed by the processor, and the processor calls the program instructions to execute a face registration method based on a 3D structured light camera in embodiment 1 or any possible implementation thereof.
[0106] Specifically, the processor can be implemented by hardware or by software. When implemented by hardware, the processor can be a logic circuit, an integrated circuit, etc.; when implemented by software, the processor can be a general-purpose processor implemented by reading software codes stored in a memory. The memory can be integrated in the processor or can be located outside the processor and exist independently.
[0107] In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present invention is generated in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable systems. The computer instructions can be stored in a computer-readable storage medium, or transmitted from a computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions can be transmitted from a website site, computer, server or data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center.
[0108] Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general computing system, they can be concentrated on a single computing system, or distributed on a network composed of multiple computing systems, and optionally, they can be implemented by a program code executable by a computing system, so that they can be stored in a storage system and executed by the computing system, and in some cases, the steps shown or described can be executed in a different order than here, or they can be made into individual integrated circuit modules, or multiple modules or steps therein can be made into a single integrated circuit module for implementation. Thus, the present invention is not limited to any specific combination of hardware and software.
[0109] Although the present invention has been described in detail above by general description and specific embodiments, it is obvious to those skilled in the art that some modifications or improvements can be made to the present invention. Therefore, these modifications or improvements made without departing from the spirit of the present invention all belong to the scope of protection claimed by the present invention.
Claims
1. A face registration method based on a 3D structured light camera, characterized in that: include: Start the 3D structured light camera through the industrial computer system; Capturing video stream data of the user's face through the 3D structured light camera; The industrial computer system starts the RTMP service, and pushes the captured video stream data of the user's face to the server of the industrial computer system through the RTMP service; When the video stream data of the user's face captured by the 3D structured light camera meets the set requirements, the host computer system obtains the video stream data of the user's face through the server of the industrial computer system; The host computer system scans and recognizes the user's face according to the video stream data of the user's face, and completes the user's face registration; The industrial computer system performs liveness detection and image quality detection on the registered user's face through a set program; The industrial computer system takes a screenshot of the user's face picture that has completed the liveness detection and the picture quality detection, and sends the screenshot to the host computer system; The host computer system performs preliminary processing on the received screenshots, and sends the screenshots that have completed the preliminary processing to the cloud server; The cloud server performs user face registration based on the screenshots received after preliminary processing, completing user face registration and cloud backup.
2. A face registration method based on a 3D structured light camera according to claim 1, characterized in that: In the process of capturing the video stream data of the user's face through the 3D structured light camera, the video stream data includes color stream, infrared stream and depth information stream data.
3. The face registration method based on a 3D structured light camera according to claim 2, characterized in that: In the process of the industrial computer system performing liveness detection and image quality detection on the registered user's face through a setting program, the setting program is the liveness detection and image quality detection program of Baidu face recognition SDK.
4. The face registration method based on a 3D structured light camera according to claim 3, characterized in that: In the process of the industrial computer system taking screenshots of the user's face picture after the liveness detection and the picture quality detection, the screenshot processing is to capture a frame of color stream picture data after the liveness detection and the picture quality detection are completed.
5. The face registration method based on a 3D structured light camera according to claim 4, characterized in that: When the host computer system performs preliminary processing on the received screenshot, the preliminary processing includes image cropping and image correction processing on the screenshot.
6. A face registration device based on a 3D structured light camera, using a face registration method based on a 3D structured light camera according to any one of claims 1 to 5, characterized in that: include: The face video data stream acquisition module is used to start the 3D structured light camera through the industrial computer system; Capturing video stream data of the user's face through the 3D structured light camera; The video data stream push module is used for the industrial computer system to start the RTMP service and push the captured video stream data of the user's face to the server of the industrial computer system through the RTMP service; The host computer system face registration module is used for obtaining the video stream data of the user's face through the server of the industrial computer system when the video stream data of the user's face captured by the 3D structured light camera meets the set requirements; The host computer system scans and recognizes the user's face according to the video stream data of the user's face, and completes the user's face registration; The face registration information detection module is used for the industrial computer system to perform liveness detection and image quality detection on the registered user's face through a set program; A user face screenshot processing module is used for the industrial computer system to take a screenshot of the user face picture that has completed the liveness detection and the picture quality detection, and send the screenshot to the host computer system; The screenshot preliminary processing module is used for the host computer system to perform preliminary processing on the received screenshots and send the screenshots that have completed the preliminary processing to the cloud server; The cloud face registration module is used for the cloud server to register the user's face according to the screenshot after preliminary processing, and complete the user's face registration and cloud backup.
7. The face registration device based on a 3D structured light camera according to claim 6, characterized in that: In the face video data stream acquisition module, in the process of capturing the video stream data of the user's face through the 3D structured light camera, the video stream data includes color stream, infrared stream and depth information stream data.
8. The face registration device based on a 3D structured light camera according to claim 7, characterized in that: In the face registration information detection module, during the process of the industrial computer system performing liveness detection and image quality detection on the registered user's face through a setting program, the setting program is the liveness detection and image quality detection program of Baidu face recognition SDK.
9. The face registration device based on a 3D structured light camera according to claim 8, characterized in that: In the user face screenshot processing module, during the process of the industrial computer system performing screenshot processing on the user face image that has completed the liveness detection and the image quality detection, the screenshot processing is to capture a frame of color stream image data after completing the liveness detection and the image quality detection.
10. The face registration device based on a 3D structured light camera according to claim 9, characterized in that: In the screenshot preliminary processing module, when the host computer system performs preliminary processing on the received screenshot, the preliminary processing includes image cropping and image correction processing on the screenshot.
Citation Information
Patent Citations
A monitoring method based on face recognition
CN109190557A
3D structured light camera system, data acquisition method and device and storage medium
CN115567697A
Real-time three-dimensional scene reconstruction method based on Android mobile terminal and storage medium
CN117115344A
Registration method and system, and electronic device, storage medium and computer program product
WO2023273070A1
