A face recognition interaction method and system based on privacy protection

Abstract

The present invention relates to the field of face recognition interaction technology, and specifically discloses a face recognition interaction method and system based on privacy protection. The method includes the following steps: dividing the detected image into grid regions, numbering the grid regions; determining normal grids based on the similarity degree of the grid regions with the same number in the standard image and the comparison image; grouping the normal grids, and determining normal regions according to the grouping; collecting the user's face image through the normal region with the largest area, and performing privacy protection processing on the face image. The present invention improves the accuracy of face recognition while protecting the privacy of users.

Description

Technical Field

[0001] The present invention relates to the technical field of face recognition interaction, and in particular to a face recognition interaction method and system based on privacy protection. Background Art

[0002] Face recognition interaction is a human-computer interaction method based on biometric recognition technology. It automatically captures and analyzes the facial features of users through cameras and algorithms to achieve identity verification or behavior authorization, and is widely used in fields such as mobile phone unlocking, payment authentication, security monitoring, and intelligent access control. With the continuous development of face recognition technology, its interaction experience has become smoother and more efficient, and at the same time, higher requirements have been put forward for privacy protection and data security.

[0003] A Chinese patent with the patent publication number CN113313026B discloses a face recognition interaction method, device, and equipment based on privacy protection. The main steps in its solution include: collecting the face image of a user; determining the face key points in the face image; according to the face key points, determining a partial area in the face area of the face image as the face key area; performing privacy protection processing on the background area in the face image and the face area outside the face key area; and presenting the face key area and the area after privacy protection processing to the user to complete the face recognition process of the user.

[0004] However, with the continuous increase in the usage time, the device for collecting face images may experience varying degrees of wear under long-term operation and the influence of the external environment. For example, physical damages such as scratches on the lens surface may occur, resulting in unclear phenomena such as blurring, uneven brightness, or missing details in certain areas of the captured face image. Furthermore, the problem that the face key area in the obtained face image is unclear may occur, affecting the face recognition effect. Summary of the Invention

[0005] The purpose of the present invention is to provide a face recognition interaction method and system based on privacy protection to solve the following technical problems:

[0006] With the continuous increase in the usage time, the device for collecting face images may experience varying degrees of wear under long-term operation and the influence of the external environment. For example, physical damages such as scratches on the lens or sensor surface may occur, resulting in unclear phenomena such as blurring, uneven brightness, or missing details in certain areas of the captured face image. Furthermore, the problem that the face key area in the obtained face image is unclear may occur, affecting the face recognition effect.

[0007] The purpose of the present invention can be achieved through the following technical solutions:

[0008] A face recognition interaction method based on privacy protection includes the following steps:

[0009] Obtain an image of the front of the lens of the face image acquisition device during a period when face recognition is not performed, record it as a detection image, perform grid division on the detection image to obtain a number of grid regions, the length and width of a single grid region are both preset values, and number the grid regions;

[0010] Mark the detection image corresponding to the time point when the face image acquisition device starts to be put into use as a standard image, and mark the detection image corresponding to the current time as a comparison image; Denote the grid region numbered i in the standard image and the comparison image as grid Di and grid Di' respectively, obtain the similarity degree Xi between the grid Di and grid Di', and when the similarity degree is greater than a preset similarity degree threshold, mark the grid Di' as a normal grid;

[0011] Group the normal grids, there is the same side between the normal grids in the same group and at least one of the normal grids in this group, obtain the area composed of all the normal grids in the same group, and record it as a normal area;

[0012] When the user performs face recognition, collect the user's face image through the normal area with the largest area, and perform privacy protection processing on the face image.

[0013] As a further solution of the present invention: Collecting the user's face image through the normal area with the largest area includes:

[0014] Mark the normal area with the largest area as the target area, and when the face key area is not completely included in the face image obtained from the target area, perform the following steps:

[0015] Mark the center point of the part of the face key area that is not included as point A1, mark the center point of the face key area as point A2, and mark the direction from point A2 to point A1 as the target direction;

[0016] Control the face image acquisition device to move along the target direction until the face key area is completely included in the face image obtained from the target area.

[0017] As a further solution of the present invention: When the ratio of the part of the face key area that is not included to the face key area exceeds a preset ratio threshold, send a warning message to prompt the user.

[0018] As a further solution of the present invention: Performing privacy protection processing on the face image includes: Cropping the part of the face image except the face key area.

[0019] As a further solution of the present invention: when the area of the target area is smaller than a preset area threshold, a warning message is sent to a preset management personnel.

[0020] As a further solution of the present invention: a new normal grid is obtained after a preset time interval.

[0021] A face recognition interaction system based on privacy protection, comprising:

[0022] Collection module: obtain an image in front of the lens of the face image acquisition device during a time period when face recognition is not performed, record it as a detection image, divide the detection image into a plurality of grid areas, the length and width of a single grid area are both preset values, and number the grid areas;

[0023] Positioning module: mark the detection image corresponding to the time point when the face image acquisition device starts to be put into use as a standard image, and mark the detection image corresponding to the current time as a comparison image; respectively record the grid area numbered i in the standard image and the comparison image as grid Di and grid Di', obtain the similarity degree Xi between grid Di and grid Di', and when the similarity degree is greater than a preset similarity degree threshold, mark grid Di' as a normal grid;

[0024] Group the normal grids, there is the same side between the normal grids in the same group and at least one of the normal grids in the group, and obtain the area composed of all the normal grids in the same group, which is recorded as a normal area;

[0025] Privacy module: when the user performs face recognition, collect the user's face image through the normal area with the largest area, and perform privacy protection processing on the face image.

[0026] The beneficial effects of the present invention: compared with the prior art:

[0027] 1) By obtaining the lens detection image and dividing the grid during the non-recognition period, and comparing the similarity of the corresponding grids in the standard image and the current image, the present invention can dynamically detect and identify the image degradation areas in the lens caused by wear, stains or aging, etc., and accordingly delimit the available normal areas, avoiding the dependence on the degraded areas during the face image acquisition process, and fundamentally solving the recognition failure problem caused by the blurred image, uneven brightness or missing details due to long-term use of the device;

[0028] 2) In the prior art, more emphasis is placed on desensitizing the image content. For example, only the key areas are retained and the background areas are masked, but the impact that the change in image quality may have on the key areas of the face itself is ignored, resulting in the risk of formal privacy protection and recognition failure. Based on ensuring privacy protection, the present invention proposes to collect faces by dynamically detecting normal areas and accurately identifying the maximum effective area, and at the same time, combining the integrity check of the key areas of the face with the device automatic adjustment compensation mechanism to ensure that the final collected image contains complete and clear key areas. By cropping the non-key parts and adjusting the acquisition perspective in real time, not only is the user's privacy information protected from leakage, but also the image quality is effectively ensured to be in a usable state, enabling the system to achieve a technical balance between privacy protection and recognition accuracy and improving the actual usability. BRIEF DESCRIPTION OF THE DRAWINGS

[0029] The present invention will be further described below with reference to the accompanying drawings.

[0030] Figure 1 It is a schematic flowchart of a face recognition interaction method based on privacy protection according to the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0031] The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0032] Please refer to Figure 1 As shown, the present invention is a face recognition interaction method based on privacy protection, including the following steps:

[0033] During the time period when face recognition is not performed, an image of the front of the lens of the face image acquisition device is obtained, denoted as the detection image. The detection image is divided into a plurality of grid regions, the length and width of a single grid region are both preset values, and the grid regions are numbered.

[0034] It should be noted that during non-face recognition periods, the images captured are those taken by the lens of the face image acquisition device itself, i.e., the detection images. The purpose is not to identify users but to determine whether there are any abnormalities in the lens, such as physical problems like wear, scratches, stains, or aging that may cause a decline in imaging quality. The system controls the camera to take an image of the current environment during periods without recognition tasks (such as early morning or idle time), and divides this image into several equally sized grid regions. For example, an image of 1920×1080 is divided into grids of 60×60 pixels, totaling 576. Each grid represents a part of the lens imaging area, and the system assigns a number to each grid for subsequent image quality comparison and anomaly detection. If there are slight scratches or local stains on the lens, usually only some image areas will be affected. By identifying whether there are physical anomalies in the lens, the accuracy and clarity of subsequent face images collected can be ensured;

[0035] Mark the detection image corresponding to the time point when the face image acquisition device is first put into use as the standard image, and mark the detection image corresponding to the current time as the comparison image; Denote the grid region numbered i in the standard image and the comparison image as grid Di and grid Di' respectively, obtain the similarity degree Xi between grid Di and grid Di', and when the similarity degree is greater than the preset similarity degree threshold, mark grid Di' as a normal grid;

[0036] It can be understood that when the lens leaves the factory or the device is first put into use, an image of the lens state at that time is captured as the standard image, indicating the initial state of the lens without scratches, pollution, and with good imaging quality. Subsequently, during the operation of the device, the system regularly captures lens imaging images as comparison images for quality comparison with the standard image. Each image has been numbered according to a fixed grid rule. For example, the grid region numbered i is extracted from the standard image and the comparison image respectively, denoted as grid Di and Di', and the similarity of these two corresponding grid regions is calculated. Methods can include structural similarity index (SSIM), histogram comparison, edge information matching, etc., to obtain the similarity degree Xi of this region. If Xi exceeds the set threshold (such as 0.9), it indicates that the imaging of this region in the current image is not much different from the initial state and can be considered not affected by lens wear. Therefore, mark grid Di' as a normal grid. Through this per-grid comparison method, the system can carefully identify which positions in the lens imaging area are still clearly usable, thereby dynamically constructing the collectible area and improving the monitoring accuracy of image quality and the reliability of subsequent face collection;

[0037] It should be noted that the normal grids are re-obtained after every preset time period.

[0038] Group the normal grids. The normal grids in the same group share at least one side with at least one of the normal grids in the group. Obtain the area composed of all the normal grids in the same group, which is denoted as the normal area;

[0039] When the user performs face recognition, collect the user's face image through the normal area with the largest area, and perform privacy protection processing on the face image;

[0040] In a preferred embodiment of the present invention, collecting the user's face image through the normal area with the largest area includes:

[0041] Mark the normal area with the largest area as the target area. When the face key area is not completely included in the face image obtained from the target area, perform the following steps:

[0042] Mark the center point of the part of the face key area that is not included as point A1, mark the center point of the face key area as point A2, and mark the direction from point A2 to point A1 as the target direction;

[0043] Control the face image acquisition device to move along the target direction until the face key area is completely included in the face image obtained from the target area;

[0044] It can be understood that when the area of the target area is less than the preset area threshold, send a warning message to the preset management personnel;

[0045] It should be noted that after the similarity analysis of all grid regions is completed, the regions determined to be normal grids will be subjected to connectivity analysis, and the adjacent judgment method is used to group the interconnected normal grids into the same group. Specifically, if a normal grid shares an edge with another normal grid (adjacent in the up, down, left, or right direction), they are considered to belong to the same connected region. The system traverses all normal grids to form multiple continuous blocky grid sets, called normal regions. Subsequently, the system compares the areas of each normal region and selects the region with the largest area as the target acquisition region for image acquisition in subsequent face recognition. If the face image acquired in this target region fails to completely cover the key face regions (such as eyes, nose, mouth, etc.), the system will determine the position of the missing part through the edge of the key region. Taking the center point of the key face region as A2 and the center of the missing part as A1, the system calculates the vector direction from A2 to A1 as the target direction and controls the camera or the acquisition module to move along this direction until the target region in the newly captured image completely covers the key face region. During this process, the image acquisition structure remains unchanged, and compensation is achieved only by adjusting the acquisition perspective or the composition position, so as to ensure that the face image not only avoids the damaged area of the lens but also contains complete key face information, providing a reliable basis for subsequent recognition and privacy processing;

[0046] It should be noted that when the ratio of the part of the key face region not included exceeds the preset ratio threshold, a warning message is sent to prompt the user.

[0047] In another preferred embodiment of the present invention, the privacy protection process for the face image includes: cropping the part of the face image other than the key face region.

[0048] A face recognition interaction system based on privacy protection includes:

[0049] Acquisition module: Obtain an image of the front of the lens of the face image acquisition device during the period when face recognition is not performed, record it as a detection image, divide the detection image into several grid regions, the length and width of a single grid region are both preset values, and number the grid regions;

[0050] Positioning module: Mark the detection image corresponding to the time point when the face image acquisition device starts to be put into use as the standard image, and mark the detection image corresponding to the current time as the comparison image; Denote the grid regions numbered i in the standard image and the comparison image as grid Di and grid Di' respectively, obtain the similarity degree Xi between the grid Di and the grid Di', and when the similarity degree is greater than the preset similarity degree threshold, mark the grid Di' as a normal grid;

[0051] Group the normal grids. The normal grids in the same group share at least one side with at least one of the normal grids in the group. Obtain the area formed by all the normal grids in the same group, which is denoted as the normal area;

[0052] Privacy module: When the user performs face recognition, collect the user's face image through the normal area with the largest area, and perform privacy protection processing on the face image.

[0053] The above has described an embodiment of the present invention in detail, but the content is only a preferred embodiment of the present invention and cannot be considered as limiting the scope of implementation of the present invention. All equivalent changes and improvements made according to the scope of the application of the present invention should still fall within the scope covered by the present invention.

Claims

1. A face recognition interaction method based on privacy protection, characterized in that It includes the following steps: Obtain an image of the front of the lens of the face image acquisition device during a period when face recognition is not being performed, record it as a detection image, perform grid division on the detection image to obtain a number of grid regions, the length and width of a single grid region are both preset values, and number the grid regions; Mark the detection image corresponding to the time point when the face image acquisition device starts to be put into use as a standard image, and mark the detection image corresponding to the current time as a comparison image; Denote the grid region numbered i in the standard image and the comparison image as grid Di and grid Di' respectively, obtain the similarity degree Xi between grid Di and grid Di', and when the similarity degree is greater than a preset similarity degree threshold, mark grid Di' as a normal grid; Group the normal grids, and there is the same side between the normal grids in the same group and at least one of the normal grids in this group, obtain the area composed of all the normal grids in the same group, and record it as a normal area; When the user performs face recognition, collect the user's face image through the normal area with the largest area, and perform privacy protection processing on the face image.

2. The face recognition interaction method based on privacy protection according to claim 1, wherein Collecting the user's face image through the normal area with the largest area includes: Mark the normal area with the largest area as the target area, and when the face key area is not completely included in the face image obtained from the target area, perform the following steps: Mark the center point of the part of the face key area that is not included as point A1, mark the center point of the face key area as point A2, and mark the direction from point A2 to point A1 as the target direction; Control the face image acquisition device to move along the target direction until the face key area is completely included in the face image obtained from the target area.

3. The face recognition interaction method based on privacy protection according to claim 2, wherein When the ratio of the part of the face key area that is not included to the face key area exceeds a preset ratio threshold, send a warning message to prompt the user.

4. A face recognition interaction method based on privacy protection according to claim 1, characterized in that, Performing privacy protection processing on the face image includes: cropping the part of the face image except the face key area.

5. The face recognition interaction method based on privacy protection according to claim 2, characterized in that When the area of the target area is less than a preset area threshold, send a warning message to a preset administrator.

6. The face recognition interaction method based on privacy protection according to claim 1, characterized in that, Re-obtain normal grids after a preset time interval.

7. A face recognition interaction system based on privacy protection, characterized in that, It includes: Acquisition module: Obtain an image of the front of the lens of the face image acquisition device during a period when face recognition is not being performed, record it as a detection image, perform grid division on the detection image to obtain a number of grid regions, the length and width of a single grid region are both preset values, and number the grid regions; Positioning module: Mark the detection image corresponding to the time point when the face image acquisition device starts to be put into use as a standard image, and mark the detection image corresponding to the current time as a comparison image; Denote the grid region numbered i in the standard image and the comparison image as grid Di and grid Di' respectively, obtain the similarity degree Xi between grid Di and grid Di', and when the similarity degree is greater than a preset similarity degree threshold, mark grid Di' as a normal grid; Group the normal grids. The normal grids in the same group share at least one side with at least one of the normal grids in the group. Obtain the area composed of all the normal grids in the same group, which is denoted as the normal area. Privacy module: When the user performs face recognition, collect the user's face image through the normal area with the largest area, and perform privacy protection processing on the face image.

Images