Face Image Acquisition Method, Recognition Method, Flexible Screen Terminal and Storage Medium

Abstract

The present invention discloses a method for collecting face images, a recognition method, a flexible screen terminal and a storage medium, belonging to the technical field of image processing. The method includes: controlling the shooting device of the flexible screen terminal to move relative to the user's face according to the deformation of the flexible screen to collect the user's face image. It can be seen that this technical solution realizes the improvement of the accuracy and security of face image collection by combining with the deformation characteristics of the flexible screen.

Description

Technical Field

[0001] The present invention relates to the technical field of image processing, and particularly to a method for collecting a face image, a recognition method, a flexible screen terminal, and a storage medium. Background Art

[0002] Face recognition technology has been widely used, such as for identity verification or unlocking, etc. Currently, the mainstream face unlocking methods include 2D face unlocking and 3D face unlocking. Among them, 2D face recognition does not fully utilize the three-dimensional information of the face and is easily deceived by means such as photos and videos in actual use, resulting in a relatively low recognition accuracy; 3D face recognition utilizes the three-dimensional information of the face and has high security, but the cost of 3D face recognition sensors is too high. At the same time, the 3D face recognition sensor is built into the "bang" of the mobile phone display screen, which will affect the appearance of the mobile phone and cannot break through a higher screen-to-body ratio again. Summary of the Invention

[0003] The present application provides a method for collecting a face image, a recognition method, a flexible screen terminal, and a storage medium to improve the accuracy and security of face image collection.

[0004] To achieve the above object, an embodiment of the present invention provides a method for collecting a face image, which is applied to a flexible screen terminal. The method includes the following steps: controlling the shooting device of the flexible screen terminal to move relative to the face of a user according to the deformation of the flexible screen to collect the face image of the user.

[0005] To achieve the above object, an embodiment of the present invention also proposes a recognition method, which is applied to a flexible screen terminal. The method includes: collecting a face image and performing face recognition according to the face image, where the face image is collected by the foregoing method for collecting a face image.

[0006] To achieve the above object, an embodiment of the present invention also proposes a flexible screen terminal, including a flexible screen, a shooting device, a processor, and a memory; the flexible screen is used for display, the shooting device is used for taking pictures; the memory is used for storing a computer program; the processor is used for executing the computer program and implementing the steps of the foregoing method for collecting a face image when executing the computer program; or, implementing the steps of the foregoing recognition method.

[0007] To achieve the above object, an embodiment of the present invention also proposes a storage medium for computer-readable storage. The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the foregoing method; or, implement the steps of the foregoing recognition method.

[0008] The present application discloses a method for collecting face images, a method for recognition, a flexible screen terminal, and a storage medium. By controlling the movement of the shooting device of the flexible screen terminal relative to the user's face according to the deformation of the flexible screen, the face image of the user is collected. It can be seen that this technical solution realizes the improvement of the accuracy and security of face image collection by combining with the deformation characteristics of the flexible screen. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 It is a schematic flowchart of a method for collecting face images provided by an embodiment of the present invention.

[0010] Figure 2 and Figure 3 It is a schematic diagram of a handheld flexible screen terminal of the present invention.

[0011] Figure 4 It is a schematic flowchart of another method for collecting face images provided by an embodiment of the present invention.

[0012] Figures 5 - 10 It is a schematic diagram of the flexible screen terminal displaying a face image in the implementation manner of the face image collection method.

[0013] Figure 11 It is a schematic diagram of controlling the deformation of the flexible screen in the implementation manner of the present invention.

[0014] Figure 12 It is a schematic flowchart of another method for collecting face images provided by an embodiment of the present invention.

[0015] Figure 13 It is a schematic diagram of controlling the rotation of the flexible screen in the implementation manner of the present invention.

[0016] Figure 14 It is a schematic flowchart of another method for collecting face images provided by an embodiment of the present invention.

[0017] Figure 15 It is a schematic flowchart of a recognition method provided by an embodiment of the present invention.

[0018] Figure 16 It is a schematic block diagram of the structure of a flexible screen terminal provided by an embodiment of the present application. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0019] Next, the technical solutions in the embodiments of the present application will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are some, but not all, of the embodiments of the present application. All other embodiments obtained by those of ordinary skill in the art based on the embodiments in the present application without making creative efforts shall fall within the protection scope of the present application.

[0020] The flowcharts shown in the accompanying drawings are only illustrative examples, and do not necessarily include all the content and operations / steps, nor do they have to be executed in the order described. For example, some operations / steps can be decomposed, combined, or partially merged, so the actual execution order may change according to the actual situation.

[0021] Embodiments of the present application provide a method for collecting face images, a method for recognition, a flexible screen terminal, and a storage medium. Among them, the method for collecting face images and the method for recognition can be applied to the flexible screen terminal.

[0022] Specifically, the flexible screen terminal includes at least one flexible screen, which can display face images; and includes at least one photographing device for collecting face images, where the photographing device includes a camera.

[0023] Exemplarily, the flexible screen terminal can be a mobile phone, a tablet, a notebook, a television, a dedicated image collection device, etc. For example, the flexible screen terminal is a dual-screen mobile phone with two flexible screens or a single-screen mobile phone with one flexible screen, or a mobile phone with a foldable flexible screen, etc.

[0024] The following will describe in detail some embodiments of the present application with reference to the accompanying drawings. Without conflict, the following embodiments and the features in the embodiments can be combined with each other.

[0025] Please refer to Figure 1 , Figure 1 , which is a schematic flowchart of a method for collecting face images provided by an embodiment of the present application.

[0026] As Figure 1 shown, this embodiment provides a method for collecting face images, and the method includes the following steps:

[0027] Step S110: Control the photographing device of the flexible screen terminal to move relative to the user's face according to the deformation of the flexible screen to collect the user's face image.

[0028] Exemplarily, the flexible screen has advantages such as high picture quality, fast response speed, simple processing technology, excellent anti-flexibility, and low driving voltage. For example, in the field of smart phones, flexible screens are becoming a major trend in the development of smart phone displays. Based on the characteristic that the flexible screen of the flexible screen terminal has deformation, the flexible screen of the flexible screen terminal is deformed by controlling the hinge or the base panel, etc., so that the photographing device on the flexible screen terminal moves relative to the user's face to collect the user's three-dimensional face image.

[0029] For example, as Figure 2 shown and as Figure 3As shown, the user holds the flexible screen terminal, which can be specifically in portrait or landscape orientation. The flexible screen terminal deforms the flexible screen by controlling the hinge or the base panel. The deformation of the flexible screen drives the photographing device to move clockwise or counterclockwise relative to the user's face, so that the photographing device acquires three-dimensional feature images of the user's face from various angles. The deformation of the flexible screen can be the deformation of a part of the flexible screen at the photographing device or the deformation of other parts of the flexible screen.

[0030] In the embodiment of the present invention, according to the principle that the flexible screen can be deformed, the photographing device of the flexible screen terminal is controlled to move relative to the face to acquire the user's face image, avoiding being easily deceived by means such as photos and videos during use, and improving the problems of low accuracy and poor security in face image recognition.

[0031] As Figure 4 shown, the embodiment of the present invention provides a schematic flowchart of another method for acquiring a face image. The method includes the following steps:

[0032] Step S120: Determine the deformation parameter of the flexible screen according to the position information of the face image in the flexible screen.

[0033] Exemplarily, as Figure 5 shown, the user holds the flexible screen terminal, and the photographing device on the flexible screen terminal photographs the user's face, and the photographed face image is displayed on the flexible screen of the flexible screen terminal. Determine the position of the face image in the flexible screen, and determine the deformation parameter of the flexible screen based on the position of the face image in the flexible screen. For example, the user holds the flexible screen terminal, turns on the photographing device, and photographs the user's face image through the photographing device. The photographed face image is presented on the flexible screen. Obtain the position of the face image in the flexible screen, where the flexible screen is uniformly divided into four regions in advance. Determine which of the four regions the face image is in, and determine the deformation parameter of the flexible screen through the region where the face image is located.

[0034] Specifically, determining the deformation parameter of the flexible screen includes: obtaining the position coordinates of the face image in the flexible screen and the preset position coordinates of the photographing device; determining the deformation parameter of the flexible screen according to the position coordinates and the preset position coordinates.

[0035] Exemplarily, obtain the face image of the user photographed by the photographing device, display the face image in the flexible screen, and determine the position coordinates of the face image in the flexible screen. Establish a coordinate system in the flexible screen in advance and determine the preset coordinate position of the photographing device in the coordinate system. Determine the deformation parameter of the flexible screen through the position coordinates and the position in the preset coordinate system.

[0036] Specifically, obtaining the position coordinates of the face image in the flexible screen includes: identifying the target features in the face image; and determining the position coordinates of the face image in the flexible screen according to the target features.

[0037] Exemplarily, the face image of the user captured by the photographing device is displayed in the flexible screen of the flexible screen terminal, and the target features of the face image in the flexible screen are identified. The target features include the tip-of-nose feature or the eye feature, etc. The identification method includes image segmentation, etc. When the tip-of-nose feature or the eye feature in the face image is identified, the position of the tip-of-nose feature or the eye feature in the flexible screen is determined. Based on the coordinate system established in the flexible screen, the coordinates of the position of the tip-of-nose feature or the eye feature in this coordinate system are obtained, the position coordinates of the tip-of-nose feature or the eye feature in the coordinate system are determined, and the position coordinates of the tip-of-nose feature or the eye feature are used as the position coordinates of the face image in the flexible screen.

[0038] Specifically, determining the deformation parameters of the flexible screen includes: determining whether the position coordinates coincide with the preset position coordinates of the photographing device; if it is determined that the position coordinates do not coincide with the preset position coordinates, then obtaining the relative direction and relative coordinates between the position coordinates and the preset position coordinates; and using the relative direction and relative coordinates as the deformation parameters of the flexible screen.

[0039] Exemplarily, when the position coordinates of the target features of the face image in the flexible screen and the preset position coordinates of the photographing device in the flexible screen are obtained, it is judged whether the position coordinates of the target features of the face image in the flexible screen coincide with the preset coordinates of the photographing device in the flexible screen. If the position coordinates of the target features of the face image in the flexible screen are different from the preset coordinates of the photographing device in the flexible screen, it is determined that the position coordinates of the target features of the face image in the flexible screen do not coincide with the preset position coordinates of the photographing device in the flexible screen. For example, as Figure 6 shown, when the obtained position coordinates of the tip of the nose of the face image in the flexible screen are (0, -2) and the preset position coordinates of the photographing device in the flexible screen are (0, 0), it is determined that the position coordinates of the target features of the face image in the flexible screen do not coincide with the preset position coordinates of the photographing device in the flexible screen.

[0040] If it is determined that the position coordinates of the target features of the face image in the flexible screen do not coincide with the preset position coordinates of the photographing device in the flexible screen, the corresponding relative direction and relative coordinates are obtained through the position coordinates of the target features of the face image in the flexible screen and the preset position coordinates of the photographing device in the flexible screen. For example, as Figure 6As described above, when the position coordinates of the tip of the nose in the face image in the flexible screen are (0, -2), and the preset position coordinates of the imaging device in the flexible screen are (0, 0), the relative direction between the position coordinates and the preset position coordinates is downward, and the relative coordinates between the position coordinates and the preset position coordinates are 2 coordinates, where the coordinates are unit distances set in advance. Or, as Figure 7 shown, when the position coordinates of the tip of the nose in the face image in the flexible screen are (2, 0), and the preset position coordinates of the imaging device in the flexible screen are (0, 0), the relative direction between the position coordinates and the preset position coordinates is rightward, and the relative coordinates between the position coordinates and the preset position coordinates are 2 coordinates, where the coordinates are unit distances set in advance. The obtained relative direction and relative coordinates are used as the deformation parameters of the flexible screen.

[0041] Specifically, after determining whether the position coordinates coincide with the preset position coordinates of the imaging device, it includes: if the position coordinates coincide with the preset position coordinates of the imaging device, determining whether the face image contains a face contour; when the face image does not contain the face contour, determining the holding posture of the current user; and determining the deformation parameters of the flexible screen according to the holding posture of the current user.

[0042] Exemplarily, when the position coordinates of the target feature in the face image in the flexible screen and the preset position coordinates of the imaging device in the flexible screen are obtained, if the position coordinates of the target feature in the face image in the flexible screen are the same as the preset coordinates of the imaging device in the flexible screen, it is determined that the position coordinates of the target feature in the face image in the flexible screen coincide with the preset position coordinates of the imaging device in the flexible screen. For example, when the position coordinates of the tip of the nose in the face image in the flexible screen are (0, 0), and the preset position coordinates of the imaging device in the flexible screen are (0, 0), it is determined that the position coordinates of the target feature in the face image in the flexible screen coincide with the preset position coordinates of the imaging device in the flexible screen.

[0043] If it is determined that the position coordinates of the target feature in the face image in the flexible screen coincide with the preset position coordinates of the imaging device in the flexible screen, it is determined whether the face image contains a face contour. As Figure 8As shown, the user holds the flexible screen terminal, and the shooting device of the flexible screen terminal captures the user's face image. Due to the distance between the flexible screen terminal and the user's face, not all of the user's face contours that the shooting device fails to capture will occur. For example, if the distance between the flexible screen terminal and the user's face is too close, the face image captured by the shooting device only has some facial features and does not include ears, etc. By processing the face image captured by the shooting device. For example, performing grayscale processing on the face image, etc. Determine whether the face image contains the user's face contour. For example, obtain the face contour in the face image by performing grayscale processing on the face image, and match the face contour with the preset face contour. If the face contour matches the preset face contour, it is determined that the face image contains the face contour; if the face contour does not match the preset face contour, it is determined that the face image does not contain the face contour.

[0044] If the face image does not contain the face contour, determine the posture of the user holding the flexible screen terminal. The postures of the user holding the flexible screen terminal include the user holding the flexible screen terminal horizontally and vertically. Based on the current user's posture of holding the flexible screen, determine the relative direction and relative coordinates of the deformation of the flexible screen. For example, when the current user holds the flexible screen terminal, obtain the gravity parameters and direction information detected by the motion sensor in the flexible screen terminal, and determine the current user's posture of holding the flexible screen terminal based on the gravity parameters and direction parameters.

[0045] Specifically, determining the deformation parameters of the flexible screen according to the current user's holding posture includes: if the current user's holding posture is landscape, adjust the flexible screen to deform in at least one direction backward, upward, or downward; or, if the current user's holding posture is portrait, adjust the flexible screen to deform in at least one direction backward, leftward, or rightward.

[0046] Exemplarily, when it is determined that the current user's posture of holding the flexible screen terminal is landscape as shown in Figure 3 Adjust the part of the flexible screen at the shooting device of the flexible screen terminal to deform backward so that the face image captured by the shooting device contains the face contour. For example, during the process of adjusting the part of the flexible screen at the shooting device of the flexible screen terminal to deform backward, the shooting device continuously captures the user's face image and determines whether the currently captured face image contains the user's face contour. If the currently captured face image does not contain the face contour, continue to adjust the part of the flexible screen at the shooting device of the flexible screen terminal to deform backward until it is determined that the captured face image contains the user's face contour.

[0047] When it is determined that the captured face image contains a face contour, and the position coordinates of the target feature of the face image in the flexible screen and the preset position coordinates of the shooting device in the flexible screen are obtained, it is judged whether the position coordinates of the target feature of the face image in the flexible screen coincide with the preset coordinates of the shooting device in the flexible screen. If the position coordinates of the target feature of the face image in the flexible screen are different from the preset coordinates of the shooting device in the flexible screen, it is determined that the position coordinates of the target feature of the face image in the flexible screen do not coincide with the preset coordinates of the shooting device in the flexible screen. For example, when the position coordinates of the tip of the nose of the face image in the flexible screen are obtained as (0, 1) and the preset position coordinates of the shooting device in the flexible screen are (0, 0), it is determined that the position coordinates of the target feature of the face image in the flexible screen do not coincide with the preset position coordinates of the shooting device in the flexible screen.

[0048] If it is determined that the position coordinates of the target feature of the face image in the flexible screen do not coincide with the preset position coordinates of the shooting device in the flexible screen, the corresponding relative direction and relative coordinates are obtained through the position coordinates of the target feature of the face image in the flexible screen and the preset position coordinates of the shooting device in the flexible screen. For example, when the position coordinates of the tip of the nose of the face image in the flexible screen are obtained as (0, 1) and the preset position coordinates of the shooting device in the flexible screen are (0, 0), the relative direction between the position coordinates and the preset position coordinates is upward, and the relative coordinates between the position coordinates and the preset position coordinates are 1 coordinate. Or, when the position coordinates of the tip of the nose of the face image in the flexible screen are obtained as (0, -1) and the preset position coordinates of the shooting device in the flexible screen are (0, 0), the relative direction between the position coordinates and the preset position coordinates is downward, and the relative coordinates between the position coordinates and the preset position coordinates are 1 coordinate.

[0049] If it is determined that the posture of the current user holding the flexible screen terminal is the portrait screen as shown in Figure 2 Adjust a part of the flexible screen at the shooting device of the flexible screen terminal to deform backward so that the face image captured by the shooting device contains a face contour. For example, during the process of adjusting a part of the flexible screen at the shooting device of the flexible screen terminal to deform backward, the shooting device captures the user's face image in real time and determines whether the currently captured face image contains the user's face contour. If the currently captured face image does not contain a face contour, continue to adjust a part of the flexible screen at the shooting device of the flexible screen terminal to deform backward until it is determined that the captured face image contains the user's face contour.

[0050] When it is determined that the captured face image contains a face contour, the position coordinates of the target feature of the face image in the flexible screen and the preset position coordinates of the shooting device in the flexible screen are obtained, and it is determined whether the position coordinates of the target feature of the face image in the flexible screen coincide with the preset coordinates of the shooting device in the flexible screen. If the position coordinates of the target feature of the face image in the flexible screen are different from the preset coordinates of the shooting device in the flexible screen, it is determined that the position coordinates of the target feature of the face image in the flexible screen do not coincide with the preset coordinates of the shooting device in the flexible screen. For example, when the position coordinates of the tip of the nose in the face image obtained in the flexible screen are (2, 0), and the preset position coordinates of the shooting device in the flexible screen are (0, 0), it is determined that the position coordinates of the target feature of the face image in the flexible screen do not coincide with the preset position coordinates of the shooting device in the flexible screen.

[0051] If it is determined that the position coordinates of the target feature of the face image in the flexible screen do not coincide with the preset position coordinates of the shooting device in the flexible screen, the corresponding relative direction and relative coordinates are obtained through the position coordinates of the target feature of the face image in the flexible screen and the preset position coordinates of the shooting device in the flexible screen. For example, when the position coordinates of the tip of the nose in the face image obtained in the flexible screen are (2, 0), and the preset position coordinates of the shooting device in the flexible screen are (0, 0), the relative direction between the position coordinates and the preset position coordinates is the right, and the relative coordinates between the position coordinates and the preset position coordinates are 2 coordinates. Or, when the position coordinates of the tip of the nose in the face image obtained in the flexible screen are (-2, 0), and the preset position coordinates of the shooting device in the flexible screen are (0, 0), the relative direction between the position coordinates and the preset position coordinates is the left, and the relative coordinates between the position coordinates and the preset position coordinates are 2 coordinates.

[0052] Specifically, after determining whether the face image contains a face contour, it further includes: if the face image contains the face contour, obtaining the contour size of the face contour; and determining the deformation parameter of the flexible screen based on the contour size of the face contour.

[0053] Exemplarily, if it is detected that the face image contains a face contour, the size of the face contour in the face image is obtained. For example, as Figure 9 shown or as Figure 10As shown, the face image is presented on the flexible screen. Determine the position coordinates of the face contour in the face image in the coordinate system of the flexible screen, and calculate the length or width of the face contour. Take the calculated length or width of the face contour as the contour size of the face contour. Determine the deformation parameter of the flexible screen based on the length or width of the face contour. For example, when the calculated length of the face contour is less than the preset length; or when the calculated width of the face contour is less than the preset width, it is determined that the distance between the user and the flexible screen terminal is too far, which may cause the captured face image of the user to be unclear. Then adjust the part of the flexible screen at the shooting device in the flexible screen to deform forward, so that the length of the face contour captured by the shooting device in the current face image is greater than or equal to the preset length or the width of the face contour is greater than or equal to the preset width.

[0054] Obtain the position coordinates of the target feature in the current face image in the flexible screen and the preset position coordinates of the shooting device in the flexible screen. Based on these position coordinates and the preset position coordinates, determine the relative direction and relative coordinates of the flexible screen, where the relative direction includes at least one of the directions of up, down, left, and right.

[0055] Step S130: Adjust the flexible screen according to the deformation parameter so that the face image is located in the flexible screen.

[0056] Exemplarily, obtain the relative direction and relative coordinates of the deformation of the flexible screen, as Figure 11 shown. Adjust the part of the flexible screen at the shooting device in the flexible screen. For example, when the obtained relative direction is upward and the relative coordinate is 2 coordinates, adjust the part of the flexible screen at the shooting device in the flexible screen to move upward by 2 coordinates; or when the obtained relative direction is rightward and the relative coordinate is 1 coordinate, adjust the part of the flexible screen at the shooting device in the flexible screen to move rightward by 1 coordinate.

[0057] After adjusting the part of the flexible screen at the shooting device in the flexible screen to deform in the relative direction and relative coordinates, capture the face image of the current user through the shooting device, so that the position coordinates of the target feature in the current face image coincide with the preset coordinate position of the shooting device.

[0058] If the position coordinates of the target feature in the current face image do not coincide with the preset coordinate position of the shooting device; or the current face image does not contain a face contour; or the face contour in the current face image is less than the preset length or width, obtain the relative direction and relative coordinates of the deformation of the flexible screen, and continue to deform the flexible screen.

[0059] In an embodiment of the present invention, a face image captured by a photographing device is displayed on a flexible screen of a flexible screen terminal, and a deformation parameter of the flexible screen is determined according to the position of the face image in the flexible screen. The flexible screen is adjusted according to the deformation parameter so that the face image is located in the flexible screen, thereby improving the accuracy of capturing the face image.

[0060] As Figure 12 shown, an embodiment of the present invention provides another method for capturing a face image, and the method includes the following steps:

[0061] Step S210: According to the deformation of the flexible screen, control a part of the flexible screen corresponding to the photographing device to rotate relative to the user's face to capture the user's face image.

[0062] Exemplarily, based on the characteristic that the flexible screen of the flexible screen terminal has deformation, the flexible screen of the flexible screen terminal is deformed by controlling a hinge or a base panel, etc. The deformation of the flexible screen may be the deformation of a part of the flexible screen at the photographing device or the deformation of other parts of the flexible screen.

[0063] In an embodiment of the present invention, controlling a part of the flexible screen corresponding to the photographing device to rotate relative to the user's face may be, for example, rotating counterclockwise or clockwise, etc., and capturing the user's face image during the rotation.

[0064] As Figure 5 shown, the user holds the flexible screen terminal, and the photographing device captures the user's face image. The deformation parameter of the flexible screen is determined according to the position coordinates of the target feature in the face image on the flexible screen, the preset position coordinates of the photographing device on the flexible screen, and the face contour in the face image. The flexible screen terminal controls the flexible screen to deform according to the deformation parameter to rotate relative to the face, or cooperates with the user to rotate the face, so as to enable the photographing device to capture the three-dimensional face images of the user from multiple angles.

[0065] Specifically, capturing the user's face image includes: detecting whether the face of the current user moves; if the face does not move, controlling a part of the flexible screen corresponding to the photographing device to rotate clockwise or counterclockwise relative to the user's face, and capturing the user's face image during the rotation.

[0066] In the demonstration example, it is to detect in real time whether the face of the current user moves, and the detection methods include image analysis, etc. For example, the face image of the user is collected in real time through a shooting device, and the images collected at different times are compared and analyzed to determine whether the face of the current user moves. If the face images collected at different times before and after are inconsistent, it is determined that the face of the current user moves. If the face images collected at different times before and after are consistent, it is determined that the face of the current user does not move. If it is determined that the face of the current user moves, the flexible screen terminal uses a hinge or a base panel to make a corresponding part of the flexible screen of the shooting device, such as Figure 13 shown, move counterclockwise or clockwise relative to the face of the user. Among them, the order of the clockwise and counterclockwise movements can be to first make a clockwise movement and then a counterclockwise movement; or first make a counterclockwise movement and then a clockwise movement, and the angle of the clockwise movement or counterclockwise movement is 0-360 degrees.

[0067] Specifically, after detecting whether the face of the current user moves, it further includes: if the face moves, obtaining the direction and angle of the face movement; based on the direction and angle of the face movement, determining the direction and angle of rotation of the corresponding part of the flexible screen of the shooting device; adjusting the flexible screen to deform according to the rotation direction and angle.

[0068] Exemplarily, if the face of the current user moves, obtain the direction of the face movement of the user and the moving angle. For example, it is obtained that the direction of the face movement of the user is one of up, down, left, and right, and the angle of moving to this direction, and this angle is 0-360 degrees. The obtaining method includes collecting the face image of the user in real time, obtaining the coordinates of the target feature in the flexible screen in the face images at different times, and calculating the face movement direction and moving angle of the user through the coordinates of the target feature in the flexible screen in the face images at different times. After obtaining the direction and angle of the face movement of the user, calculate the direction and angle of rotation of the corresponding part of the flexible screen of the shooting device. For example, when it is obtained that the direction of the face movement of the user is to the left and the moving angle is 20 degrees, it is calculated that the direction of rotation of the corresponding part of the flexible screen of the shooting device is to the right, and the rotation angle is 0-340 degrees; or it is calculated that the direction of rotation of the corresponding part of the flexible screen of the shooting device is to the left, and the rotation angle is 0-340 degrees, etc. As Figure 13 shown, adjust the corresponding part of the flexible screen of the shooting device to rotate in at least one direction of up, down, left, and right, and the rotation angle is 0-360 degrees.

[0069] In the embodiment of the present invention, according to the deformation of the flexible screen, the shooting device of the flexible screen terminal is controlled to rotate in the scenarios where the face moves and does not move, so as to collect the images of the face during the movement and non-movement processes, and improve the accuracy of collecting face images.

[0070] As Figure 14 shown, an embodiment of the present invention provides another method for collecting face images, and the method includes the following steps:

[0071] Step S310: Determine the deformation parameters of the flexible screen according to the position information of the face image in the flexible screen.

[0072] Exemplarily, as Figure 5 shown, the user holds the flexible screen terminal, and the photographing device on the flexible screen terminal photographs the user's face, and the captured face image is displayed on the flexible screen of the flexible screen terminal. Determine the position of the face image in the flexible screen, and determine the deformation parameters of the flexible screen based on the position of the face image in the flexible screen. For example, the user holds the flexible screen terminal, turns on the photographing device, and photographs the user's face image through the photographing device, and the captured face image is presented on the flexible screen. Obtain the position of the face image in the flexible screen, where the flexible screen is evenly divided into four regions in advance. Determine which of the four regions the face image is in, and determine the deformation parameters of the flexible screen through the region where the face image is located.

[0073] Step S320: Adjust the flexible screen according to the deformation parameters so that the face image is located in the flexible screen.

[0074] Demonstratively, obtain the relative direction and relative coordinates of the deformation of the flexible screen. As Figure 11 shown, adjust the part of the flexible screen at the photographing device in the flexible screen. For example, when the relative direction obtained is upward and the relative coordinate is 2 coordinates, move the part of the flexible screen at the photographing device in the flexible screen upward by 2 coordinates; or, when the relative direction obtained is rightward and the relative coordinate is 1 coordinate, move the part of the flexible screen at the photographing device in the flexible screen rightward by 1 coordinate.

[0075] After adjusting the part of the flexible screen at the photographing device in the flexible screen to deform in the relative direction and relative coordinates, collect the face image of the current user through the photographing device so that the position coordinates of the target feature in the current face image coincide with the preset coordinate position of the photographing device.

[0076] If the position coordinates of the target feature in the current face image do not coincide with the preset coordinate position of the photographing device; or, the current face image does not include a face contour; or, the face contour in the current face image is smaller than the preset length or width, then obtain the relative direction and relative coordinates of the deformation of the flexible screen, and continue to deform the flexible screen.

[0077] Step S330: Control the part of the flexible screen corresponding to the photographing device to rotate relative to the user's face to collect the face image of the user.

[0078] AsFigure 5 As shown, the user holds the flexible screen terminal, and the imaging device captures the user's face image. The deformation parameters of the flexible screen are determined based on the position coordinates of the target features in the face image on the flexible screen, the preset position coordinates of the imaging device on the flexible screen, and the face contour in the face image. The flexible screen terminal deforms the flexible screen according to the deformation parameters by controlling the hinge or the base panel. The user rotates the face to enable the imaging device to capture the three-dimensional face images of the user from multiple angles.

[0079] Specifically, capturing the user's face image includes: detecting whether the face of the current user has moved; if the face has not moved, controlling the corresponding part of the flexible screen of the imaging device to rotate clockwise or counterclockwise relative to the user's face.

[0080] Exemplarily, it is detected in real time whether the face of the current user has moved, and the detection methods include image analysis, etc. For example, the face image of the user is captured in real time by the imaging device, and the images captured at different times are compared and analyzed to determine whether the face of the current user has moved. If the face images captured at different times before and after are inconsistent, it is determined that the face of the current user has moved. If the face images captured at different times before and after are consistent, it is determined that the face of the current user has not moved. If it is determined that the face of the current user has not moved, the flexible screen terminal uses the hinge or the base panel to make the corresponding part of the flexible screen of the imaging device move counterclockwise or clockwise relative to the user's face as Figure 13 shown. Among them, the order of clockwise and counterclockwise movements does not matter. It can first make a clockwise movement and then a counterclockwise movement; or first make a counterclockwise movement and then a clockwise movement. The angle of clockwise or counterclockwise movement is 0 - 360 degrees.

[0081] Specifically, after detecting whether the face of the current user has moved, it further includes: if the face has moved, obtaining the direction and angle of the face movement; based on the direction and angle of the face movement, determining the direction and angle of rotation of the corresponding part of the flexible screen of the imaging device; adjusting the flexible screen to deform according to the direction and angle of rotation.

[0082] Exemplarily, if the face of the current user moves, obtain the direction and angle of the user's face movement. For example, obtain that the direction of the user's face movement is one of up, down, left, and right, and the angle of movement to this direction, where the angle is 0 - 360 degrees. The acquisition method includes real-time collection of the user's face image, obtaining the coordinates of the target features in the flexible screen in the face images at different times, and calculating the direction and angle of the user's face movement through the coordinates of the target features in the flexible screen in the face images at different times. After obtaining the direction and angle of the user's face movement, calculate the direction and angle of rotation of the corresponding part of the flexible screen of the shooting device. For example, when it is obtained that the direction of the user's face movement is to the left and the movement angle is 20 degrees, calculate that the direction of rotation of the corresponding part of the flexible screen of the shooting device is to the right, and the rotation angle is 0 - 340 degrees; or calculate that the direction of rotation of the corresponding part of the flexible screen of the shooting device is to the left, and the rotation angle is 0 - 340 degrees, etc. As Figure 13 shown, adjust the corresponding part of the flexible screen of the shooting device to rotate in at least one direction of up, down, left, and right, and the rotation angle is 0 - 360 degrees.

[0083] In this real-time example, determine the deformation parameters of the flexible screen according to the face image, and adjust the flexible screen through the deformation parameters so that the face image of the user collected by the shooting device of the flexible screen terminal is located in the flexible screen, and control the corresponding part of the flexible screen of the shooting device to rotate relative to the user's face to collect the three-dimensional face image of the user, which not only improves the accuracy of face image collection but also improves the security of face image collection.

[0084] Please refer to Figure 15 , Figure 15 which is a schematic flowchart of an identification method provided by an embodiment of the present application.

[0085] As Figure 15 shown, this embodiment provides an identification method, and the method includes the following steps:

[0086] Step S410: Collect a face image and perform face recognition according to the face image.

[0087] Among them, the acquisition method of collecting the face image adopts the face image acquisition method provided by any one of the above embodiments.

[0088] Collect the face image of the current user in the flexible screen through the shooting device. Obtain the collected face image and perform recognition on this face image. The recognition method includes extracting features such as the user's eyes, eyebrows, ears, and nose in the face image, and matching these features with the features such as eyes, eyebrows, ears, and nose in the preset face feature library to obtain the identification information of the matching features, so as to identify the identity information of the user.

[0089] Please refer to Figure 16 , Figure 16 which is a schematic block diagram of the structure of a flexible screen terminal provided by an embodiment of the present application. The flexible screen terminal includes at least one flexible screen, and the flexible screen is used to display a face image.

[0090] Exemplarily, the flexible screen terminal can be a mobile phone, a tablet computer, a notebook, a desktop computer, a television, a dedicated input device, etc. For example, the flexible screen terminal is a dual-screen mobile phone with two flexible screens or a single-screen mobile phone with one flexible screen, or a flexible foldable mobile phone, etc.

[0091] The flexible screen terminal includes at least one photographing device for collecting a face image, and the photographing device includes a camera.

[0092] The flexible screen terminal further includes a processor and a memory, and the memory is used to store a computer program.

[0093] The processor is used to execute the computer program and implement the foregoing face image acquisition method or recognition method provided by the embodiment of the present application when executing the computer program.

[0094] It should be understood that the processor can be a central processing unit (CPU), and the processor can also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor can be a microprocessor or the processor can also be any conventional processor, etc.

[0095] An embodiment of the present application also provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the processor is caused to implement any one of the face image acquisition methods or recognition methods provided by the embodiment of the present application.

[0096] Those of ordinary skill in the art can understand that all or some of the steps in the methods disclosed above, and the functional modules / units in the systems and devices, can be implemented as software, firmware, hardware, and their appropriate combinations. In the hardware implementation, the division between the functional modules / units mentioned above does not necessarily correspond to the division of physical components; for example, one physical component can have multiple functions, or one function or step can be executed by several physical components working together. Some or all of the physical components can be implemented as software executed by a processor, such as a central processing unit, a digital signal processor, or a microprocessor, or implemented as hardware, or implemented as an integrated circuit, such as an application-specific integrated circuit. Such software can be distributed on a computer-readable storage medium, which can include a computer-readable storage medium (or non-transitory medium) and a communication medium (or transitory medium).

[0097] As is well known to those of ordinary skill in the art, the term computer-readable storage medium includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storing information, such as computer-readable instructions, data structures, program modules, or other data. The computer-readable storage medium includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technologies, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cassette, tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by a computer. In addition, it is well known to those of ordinary skill in the art that a communication medium typically contains computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transmission mechanism, and can include any information delivery medium.

[0098] Exemplarily, the computer-readable storage medium can be the internal storage unit of the electronic device described in the foregoing embodiments, such as the hard disk or memory of the electronic device. The computer-readable storage medium can also be the external storage device of the electronic device, such as the plug-in hard disk, smart media card (SMC), secure digital (SD) card, flash card, etc. equipped on the electronic device.

[0099] The electronic device and the computer-readable storage medium provided in the foregoing embodiments control the movement of the photographing device of the flexible screen terminal relative to the user's face according to the deformation of the flexible screen to collect the user's face image. By combining with the deformation characteristics of the flexible screen, the accuracy and security of face image collection are improved.

[0100] As described above, it is only the specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art within the technical scope disclosed by the present application can easily think of various equivalent modifications or substitutions, and these modifications or substitutions should all be covered within the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A method for collecting face images, characterized in that, Applied to a flexible screen terminal, the method includes: Detect whether the face of the current user moves in the flexible screen; If the face in the flexible screen does not move, then according to the deformation of the flexible screen, control a corresponding part of the flexible screen of the shooting device of the flexible screen terminal to rotate clockwise or counterclockwise relative to the user's face to collect a face image of the user; the face image is used for three-dimensional face recognition.

2. The face image acquisition method according to claim 1, wherein, The method includes: Determine the deformation parameters of the flexible screen according to the position information of the face image in the flexible screen; Adjust the flexible screen according to the deformation parameters so that the face image is located in the flexible screen.

3. The face image acquisition method according to claim 2, characterized in that The determining the deformation parameters of the flexible screen according to the position information of the face image in the flexible screen includes: Obtain the position coordinates of the face image in the flexible screen and the preset position coordinates of the shooting device; Determine the deformation parameters of the flexible screen according to the position coordinates and the preset position coordinates.

4. The face image acquisition method according to claim 3, characterized in that The determining the deformation parameters of the flexible screen according to the position coordinates and the preset position coordinates includes: Determine whether the position coordinates coincide with the preset position coordinates of the shooting device; If it is determined that the position coordinates do not coincide with the preset position coordinates, then obtain the relative direction and relative coordinates of the position coordinates and the preset position coordinates; Take the relative direction and relative coordinates as the deformation parameters of the flexible screen.

5. The face image acquisition method according to claim 4, wherein, After determining whether the position coordinates coincide with the preset position coordinates of the shooting device, it includes: If the position coordinates coincide with the preset position coordinates of the shooting device, determine whether the face image contains a face contour; When the face image does not contain the face contour, determine the holding posture of the current user; Determine the deformation parameters of the flexible screen according to the holding posture of the current user.

6. The face image acquisition method according to claim 5, wherein, The determining the deformation parameters of the flexible screen according to the holding posture of the current user includes: If the current holding posture of the user is landscape orientation, adjust the flexible screen to deform in at least one direction of backward, upward or downward; or, If the current holding posture of the user is portrait orientation, adjust the flexible screen to deform in at least one direction of backward, leftward or rightward.

7. The face image acquisition method according to claim 5, wherein After determining whether the face image contains a face contour, it further includes: If the face image contains the face contour, obtain the contour size of the face contour; Determine the deformation parameters of the flexible screen based on the contour size of the face contour.

8. The face image acquisition method according to claim 3, wherein The obtaining the position coordinates of the face image in the flexible screen includes: Identify the target feature in the face image; Determine the position coordinates of the face image in the flexible screen according to the target feature.

9. The face image acquisition method according to claim 8, wherein The target feature includes a nose tip feature or an eye feature.

10. The face image acquisition method according to claim 1, wherein After detecting whether the face of the current user moves, it further includes: If the face moves, obtain the direction and angle of the face movement; Determine the direction and angle of rotation of the corresponding part of the flexible screen of the shooting device based on the direction and angle of the face movement; Adjust the flexible screen to deform according to the rotation direction and angle.

11. A recognition method, characterized in that, Applied to a flexible screen terminal, the method includes: Collect a face image and perform face recognition based on the face image, wherein the face image is collected by the face image collection method according to any one of claims 1 to 10.

12. A flexible screen terminal, characterized in that, It includes a flexible screen, a photographing device, a processor, and a memory; The flexible screen is used for display, and the photographing device is used for photographing images; The memory is used for storing computer programs; The processor is used for executing the computer program and implementing the steps of the face image collection method according to any one of claims 1 to 10 when executing the computer program; Or, the steps of the recognition method according to claim 11.

13. A computer-readable storage medium for computer-readable storage, characterized in that, The storage medium stores one or more programs, and the one or more programs can be executed by one or more processors to implement the steps of the face image collection method according to any one of claims 1 to 10; Or, the steps of the recognition method according to claim 11.

Images