Face space calibration method and device, wearable device and beauty care system

Abstract

The application discloses a face space calibration method and device, a wearable device and a beauty care system. The method comprises the following steps: acquiring space pose information of a first preset face positioning point when a user wears a wearable device, wherein the first preset face positioning point comprises contact points between the left and right ears of the user and two ends of the wearable device; determining space pose information of a second preset face positioning point when the user holds a beauty care device and acts on the second preset face positioning point, wherein the second preset face positioning point is any one of multiple face key points; and determining a face three-dimensional model corresponding to the user by using a preset face three-dimensional model according to the space pose information of the first preset face positioning point and the second preset face positioning point. The application is based on the contact characteristics of the wearable device and the head of the user, and the space calibration of the face of the user can be completed by only acting on a face key point by holding the beauty care device, so that the efficiency of the face space calibration is improved, and the skin care experience of the user is improved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of beauty care, and in particular to a face space calibration method and device, a wearable device, and a beauty care system. BACKGROUND

[0002] Traditional medical beauty care devices mainly switch different beauty modes by setting keys for different areas of a face. This solution is relatively reliable but has poor experience. To solve the problem that traditional medical beauty care devices cannot automatically switch beauty care modes, automatic positioning of a face area on which a beauty care device acts becomes a breakthrough point. Precise skin care in different zones and automatic generation of personalized care suggestions can be achieved through automatic positioning of the face area on which the beauty care device acts in space.

[0003] To achieve automatic positioning of the face area on which the beauty care device acts, the user's face in space needs to be calibrated in advance, that is, it is determined which user is using the beauty care device and the pose of the user's face in a space coordinate system, thereby providing support for subsequent positioning of the face area on which the beauty care device acts.

[0004] The main calibration solution at present is to guide the user to click multiple face key points by hand-holding the beauty care device before the user uses the beauty care device for skin care each time. However, this solution requires the user to click multiple face key points by hand-holding the beauty care device before the user uses the beauty care device for skin care each time. The calibration link is inefficient, and the operation difficulty of the user is increased, thereby affecting the skin care experience of the user. SUMMARY

[0005] The embodiments of the present application provide a face space calibration method and device, a wearable device, and a beauty care system to improve the efficiency of face space calibration and the skin care experience of the user.

[0006] The embodiments of the present application adopt the following technical solutions:

[0007] In a first aspect, the embodiments of the present application provide a face space calibration method, which includes the following steps:

[0008] In the case that the user wears a wearable device, the space pose information of a first preset face positioning point is acquired, and the first preset face positioning point includes contact points of the left and right ears of the user and two ends of the wearable device;

[0009] In the case that the user hand-holds a beauty care device to act on a second preset face positioning point, the space pose information of the second preset face positioning point is determined, and the second preset face positioning point is any one of multiple face key points;

[0010] According to the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point, a preset face three-dimensional model is used to determine a face three-dimensional model of the user.

[0011] Optionally, the wearable device is provided with a contact capacitive sensor at each end thereof, and the spatial pose information of the first preset face positioning point is obtained when the user wears the wearable device, including:

[0012] Obtaining capacitive sensing data of the contact capacitive sensor;

[0013] According to the capacitive sensing data of the contact capacitive sensor, determining a contact state of the two ends of the wearable device with the left and right ears of the user;

[0014] In a case where the contact state of the two ends of the wearable device with the left and right ears of the user is sufficient contact, the spatial pose information of the first preset face positioning point is determined.

[0015] Optionally, in the case where the contact state of the two ends of the wearable device with the left and right ears of the user is sufficient contact, the spatial pose information of the first preset face positioning point is determined, including:

[0016] In the case where the contact state of the two ends of the wearable device with the left and right ears of the user is sufficient contact, current spatial pose information of the two ends of the wearable device is determined.

[0017] According to the current spatial pose information of the two ends of the wearable device, the spatial pose information of the first preset face positioning point is determined.

[0018] Optionally, in the case where the contact state of the two ends of the wearable device with the left and right ears of the user is sufficient contact, the current spatial pose information of the two ends of the wearable device is determined, including:

[0019] In the case where the contact state of the two ends of the wearable device with the left and right ears of the user is sufficient contact, a current opening angle of the wearable device is determined.

[0020] Obtaining initial spatial pose information and an initial opening angle of the two ends of the wearable device;

[0021] According to the current opening angle of the wearable device and the initial spatial pose information and the initial opening angle of the two ends of the wearable device, the current spatial pose information of the two ends of the wearable device is determined.

[0022] Optionally, a bending sensor is arranged on the side of the wearable device in contact with the head of the user, and the determining of the current opening angle of the wearable device in the case that the wearable device is in full contact with the left and right ears of the user includes:

[0023] acquiring current bending sensing data of the bending sensor and a correspondence between the opening angle of the wearable device and the bending sensing data of the bending sensor;

[0024] determining the current opening angle corresponding to the current bending sensing data according to the correspondence.

[0025] Optionally, the determining of the spatial pose information of the second preset facial positioning point in the case that the user holds the beauty care device to act on the second preset facial positioning point includes:

[0026] acquiring spatial pose information of the beauty care device in the case that the user holds the beauty care device to act on the second preset facial positioning point;

[0027] determining the spatial pose information of the second preset facial positioning point according to the spatial pose information of the beauty care device.

[0028] Optionally, the determining of the three-dimensional face model corresponding to the user according to the spatial pose information of the first preset facial positioning point and the spatial pose information of the second preset facial positioning point and the preset three-dimensional face model includes:

[0029] acquiring geometric structure information of the wearable device;

[0030] determining spatial pose information of a head contour of the user in contact with the wearable device according to the current spatial pose information of the two ends of the wearable device and the geometric structure information of the wearable device;

[0031] determining the three-dimensional face model corresponding to the user according to the spatial pose information of the first preset facial positioning point and the spatial pose information of the second preset facial positioning point and the spatial pose information of the head contour and the preset three-dimensional face model.

[0032] Optionally, the preset three-dimensional face model includes a standard three-dimensional face model, and the standard three-dimensional face model is a deformable model, and the determining of the three-dimensional face model corresponding to the user according to the spatial pose information of the first preset facial positioning point and the spatial pose information of the second preset facial positioning point and the preset three-dimensional face model includes:

[0033] deforming the standard three-dimensional face model according to the spatial pose information of the first preset facial positioning point and the spatial pose information of the second preset facial positioning point to obtain the three-dimensional face model corresponding to the user.

[0034] Optionally, the preset face three-dimensional model comprises face three-dimensional models of a plurality of users, and the determining of the face three-dimensional model corresponding to the user by using the preset face three-dimensional model according to the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point comprises:

[0035] matching the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point with the face three-dimensional models of the plurality of users respectively;

[0036] determining the face three-dimensional model corresponding to the user according to a matching result.

[0037] In a second aspect, an embodiment of the present application further provides a face space calibration device, which comprises:

[0038] an acquisition unit, configured to acquire spatial pose information of a first preset face positioning point in a case where a user wears a wearable device, the first preset face positioning point comprising contact points of two ends of the wearable device and ears of the user;

[0039] a first determination unit, configured to determine spatial pose information of a second preset face positioning point in a case where the user holds a beauty device to act on the second preset face positioning point, the second preset face positioning point being any one of a plurality of face key points;

[0040] a second determination unit, configured to determine a face three-dimensional model corresponding to the user by using a preset face three-dimensional model according to the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point.

[0041] In a third aspect, an embodiment of the present application further provides a wearable device, which comprises:

[0042] a contact capacitive sensor, configured to collect capacitive sensing data generated by the wearable device;

[0043] a processor, connected with the contact capacitive sensor, configured to acquire the capacitive sensing data collected by the contact capacitive sensor, and determine spatial pose information of a first preset face positioning point according to the capacitive sensing data, the first preset face positioning point comprising contact points of two ends of the wearable device and ears of the user, and determine spatial pose information of a second preset face positioning point, the second preset face positioning point being any one of a plurality of face key points, and determine a face three-dimensional model corresponding to the user by using a preset face three-dimensional model according to the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point.

[0044] Optionally, the wearable device is in an arc structure.

[0045] Optionally, the arc structure is provided with two ends, and the two ends of the arc structure are respectively configured to contact the back of the left and right ears of the user.

[0046] Optionally, the contact capacitive sensor includes two, and is respectively arranged at the two ends of the arc structure, and is respectively configured to collect capacitive sensing data generated by the two ends of the arc structure in the case that the two ends of the arc structure respectively contact the back of the left and right ears of the user.

[0047] Optionally, the arc structure is provided with an inner side, and the inner side of the arc structure is configured to contact the contour of the head of the user.

[0048] Optionally, the wearable device further includes a bending sensor, and the bending sensor is arranged at the inner side of the arc structure and is configured to collect bending sensing data generated by the wearable device in the case that the inner side of the arc structure contacts the contour of the head of the user.

[0049] Optionally, the processor is connected with the bending sensor, and is configured to acquire the bending sensing data collected by the bending sensor, and determine the spatial pose information of the contour of the head of the user contacting the wearable device according to the bending sensing data and the geometric structure information of the wearable device.

[0050] Optionally, the wearable device further includes a magnetic sensor, and the magnetic sensor is configured to sense a magnetic signal emitted by a magnetic source on the beauty care device and generate electromagnetic sensing data, or the wearable device further includes a magnetic source, and the magnetic source is configured to emit a magnetic signal to the magnetic sensor arranged on the beauty care device.

[0051] Optionally, the processor is connected with the magnetic sensor, and is configured to acquire the electromagnetic sensing data generated by the magnetic sensor, and determine the spatial pose information of the beauty care device according to the electromagnetic sensing data.

[0052] In a fourth aspect, the embodiments of the present application further provide a beauty care system, and the beauty care system includes a beauty care device and the wearable device according to any one of the preceding embodiments.

[0053] In a fifth aspect, the embodiments of the present application further provide a computer readable storage medium, and the computer readable storage medium stores one or more programs, and the one or more programs, when executed by a wearable device including a plurality of application programs, cause the wearable device to execute the method according to any one of the preceding embodiments.

[0054] The above-mentioned at least one technical solution adopted in the embodiments of this application can achieve the following beneficial effects: The face spatial calibration method of the embodiments of this application firstly obtains the spatial pose information of a first preset face positioning point when the user is wearing a wearable device. The first preset face positioning point includes the contact points between the user's left and right ear backs and both ends of the wearable device. Then, when the user holds the beauty device and applies it to a second preset face positioning point, the spatial pose information of the second preset face positioning point is determined. The second preset face positioning point is any one of multiple facial key points. Finally, based on the spatial pose information of the first and second preset face positioning points, the user's corresponding three-dimensional face model is determined using a preset three-dimensional face model. The face spatial calibration method of the embodiments of this application is based on the contact characteristics between the wearable device and the user's head. The user only needs to hold the beauty device and apply it to one facial key point to complete the spatial calibration of the user's face. Compared with the solution that requires the user to hold the beauty device and click on multiple facial key points, it greatly improves the efficiency of face spatial calibration, reduces the user's operating difficulty, and thus improves the user's skin care experience. Attached Figure Description

[0055] The accompanying drawings, which are included to provide a further understanding of this application and form part of this application, illustrate exemplary embodiments and are used to explain this application, but do not constitute an undue limitation of this application. In the drawings:

[0056] Figure 1 This is a flowchart illustrating a face spatial calibration method according to an embodiment of this application;

[0057] Figure 2 This is a schematic diagram of a face spatial calibration process in an embodiment of this application;

[0058] Figure 3 This is a schematic diagram of the structure of a face spatial calibration device in an embodiment of this application;

[0059] Figure 4 This is a schematic diagram of the structure of a wearable device according to an embodiment of this application;

[0060] Figure 5 This is a schematic diagram of the structure of another wearable device in the embodiments of this application;

[0061] Figure 6 This is a schematic diagram of the architecture of a beauty care system according to an embodiment of this application.

[0062] In the diagram: 1. Wearable device; 11. Contact capacitive sensor; 12. Processor; 13. Bending sensor; 14. Magnet sensor; 15. Magnetic source. Detailed Implementation

[0063] To make the objectives, technical solutions, and advantages of this application clearer, the technical solutions of this application will be clearly and completely described below in conjunction with specific embodiments and corresponding drawings. Obviously, the described embodiments are only a part of the embodiments of this application, and not all of them. Based on the embodiments in this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0064] The technical solutions provided by the various embodiments of this application are described in detail below with reference to the accompanying drawings.

[0065] This application provides a face spatial calibration method, such as... Figure 1 The diagram provided illustrates a flowchart of a face space calibration method according to an embodiment of this application. The face space calibration method includes at least the following steps S110 to S130:

[0066] Step S110: When the user is wearing the wearable device, obtain the spatial pose information of the first preset face positioning point. The first preset face positioning point includes the contact points between the user's left and right ear backs and both ends of the wearable device.

[0067] The face space calibration method of this application embodiment can be performed by an independently deployed wearable device. When performing face space calibration, the user needs to wear the wearable device first. The wearable device can be regarded as an auxiliary positioning device independent of the beauty care device. It can be a wearable device in the form of a headband, headphones, etc., and fixedly worn on the user's head.

[0068] After the user puts on the wearable device, the spatial pose information of the first preset face positioning point can be obtained based on the geometric structure of the wearable device and its contact characteristics with the user's head. The wearable device in this embodiment can adopt a design with an arc structure, such as a headband or headphones. When the user puts on the wearable device, the two ends of the arc structure will contact the back of the user's left and right ears respectively. Based on this contact characteristic, the "first preset face positioning point" defined here in this embodiment refers to the contact points of the two ends of the wearable device with the back of the user's left and right ears respectively.

[0069] When determining the spatial pose information of the first preset face positioning point, it is necessary to first define a reference spatial coordinate system. Here, the wearable device itself can be used as the reference to establish the wearable device coordinate system. The specific construction method can be flexibly defined according to actual needs. For example, the origin of the coordinate system and the corresponding axis directions can be defined based on any point on the wearable device, or the coordinate system can be constructed directly with the position of other hardware devices on the wearable device as the origin. The spatial pose information of the first preset face positioning point in the wearable device coordinate system can refer to the six degrees of freedom information of the first preset face positioning point relative to the wearable device. That is, the rigid body can translate on the three mutually perpendicular coordinate axes of front-back, up-down, and left-right, and can also rotate its direction on the three perpendicular axes. The three rotation directions are called pitch, yaw, and roll.

[0070] Based on the wearable device coordinate system defined above, the spatial pose information of the first preset face positioning point can be determined by combining the positions of the two ends of the wearable device on the wearable device.

[0071] Step S120: When the user holds the beauty device and applies it to the second preset face positioning point, determine the spatial pose information of the second preset face positioning point, wherein the second preset face positioning point is any one of a plurality of facial key points.

[0072] The aforementioned steps can determine the spatial pose information of at least two face positioning points based on the contact characteristics between the wearable device and the user's head when worn, thereby providing support for subsequent face spatial calibration. Of course, to further improve the accuracy of subsequent face spatial calibration, this embodiment can also guide the user to hold the beauty device and apply it to a second preset face positioning point after the user has put on the wearable device. The second preset face positioning point can be any one of a plurality of predefined facial key points, thereby determining the spatial pose information of the second preset face positioning point in the wearable device coordinate system by tracking the spatial pose of the beauty device.

[0073] The aforementioned facial key points can be flexibly defined according to actual needs, and may include facial feature points in areas such as eyebrows, eyelids, lips, and nose. Compared to feature points in other areas of the face, the differences in features at facial key points are more obvious among different users. By using predefined facial key points, different users can be distinguished more accurately. Since this embodiment can also provide at least two facial positioning points for the spatial calibration of the user's face through the aforementioned step S110, in step S120, the user only needs to hold the beauty device and click on one facial key point, thereby greatly saving the operational costs that the user needs to invest in the calibration process each time they use the beauty device, and also improving the efficiency of facial spatial calibration.

[0074] The facial spatial positioning points obtained in the aforementioned steps are the basis for subsequent reconstruction / matching of the 3D facial model. Therefore, it should be noted that although the 3D facial model in some solutions is constructed based on the spatial points of the entire head, the implementation of functions such as automatic switching of the beauty mode is mainly aimed at the facial region. Therefore, the second preset facial positioning point selected here can also be a position point that can highlight and distinguish the facial features of different users as much as possible. For example, the position point at the center of the forehead can be selected. On the one hand, the position of the center of the forehead of different users is relatively obvious. On the other hand, the position of the center of the forehead is also easy for users to click.

[0075] Step S130: Based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point, determine the 3D face model corresponding to the user using the preset 3D face model.

[0076] Based on the spatial pose information of the first and second preset face positioning points obtained from the aforementioned steps, the three-dimensional face model corresponding to the user currently using the beauty care device can be determined using a predefined preset three-dimensional face model, thereby completing the spatial calibration of the user's face.

[0077] This application embodiment can obtain a user's 3D face model by reconstructing a preset 3D face model based on the spatial pose information of the first and second preset face positioning points obtained in the aforementioned steps, or by matching the preset 3D face model with the image. The specific method used can be flexibly selected by those skilled in the art according to actual needs, and no specific limitation is made here.

[0078] The facial spatial calibration method in this application is based on the contact characteristics between wearable devices and the user's head. The user only needs to hold the beauty device and apply it to one facial key point to complete the spatial calibration of the user's face. Compared with the solution that requires the user to hold the beauty device and click on multiple facial key points, it greatly improves the efficiency of facial spatial calibration, reduces the user's operating difficulty, and thus improves the user's skin care experience.

[0079] In some embodiments of this application, the wearable device is provided with contact capacitive sensors at both ends. When the user is wearing the wearable device, obtaining the spatial pose information of the first preset face positioning point includes: obtaining the capacitive sensing data of the contact capacitive sensors; determining the contact state between the two ends of the wearable device and the user's left and right ear backs based on the capacitive sensing data of the contact capacitive sensors; and determining the spatial pose information of the first preset face positioning point when the two ends of the wearable device are in full contact with the user's left and right ear backs.

[0080] The wearable device with an arc-shaped structure adopted in this application embodiment is provided with contact capacitive sensors at both ends of the arc-shaped structure. The contact capacitive sensors can determine the contact state between the two ends of the arc-shaped structure and the user's left and right ear backs by sensing changes in capacitance. The specific relationship between capacitance changes and contact state can be obtained in advance through testing. When it is determined that the two ends of the wearable device are in full contact with the user's left and right ear backs, it means that the user has worn the wearable device properly. At this time, the spatial pose information of the contact points between the user's left and right ear backs and the two ends of the wearable device can be further determined.

[0081] In some embodiments of this application, determining the spatial pose information of the first preset face positioning point when the two ends of the wearable device are in full contact with the user's left and right ear backs includes: determining the current spatial pose information of the two ends of the wearable device when the two ends of the wearable device are in full contact with the user's left and right ear backs; and determining the spatial pose information of the first preset face positioning point based on the current spatial pose information of the two ends of the wearable device.

[0082] The spatial pose information of the contact points between the user's left and right ear backs and the two ends of the wearable device can be indirectly determined by the current spatial pose information of the two ends of the wearable device. This is because the current spatial pose information of the two ends of the wearable device and the spatial pose information of the contact points between the user's left and right ear backs and the two ends of the wearable device are both relative to the reference wearable device coordinate system. When the user's left and right ear backs are in full contact with the two ends of the wearable device, the spatial positioning points of the two ends of the wearable device coincide with the spatial positioning points of the user's left and right ear backs. Therefore, in this case, the current spatial pose information of the two ends of the wearable device can be regarded as the spatial pose information of the contact points between the user's left and right ear backs and the two ends of the wearable device.

[0083] In some embodiments of this application, determining the current spatial pose information of the two ends of the wearable device when the two ends of the wearable device are in full contact with the user's left and right ear backs includes: determining the current opening angle of the wearable device when the two ends of the wearable device are in full contact with the user's left and right ear backs; obtaining the initial spatial pose information and initial opening angle of the two ends of the wearable device; and determining the current spatial pose information of the two ends of the wearable device based on the current opening angle of the wearable device and the initial spatial pose information and initial opening angle of the two ends of the wearable device.

[0084] It is understandable that, in order to improve the user's wearing experience and wearing effect, the wearable devices with arc-shaped structures, such as headbands or headphones, used in this application embodiment often undergo a certain degree of deformation after being worn on the user's head, thereby ensuring sufficient contact between the device and the user's head. Therefore, in the wearable device coordinate system, the spatial pose information of the two ends of the wearable device will change before and after the user wears it. Therefore, this application embodiment needs to consider this change when determining the current spatial pose information of the two ends of the wearable device.

[0085] Specifically, when a wearable device is not worn, i.e., in its natural state, its two ends have an initial spatial pose and an initial opening angle. Since the geometric structure information of the wearable device is known after it leaves the factory, the initial spatial pose and initial opening angle of the two ends can be determined after defining the wearable device's coordinate system. When the wearable device is worn by the user, the spatial pose of the two ends of the wearable device will change due to deformation. The changed spatial pose can be calculated based on the changed current opening angle and the initial spatial pose and initial opening angle of the two ends of the wearable device. That is, the angle change can be determined based on the current opening angle and the initial opening angle, the spatial displacement of the two ends of the wearable device can be determined based on the angle change, and then combined with the initial spatial pose, the current spatial pose can be determined.

[0086] In some embodiments of this application, a bending sensor is provided on the side of the wearable device that contacts the user's head. Determining the current opening angle of the wearable device when both ends of the wearable device are in full contact with the user's left and right earlobes includes: acquiring the current bending sensing data of the bending sensor and the correspondence between the opening angle of the wearable device and the bending sensing data of the bending sensor; and determining the current opening angle corresponding to the current bending sensing data based on the correspondence.

[0087] In this embodiment of the wearable device, a bending sensor is also provided on the inner side that contacts the user's head. The precise bending angle is measured based on the bending sensing data output by the bending sensor, such as resistance values. Here, the correspondence between different opening angles of the wearable device and the bending sensing data output by the bending sensor can be determined in advance through testing. Based on this correspondence, after the user puts on the wearable device, the current opening angle corresponding to the current bending sensing data can be determined according to the current bending sensing data output by the bending sensor.

[0088] The aforementioned bending sensor can be, for example, a flexible bending sensor with a surface layer of special resistive material. When the bending sensor is subjected to pressure and undergoes bending deformation, the surface resistance value changes. Of course, those skilled in the art can flexibly choose the specific form of bending sensor according to actual needs, and no specific limitation is made here.

[0089] In some embodiments of this application, determining the spatial pose information of the second preset face positioning point when the user holds the beauty device and it acts on the second preset face positioning point includes: acquiring the spatial pose information of the beauty device when the user holds the beauty device and it acts on the second preset face positioning point; and determining the spatial pose information of the second preset face positioning point based on the spatial pose information of the beauty device.

[0090] Since the second preset face positioning point is any facial key point clicked by the user holding the beauty device, the spatial pose information of the second preset face positioning point in the wearable device system can be determined by the spatial pose of the beauty device. As in the aforementioned embodiment, the reference spatial coordinate system defined in this application is the wearable device system; therefore, the spatial pose information of the beauty device here also refers to the spatial pose of the beauty device in the wearable device coordinate system. When the user holds the beauty device and clicks on a facial key point, the spatial pose of the beauty device in the wearable device coordinate system coincides with the spatial pose of the facial key point in the wearable device coordinate system. Therefore, the spatial pose of the beauty device in the wearable device coordinate system can be directly used as the spatial pose of the facial key point in the wearable device coordinate system.

[0091] The spatial orientation information of beauty care equipment can be determined based on positioning technologies such as vision, magnetic sensing, or optical sensing. Of course, those skilled in the art can flexibly choose the specific method to determine the spatial orientation of the beauty care equipment according to actual needs, and no specific limitation is made here.

[0092] In some embodiments of this application, determining the user's corresponding 3D face model using a preset 3D face model based on the spatial pose information of the first preset face positioning point and the second preset face positioning point includes: acquiring the geometric structure information of the wearable device; determining the spatial pose information of the user's head contour that is in contact with the wearable device based on the current spatial pose information of both ends of the wearable device and the geometric structure information of the wearable device; and determining the user's corresponding 3D face model using a preset 3D face model based on the spatial pose information of the first preset face positioning point, the second preset face positioning point, and the spatial pose information of the head contour.

[0093] Based on the current spatial pose information of both ends of the wearable device obtained when determining the spatial pose information of the first preset face positioning point in the aforementioned embodiments, more spatial pose information of the user's head positioning point can be calculated, thereby providing more sufficient support for the subsequent reconstruction or matching of the user's three-dimensional face model.

[0094] Since the geometric structure information of the wearable device is also known, the initial curve information corresponding to the arc structure can be determined based on the arc structure of the wearable device when it is not worn. After the user wears the wearable device, the current spatial pose information of the two ends of the wearable device can be determined based on the aforementioned embodiments. Then, the spatial changes of the two ends can be calculated based on the current spatial pose information of the two ends of the wearable device, and the curve information corresponding to the arc structure of the wearable device when it is worn can be determined. The curve information corresponding to the arc structure when it is worn can be regarded as the spatial information of the user's head contour, specifically including the spatial pose of each point on the head contour. This greatly enriches the number of spatial points on the user's head, thus providing more basis for the subsequent reconstruction or matching of the user's three-dimensional face model.

[0095] In some embodiments of this application, the preset 3D face model includes a standard 3D face model, which is a deformable model. The step of determining the user's corresponding 3D face model using the preset 3D face model based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point includes: performing deformation processing on the standard 3D face model based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point to obtain the user's corresponding 3D face model.

[0096] In this embodiment of the application, it is determined that the three-dimensional face model corresponding to the user can be obtained based on the reconstruction of the three-dimensional face model. The reconstruction of the three-dimensional face model is mainly based on the standard three-dimensional face model. The standard three-dimensional face model can be understood as a benchmark model obtained by fitting the spatial points of the head of a large number of users based on existing technologies such as the Flame model and the 3D MM model. The specific three-dimensional fitting model used to determine the standard three-dimensional face model can be flexibly selected by those skilled in the art according to actual needs, and no specific limitation is made here.

[0097] The standard 3D face model is a feasible variable model. A large number of different users' 3D face models can be generated by adjusting the deformation parameters. Since the implementation of this application requires determining the 3D face model of the user who is currently using the beauty care device, when reconstructing the user's 3D face model, it is necessary to consider the multiple spatial point information of the user's head obtained in the aforementioned embodiments, so that the reconstructed 3D face model is as close as possible to or conforms to the user's real facial features.

[0098] For example, the spatial points behind the user's left and right ears, the spatial point at the center of the forehead, and multiple spatial points on the head contour can be used as reference points to adjust the deformation parameters in the standard 3D face model so that the spatial points at the corresponding positions in the generated 3D face model coincide with the aforementioned reference points.

[0099] In some embodiments of this application, the preset 3D face model includes 3D face models of multiple users. The step of determining the 3D face model corresponding to a user based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point includes: matching the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point with the 3D face models of multiple users respectively; and determining the 3D face model corresponding to the user based on the matching results.

[0100] In this application embodiment, when determining the user's corresponding 3D facial model, it can also be determined through matching. This is based on a previously generated 3D facial model for the user, meaning the user is not using the beauty device for the first time. For the user's first use of the beauty device, facial space calibration can be achieved by guiding the user to click on multiple facial key points, or, based on the aforementioned embodiment of this application, by clicking on only one facial key point. Regardless of the method, the 3D facial model created for the user during initial use can be obtained. When the user uses the beauty device again subsequently, it is not necessary to rebuild the 3D facial model; simply matching it with the previously saved 3D facial model is sufficient to determine which user is the user and their corresponding 3D facial model, thus completing the facial space calibration.

[0101] Of course, considering the possibility of matching failure, the matching method in this application embodiment can also be used as a pre-judgment step in the aforementioned embodiment. That is, the determined multiple spatial points are first matched with the saved three-dimensional face model of the user. If a match cannot be found, the three-dimensional face model is reconstructed using the standard three-dimensional face model in the aforementioned embodiment.

[0102] For ease of understanding of the various embodiments of this application, such as Figure 2The diagram illustrates a face spatial calibration process according to an embodiment of this application. The face spatial calibration process of this application requires determining spatial point information in three dimensions, including the spatial pose information of a first preset facial key point, the spatial pose information of a second preset facial key point, and the spatial pose information of the user's head contour.

[0103] When determining the spatial pose information of the first preset facial key points and the spatial pose information of the user's head contour, it is necessary to first obtain the capacitive sensing data of the contact capacitive sensor. Based on the capacitive sensing data of the contact capacitive sensor, the contact state between the two ends of the wearable device and the user's left and right ear backs can be determined. Under the condition of sufficient contact, the current bending sensing data of the bending sensor and the correspondence between the opening angle of the wearable device and the bending sensing data of the bending sensor are obtained. Based on the correspondence, the current opening angle corresponding to the current bending sensing data is determined. Combining the initial spatial pose information and the initial opening angle of the two ends of the wearable device, the current spatial pose information of the two ends of the wearable device is determined.

[0104] Based on the current spatial pose information of the two ends of the wearable device, the spatial pose information of the first preset face positioning point can be determined on the one hand, and the spatial pose information of the user's head contour can be determined by combining the geometric structure information of the wearable device on the other hand.

[0105] When determining the spatial pose information packet of the second preset face positioning point, the spatial pose information of the beauty device can be obtained when the user holds the beauty device and applies it to the second preset face positioning point. At this time, the spatial pose information of the beauty device can be directly used as the spatial pose information of the second preset face positioning point.

[0106] Based on the spatial pose information of the first preset facial key points, the spatial pose information of the second preset facial key points, and the spatial pose information of the user's head contour, the preset facial 3D model can be used to determine the current user's corresponding facial 3D model through reconstruction or matching.

[0107] This application also provides a face spatial calibration device 300, such as... Figure 3 As shown, a structural schematic diagram of a face space calibration device according to an embodiment of this application is provided. The face space calibration device 300 includes:

[0108] The acquisition unit 310 is used to acquire the spatial pose information of a first preset face positioning point when the user is wearing a wearable device. The first preset face positioning point includes the contact points between the two ends of the wearable device and the back of the user's ear.

[0109] The first determining unit 320 is used to determine the spatial pose information of the second preset face positioning point when the user's handheld beauty device is applied to the second preset face positioning point. The second preset face positioning point is any one of a plurality of face key points.

[0110] The second determining unit 330 is used to determine the user's corresponding three-dimensional face model based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point using a preset three-dimensional face model.

[0111] In some embodiments of this application, the wearable device is provided with contact capacitive sensors at both ends. The acquisition unit 310 is specifically used to: acquire the capacitive sensing data of the contact capacitive sensors; determine the contact state between the two ends of the wearable device and the user's left and right ear backs based on the capacitive sensing data of the contact capacitive sensors; and determine the spatial pose information of the first preset face positioning point when the two ends of the wearable device are in full contact with the user's left and right ear backs.

[0112] In some embodiments of this application, the acquisition unit 310 is specifically used to: determine the current spatial pose information of the two ends of the wearable device when the two ends of the wearable device are in full contact with the left and right backs of the user's ears; and determine the spatial pose information of the first preset face positioning point based on the current spatial pose information of the two ends of the wearable device.

[0113] In some embodiments of this application, the acquisition unit 310 is specifically used to: determine the current opening angle of the wearable device when the two ends of the wearable device are in full contact with the left and right backs of the user's ears; acquire the initial spatial pose information and initial opening angle of the two ends of the wearable device; and determine the current spatial pose information of the two ends of the wearable device based on the current opening angle of the wearable device and the initial spatial pose information and initial opening angle of the two ends of the wearable device.

[0114] In some embodiments of this application, a bending sensor is provided on the side of the wearable device that contacts the user's head. The acquisition unit 310 is specifically used to: acquire the current bending sensing data of the bending sensor and the correspondence between the opening angle of the wearable device and the bending sensing data of the bending sensor; and determine the current opening angle corresponding to the current bending sensing data based on the correspondence.

[0115] In some embodiments of this application, the first determining unit 320 is specifically used to: obtain the spatial pose information of the beauty device when the user holds the beauty device and applies it to the second preset face positioning point; and determine the spatial pose information of the second preset face positioning point based on the spatial pose information of the beauty device.

[0116] In some embodiments of this application, the second determining unit 330 is specifically used to: acquire the geometric structure information of the wearable device; determine the spatial pose information of the head contour of the user in contact with the wearable device based on the current spatial pose information of both ends of the wearable device and the geometric structure information of the wearable device; and determine the corresponding three-dimensional face model of the user using a preset three-dimensional face model based on the spatial pose information of the first preset face positioning point, the spatial pose information of the second preset face positioning point, and the spatial pose information of the head contour.

[0117] In some embodiments of this application, the preset face 3D model includes a standard face 3D model, which is a deformable model. The second determining unit 330 is specifically used to: perform deformation processing on the standard face 3D model according to the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point to obtain the face 3D model corresponding to the user.

[0118] In some embodiments of this application, the preset three-dimensional face model includes three-dimensional face models of multiple users, and the second determining unit 330 is specifically used to: match the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point with the three-dimensional face models of multiple users respectively; and determine the three-dimensional face model corresponding to the user based on the matching result.

[0119] It is understood that the above-mentioned face space calibration device can realize all the steps of the face space calibration method provided in the foregoing embodiments. The relevant explanations of the face space calibration method are applicable to the face space calibration device, and will not be repeated here.

[0120] This application also provides a wearable device, including: a processor; and a memory arranged to store computer-executable instructions, which, when executed, cause the processor to perform any of the aforementioned beauty device positioning methods.

[0121] Figure 4 This is a schematic diagram of the structure of a wearable device according to an embodiment of this application. Please refer to it. Figure 4At the hardware level, the wearable device includes a processor, and optionally also an internal bus, network interface, and memory. The memory may include RAM, such as high-speed random-access memory (RAM), or non-volatile memory, such as at least one disk drive. Of course, the wearable device may also include other hardware required for its business operations.

[0122] The processor, network interface, and memory can be interconnected via an internal bus, which can be an ISA (Industry Standard Architecture) bus, a PCI (Peripheral Component Interconnect) bus, or an EISA (Extended Industry Standard Architecture) bus, etc. This bus can be divided into address bus, data bus, control bus, etc. For ease of representation, Figure 4 The symbol is represented by a single double-headed arrow, but this does not mean that there is only one bus or one type of bus.

[0123] Memory is used to store programs. Specifically, programs may include program code, which includes computer operation instructions. Memory may include main memory and non-volatile memory, and provides instructions and data to the processor.

[0124] The processor reads the corresponding computer program from non-volatile memory into main memory and then runs it, forming a face spatial calibration device at the logical level. The processor executes the program stored in memory and specifically performs the following operations:

[0125] When a user is wearing a wearable device, the spatial pose information of a first preset face positioning point is obtained. The first preset face positioning point includes the contact points between the user's left and right ear backs and both ends of the wearable device.

[0126] When the user holds a beauty device and applies it to the second preset face positioning point, the spatial pose information of the second preset face positioning point is determined. The second preset face positioning point is any one of multiple facial key points.

[0127] Based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point, the user's corresponding three-dimensional face model is determined using the preset three-dimensional face model.

[0128] The above is as stated in this application. Figure 1The face spatial calibration device disclosed in the illustrated embodiment can be applied to a processor or implemented by a processor. The processor may be an integrated circuit chip with signal processing capabilities. During implementation, each step of the above method can be completed by integrated logic circuits in the processor's hardware or by instructions in software form. The processor can be a general-purpose processor, including a Central Processing Unit (CPU), a Network Processor (NP), etc.; it can also be a Digital Signal Processor (DSP), an Application Specific Integrated Circuit (ASIC), a Field-Programmable Gate Array (FPGA), or other programmable logic devices, discrete gate or transistor logic devices, or discrete hardware components. It can implement or execute the methods, steps, and logic block diagrams disclosed in the embodiments of this application. The general-purpose processor can be a microprocessor or any conventional processor. The steps of the method disclosed in the embodiments of this application can be directly embodied as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software module can reside in a mature storage medium in the field, such as random access memory, flash memory, read-only memory, programmable read-only memory, electrically erasable programmable memory, or registers. This storage medium is located in memory, and the processor reads information from the memory and, in conjunction with its hardware, completes the steps of the above method.

[0129] The wearable device can also perform Figure 1 A method for implementing a face spatial calibration device, and how the face spatial calibration device is implemented in... Figure 1 The functions of the embodiments shown are not described in detail here.

[0130] This application also proposes a computer-readable storage medium that stores one or more programs, the programs including instructions that, when executed by a wearable device comprising multiple applications, enable the wearable device to perform... Figure 1 The method executed by the face spatial calibration device in the illustrated embodiment is specifically used to perform:

[0131] When a user is wearing a wearable device, the spatial pose information of a first preset face positioning point is obtained. The first preset face positioning point includes the contact points between the user's left and right ear backs and both ends of the wearable device.

[0132] When the user holds a beauty device and applies it to the second preset face positioning point, the spatial pose information of the second preset face positioning point is determined. The second preset face positioning point is any one of multiple facial key points.

[0133] Based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point, the user's corresponding three-dimensional face model is determined using the preset three-dimensional face model.

[0134] Those skilled in the art will understand that embodiments of the present invention can be provided as methods, systems, or computer program products. Therefore, the present invention can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present invention can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0135] This invention is described with reference to flowchart illustrations and / or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and / or block diagrams, and combinations of blocks in the flowchart illustrations and / or block diagrams, can be implemented by computer program instructions. These computer program instructions can be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, generate instructions for implementing the flowchart illustrations and / or block diagrams. Figure 1 One or more processes and / or boxes Figure 1 A device that provides the functions specified in one or more boxes.

[0136] These computer program instructions may also be stored in a computer-readable storage medium that can direct a computer or other programmable data processing device to function in a particular manner, such that the instructions stored in the computer-readable storage medium produce an article of manufacture including instruction means, which are implemented in a process Figure 1 One or more processes and / or boxes Figure 1 The function specified in one or more boxes.

[0137] These computer program instructions may also be loaded onto a computer or other programmable data processing equipment to cause a series of operational steps to be performed on the computer or other programmable equipment to produce a computer-implemented process, thereby providing instructions that execute on the computer or other programmable equipment for implementing the process. Figure 1 One or more processes and / or boxes Figure 5 The steps of the function specified in one or more boxes.

[0138] In a typical configuration, a computing device includes one or more processors (CPU), input / output interfaces, network interfaces, and memory.

[0139] Memory may include non-persistent storage in computer-readable media, such as random access memory (RAM) and / or non-volatile memory, such as read-only memory (ROM) or flash RAM. Memory is an example of computer-readable media.

[0140] Computer-readable media includes both permanent and non-permanent, removable and non-removable media that can store information using any method or technology. Information can be computer-readable instructions, data structures, modules of programs, or other data. Examples of computer storage media include, but are not limited to, phase-change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technologies, CD-ROM, digital versatile optical disc (DVD) or other optical storage, magnetic tape, magnetic magnetic disk storage or other magnetic storage devices, or any other non-transferable medium that can be used to store information accessible by a computing device. As defined herein, computer-readable media does not include transient computer-readable media, such as modulated data signals and carrier waves.

[0141] This application also provides another wearable device, such as... Figure 6 The diagram shows a structural schematic of another wearable device in this application embodiment. The wearable device 1 includes: a contact capacitive sensor 11 for collecting capacitive sensing data generated by the wearable device 1; a processor 12 connected to the contact capacitive sensor 11 for acquiring the capacitive sensing data collected by the contact capacitive sensor 11, and determining the spatial pose information of a first preset face positioning point based on the capacitive sensing data. The first preset face positioning point includes the contact points between the user's left and right ear backs and both ends of the wearable device. The processor 12 is also used to determine the spatial pose information of a second preset face positioning point, which is any one of multiple facial key points. Furthermore, the processor 12 is used to determine the user's corresponding three-dimensional face model using a preset three-dimensional face model based on the spatial pose information of the first and second preset face positioning points.

[0142] The wearable device in this application embodiment mainly includes two parts: a contact capacitive sensor and a processor. The contact capacitive sensor is set at a fixed position on the wearable device and is mainly used to collect capacitance sensing data. Based on the capacitance sensing data, the contact state between the wearable device and the user can be determined. The specific model and operating voltage of the contact capacitive sensor can be flexibly selected according to actual needs and are not specifically limited here.

[0143] The processor in this embodiment can be connected to the aforementioned contact capacitive sensor via a wired connection to receive capacitance sensing data sent by the contact capacitive sensor, thereby achieving the functions that can be achieved by any of the methods in the foregoing embodiments, and thus achieving the purpose of face spatial calibration.

[0144] In some embodiments of this application, the wearable device 1 has an arc-shaped structure.

[0145] The wearable device in this application embodiment can adopt an arc-shaped structure similar to a headband or headphones. When a user performs skincare operations using the beauty device, by wearing the arc-shaped wearable device on the top of their head, the arc shape ensures that the wearable device fits snugly against the top of the user's head, thus fixing the spatial relative position between the wearable device and the user's face and ensuring the correct implementation of subsequent functions such as face area positioning. On the other hand, the arc-shaped wearable device can also assist the user in tidying up their hair, thereby facilitating the user's skincare operations and improving the user's skincare experience.

[0146] In some embodiments of this application, the arc-shaped structure is provided with two ends, which are respectively used to contact the back of the user's left and right ears.

[0147] The arc-shaped structure of this application embodiment has two ends, left and right. When the user wears the wearable device, the two ends contact the user's left and right ear backs respectively, thereby providing support for determining the spatial pose information of the user's left and right ear backs.

[0148] Of course, it should be noted that since the size and structure of wearable devices are based on the general size designed for the general population, the two ends of the wearable device may not be exactly aligned with the back of the user's left and right ears after some users wear the wearable device. However, this does not affect the subsequent face space calibration. That is, the contact points between the back of the user's left and right ears and the two ends of the wearable device as defined in the embodiments of this application can be extended to other points in the vicinity of the back of the left and right ears.

[0149] In some embodiments of this application, the contact capacitive sensor 11 includes two sensors, which are respectively disposed at both ends of the arc-shaped structure, and are respectively used to collect the capacitive sensing data generated at both ends of the arc-shaped structure when the two ends of the arc-shaped structure are in contact with the left and right backs of the user's ears.

[0150] To provide more information on the user's facial spatial points, embodiments of this application may include a contact-type capacitive sensor at each end of the arc-shaped wearable device. These sensors are used to collect capacitive sensing data generated at both ends when the wearable device is in contact with the user's left and right earlobes. Of course, those skilled in the art can flexibly adjust the number and location of the contact sensors according to actual needs.

[0151] In some embodiments of this application, the arc-shaped structure is provided with an inner side, which is used to contact the contour of the user's head.

[0152] The arc-shaped structure in this embodiment of the application is also provided with an inner side. The design of the inner side is mainly to ensure that the inner side of the arc-shaped structure can fully contact the user's head contour as much as possible after the user wears the wearable device. This allows for the acquisition of more spatial points on the user's head contour based on the wearing characteristics of the wearable device, thereby improving the accuracy of subsequent facial spatial calibration.

[0153] In some embodiments of this application, the wearable device 1 further includes a bending sensor 13, which is disposed on the inner side of the arc-shaped structure and is used to collect bending sensing data generated by the wearable device 1 when the inner side of the arc-shaped structure is in contact with the contour of the user's head.

[0154] The wearable device in this embodiment further includes a bending sensor. The bending sensor can be disposed on the inner side of the arc-shaped structure. Specifically, the bending sensor can be a flexible strip structure disposed along the inner side of the wearable device. A special resistive material is disposed on the surface of the bending sensor. When the bending sensor is subjected to pressure and undergoes bending deformation, the surface resistance value changes. Therefore, the change in the opening angle of the arc-shaped structure after the user wears the wearable device can be determined based on the change in resistance value. Of course, the specific form of the bending sensor used can be flexibly selected by those skilled in the art according to actual needs, and is not specifically limited here. Thus, based on...

[0155] In some embodiments of this application, the processor 12 is connected to the bending sensor 13 to acquire bending sensing data collected by the bending sensor 13, and to determine the spatial pose information of the user's head contour in contact with the wearable device 1 based on the bending sensing data and the geometric structure information of the wearable device 1.

[0156] The processor in this embodiment can be connected to the aforementioned bending sensor via a wired connection to receive bending sensing data collected by the bending sensor. Based on the bending sensing data and the geometric structure information of the wearable device, the spatial pose information of the user's head contour in contact with the wearable device can be determined.

[0157] In some embodiments of this application, the wearable device 1 further includes a magnetic sensor 14 for sensing magnetic signals emitted by a magnetic source on the beauty device and generating electromagnetic induction data, or the wearable device further includes a magnetic source 15 for emitting magnetic signals to the magnetic sensor on the beauty device.

[0158] To determine the spatial pose information of a beauty device in a wearable coordinate system, electromagnetic induction technology can be used to achieve spatial positioning of the device. Therefore, one approach in this application embodiment is to set a magnetic sensor on the wearable device and a magnetic source on the beauty device, using the magnetic sensor to sense the magnetic signal emitted by the magnetic source to achieve spatial positioning of the beauty device. Another approach is to set the magnetic source on the wearable device and the magnetic sensor on the beauty device. The specific setup can be flexibly configured by those skilled in the art according to actual needs, and is not specifically limited here.

[0159] In some embodiments of this application, the processor 12 is connected to the magnetic sensor to acquire electromagnetic induction data generated by the magnetic sensor and determine the spatial pose information of the beauty device based on the electromagnetic induction data.

[0160] The processor in this embodiment can be connected to a magnetic sensor. If the magnetic sensor is installed on a wearable device, the processor can transmit data to the magnetic sensor via a wired connection. If the magnetic sensor is installed on a beauty device, the processor can obtain the magnetic induction data collected by the magnetic sensor on the beauty device via a wireless connection.

[0161] This application also provides a beauty care system, such as... ​ The diagram shows an architecture of a beauty care system according to an embodiment of this application. The beauty care system includes beauty care devices and wearable devices as described in any of the preceding claims.

[0162] It should also be noted that the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0163] Those skilled in the art will understand that embodiments of this application can be provided as methods, systems, or computer program products. Therefore, this application can take the form of a completely hardware embodiment, a completely software embodiment, or an embodiment combining software and hardware aspects. Furthermore, this application can take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, etc.) containing computer-usable program code.

[0164] The above description is merely an embodiment of this application and is not intended to limit the scope of this application. Various modifications and variations can be made to this application by those skilled in the art. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the scope of the claims of this application.

Claims

1. A face spatial calibration method, characterized in that, The face spatial calibration method includes: When a user is wearing a wearable device, the spatial pose information of a first preset face positioning point is obtained. The first preset face positioning point includes the contact points between the user's left and right ear backs and both ends of the wearable device. When the user holds a beauty device and applies it to the second preset face positioning point, the spatial pose information of the second preset face positioning point is determined. The second preset face positioning point is any one of multiple facial key points. Based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point, the user's corresponding three-dimensional face model is determined using the preset three-dimensional face model.

2. The face spatial calibration method according to claim 1, characterized in that, The wearable device is equipped with contact capacitive sensors at both ends. The step of acquiring the spatial pose information of the first preset face positioning point when the user is wearing the wearable device includes: Acquire the capacitance sensing data of the contact capacitive sensor; The contact state between the two ends of the wearable device and the user's left and right ear backs is determined based on the capacitance sensing data of the contact capacitive sensor. When the two ends of the wearable device are in full contact with the user's left and right earlobes, the spatial pose information of the first preset face positioning point is determined.

3. The face spatial calibration method according to claim 2, characterized in that, When the wearable device is in full contact with the user's left and right earlobes, determining the spatial pose information of the first preset face positioning point includes: Under the condition that the two ends of the wearable device are in full contact with the user's left and right ear backs, the current spatial pose information of the two ends of the wearable device is determined; The spatial pose information of the first preset face positioning point is determined based on the current spatial pose information of both ends of the wearable device.

4. The face spatial calibration method according to claim 3, characterized in that, When the wearable device is in full contact with the user's left and right earlobes, determining the current spatial pose information of the two ends of the wearable device includes: Determine the current opening angle of the wearable device when both ends of the wearable device are in full contact with the user's left and right ear backs. Obtain the initial spatial pose information and initial opening angle of both ends of the wearable device; Based on the current opening angle of the wearable device and the initial spatial pose information and initial opening angle of the two ends of the wearable device, the current spatial pose information of the two ends of the wearable device is determined.

5. The face spatial calibration method according to claim 4, characterized in that, A bend sensor is provided on the side of the wearable device that contacts the user's head. Determining the current opening angle of the wearable device when both ends are in full contact with the user's left and right earlobes includes: Obtain the current bending sensing data of the bending sensor and the correspondence between the opening angle of the wearable device and the bending sensing data of the bending sensor; Based on the correspondence, the current opening angle corresponding to the current bending sensing data is determined.

6. The face spatial calibration method according to claim 1, characterized in that, When the user's handheld beauty device is applied to the second preset face positioning point, determining the spatial pose information of the second preset face positioning point includes: When the user holds the beauty device and applies it to the second preset face positioning point, the spatial pose information of the beauty device is obtained; The spatial pose information of the second preset face positioning point is determined based on the spatial pose information of the beauty care device.

7. The face spatial calibration method according to claim 3, characterized in that, The step of determining the user's corresponding 3D face model using a preset 3D face model based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point includes: Obtain the geometric structure information of the wearable device; Based on the current spatial pose information of both ends of the wearable device and the geometric structure information of the wearable device, the spatial pose information of the user's head contour in contact with the wearable device is determined. Based on the spatial pose information of the first preset face positioning point, the spatial pose information of the second preset face positioning point, and the spatial pose information of the head contour, the user's corresponding three-dimensional face model is determined using a preset three-dimensional face model.

8. The face spatial calibration method according to claim 1, characterized in that, The preset 3D face model includes a standard 3D face model, which is a deformable model. The step of determining the user's corresponding 3D face model using the preset 3D face model based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point includes: Based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point, the standard face 3D model is deformed to obtain the face 3D model corresponding to the user.

9. The face spatial calibration method according to claim 1, characterized in that, The preset 3D face model includes 3D face models of multiple users. The step of determining the 3D face model corresponding to a user based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point, using the preset 3D face model, includes: The spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point are matched with the three-dimensional face models of multiple users respectively. The 3D facial model corresponding to the user is determined based on the matching results.

10. A face spatial calibration device, characterized in that, The face spatial calibration device includes: The acquisition unit is used to acquire the spatial pose information of a first preset face positioning point when the user is wearing a wearable device. The first preset face positioning point includes the contact points between the two ends of the wearable device and the user's left and right ear backs. The first determining unit is used to determine the spatial pose information of the second preset face positioning point when the user's handheld beauty device is applied to the second preset face positioning point. The second preset face positioning point is any one of a plurality of facial key points. The second determining unit is used to determine the user's corresponding three-dimensional face model using a preset three-dimensional face model based on the spatial pose information of the first preset face positioning point and the spatial pose information of the second preset face positioning point.

11. A wearable device, characterized in that, include: Contact capacitive sensors are used to collect capacitive sensing data generated by wearable devices. The processor, connected to the contact capacitive sensor, is used to acquire the capacitive sensing data collected by the contact capacitive sensor, and determine the spatial pose information of a first preset face positioning point based on the capacitive sensing data. The first preset face positioning point includes the contact points between the user's left and right ear backs and both ends of the wearable device. The processor is also used to determine the spatial pose information of a second preset face positioning point. The second preset face positioning point is any one of a plurality of facial key points. The spatial pose information of the second preset face positioning point is the spatial pose information of any facial key point acted upon by the handheld beauty care device. Based on the spatial pose information of the first and second preset face positioning points, the processor uses a preset face 3D model to determine the user's corresponding face 3D model.

12. The wearable device according to claim 11, characterized in that, The wearable device has an arc-shaped structure.

13. The wearable device according to claim 12, characterized in that, The arc-shaped structure has two ends, which are respectively used to contact the back of the user's left and right ears.

14. The wearable device according to claim 13, characterized in that, The contact capacitive sensors include two, which are respectively disposed at both ends of the arc-shaped structure. They are used to collect the capacitive sensing data generated at both ends of the arc-shaped structure when the two ends of the arc-shaped structure are in contact with the user's left and right ear backs, respectively.

15. The wearable device according to claim 12, characterized in that, The arc-shaped structure has an inner side, which is designed to contact the contour of the user's head.

16. The wearable device according to claim 15, characterized in that, The wearable device also includes a bending sensor disposed on the inner side of the arc-shaped structure, which is used to collect bending sensing data generated by the wearable device when the inner side of the arc-shaped structure is in contact with the contour of the user's head.

17. The wearable device according to claim 16, characterized in that, The processor is connected to the bending sensor and is used to acquire bending sensing data collected by the bending sensor, and to determine the spatial pose information of the user's head contour in contact with the wearable device based on the bending sensing data and the geometric structure information of the wearable device.

18. The wearable device according to claim 11, characterized in that, The wearable device also includes a magnetic sensor for sensing magnetic signals emitted by a magnetic source on the beauty device and generating electromagnetic induction data, or the wearable device also includes a magnetic source for emitting magnetic signals to the magnetic sensor on the beauty device.

19. The wearable device according to claim 18, characterized in that, The processor is connected to the magnetic sensor and is used to acquire electromagnetic induction data generated by the magnetic sensor and determine the spatial pose information of the beauty device based on the electromagnetic induction data.

20. A beauty care system, characterized in that, The beauty care system includes beauty care devices and wearable devices as described in any one of claims 11 to 19.

Images