Beauty physiotherapy instrument adopting superaudio vibration massage and control method

Abstract

The invention provides a beauty physiotherapy instrument adopting superaudio vibration massage and a control method, and the method comprises the steps: carrying out the superaudio vibration massage on a beauty physiotherapy instrument user based on a face massage mode, and collecting a vibration signal of a massage region boundary in real time in a massage process, so as to obtain a massage vibration response signal; performing resistance characteristic extraction according to massage parameters corresponding to the face massage mode and the massage vibration response signal to obtain face skin resistance characteristics, performing feature clustering on the face skin resistance characteristics, and determining the water content of the face cuticle based on a clustering result; the method comprises the following steps: acquiring a real-time water content of a facial cuticle, determining a water content change value based on the initial water content of the facial cuticle, and adjusting a facial massage mode in real time according to the water content change value. And the discomfort in the beauty physical therapy process is relieved.

Description

TECHNICAL FIELD

[0001] The present application relates to the technical field of massage and physiotherapy, and more particularly, to a beauty physiotherapy instrument using super-audio frequency vibration massage and a control method, such as a terminal device, a chip, a computer storage medium, etc. BACKGROUND

[0002] As an intelligent device applied to the non-invasive or minimally invasive physiotherapy field of skin beauty, tissue repair, and skin health management, the beauty physiotherapy instrument has been widely used in various application scenarios such as home care, beauty salons, and medical beauty in recent years. This kind of device stimulates or adjusts the skin tissue or superficial muscle through the integration of different types of physical therapy means, such as photon irradiation and electric pulse stimulation, so as to achieve multiple beauty physiotherapy effects such as promoting collagen regeneration, lightening color spots, tightening and lifting, enhancing skin barrier function, and improving microcirculation.

[0003] In the prior art, a facial vibration massage device is usually added to the beauty physiotherapy device to relieve discomfort or pain during the beauty physiotherapy process. However, the beauty physiotherapy process often requires long-time application of essence or mask on the face. The cuticle layer of the facial skin is composed of keratin, and long-time contact with liquid will cause the keratin to swell due to water absorption. In particular, as age increases, the natural moisturizing factor content of the cuticle layer decreases, and the cell water content is unstable. After the cuticle layer swells due to water absorption, the softening of the colloid structure will cause the skin medium impedance to decrease, the absorption of super-audio mechanical waves to increase, and mechanical buffering to form, so that the vibration energy is absorbed by the surface layer, the deep stimulation of massage is reduced, and the vibration massage is difficult to relieve the discomfort during the beauty physiotherapy process. SUMMARY

[0004] The present application provides a beauty physiotherapy instrument using super-audio frequency vibration massage and a control method, which can adjust the facial massage mode in real time according to the change of the water content of the facial cuticle layer of the user, and relieve the discomfort during the beauty physiotherapy process.

[0005] In a first aspect, the present application provides a control method of a beauty physiotherapy instrument using super-audio frequency vibration massage. The method can be executed by a network device, or can also be executed by a chip configured in the network device, which is not limited by the present application.

[0006] Specifically, the method comprises: collecting facial expression images of a user of a beauty physiotherapy instrument, extracting emotion features from the facial expression images, and adjusting a facial massage mode according to the emotion features of the user of the beauty physiotherapy instrument; based on the facial massage mode, performing super-audio frequency vibration massage on the user of the beauty physiotherapy instrument, and collecting vibration signals of the boundary of the massage area in real time during the massage process to obtain a massage vibration response signal; Resistance characteristics are extracted based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal to obtain facial skin resistance characteristics. Feature clustering is performed on the facial skin resistance characteristics, and the water content of the facial stratum corneum is determined based on the clustering results. The system acquires real-time facial stratum corneum moisture content and determines the moisture content change value based on the initial facial stratum corneum moisture content. The facial massage mode is then adjusted in real-time according to the moisture content change value.

[0007] In conjunction with the first aspect, in some implementations of the first aspect, the process of performing ultrasonic vibration massage on the user of the beauty therapy device involves using electromagnetic drive to convert electrical signals into high-frequency mechanical vibrations of the massage head, thereby performing ultrasonic vibration massage on the user through the massage head.

[0008] In conjunction with the first aspect, in certain implementations of the first aspect, the extraction of resistance characteristics based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal to obtain the facial skin resistance characteristics specifically includes: A massage vibration input signal is constructed based on the massage parameters corresponding to the facial massage mode; The massage vibration response signal is acquired, and after background noise is removed by a bandpass filter with a preset frequency band, a feature vector is extracted based on the massage vibration response signal and the massage vibration input signal. This vector is composed of amplitude attenuation rate, vibration signal delay, frequency response distribution, and energy dissipation characteristics, and is used as the facial skin resistance characteristics.

[0009] In conjunction with the first aspect, in some implementations of the first aspect, a convolutional neural network is used to perform feature clustering on the facial skin resistance characteristics.

[0010] In conjunction with the first aspect, in some implementations of the first aspect, determining the change in water content based on the initial water content of the facial stratum corneum, and adjusting the facial massage mode in real time according to the change in water content specifically includes: Obtain the preset mode adjustment cycle, obtain the current facial stratum corneum moisture content within the current mode adjustment cycle, and obtain the facial stratum corneum moisture content corresponding to the first mode adjustment cycle as the initial facial stratum corneum moisture content. Based on the current and initial facial stratum corneum moisture content, the moisture content change value is determined, the current massage power of the facial massage mode corresponding to the current mode adjustment cycle is obtained, the power compensation amount corresponding to the moisture content change value is determined according to the preset power adjustment function and the current massage power, and the facial massage mode of the next mode adjustment cycle is adjusted according to the power compensation amount.

[0011] In conjunction with the first aspect, in some implementations of the first aspect, before extracting emotional features from the facial expression image, the method further includes: performing image preprocessing on the facial expression image, wherein the image preprocessing specifically includes: after grayscale processing of the facial expression image, standardizing the image to a uniform facial pose to achieve facial alignment by locating facial key points.

[0012] In conjunction with the first aspect, in certain implementations of the first aspect, extracting emotional features from the facial expression image specifically includes: Extract the key facial structural points from the facial expression image, and extract a quantitative expression feature vector based on the relative position of the key facial points; The facial expression feature vector is classified using an emotion recognition classification model to obtain the user's current emotion category label as the emotion feature.

[0013] Secondly, this application provides a beauty therapy device employing ultrasonic vibration massage, which includes a massage mode control unit, the massage mode control unit comprising: The user emotion sensing module is used to collect facial expression images of the beauty therapy device user, extract emotional features from the facial expression images, and adjust the facial massage mode based on the emotional features of the beauty therapy device user. The massage effect sensing module is used to perform ultrasonic vibration massage on the user of the beauty therapy device, and to collect the vibration signal of the boundary of the massage area in real time during the massage process to obtain the massage vibration response signal; The massage effect sensing module is also used to extract resistance characteristics based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal, obtain facial skin resistance characteristics, perform feature clustering on the facial skin resistance characteristics, and determine the facial stratum corneum moisture content based on the clustering results. The massage mode adjustment module is used to obtain the real-time moisture content of the facial stratum corneum, determine the moisture content change value based on the initial facial stratum corneum moisture content, and adjust the facial massage mode in real time according to the moisture content change value.

[0014] Thirdly, this application provides a computer terminal device, which includes a memory and a processor. The memory stores code, and the processor is configured to acquire the code and execute the control method described above for a beauty therapy device using ultrasonic vibration massage.

[0015] Fourthly, this application provides a computer-readable storage medium storing at least one computer program, which is loaded and executed by a processor to perform the operations described above in the control method for a beauty therapy device employing ultrasonic vibration massage.

[0016] The technical solutions provided by the embodiments disclosed in this application have the following beneficial effects: This application provides a beauty therapy device and control method using ultrasonic vibration massage. First, facial expression images of the user are acquired, and emotional features are extracted from these images. The facial massage mode is then adjusted based on the user's emotional features. Ultrasonic vibration massage is performed on the user based on the facial massage mode, and vibration signals at the boundaries of the massage area are acquired in real time during the massage to obtain a massage vibration response signal. Resistance characteristics are extracted based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal to obtain facial skin resistance characteristics. Feature clustering is performed on these facial skin resistance characteristics, and the facial stratum corneum moisture content is determined based on the clustering results. Real-time facial stratum corneum moisture content is obtained, and the moisture content change value is determined based on the initial facial stratum corneum moisture content. The facial massage mode is then adjusted in real time based on the moisture content change value.

[0017] Therefore, it can be seen that this application collects vibration response signals by massaging the boundary area during vibration massage, monitors the dynamic impedance response of the skin to mechanical signals of different frequencies and intensities, indirectly reflects the changes in the density, relaxation state, and hydration of the stratum corneum, and performs feature clustering based on the resistance characteristics of facial skin, mapping the clustering results to the water content level of the stratum corneum, realizing non-invasive dynamic monitoring of the water content of the stratum corneum. When changes in the water content of the facial stratum corneum lead to a decrease in skin dielectric impedance, resulting in a decrease in the deep stimulation of the massage, the facial massage mode of the vibration massage can be dynamically adjusted to maintain the technical goal of keeping the actual mechanical amplitude transmitted from the massage head to the skin constant, so as to ensure a consistent massage experience for the user and relieve discomfort during the beauty therapy process through massage.

[0018] In summary, this application can adjust the facial massage mode in real time according to the changes in the moisture content of the user's facial stratum corneum, thus alleviating the discomfort during the beauty treatment process. Attached Figure Description

[0019] Figure 1 This is an exemplary flowchart illustrating a control method for a beauty therapy device employing ultrasonic vibration massage, according to some embodiments of this application. Figure 2 This is a schematic diagram of the structure of a massage mode control unit according to some embodiments of this application; Figure 3 This is a schematic diagram of the structure of a computer terminal device that implements a control method for a beauty therapy device using ultrasonic vibration massage, according to some embodiments of this application. Detailed Implementation

[0020] This application collects facial expression images of users of a beauty therapy device, extracts emotional features from these images, and adjusts the facial massage mode based on these emotional features. It then applies ultrasonic vibration massage to the user based on the facial massage mode, and collects vibration signals at the boundaries of the massage area in real time during the massage to obtain a massage vibration response signal. Based on the massage parameters and vibration response signal corresponding to the facial massage mode, it extracts resistance characteristics to obtain facial skin resistance characteristics. These resistance characteristics are then clustered to determine the facial stratum corneum moisture content. The application acquires the real-time facial stratum corneum moisture content and determines the change in moisture content based on the initial moisture content. The facial massage mode is then adjusted in real time according to these changes. This application's ability to adjust the facial massage mode in real time based on changes in the user's facial stratum corneum moisture content alleviates discomfort during the beauty therapy process.

[0021] To better understand the above technical solutions, a detailed description of the solutions will be provided below in conjunction with the accompanying drawings and specific implementation methods. (Reference) Figure 1 The figure is an exemplary flowchart of a control method for a beauty therapy device employing ultrasonic vibration massage, according to some embodiments of this application. The control method 100 for the beauty therapy device employing ultrasonic vibration massage mainly includes the following steps: In step S101, facial expression images of the user of the beauty therapy device are acquired, and emotional features are extracted from the facial expression images. The facial massage mode is then adjusted based on the emotional features of the user of the beauty therapy device.

[0022] Optionally, in some embodiments, a miniature camera may be used to capture facial expression images of the user of the beauty therapy device.

[0023] Optionally, in some embodiments, before extracting emotional features from the facial expression image, the method further includes: performing image preprocessing on the facial expression image, wherein the image preprocessing specifically includes: after grayscale processing of the facial expression image, standardizing the image to a uniform facial pose by locating facial key points to achieve facial alignment.

[0024] Optionally, in some embodiments, extracting emotional features from the facial expression image specifically includes: Extract the key facial structural points from the facial expression image, and extract a quantitative expression feature vector based on the relative position of the key facial points; The facial expression feature vector is classified using an emotion recognition classification model to obtain the user's current emotion category label as the emotion feature.

[0025] In specific implementation, convolutional neural networks, commonly used in facial recognition in existing technologies, can be used as the face recognition model to locate key facial structural points. These key facial structural points, located by a deep learning-based multi-task convolutional neural network, include: eyebrow contours, nasal wing deformation, eye opening and closing points, and mouth corner upward or downward positioning points. The displacement, bending, and opening / closing changes of these key facial structural points are crucial for determining the emotions of the user of the beauty therapy device. The expression feature vector stores the positional data of different facial key structural points in a multi-dimensional manner. In some specific embodiments of this application, a support vector machine trained based on sample data can be used as a classification model to classify the expression feature vectors of the beauty therapy device user and output emotion category labels based on the classification results.

[0026] Preferably, in some specific embodiments of this application, user emotion labels can also be output using a multilayer perceptron + Softmax layer commonly used for feature classification. Specifically, user emotion labels can be divided into 7 categories, including relaxed, happy, tense, tired, angry, worried, and neutral labels, as well as corresponding label feature values. The label feature values ​​are used to reflect the intensity of the user's emotion in that emotion category. Thus, the user emotion labels and corresponding label feature values ​​are used as emotion features. Preferably, in some embodiments, adjusting the facial massage mode based on the user's emotion features of the beauty therapy device specifically includes: mapping the emotion features to the corresponding facial massage mode through a preset mapping rule library. The process of mapping the emotion features to the corresponding facial massage mode is based on the threshold range of the emotion label and label feature value within the emotion features, which is mapped to different massage frequencies and massage amplitudes of the facial massage mode.

[0027] It should be noted that this application adjusts the facial massage mode according to the emotional characteristics of the user of the beauty therapy device, realizing dynamic adjustment of massage amplitude and frequency based on the threshold range of emotional state. It can adapt to the user's state, improve the human adaptability, user experience and safety of the facial massage process. In some specific embodiments of this application, emotional labels and feature values ​​can also be used as two factors as input variables to train a unified neural network mapping model for facial massage mode adjustment. Furthermore, with the accumulation of user data, the mapping function can be further optimized to realize the linkage between emotion, physiology and massage behavior, which is convenient for later iteration and cross-user migration and has good generalization ability.

[0028] In step S102, the user of the beauty therapy device is given an ultrasonic vibration massage based on the facial massage mode, and the vibration signal of the massage area boundary is collected in real time during the massage to obtain the massage vibration response signal.

[0029] It should be noted that ultrasonic vibration massage is a massage method that utilizes high-frequency mechanical vibration waves, which are transmitted to the skin surface through driving elements (such as piezoelectric ceramics and magnetostrictive elements) to achieve physiological effects such as deep stimulation, microcirculation promotion, and tissue relaxation. Optionally, in some embodiments, the process of performing ultrasonic vibration massage on the user of the beauty therapy device can be carried out by using electromagnetic drive to convert electrical signals into high-frequency mechanical vibrations of the massage head. The massage head then performs ultrasonic vibration massage on the user, causing the skin tissue to undergo micro-amplitude periodic movements, stimulating nerve endings, inducing facial tissue relaxation, and improving the user's comfort during the use of the beauty therapy device.

[0030] Optionally, in some embodiments, a miniature piezoelectric sensor is used to collect vibration signals at the boundary of the massage area in real time to obtain a massage vibration response signal. The miniature piezoelectric sensor monitors and records the minute vibration deformations of the user's skin surface by contacting it. For example, a miniature piezoelectric sensor arranged around the massage head of an ultrasonic vibration massage can collect the massage vibration frequency and amplitude at the user's skin surface at the boundary of the massage area and convert them into corresponding digital signals for output, thereby obtaining the massage vibration response signal. In a specific implementation, four miniature piezoelectric sensors can be symmetrically arranged around the massage area with a sampling frequency of 20kHz to record the massage vibration response signal.

[0031] In some other embodiments, the acquisition of the massage vibration response signal can also be achieved by a novel flexible sensor or an accelerometer. The flexible sensor is usually made of a flexible sensitive structure such as conductive polymer, liquid metal, or nano-carbon material, which has good skin fit and deformation compliance, and is suitable for monitoring the vibration characteristics of dynamic areas. Compared with traditional piezoelectric devices, the flexible sensor improves wearing comfort while reducing dependence on local stress concentration points, and is suitable for more complex facial contours. This application does not limit the type and layout of this part of the sensor, and the above-described implementation is only one of the optional implementations of this technical solution.

[0032] In step S103, resistance characteristics are extracted based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal to obtain facial skin resistance characteristics. Feature clustering is performed on the facial skin resistance characteristics, and the moisture content of the facial stratum corneum is determined based on the clustering results.

[0033] It should be noted that the facial stratum corneum is composed of keratinocytes and contains a certain proportion of natural moisturizing factors, possessing a certain degree of hydrophilicity. During beauty treatments, users typically apply serums, masks, or use iontophoresis products, causing the skin surface to be in a high-humidity environment for an extended period. Prolonged contact with liquids causes the stratum corneum to absorb water and swell, transforming it from a dense and tough state into a soft and relaxed one. This, in turn, buffers the mechanical vibration energy transmitted by the massage head. The change in resistance caused by the swelling will result in a decrease in the massage intensity and comfort perceived by the user, making it difficult for vibration massage to achieve the goal of alleviating pain during beauty treatments. Traditional devices cannot dynamically sense this physiological change, resulting in fixed massage patterns and delayed responses, making it difficult to adapt to the transmission differences caused by changes in skin condition, thus reducing the massage effect and comfort.

[0034] Optionally, in some embodiments, the extraction of resistance characteristics based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal to obtain facial skin resistance characteristics specifically includes: A massage vibration input signal is constructed based on the massage parameters corresponding to the facial massage mode; The massage vibration response signal is acquired, and after background noise is removed by a bandpass filter with a preset frequency band, a feature vector is extracted based on the massage vibration response signal and the massage vibration input signal. This vector is composed of amplitude attenuation rate, vibration signal delay, frequency response distribution, and energy dissipation characteristics, and is used as the facial skin resistance characteristics.

[0035] In specific implementation, constructing a massage vibration input signal based on the massage parameters corresponding to the facial massage mode includes: acquiring the massage vibration frequency and amplitude corresponding to the facial massage mode, and generating an ideal excitation input signal based on the massage vibration frequency and amplitude. For example, when acquiring the massage vibration frequency corresponding to the facial massage mode... 20kHz, amplitude When the value is 1.5μm, the specific method for constructing the massage vibration input signal is as follows: ; in, Input signal for massage vibration.

[0036] Preferably, in some specific embodiments of this application, the amplitude attenuation rate can be obtained by performing a short-time Fourier transform on the massage vibration response signal and the massage vibration input signal, and using (1 - the ratio of the maximum amplitude at the main frequency domain position) as the amplitude attenuation rate, and using the phase difference at the main frequency domain position as the vibration signal delay. The vibration signal delay can reflect the viscoelasticity / response hysteresis of skin tissue. Furthermore, the massage vibration response signal can be decomposed into wavelet packets, and a basis function with good time-frequency local performance (such as the Daubechies wavelet) can be selected. Alternatively, the frequency band covered by the main frequency domain can be divided into multiple sub-frequency bands at equal intervals. The preset response frequency band (main frequency domain) is divided into multiple sub-frequency bands at equal intervals. The energy ratio of each sub-frequency band is obtained by integrating the sub-frequency band signals. Based on the frequency band size, an energy distribution vector containing the corresponding energy of each sub-frequency band is constructed as the frequency response distribution feature. Based on the energy ratio between the massage vibration response signal and the massage vibration input signal in each sub-frequency band, an energy loss distribution vector is constructed as the energy dissipation feature to reflect the local loss mode in the energy conduction process in the skin tissue. This further determines the physical response characteristics of the massage vibration and provides high-quality data for subsequent skin moisture estimation and adaptive massage mode adjustment.

[0037] Optionally, in some embodiments, a convolutional neural network is used to perform feature clustering on the facial skin resistance characteristics, and the facial stratum corneum water content is determined based on the clustering results.

[0038] The following is a specific embodiment of this application that uses a convolutional neural network to perform feature clustering on the facial skin resistance characteristics and determines the facial stratum corneum water content based on the clustering results: In the process of learning and clustering facial skin resistance characteristics using a convolutional neural network, the facial skin resistance characteristics can be input as a data vector. The input layer receives the aforementioned resistance feature vector, and multiple convolutional layers extract local features through sliding convolution kernels, extracting potential nonlinear mapping relationships and time-frequency patterns. Hidden layers are configured with multiple activation function nodes to perform nonlinear transformations on the features, enhancing the network's ability to learn complex feature structures. Finally, the output layer maps the learned features to several predefined cluster categories, each representing a different level of facial stratum corneum hydration. Based on the clustering results corresponding to the facial skin resistance characteristics, the facial stratum corneum hydration is mapped to obtain the corresponding hydration (percentage) as the facial stratum corneum hydration. The data vector includes vector elements of the feature vectors for amplitude attenuation rate, vibration signal delay, frequency response distribution, and energy dissipation characteristics, respectively, across different dimensions.

[0039] In specific implementation, the system constructs a training set to supervise the learning of cluster boundaries by the convolutional neural network model. This training set consists of multiple known facial skin resistance characteristic samples and their corresponding manually detected values ​​of stratum corneum moisture content. During training, these samples are input into the convolutional neural network model for forward propagation. The output classification labels are compared with the manually detected results. That is, multiple facial skin resistance characteristic samples are input into the convolutional neural network for classification training. The hidden layer of the convolutional neural network contains multiple activation function nodes for classification training of the input samples, and the classification results are output through the output layer of the convolutional neural network. The classification results are then compared with the corresponding manually detected stratum corneum moisture content results. When the correlation between the clustering results and the manually detected stratum corneum moisture content results (which can be expressed as mean squared error) is lower than a preset threshold, the network parameters are optimized through a backpropagation mechanism. The activation parameters in the activation functions of the hidden layers of the convolutional neural network are adjusted until the correlation between the clustering results and the manually detected stratum corneum moisture content results reaches a preset standard. The mapping relationship between the clustering results and the manually detected stratum corneum moisture content results is obtained, and the training of the convolutional neural network model is considered complete.

[0040] In step S104, the real-time moisture content of the facial stratum corneum is obtained, and the moisture content change value is determined based on the initial moisture content of the facial stratum corneum. The facial massage mode is then adjusted in real time according to the moisture content change value.

[0041] Optionally, in some embodiments, determining the change in moisture content based on the initial moisture content of the facial stratum corneum, and adjusting the facial massage mode in real time according to the change in moisture content specifically includes: Obtain the preset mode adjustment cycle, obtain the current facial stratum corneum moisture content within the current mode adjustment cycle, and obtain the facial stratum corneum moisture content corresponding to the first mode adjustment cycle as the initial facial stratum corneum moisture content. Based on the current and initial facial stratum corneum moisture content, the moisture content change value is determined, the current massage power of the facial massage mode corresponding to the current mode adjustment cycle is obtained, the power compensation amount corresponding to the moisture content change value is determined according to the preset power adjustment function and the current massage power, and the facial massage mode of the next mode adjustment cycle is adjusted according to the power compensation amount.

[0042] It should be noted that when the stratum corneum absorbs water and swells, the softening of the gel-like structure leads to a decrease in the skin's dielectric impedance. This enhances the absorption of ultrasonic mechanical waves, forming a mechanical buffer. Consequently, the vibration energy is absorbed by the surface layer, reducing the deep stimulation sensation during massage. The following empirical model can be established to simulate the loss of vibration amplitude caused by water absorption: ; in, This refers to the actual effective amplitude transmitted to the skin. The effective amplitude transmitted to the skin during the first mode adjustment cycle. It is the natural logarithm. This is an empirical damping coefficient, which can be experimentally calibrated to range from 0.1 to 0.3 depending on different environmental parameters. This represents the change in water content.

[0043] Therefore, this application needs to achieve the technical goal of maintaining a constant actual mechanical amplitude transmitted from the massage head to the skin, so as to ensure a consistent user massage experience. This requires, based on the physical modeling of the vibration system, to ensure a constant effective amplitude. The required adjustment power is: ; in, Adjust the massage power value of the facial massage mode for the next adjustment cycle. Adjust the current massage power of the facial massage mode corresponding to the current mode's cycle. It is the natural logarithm. This is the empirical damping coefficient. This represents the change in water content.

[0044] In addition, to prevent adverse reactions such as burning and skin allergies caused by excessive power increase, this application also sets a power change range limit of ±5%. When the power change range limit is reached, the power increase will be paused and the user will be notified.

[0045] In another aspect, in some embodiments, this application provides a beauty therapy device employing ultrasonic vibration massage. This system includes a massage mode control unit, as referenced. Figure 2 The figure is a schematic diagram of the exemplary hardware and / or software structure of a massage mode control unit according to some embodiments of this application. The massage mode control unit 200 includes: a user emotion sensing module 201, a massage effect sensing module 202, and a massage mode adjustment module 203, which are described below: The user emotion sensing module 201 is used to collect facial expression images of the user of the beauty therapy device, extract emotional features from the facial expression images, and adjust the facial massage mode based on the emotional features of the user of the beauty therapy device. The massage effect sensing module 202 is used to perform ultrasonic vibration massage on the user of the beauty therapy device, and to collect the vibration signal of the boundary of the massage area in real time during the massage process to obtain the massage vibration response signal; The massage effect sensing module 202 is also used to extract resistance characteristics based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal to obtain facial skin resistance characteristics, perform feature clustering on the facial skin resistance characteristics, and determine the facial stratum corneum moisture content based on the clustering results. The massage mode adjustment module 203 is used to acquire the real-time moisture content of the facial stratum corneum, determine the moisture content change value based on the initial moisture content of the facial stratum corneum, and adjust the facial massage mode in real time according to the moisture content change value.

[0046] The foregoing has provided a detailed example of a beauty therapy device and control method using ultrasonic vibration massage provided in the embodiments of this application. It is understood that, in order to achieve the above functions, the corresponding device includes hardware structures and / or software modules for performing each function.

[0047] Those skilled in the art should readily recognize that, based on the units and algorithm steps of the various examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a certain function in the application is executed in a manner that drives hardware or computer software depends on the specific application and design constraints of the technical solution. Therefore, those skilled in the art can use different methods to implement the described function for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0048] In addition, this application also provides a computer terminal device, which includes a memory and a processor. The memory stores code, and the processor is configured to acquire the code and execute the control method of the beauty therapy device using ultrasonic vibration massage described above.

[0049] In some embodiments, reference Figure 3 The figure is a schematic diagram of the structure of a computer terminal device implementing a control method for a beauty therapy device employing ultrasonic vibration massage, according to some embodiments of this application. The control method for a beauty therapy device employing ultrasonic vibration massage in the above embodiments can be achieved through... Figure 3 The computer terminal device 300 shown is used to implement this, and the computer terminal device 300 includes at least one communication bus 301, communication interface 302, processor 303 and memory 304.

[0050] The processor 303 may be a general-purpose central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more devices used to control the execution of a control method for a beauty therapy device employing ultrasonic vibration massage as described in this application.

[0051] The communication bus 301 may include a path for transmitting information between the aforementioned components.

[0052] Memory 304 may be a read-only memory (ROM) or other type of static storage device capable of storing static information and instructions, random access memory (RAM) or other type of dynamic storage device capable of storing information and instructions, or electrically erasable programmable read-only memory (EEPROM), compact disc read-only memory (CD-ROM) or other optical disc storage, optical disc storage (including compressed optical discs, laser discs, optical discs, digital universal optical discs, Blu-ray discs, etc.), magnetic disks or other magnetic storage devices, or any other medium capable of carrying or storing desired program code in the form of instructions or data structures and accessible by a computer, but not limited thereto. Memory 304 may exist independently and be connected to processor 303 via communication bus 301. Memory 304 may also be integrated with processor 303.

[0053] The memory 304 stores program code for executing the scheme of this application, and its execution is controlled by the processor 303. The processor 303 executes the program code stored in the memory 304. The program code may include one or more software modules. In the above embodiments, the determination of emotional characteristics can be achieved by the processor 303 and one or more software modules in the program code in the memory 304.

[0054] Communication interface-302 uses any transceiver-like device to communicate with other devices or communication networks, such as Ethernet, radio access network (RAN), wireless local area network (WLAN), etc.

[0055] Optionally, the computer terminal device 300 may also include a power supply 305 for providing power to various devices or circuits in the real-time computer terminal device.

[0056] In a specific implementation, as one example, a computer terminal device may include multiple processors, each of which may be a single-core (single-CPU) processor or a multi-core (multi-CPU) processor. Here, a processor may refer to one or more devices, circuits, and / or processing cores used to process data (e.g., computer program instructions).

[0057] The aforementioned computer terminal device can be a general-purpose computer terminal device or a dedicated computer terminal device. In specific implementations, the computer terminal device can be a desktop computer, a portable computer, a network server, a handheld computer (PDA), a mobile phone, a tablet computer, a wireless terminal device, a communication device, or an embedded device. This application does not limit the type of computer terminal device.

[0058] In addition, other aspects of this application provide a computer-readable storage medium storing at least one computer program that is loaded and executed by a processor to perform the operations performed by the control method of the beauty therapy device employing ultrasonic vibration massage described above.

[0059] In summary, the beauty therapy device and control method using ultrasonic vibration massage disclosed in this application firstly acquires facial expression images of the user, extracts emotional features from the facial expression images, and adjusts the facial massage mode based on the user's emotional features; then, ultrasonic vibration massage is performed on the user based on the facial massage mode, and vibration signals at the boundary of the massage area are acquired in real time during the massage to obtain massage vibration response signals; resistance characteristics are extracted based on the massage parameters corresponding to the facial massage mode and the massage vibration response signals to obtain facial skin resistance characteristics, feature clustering is performed on the facial skin resistance characteristics, and the facial stratum corneum moisture content is determined based on the clustering results; the real-time facial stratum corneum moisture content is obtained, and the moisture content change value is determined based on the initial facial stratum corneum moisture content; the facial massage mode is adjusted in real time based on the moisture content change value. This application can adjust the facial massage mode in real time according to the user's facial stratum corneum moisture content changes, alleviating the discomfort during the beauty therapy process.

[0060] The above descriptions are merely embodiments of this application, and common knowledge such as specific technical solutions or characteristics in the solutions are not described in detail here. It should be noted that those skilled in the art can make several modifications and improvements without departing from the technical solutions of this application, and these should also be considered within the scope of protection of this application, without affecting the effectiveness of the implementation of this application or the practicality of the patent.

[0061] The scope of protection claimed in this application shall be determined by the content of its claims. The specific embodiments described in the specification can be used to interpret the content of the claims. Obviously, those skilled in the art can make various modifications and variations to this application without departing from the spirit and scope of the invention. Therefore, if these modifications and variations of this application fall within the scope of the claims of this application and their equivalents, this application also intends to include these modifications and variations.

Claims

1. A control method for a beauty therapy device employing ultrasonic vibration massage, characterized in that, include: Collect facial expression images of users of the beauty therapy device, extract emotional features from the facial expression images, and adjust the facial massage mode based on the emotional features of the users of the beauty therapy device; Based on the facial massage mode, the user of the beauty therapy device is given an ultrasonic vibration massage, and the vibration signal of the massage area boundary is collected in real time during the massage to obtain the massage vibration response signal. Resistance characteristics are extracted based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal to obtain facial skin resistance characteristics. Feature clustering is performed on the facial skin resistance characteristics, and the water content of the facial stratum corneum is determined based on the clustering results. The system acquires real-time facial stratum corneum moisture content and determines the moisture content change value based on the initial facial stratum corneum moisture content. The facial massage mode is then adjusted in real-time according to the moisture content change value.

2. The method as described in claim 1, characterized in that, The process of providing ultrasonic vibration massage to the user of the beauty therapy device uses electromagnetic drive to convert electrical signals into high-frequency mechanical vibrations of the massage head, which then provides ultrasonic vibration massage to the user.

3. The method as described in claim 1, characterized in that, Based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal, resistance characteristics are extracted to obtain the facial skin resistance characteristics, specifically including: A massage vibration input signal is constructed based on the massage parameters corresponding to the facial massage mode. The massage vibration response signal is acquired, and background noise is removed by a bandpass filter with a preset frequency band. Based on the massage vibration response signal and the massage vibration input signal, a feature vector is extracted, which consists of amplitude attenuation rate, vibration signal delay, frequency response distribution, and energy dissipation characteristics. This vector is used as the facial skin resistance characteristics, where the energy dissipation characteristic is the energy ratio between the massage vibration response signal and the massage vibration input signal.

4. The method as described in claim 1, characterized in that, A convolutional neural network was used to perform feature clustering on the facial skin resistance characteristics.

5. The method as described in claim 1, characterized in that, The facial massage mode is adjusted in real time based on the initial facial stratum corneum moisture content to determine the moisture content change value, specifically including: Obtain the preset mode adjustment cycle, obtain the current facial stratum corneum moisture content within the current mode adjustment cycle, and obtain the facial stratum corneum moisture content corresponding to the first mode adjustment cycle as the initial facial stratum corneum moisture content. Based on the current and initial facial stratum corneum moisture content, the moisture content change value is determined, the current massage power of the facial massage mode corresponding to the current mode adjustment cycle is obtained, the power compensation amount corresponding to the moisture content change value is determined according to the preset power adjustment function and the current massage power, and the facial massage mode of the next mode adjustment cycle is adjusted according to the power compensation amount.

6. The method as described in claim 1, characterized in that, Before extracting emotional features from the facial expression image, the method further includes: preprocessing the facial expression image, specifically including: after converting the facial expression image to grayscale, standardizing the image to a uniform facial pose to achieve facial alignment by locating facial key points.

7. The method as described in claim 1, characterized in that, Extracting emotional features from the facial expression images specifically includes: Extract the key facial structural points from the facial expression image, and extract a quantitative expression feature vector based on the relative position of the key facial points; The facial expression feature vector is classified using an emotion recognition classification model to obtain the user's current emotion category label as the emotion feature.

8. A beauty therapy device employing ultrasonic vibration massage, comprising a massage mode control unit, wherein the massage mode control unit is used to execute the control method of the beauty therapy device employing ultrasonic vibration massage as described in any one of claims 1 to 7, characterized in that, The massage mode control unit includes: The user emotion sensing module is used to collect facial expression images of the beauty therapy device user, extract emotional features from the facial expression images, and adjust the facial massage mode based on the emotional features of the beauty therapy device user. The massage effect sensing module is used to perform ultrasonic vibration massage on the user of the beauty therapy device, and to collect the vibration signal of the boundary of the massage area in real time during the massage process to obtain the massage vibration response signal; The massage effect sensing module is also used to extract resistance characteristics based on the massage parameters corresponding to the facial massage mode and the massage vibration response signal, obtain facial skin resistance characteristics, perform feature clustering on the facial skin resistance characteristics, and determine the facial stratum corneum moisture content based on the clustering results. The massage mode adjustment module is used to obtain the real-time moisture content of the facial stratum corneum, determine the moisture content change value based on the initial facial stratum corneum moisture content, and adjust the facial massage mode in real time according to the moisture content change value.

9. A computer terminal device, characterized in that, The computer terminal device includes a memory and a processor. The memory stores code, and the processor is configured to acquire the code and execute a control method for a beauty therapy device employing ultrasonic vibration massage as described in any one of claims 1 to 7.

10. A computer-readable storage medium storing at least one computer program, characterized in that, The computer program is loaded and executed by a processor to perform the operations described in any one of claims 1 to 7 of a control method for a beauty therapy device employing ultrasonic vibration massage.

Images