A Handheld Intelligent Physiotherapy Device OTA System

Abstract

A handheld intelligent physiotherapy device OTA system, including a handheld intelligent physiotherapy device. By introducing a high-definition camera module, the background server can facilitate operation, perform custom wrinkle calibration, and intelligently identify the severity of wrinkles, solving the problems of high-precision recognition and memory of wrinkle sites and the determination of severity. At the same time, through OTA technology, the functions are continuously updated, reducing the load on the intelligent chip and production costs and enhancing the user experience.

Description

Technical Field

[0001] The present invention relates to an OTA system, and more particularly to an OTA system for a handheld intelligent physiotherapy device, belonging to the field of beauty physiotherapy. Background Art

[0002] When existing beauty devices are used for the five major functions of cleaning, nourishing, lifting and firming, eye care, and blue light calming, on the one hand, the instruction manual often only prompts the approximate action time, frequency, and the recommended action time and frequency according to different skin types. The mastery of these parameters is left to the user to actively select according to their skin type.

[0003] Facing the update and iteration of multiple functions, especially the addition of intelligent functions, how to achieve local updates of the system without the need for overall re-downloading has become an urgent problem to be solved. In the automotive industry, in-vehicle systems often adopt OTA technology. However, this technology has not been implemented for small physiotherapy device products. The reason is that in general, the industry believes that the functions of physiotherapy devices are fixed and no differentiation in customer needs has been found. However, customized production has become the goal of current personalized design. For example, how to intelligently select parameters suitable for the user's skin has become the primary task of function development, which requires continuous system updates. Summary of the Invention

[0004] Facing the above four major problem contents, the present invention considers from the following three aspects: First, refine the parameters of the five major functions, and intelligently identify the personalized parameters required for one of the five major functions selected by the user through machine learning based on facial skin recognition; Second, consider an automatic application scheme for the physiotherapy liquid applied before the action with random matching; Third, design a mechanical skin tightening mechanism, an external mechanical auxiliary function involved when performing the five major functions, to achieve a multi-combination physiotherapy scheme of external mechanical action + electrical pulse + optical action; Fourth, set a high-definition shooting function on the physiotherapy device and strengthen the computing power of the intelligent chip; Fifth, implement an OTA system with continuous function updates.

[0005] In view of the above considerations, an object of the present invention is to provide a handheld intelligent physiotherapy device OTA system, including a handheld intelligent physiotherapy device and a background server. The handheld intelligent physiotherapy device communicates with the background server in an OTA manner, enabling the handheld intelligent physiotherapy device to selectively download updates to the original functions or extended new functions from the background server. Among them, the handheld intelligent physiotherapy device includes: a handheld housing, a physiotherapy head, a switch / mode button, a charging hole, a mode display, and a charging display, a pinhole camera for collecting skin images of the human face, and a battery inside the handheld housing. Among them, the physiotherapy head includes a massage head that can perform vibration and / or MFIP functions, and a light therapy care source that can emit amber light, red light, dark red light, and blue light. The mode display includes a display that realizes cyclic switching of five functions of cleaning, nourishing, lifting and firming, eye care, and blue light calming in sequence by short pressing the switch / mode button. It is characterized in that the physiotherapy head further includes a touch sensing part coupled to the massage head and a mechanical skin tightening mechanism provided on the physiotherapy head around the massage head. The touch sensing part automatically or manually activates the mechanical skin tightening mechanism according to the contact of the facial skin with the massage head to realize the multi-directional horizontal extension effect on the skin simultaneously with physiotherapy;

[0006] The handheld intelligent physiotherapy device further includes a high-definition camera module capable of collecting human faces, and a secondary housing that is detachable and extends from one side of the handheld housing and is provided with a high-definition touch screen with a front camera. There is a holding finger groove between the secondary housing and the extended side of the handheld housing to facilitate holding and operating the high-definition touch screen. When the high-definition camera module is started, a real-time human face image appears on the high-definition touch screen. At this time, the holding hand remains still, and the other hand can perform operations such as magnifying the real-time human face image and circling the wrinkle area, and determine to upload it to the background server for storage. When performing skin tightening next time, the high-definition camera module recognizes the current real-time human face image through the face recognition function in the intelligent chip and calls out the saved human face image of the circled wrinkle area to indicate the area where skin tightening is required by the user. The user can perform a deletion operation on the action area on the high-definition camera module and determine to upload it to the background server again to update the human face image. The optimization of the face recognition function is executed by the background server and the user can selectively choose whether to OTA download it to the intelligent chip for update. The optimization of the face recognition can be considered for research and development in the direction of reducing the amount of calculation. For example, analyzing from the detailed features of the facial features alone, from the collection of the facial contour and comparison with the previously saved contour, or from the position distribution features of the detailed facial features in the contour, etc. When the effect of skin tightening is achieved and the user believes that skin tightening is no longer required, a deletion operation can be selected. Due to the reduction of the amount of calculation, there may be a certain probability of recognition errors, so it is necessary to consider that the user discovers and reports the errors to the background server.

[0007] Therefore, preferably, when the user finds that the called face image is incorrect, it is reported to the background server through the high-definition touch screen, and through the uploaded registered account, the background server is made to send the correct face image, so that the high-definition touch screen is updated in an OTA manner, and the incorrect recognition result is automatically replaced with the OTA update result during the next recognition to make a correct recognition. In this way, without optimizing the algorithm itself, the incorrect result is automatically replaced with the correct OTA result, which is equivalent to optimizing the algorithm. And the user will not be aware of this, but only think that the recognition accuracy has been improved.

[0008] A plurality of physiotherapy agent discharge holes are arranged on the side of the physiotherapy head away from the mechanical skin tightening mechanism. The physiotherapy agent discharge holes are communicated with a plurality of physiotherapy agent accommodating cavities formed by being enclosed by a transparent material body inside the handheld housing and having one side passing through the surface of the handheld housing to display the position of the piston therein. Each of the plurality of physiotherapy agent accommodating cavities can extrude the physiotherapy agent contained inside the physiotherapy agent accommodating cavity by being pushed by a piston push rod. A push portion arranged at one end of the piston push rod protrudes from a guiding groove on the outer surface of the handheld housing. When the push portion is toggled to move along the guiding groove, the current pushed position of the piston can be observed through the transparent material body, and the corresponding physiotherapy agent can be discharged from the physiotherapy agent accommodating cavity, pass through the catheter and be discharged from the corresponding physiotherapy agent discharge hole and applied to the finger or the face to be physiotherapied, and then be applied by means of the finger or the side of the physiotherapy head respectively; A protective cap is arranged on the plurality of physiotherapy agent discharge holes to cover the protective cap when not in use to prevent the volatilization and / or deterioration of the physiotherapy agent components; The handheld housing can be disassembled to pull out the piston push rod and fill the corresponding physiotherapy agent into the physiotherapy agent accommodating cavity;

[0009] An intelligent chip is arranged inside the handheld housing, which is used to perform parameter setting based on intelligent settings according to one of the skin image collection and the user-selected functions of cleaning, nourishing, lifting and tightening, eye care, and blue light calming, so as to automatically or manually start the mechanical skin tightening mechanism while performing the physiotherapy of the selected function after the parameter setting is completed and the physiotherapy agent is applied; When the facial skin or the skin of any other part touches the touch sensing part and then leaves the touch sensing part and presents a non-contact state, the mechanical skin tightening mechanism is driven to perform reverse movement and automatically pauses the physiotherapy of the selected function. At this time, the user can forcefully long-press the switch / mode button for 2 - 3 s to terminate the physiotherapy and enter the mode of reselecting the function, and press the switch / mode button twice continuously to confirm the selected function; Or there are two operation methods of long-pressing the switch / mode button for 4 - 5 s to turn off the handheld intelligent physiotherapy instrument;

[0010] And the age input part, the age input part button or voice input method, for the button input method, that is, cyclic switching among multiple age groups (the current switched age group can be displayed in the manual gear shift panel), when selected, press and hold the age input part button for 1-2 seconds to confirm; for the voice input method, voice input can be performed multiple times and the most recent voice input will be cyclically overwritten until no voice input is received within 2-5 seconds.

[0011] Preferably, the user can establish a treatment record through the high-definition touch screen, and control the front camera to collect images of the push-up position through the high-definition touch screen. The back-end server calculates the recommended push-up position based on the collected skin image to adapt to the user's skin, and downloads the recommended push-up position image to the high-definition touch screen through OTA, and automatically inputs it into the smart chip after the secondary shell is connected to the handheld shell, so as to calculate the recommended position again for each future use, wherein the calculation algorithm for calculating the recommended push-up position based on the collected skin image can be continuously optimized by the back-end server, and the user can choose whether to update it regularly through OTA. That is, when the user thinks that the current algorithm is satisfactory, the OTA update can be selected.

[0012] Optionally, the recalculation method is that, based on the current recommended position of the background server, the amount of physiotherapy agent usage corresponding to the recommended positions in the future shows a decreasing function trend; the OTA update also includes the user being able to choose whether to make the following update: that is, when the deletion operation is performed on the high-definition touch screen, a dialog box will pop up to display a message reminding the user that the facelift needs to be consolidated and persisted, and asking whether it is really necessary to delete it. Therefore, through the notice, the user is prevented from being overconfident and missing the opportunity for consolidation to produce a rebound effect.

[0013] Optionally, the subtraction function is linear, and a scale is provided on the handheld housing passing through part of the edge, which can read the position of the piston on the scale by comparing it with the piston position. After the recalculation is completed, the smart chip can display the recommended scale position indication for multiple future uses on the high-definition touch screen for user reference.

[0014] Preferably, the pause time of the physical therapy that automatically pauses the execution of the selected function is included in the compensation time after the next contact for physical therapy, and the compensation time is not more than 1 minute.

[0015] It is understandable that if the contact again is with a non-therapy area or any other object, the user is generally likely to move away immediately or move away due to a change of therapy area. This is equivalent to pausing again, and the time lost in therapy due to incorrect contact or the time incurred during the change of area is also included in the compensation time, thereby avoiding as much as possible the shortening of therapy time due to incorrect contact.

[0016] Preferably, the handheld housing includes a detachable front part and a rear part based on a partition board. The partition board divides the space enclosed by the front part and the rear part installed in place into an independent and sealed front cavity and a rear cavity respectively. The rear cavity houses the plurality of physiotherapy agent accommodating cavities, the corresponding piston push rod, a part of the pushing part, and at least part of the catheter. The physiotherapy agent discharge hole is located on the side of the physiotherapy head opposite to the mechanical skin tightening mechanism; the front cavity is used to house the battery and the intelligent chip in the handheld housing; the switch / mode button, mode display, and charging display are located on the front part, and the charging hole is arranged at one end of the front part belonging to the bottom of the front cavity.

[0017] Preferably, the plurality of physiotherapy agent accommodating cavities are detachably fixed on the partition board.

[0018] Optionally, in one embodiment, the mechanical skin tightening mechanism includes a back plate fixedly connected to the physiotherapy head and having a central column, a driven gear sleeved on the central column of the back plate, a main gear meshing with the driven gear, a motor accommodated in the inner cavity of the physiotherapy head and connected to the main gear through a speed reducer or directly connected, and a plurality of push heads. Among them, the central hole of the main gear is shaft-connected to the speed reducer shaft through the through hole on the back plate. The driven gear has a plurality of spiral grooves with the same number as the number of push heads. The push head has a push rod, and the push rod is slidably fitted in the chute of the back plate. One end of the push rod has a convex rod passing through the spiral groove. When the motor drives the main gear to rotate clockwise or counterclockwise, the convex rod drives the convex rod to slide in the spiral groove due to the rotation of the driven gear, thereby pushing the push rod of the plurality of push heads to radially move outwards in the chute, so that the plurality of push heads open. At any subsequent moment, when the motor drives the main gear to rotate in the reverse direction, the push rod moves radially inwards in the chute, so that the plurality of push heads converge in the reverse direction, thereby realizing the external auxiliary pulling effect on the skin. The motor is communicatively connected to the intelligent chip. The part of the back plate between the push rods has at least one wire hole for passing through the components and / or wires of the touch sensing part, massage head, and light therapy nursing source to be communicatively connected to the intelligent chip.

[0019] Optionally, the motor is a stepper motor.

[0020] In another embodiment, the mechanical skin tightening mechanism includes a skin tightening scissor, the front end of which is provided with a pair of pushing arcs on the side where the massage head is located and can be pressed tightly against the skin. The rear end handle passes through the inner cavity of the physiotherapy head and penetrates the outer shell of the physiotherapy head for hand gripping to perform a shearing operation by pressing the handle relatively. When the handle is released after pressing the skin, the skin tightening operation is realized, and the reverse pushing and pulling to tighten the skin is realized under the state that the front end pushing arcs press the skin tightly. The part of the physiotherapy head that is penetrated forms a pair of guiding grooves for guiding the handle to perform the shearing operation and the skin tightening operation. At this time, when the user selects to push the pushing part, the physiotherapy agent will be discharged from the physiotherapy agent discharge hole and applied to the finger or other application materials (such as cotton pads, etc.) to apply the physiotherapy agent to the part to be physiotherapied.

[0021] Optionally, the method of intelligent setting includes the following steps:

[0022] S1 Set up five experimental groups: the cleaning group, the nourishing group, the lifting and firming group, the eye care group, and the blue light calming group. Each experimental group is divided into six subgroups: 18 - 24 years old, 25 - 35 years old, 35 - 45 years old, 45 - 60 years old, 60 - 75 years old, and over 75 years old. For each subgroup, a training set, a validation set, and a test set are set up, and the ratio of the three is 5 - 3:1 - 2:1. All the experimenters follow the preset work and rest rules for 1 - 3 months. The work and rest rules are as follows: those aged 18 - 24 get up at 7:30 in the morning, those aged 25 - 35 get up at 7:00, those aged 35 - 45 get up at 7:00, those aged 45 - 60 get up at 6:30, those aged 60 - 75 get up at 6:00, and those over 75 years old get up at 6:00. All the experimental groups go to bed between 10 - 11 pm. They have three meals a day. Breakfast, lunch, and dinner start within 30 minutes after getting up, between 11:30 - 12:30, and between 17:30 - 18:30 respectively.

[0023] S2 The five experimental groups train the artificial intelligence model according to the following parameters respectively:

[0024] The cleaning group has seven parameters: low, medium, and high gears of low - frequency vibration, low, medium, and high gears of amber light intensity, and a total cleaning time of 4 minutes under the warm - heat effect.

[0025] The nourishing group has seven parameters: low, medium, and high gears of high - frequency vibration, low, medium, and high gears of red light intensity, and a total nourishing time of 4 minutes under the warm - heat effect.

[0026] The lifting and firming group has fifteen parameters: low, medium, and high gears of low - frequency vibration, low, medium, and high gears of high - frequency vibration, high, medium, and low gears of MFIP pulse frequency, high, medium, and low gears of pulse intensity, dark red light intensity, amber light intensity, and a total lifting and firming time of 4 minutes under the warm - heat effect.

[0027] Eye care group, with three gears for MFIP pulse frequency: high, medium, and low; three gears for pulse intensity: high, medium, and low; three gears for low-frequency vibration: low, medium, and high; three gears for high-frequency vibration: low, medium, and high; the interval time between the actions of high and low-frequency vibrations, and the total eye care time under the warming effect is 4 minutes, with fourteen parameters.

[0028] Blue light sedation, blue light intensity, and ice compress effect, that is, cooling the massage head for 4 minutes, one parameter.

[0029] In S3, when starting up, a pinhole camera is used to collect images of the face to be physiotherapied and uploaded to the background server. The background server uses a pre-set sensitive skin recognition model (i.e., recognizing based on features such as facial burning scars, blood streaks, and blushing in the collected images) to identify whether it belongs to sensitive skin. If so, the action time of all groups is halved. The training sets of each group are respectively subjected to a cross-testing scheme for parameter selection of five major functional physiotherapies, and the top N parameter configurations (N≤5) are obtained through overall evaluation. The classification scores of the top three in the physiotherapy results of each parameter configuration are taken; and the corresponding collected images are respectively input into the corresponding artificial intelligence models for training, and the validation set is used to verify the accuracy rate. The loss function is used to adjust the network parameters of the model until the accuracy rate and the loss function value are stable, and the training is stopped, so as to obtain the classification of good, medium, and poor (i.e., three grades from the highest to the relatively lowest according to the three scores) of the top three scores of each parameter configuration of each functional physiotherapy under each group; by randomly selecting the intermediate parameter configuration corresponding to the prediction result of good or medium for each parameter configuration, the parameter configuration with the highest score among the intermediate parameter configurations of N parameter configurations is compared as the best parameter configuration of the corresponding functional physiotherapy under this group. If there are multiple highest scores that are the same, one of the parameter configurations is randomly selected as the best parameter configuration of the corresponding functional physiotherapy under this group, thus forming a trained artificial intelligence model.

[0030] In S4, the high-definition touch screen downloads the artificial intelligence model trained in step S3 from the background server through the OTA method, and inputs the age of the person to be tested in the test set. By using a pinhole camera to collect images of the face to be physiotherapied of the person to be tested, and inputting the collected images into the corresponding trained artificial intelligence model, the five groups of best parameter configurations predicted under each functional physiotherapy are obtained. Based on this, the corresponding best parameter configuration is selected according to the function selected by the person to be tested for physiotherapy preparation, and physiotherapy is carried out according to the contact of the face to be physiotherapied of the person to be tested with the touch sensor part.

[0031] Through the cross-test in the early stage of training, obviously inappropriate parameter configurations for each age group were eliminated, so that the parameter configurations of the top N in training were concentrated. Considering the accuracy of training, there was an additional step to randomly select the intermediate parameters between good and medium as a compensation solution with a certain probability of simulation prediction deviation. Because one of the good and medium must be the potential best parameter configuration solution, if the model prediction is wrong, then the medium is the best choice. When the model estimation is correct, even if the medium is finally selected, the probability of producing undesirable results is relatively low. Finally, the highest score among all parameter configurations is used as the best parameter configuration for the corresponding function under this group.

[0032] Optionally, the therapeutic agents corresponding to cleansing, nourishing, lifting and firming, and eye care are makeup removers; the corresponding therapeutic agents are at least one of toner, lotion, face cream, essential oil, and facial mask; the corresponding therapeutic agents are at least one of gel, viscous essence, and firming essence; eye cream.

[0033] Preferably, the artificial intelligence model is a convolutional neural network CNN, or a ResNet based on a residual mechanism.

[0034] Optionally, the handheld intelligent physiotherapy device also includes a gear button arranged on the front, which is used to set the frequency and intensity of electric pulses, and / or the vibration frequency, and / or the intensity of light emitted by the phototherapy care source, and / or the rotation angle of the motor; the mode display also includes a manual gear adjustment panel, which is used to switch the display between the adjustment modes of electric pulses, the intensity of light emitted by the phototherapy care source, and the rotation angle of the motor by pressing the switch / mode button for 1-2 seconds multiple times, and then use the gear button to select the gear, and finally press the switch / mode button again to successfully set it.

[0035] Preferably, the therapy head is also provided with a microphone for receiving voice control sounds, and the front part also includes at least one sound outlet hole for voice prompts to issue age input prompts, respond to user voice commands, user operations, and voice prompts for function execution status.

[0036] Preferably, there are two switch / mode buttons and one of them is a spare button. The user can select one of them for operation at any time when the device is turned on. When one of the buttons fails, the spare button can still be used for operation.

[0037] Preferably, the mode display and the charging display can be shown on the high-definition touch screen. The switch / mode button, the front gear buttons, the spare button, the age input button, and the OTA button all form touch buttons on the high-definition touch screen, and a face image acquisition button is provided on the high-definition touch screen. The intelligent chip also calls a pre-trained wrinkle recognition model to perform recognition and marking on a face image collected when the user presses the face image acquisition button.

[0038] Optionally, the wrinkle recognition model is a convolutional neural network model with a residual mechanism. The training method is to obtain volunteers of different ages, and for each age group, take pictures of multiple different parts that the volunteers themselves recognize as needing facelifts, and divide the unacceptable degree of wrinkles into three grades according to the volunteers' own recognition: negligible, non-negligible, and deep processing. Then use the high-definition camera module to collect multiple high-definition images of different parts of different age groups for each part. Divide the multiple high-definition images of each part into a training set and a validation set respectively, and upload them to the background server through the high-definition touch screen. The background server forms a sub-convolutional neural network with a residual mechanism for each part, trains it using the training set, calculates the loss function to optimize the model parameters, and verifies the model accuracy using the validation set to obtain the final wrinkle recognition model. At this time, the high-definition touch screen downloads the trained wrinkle recognition model to the intelligent chip through the OTA method. During recognition, the user selects their own age group, clicks on the part of the face image that needs a facelift, and the intelligent chip can then capture and magnify the image part. Or the user can operate through the high-definition touch screen to import a saved face image with the wrinkled part circled by themselves, click on the part of the face image that needs a facelift, and input it into the sub-convolutional neural network with a residual mechanism corresponding to the corresponding part that has been trained, so as to finally obtain the classification grade to which the wrinkle recognition of each age group belongs and display it on the high-definition touch screen.

[0039] Through the description of the above algorithms, the present invention can use the OTA method to hand over some model training tasks (including the calculation algorithm for the pushing position, the optimization of the face recognition function, the artificial intelligence model in the intelligent setting method, and the wrinkle recognition model) to the background server, thereby reducing the manufacturing cost of the intelligent chip.

[0040] Preferably, both sides of the sub-shell have interfaces electrically connected to the handheld shell. When one side is connected to the handheld shell, the high-definition touch screen is turned on. This can thus meet the usage habits of left-handed and right-handed people.

[0041] Preferably, the high-definition touch screen is independently powered by a battery in the secondary housing, and a battery charging port for the battery in the secondary housing is provided on the secondary housing. When the electrical connection is disconnected, the magnifying operation can still be performed on the captured face image, and the front camera can be controlled to capture an image of the pushing part position.

[0042] Another object of the present invention is to provide a facial skin physiotherapy method using the handheld intelligent physiotherapy instrument provided by the present invention, which is characterized by including the following steps:

[0043] (1) Turn on the machine and input the age, face the pinhole camera for image acquisition to complete the parameter setting based on intelligent setting;

[0044] (2) Select the physiotherapy function through the switch / mode button;

[0045] (3) Discharge the corresponding physiotherapy agent through the physiotherapy agent discharge hole to act on the facial skin to be physiotherapied;

[0046] (4) Contact the touch sensing part with the facial skin to be physiotherapied in step (3) that has been acted on by the physiotherapy agent to perform the physiotherapy of the selected physiotherapy function; or,

[0047] After turning on the machine, directly start from step (2) to select and wake up the manual adjustment gear panel through the switch / mode button; then long-press the switch / mode button to select the manual adjustment of the electric pulse frequency and intensity, and / or the vibration frequency, and / or the intensity of the light emitted by the light therapy care source, and / or the rotation angle of the motor, use the gear button to select the gear, and finally long-press the switch / mode button again to set successfully;

[0048] Preferably, when the image acquisition fails, it can be voice-promoted through the sound outlet hole that the image acquisition fails every 3-5 s until the user's image acquisition is successful, or wake up the manual adjustment gear panel to enter the next step respectively or prompt to enter the manual adjustment parameter mode and then perform steps (3) and (4) in sequence.

[0049] The present invention further includes a wrinkle tightening treatment method based on the above-mentioned handheld intelligent physiotherapy device, which specifically includes starting the high-definition touch screen on the secondary housing, facing the high-definition camera module to collect one's own real-time high-definition image, using hands to magnify and circle the wrinkle areas on the real-time face image, and determining and saving. When performing facelift next time, the high-definition camera module recognizes the current real-time face image through the face recognition function in the intelligent chip, and prompts on the high-definition touch screen whether to call out the saved face image with the circled wrinkle areas. When selecting "Yes", it asks again whether to use the recognition model for recognition. When selecting "No", it indicates the area on the called and displayed image where the user needs facelift; when selecting "Yes", it enters the wrinkle recognition model step; when selecting "No", it also enters the wrinkle recognition model step. When entering the wrinkle recognition model step, a face image is collected by pressing the face image acquisition button, and the pre-trained wrinkle recognition model is called to perform recognition and marking on the said one face image. Specifically during recognition, the user first selects their age group, clicks on the area where facelift is needed on the collected face image, and the intelligent chip can then capture and magnify the image area, or the user imports through the high-definition touch screen operation the saved face image with the circled wrinkle areas of their own, clicks on the area where facelift is needed on the collected face image, and inputs it into the sub-convolutional neural network with a residual mechanism corresponding to the corresponding area that has been trained, so as to finally obtain the classification level to which the wrinkle recognition of each age group belongs. The user then determines the type, dosage, and tightening time of the physiotherapy agent according to the classification level.

[0050] Beneficial effects

[0051] (1) By introducing a physiotherapy agent cavity in the housing and using the physiotherapy head as the application and outlet of the physiotherapy agent, it facilitates the preparation of the physiotherapy agent;

[0052] (2) Using a mechanical facelift mechanism, it generates an additional mechanical skin tightening effect during physiotherapy, and it is easier to obtain good physiotherapy effects;

[0053] (3) Adopting an artificial intelligence algorithm, using image acquisition to identify skin types and suitable physiotherapy parameters to implement a customized physiotherapy plan for the user's skin;

[0054] (4) The addition of voice control enables the beauty device to have a better user experience, facilitating the user's operation and obtaining prompt information related to the operation and physiotherapy status.

[0055] (5) By collecting the user's real-time face images and the precise parts defined by the user around the calibration area, after targeted face recognition during use, the calibration record of the user is called, thus better and more conveniently solving the problem of forgetting or inaccurate memory of precise facelift questions. At the same time, considering dividing volunteers into different age groups, the label definitions of the training set are carried out according to the different levels of wrinkle treatment by each volunteer himself, which better meets the actual real treatment needs of users of different age groups. For example, the younger the volunteer, the more likely they are to define fine wrinkles as a higher level of severity statistically, while older volunteers are more likely to focus on defining obvious wrinkles as a high level of severity, and the fine ones can be treated or not. The wrinkle recognition model trained in this way can better perform facelifts and targeted beauty physiotherapy according to the consensus of users of different ages. Finally, by selecting the wrinkle recognition scheme for importing images, it can be applied to some users who need to prepare for physiotherapy in advance and do not know the severity of their own wrinkles, which has guiding significance.

[0056] (6) A detachable external interface is used to connect the high-definition touch screen to the handheld housing. All physiotherapy function operations and displays are integrated on the touch screen, and the real-time face images collected are displayed on the touch screen.

[0057] (7) By establishing a background server, many constructed models can be trained and optimized on the background server, so that the functions can be continuously updated through OTA technology, reducing the load of the intelligent chip and production costs, and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0058] Figure 1 Schematic diagram of the overall structure of the OTA system of the handheld intelligent physiotherapy instrument in Embodiment 1 of the present invention;

[0059] Figure 2a Schematic diagram of the overall structure of the handheld intelligent physiotherapy instrument in Embodiment 1 of the present invention;

[0060] Figure 2b Rear view of removing the rear part of the handheld housing in Embodiment 1 of the present invention;

[0061] Figure 2c is Figure 2a the side sectional view along the central axis in

[0062] Figure 2d Schematic diagram after the high-definition touch screen is turned on and lit after the secondary housing is electrically connected to the handheld housing from the left;

[0063] Figure 2e Flow chart for correcting recognition errors in the face recognition function;

[0064] Figure 3Schematic diagram of the physical therapy head structure in Embodiment 2 of the present invention, where a is the front view, b is the rear view, c is the side sectional view along the central axis in a, d is the first embodiment of the mechanical skin tightening mechanism, e shows the side sectional view of the second embodiment of the mechanical skin tightening mechanism, and f is the schematic diagram of the arc-pushing structure and the opening direction of the second embodiment of the mechanical skin tightening mechanism;

[0065] Figure 4 Flowchart of the button switching method for the handheld intelligent physical therapy instrument in Embodiment 3 of the present invention;

[0066] Figure 5 Flow diagram of the intelligent setting method in Embodiment 4 of the present invention. Detailed implementation manners

[0067] Embodiment 1

[0068] This embodiment will illustrate the overall structure of the OTA system of the handheld intelligent physical therapy instrument, as Figure 1 shown in a handheld intelligent physical therapy instrument OTA system, which includes a handheld intelligent physical therapy instrument and a background server. The handheld intelligent physical therapy instrument communicates with the background server through OTA, enabling the handheld intelligent physical therapy instrument to selectively download updates or extended new functions of the original functions from the background server. Among them, the handheld intelligent physical therapy instrument includes a physical therapy head, the front and rear parts of the handheld shell detachably installed based on a partition ( Figure 2c ), independent sealed front and rear cavities are respectively formed between the front and rear parts and the partition. The front part includes a cleaning mode display with five function displays of cleaning, nourishing, lifting and tightening, eye care, and blue light calming, a switch / mode button (including a spare), a gear button for setting the electric pulse frequency and intensity, and / or the vibration frequency, and / or the intensity of the light emitted by the light therapy care source, and / or the rotation angle of the motor, and a charging display for indicating the charging status (flashing when charging, constantly on when fully charged) ( Figure 2a ), and ( Figure 2a , 2c) a TPYE-C charging hole is provided on the front part at the bottom of the front cavity for charging the battery in the handheld shell in the front cavity, and an intelligent chip fixedly connected to the partition is also accommodated in the front cavity.

[0069] The manual gear adjustment panel is used to switch and display the adjustment modes among the electric pulse, the intensity of the light emitted by the light therapy care source, and the rotation angle of the motor by pressing the switch / mode button for 1 - 2 seconds multiple times, and then use the gear button to select the gear, and finally press the switch / mode button again to set successfully.

[0070] On the front part, there are also two sound outlets for voice prompts to issue voice prompts for age input prompts, responding to the user's voice commands, user operations, and function execution status (including announcing the name of the physiotherapy function switched to or manual gear adjustment when the user switches functions, in progress, terminating physiotherapy, shutting down and welcome to use again, etc.). On one side of the physiotherapy head close to the front part, there is a microphone for receiving sounds for voice control ( Figure 2a ). On the front part, there is also a pinhole camera for collecting facial images for constructing a sensitive skin recognition model (obtained through training a neural network model by image collection and real skin types) and an intelligent setting method.

[0071] Such as Figure 2a shown, the handheld intelligent physiotherapy device further includes a high-definition camera module provided on the handheld housing, which can be used to collect human faces, and a sub-housing with a high-definition touch screen that can extend from the left and right sides of the handheld housing. There is a holding finger groove between the sub-housing and the extended left handheld housing indicated in the figure to facilitate operating the high-definition touch screen after completing the electrical connection in the direction of the arrow in the figure. The sub-housing has a pair of interfaces on the upper and lower sides, and a pair on the left and right respectively, which can be electrically connected to the handheld housing. The high-definition touch screen is independently powered by a battery ( Figure 2a not shown) in the sub-housing, and a charging port for the battery in the sub-housing ( Figure 2a not shown) is provided on the sub-housing. When the electrical connection is disconnected, it is still possible to perform an amplification operation on the collected human face image (such as Figure 2d the amplified part shown) and control the front camera to collect an image of the pushing part. The front camera is provided above the high-definition touch screen.

[0072] Figure 2a shown, it is also possible to electrically connect a pair of interfaces on the left side of the sub-housing to the right side of the handheld housing, which is also friendly to users with a left-handed touch habit.

[0073] After the electrical connection is completed, click the Figure 2d switch button in the figure, and the high-definition camera module is activated. A real-time human face image appears on the high-definition touch screen. At this time, the hand holding the device remains still, and the other hand can perform operations such as amplifying and circling the wrinkle area on the real-time human face image, and confirm to upload and save it to the background server.

[0074] The user can perform an operation to delete the affected area on the high-definition camera module and confirm to upload and save it to the background server again to update the human face image.

[0075] The next time when performing a facelift, the high-definition camera module recognizes the current real-time human face image (such as Figure 2d shown) through the face recognition function in the intelligent chip, and gives a prompt on the high-definition touch screen ( Figure 2d(not shown) whether to call out the saved face image of the circled wrinkle area. When "yes" is selected, it is asked again whether the wrinkle recognition model is needed. When "no" is selected, the user is indicated on the image that is called and displayed where the face lift is needed, such as the forehead wrinkles of the enlarged forehead, the crow's feet of the right eye, and the nasolabial folds of the mouth. When "yes" is selected, the wrinkle recognition model step is entered; when "no" is selected, the wrinkle recognition model step is also entered.

[0076] For example Figure 2d As shown, the mode display and charging display can be displayed on the high-definition touch screen, the switch / mode button, the front gear button, the standby button, the age input button, and the OTA button all form touch buttons on the high-definition touch screen, and a face image acquisition button is provided on the high-definition touch screen; the smart chip also calls a pre-trained wrinkle recognition model to perform recognition marking on a face image based on a face image captured by the user pressing the face image acquisition button in the figure.

[0077] The face recognition function is built and optimized by the backend server. Figure 2d Click the OTA button with the word "OTA" in the pop-up dialog box (not shown in the figure) to select the OTA object to implement the corresponding update. When the user finds that the called face image is incorrect, it will be reported to the background server through the high-definition touch screen, and the background server will send the correct face image through the uploaded registered account, so that the high-definition touch screen will be updated in OTA mode, and the wrong recognition result will be automatically replaced with the OTA update correction result at the next recognition to make a correct recognition. The algorithm logic diagram is shown in the figure Figure 2e When a recognition error occurs, the backend server calls the correctly saved image based on the registered account and replaces the recognition result.

[0078] Therefore, when face recognition is performed again in the future, the recognition result will search whether there is a record of the previous recognition result being replaced due to the user reporting an error. If so, it will be automatically replaced with the correct result, otherwise the recognition result will still be adopted.

[0079] like Figure 2dAs shown, the wrinkle recognition model is a convolutional neural network model with a residual mechanism. The training method is to obtain volunteers of different age groups. For each age group, multiple different parts that the volunteer himself / herself determines to require facelift are photographed, and the unacceptable degree of wrinkles is divided into three grades by the volunteer's own determination: negligible, non-negligible, and deep processing. The high-definition camera module is used to collect multiple high-definition images of each part in three grades for different age groups (which can be obtained by automatically cropping and magnifying by the intelligent chip). The multiple high-definition images of each part are divided into a training set and a validation set according to different parts respectively. By uploading to the background server, a sub-convolutional neural network with a residual mechanism is formed for each part. The training set is used for training, the loss function is calculated to optimize the model parameters, and the accuracy of the model is verified by the validation set to obtain the final wrinkle recognition model. At this time, the trained wrinkle recognition model is downloaded to the intelligent chip through OTA by the high-definition touch screen; during recognition, the user selects his / her own age group and clicks on the part of the face image that needs facelift, so that the intelligent chip can crop and magnify the image part, or the user imports the saved face image with the circled wrinkle parts through the high-definition touch screen operation, clicks on the part of the face image that needs facelift, and inputs it into the sub-convolutional neural network with a residual mechanism corresponding to the corresponding part that has been trained, so as to finally obtain the classification grade to which the wrinkle recognition of each age group belongs, and the classification grade is displayed on the display screen.

[0080] In this way, for the solution of importing images, users can obtain the severity grades of wrinkles on each part based on the consensus of their own age group. It is especially applicable to users who usually don't pay much attention to their own wrinkles and occasionally make physical therapy preparations in advance to meet the needs of certain occasions, or for users who don't know the severity of wrinkles on each part of their body, and it also has reference significance.

[0081] Among them, the volunteers of different age groups are divided into six groups in this embodiment and Embodiment 4: 18 - 24 years old, 25 - 35 years old, 35 - 45 years old, 45 - 60 years old, 60 - 75 years old, and over 75 years old.

[0082] Such as Figure 2b and 2c , the rear cavity contains four physiotherapy agent accommodation cavities detachably fixed on the partition board, each of which has a piston push rod inside, and a push part ([ Figure 2c ) is provided at one end of the piston push rod away from the piston and passes through the rear part. The four physiotherapy agent accommodation cavities are enclosed by a transparent material body and pass through the surface of the handheld shell on one side to form a passing part to display the position of the piston therein. Among them ([ Figure 2b), a scale is provided on the hand-held housing passing through the edge of the part, and the position of the piston can be read by comparing with the scale where the piston is located. Taking the second accommodating cavity from the left as an example, the arrows in the figure indicate the lowest and highest scale positions (the intermediate scales are not shown in the figure).

[0083] The outlets of the four physiotherapy agent accommodating cavities are respectively connected to the conduits, and the conduits extend through the rear cavity to the inner cavity of the physiotherapy head and are connected and conducted with four physiotherapy agent discharge holes provided on the outer shell of the physiotherapy head.

[0084] The four physiotherapy agent discharge holes are located on the outer shell side of the physiotherapy head closer to the rear cavity in the front cavity and the rear cavity, and are sequentially arranged at a position offset from the horizontal diameter of the physiotherapy head ( Figure 2b ). A guiding groove (not shown in the figure) is provided at the rear part. The guiding groove is closed by transparent plexiglass ( Figure 2b ). On the hand-held housing beside the guiding groove, when the pushing part is toggled to move along the guiding groove, the corresponding physiotherapy agent in the four physiotherapy agent accommodating cavities is discharged from the physiotherapy agent accommodating cavities, passes through the conduits and is discharged from the physiotherapy agent discharge holes. The physiotherapy agent discharge holes are sealed by a protective cap ( Figure 2c ) to prevent the physiotherapy agent from volatilizing or deteriorating.

[0085] Figure 2b In, after the piston push rod is pulled out from the physiotherapy agent accommodating cavity, or after the physiotherapy agent accommodating cavity is first removed and then the piston push rod is pulled out, on the premise that the protective cap is closed and connected to the conduit, the physiotherapy agent can be replenished into each physiotherapy agent accommodating cavity.

[0086] From left to right, the four physiotherapy agent accommodating cavities respectively store makeup remover water, essential oil, gel, and eye cream for cleaning, nourishing, lifting and firming, and eye care for applying the physiotherapy agent in advance.

[0087] The user can establish a physiotherapy record through the high-definition touch screen and control the front camera described above ( Figure 2a ) to collect images of the position of the pushing part. The background server calculates the recommended position of the pushing part according to the collected skin images to adapt to the user's skin, and downloads the images of the recommended position of the pushing part to the high-definition touch screen through the OTA method, and automatically inputs them into the intelligent chip after the sub-housing is connected to the hand-held housing to calculate the recommended position for each future use again. Among them, the calculation algorithm for calculating the recommended position of the pushing part according to the collected skin images can be continuously optimized by the background server and regularly provided to the user through the OTA method to select whether to update. That is, when the user is satisfied with the current algorithm, the OTA update can be not selected.

[0088] Among them, the recommended position of the pushing part calculated according to the collected skin images is determined by the intelligent setting in Embodiment 4. That is, the dosage is gradually increased in three gears: low, medium, and high.

[0089] Example 2

[0090] This embodiment will explain in detail the structure of the physiotherapy head in Embodiment 1. Figure 3 The physiotherapy head shown in the figure includes a massage head, a touch sensing part coupled to the center of the massage head, and a light therapy care source between the center of the massage head and the peripheral massage head that can emit amber light, red light, crimson light, and blue light. A mechanical facelift mechanism ( Figure 3 a). Figure 3 As shown in b, four therapeutic agent discharge holes of Example 1 are arranged on the other side of the therapeutic head opposite to the massage head. The face lifting mechanism can be as follows Figure 3 c and 3d, including a back plate ( Figure 3 c), a slave gear sleeved on the central column of the back plate, a master gear meshed with the slave gear, a motor connected to the master gear through a reducer and accommodated in the inner cavity of the physiotherapy head, and a plurality of push heads ( Figure 3 d).

[0091] The central hole of the main gear is connected to the reducer shaft through the through hole on the back plate, and the slave gear has 6 rotating grooves whose number is the same as the number of the pusher heads. The pusher head has a push rod, and the push rod can be slidably engaged in the slide groove of the back plate ( Figure 3 d not shown), one end of the push rod has a convex rod passing through the rotary groove, when the motor drives the main gear to rotate clockwise, the convex rod is driven by the gear to rotate and slide in the rotary groove, thereby pushing the push head rods of the 6 push heads radially outward in the slide groove to make the multiple push heads open, and thereafter at any time when the motor drives the main gear to rotate counterclockwise, the push head rod moves radially inward in the slide groove to make the multiple push heads converge in the opposite direction, thereby achieving external auxiliary pulling effect on the skin.

[0092] The motor is communicatively connected to the smart chip, and the back plate has a wire hole (5 in total) between each of the push head rods for passing components and / or wires of the touch sensing part, massage head, and light therapy care source through so as to communicate with the smart chip.

[0093] Or the face-lifting mechanism is as follows Figure 3 e and 3f, including a facelift scissors ( Figure 3 e), the front end of which has a pair of push arcs ( Figure 3 f), and the rear end handle passes through the inner cavity of the physiotherapy head and out of the physiotherapy head shell for hand holding as shown in FIG. Figure 3e) to perform a shearing operation by pressing the handles relative to each other, and to tighten the skin when releasing the handles (specifically, the front end can resume the movement trend of opening after releasing by the compression spring arranged across the handles and / or across the front end), so as to achieve the skin being pressed by the front end push arc as shown in FIG. Figure 3 Push and pull in the opposite direction as shown by the arrows in f.

[0094] The part of the treatment head through which it is inserted forms a pair of guide grooves ( Figure 3 e is not shown). At this time, Figure 3 As shown in FIG. 5 , when the user chooses to push the pushing portion, the therapeutic agent will be discharged from the therapeutic agent discharge hole and applied to the finger to apply the therapeutic agent to the treatment area.

[0095] It is understandable that due to the obstruction and space occupied by the handle passing through the shell of the physiotherapy head, there is no suitable angle to use the physiotherapy agent discharge hole on the shell of the physiotherapy head to directly apply the physiotherapy agent to the skin and perform the application operation. Figure 3 As shown in e, we can still use Figure 3 The therapeutic agent discharge hole is set slightly lower than b to discharge the therapeutic agent to the fingers and apply the therapeutic agent.

[0096] Example 3

[0097] This embodiment will explain the key switching method of the handheld intelligent physiotherapy instrument. Figure 4 After long pressing the light / mode button for 4-5 seconds to turn on the beauty instrument, the age is input (via voice) into the beauty instrument. The user can cycle through the functions of the light / mode button by short pressing. If it is judged that the light / mode button is pressed twice in a row, the function is selected (for the sake of simplicity, this step is not shown in the figure) and it is further judged whether it is long pressed for 2-3 seconds. If it is judged that it is not pressed twice in a row, the function can continue to be cycled through short pressing;

[0098] If it is judged that the long press is 2-3 seconds, the selected function is exited (for the sake of simplicity, this step is not shown in the figure), and then it is judged whether it is long pressed for 4-5 seconds. If so, the device is turned off, otherwise the function cycle continues;

[0099] If it is continuously determined that it has not been long - pressed for 2 - 3 seconds, physical therapy for the selected function is performed through contact sensing. If it is determined during the process that it has been long - pressed for 2 - 3 seconds, the physical therapy is terminated and the function enters a cyclic switching. Otherwise, it is judged every 1 - 2 s with a time delay whether there is non - contact. If so, the calculation of the compensation time is entered; otherwise, the physical therapy for the selected function continues. If the non - physical therapy part is contacted, the user generally moves it away. At this time, if it is determined that it has not been long - pressed for 2 - 3 seconds, it is still judged as non - contact, so as to calculate the compensation time until it is determined again that the skin is contacted to perform the physical therapy for the selected function and compensate the physical therapy time. The time spent in adjusting to the correct physical therapy part due to accidental contact is included in the compensation time.

[0100] During the calculation of the compensation time, it is judged every 1 - 2 s whether the skin is contacted. If the skin is still not contacted, it is also judged every 1 - 2 s whether it has been long - pressed for 2 - 3 seconds. If so, the physical therapy is terminated and the cyclic switching of the function continues. Otherwise, it is judged whether it has been long - pressed for 4 - 5 seconds. If so, the device is powered off. Otherwise, it continues to judge whether the skin is contacted.

[0101] Embodiment 4

[0102] This embodiment will illustrate the method of the intelligent setting, as Figure 5 shown, including the following steps:

[0103] S1 Set five test groups: a cleaning group, a nourishing group, a lifting and firming group, an eye care group, and a blue - light calming group. Each test group is divided into six subgroups: 18 - 24 years old, 25 - 35 years old, 35 - 45 years old, 45 - 60 years old, 60 - 75 years old, and over 75 years old. Figure 4 Taking the cleaning function as an example, set its training set, validation set, and test set, and the ratio of the three is 3:1:1. All experimenters follow the preset daily routine for 2 months. The daily routine is that those aged 18 - 24 get up at 7:30 in the morning, those aged 25 - 35 get up at 7:00, those aged 35 - 45 get up at 7:00, those aged 45 - 60 get up at 6:30, those aged 60 - 75 get up at 6:00, and those over 75 years old get up at 6:00. All test groups go to bed between 10 - 11 pm, have three meals a day. Breakfast, lunch, and dinner start within 30 minutes after getting up, between 11:30 - 12:30, and between 17:30 - 18:30 respectively.

[0104] S2 The cleaning test group trains ResNet respectively according to the following parameters:

[0105] Three gears of low, medium, and high for low - frequency vibration, three gears of low, medium, and high for the intensity of amber light, and a total cleaning time of 4 minutes under the warm - heat effect, seven parameters,

[0106] When S3 is powered on, a pinhole camera is used to collect images of the face to be physiotherapied. According to a pre-set sensitive skin recognition model (i.e., recognized based on features such as facial burning scars, blood streaks, and blushing in the collected images), it is determined whether it belongs to sensitive skin. If so, the action time of all groups is halved. The training sets of each group are respectively subjected to a cross-testing scheme for parameter selection of five major functional physiotherapies, and the top 3 parameter configurations are obtained through overall evaluation. The classification scores of the top three in the physiotherapy results of each of these parameter configurations are taken; and the corresponding collected images are respectively input into the corresponding ResNet model for training, and the validation set is used to verify the accuracy rate. The network parameters of the model are adjusted using a loss function until the accuracy rate and the loss function value are stable, and then the training is stopped, so as to obtain the top three scores of each parameter configuration of each functional physiotherapy under each group, classified as good, medium, and poor (i.e., according to the three scores from the highest to the relatively lowest as three grades); by randomly selecting the intermediate parameter configuration corresponding to the prediction result of good or medium for each parameter configuration, the parameter configuration with the highest score among the intermediate parameter configurations of the 3 parameter configurations is compared as the best parameter configuration for the corresponding functional physiotherapy under this group. If there are multiple highest scores that are the same, one of the parameter configurations is randomly selected as the best parameter configuration for the corresponding functional physiotherapy under this group, thus forming a trained artificial intelligence model;

[0107] The high-definition touch screen downloads the artificial intelligence model trained in step S3 from the background server through the OTA method, and inputs the age of the person to be tested in the test set. By using a pinhole camera to collect images of the face to be physiotherapied of the person to be tested, and inputting the collected images into the corresponding trained ResNet model, a set of best parameter configurations predicted under cleaning is obtained. Based on this, the corresponding best parameter configuration is selected according to the cleaning selected by the person to be tested for cleaning preparation, and physiotherapy is performed according to the contact of the face to be physiotherapied of the person to be tested with the touch sensing part.

[0108] Example 5

[0109] This example will illustrate two facial skin physiotherapy methods for the handheld intelligent physiotherapy device as provided in Examples 1 - 4, including the following steps:

[0110] The first is the intelligent physiotherapy plan:

[0111] (1) Power on and input the age, and face the pinhole camera to collect images to complete the parameter setting based on intelligent settings;

[0112] (2) Select the physiotherapy function through the switch / mode button;

[0113] (3) Discharge the corresponding physiotherapy agent through the physiotherapy agent discharge hole to act on the facial skin to be physiotherapied;

[0114] (4) Physiotherapy for the selected physiotherapy function is performed by bringing the facial skin to be physiotherapied, which has been acted upon by the physiotherapy agent in step (3), into contact with the touch sensing part.

[0115] The second is the manual physiotherapy plan

[0116] After power-on, directly start from step (2) and select to wake up the manual adjustment panel through the switch / mode button; then long-press the switch / mode button to select the manual adjustment of the electric pulse frequency and intensity, and / or the vibration frequency, and / or the intensity of the light emitted by the light therapy care source, and / or the rotation angle of the motor, and use the gear buttons to select the gear, and finally long-press the switch / mode button again to set successfully;

[0117] When the image acquisition fails, it can voice prompt that the image acquisition fails every 3s through the sound hole until the user's image acquisition is successful, or wake up the manual adjustment panel to enter the next step respectively or prompt to enter the manual parameter adjustment mode and then perform steps (3) and (4) in sequence.

[0118] Table 1 shows the comparison of the physiotherapy effects of the two plans (under tension assistance), where (0) indicates that no definite improvement was measured without tension assistance, and (-) indicates that the data performance was relatively poor without tension assistance (between 0.2 - 0.5%).

[0119]

[0120]

[0121] The results show that using the intelligent plan + tension assistance shows better effects in all indicators.

Claims

1. A handheld intelligent physiotherapy instrument OTA system, characterized in that: The invention comprises a handheld intelligent physiotherapy instrument and a background server, wherein the handheld intelligent physiotherapy instrument communicates with the background server via OTA, so that the handheld intelligent physiotherapy instrument can selectively download updated or expanded new functions of the original functions from the background server, wherein the handheld intelligent physiotherapy instrument comprises: a handheld shell, a physiotherapy head, a switch / mode button, a charging port, a mode display and a charging display, a pinhole camera for collecting skin images of a human face, and a battery in the handheld shell, wherein the physiotherapy head comprises a button that can perform vibration and / or MFIP action. The massage head and the light therapy care source that can emit amber light, red light, crimson light and blue light, the mode display includes a display of five major functions of cleaning, nourishing, lifting and firming, eye care and blue light calming that can be realized by short pressing the switch / mode button, and the feature is that the therapy head also includes a touch sensing part coupled to the massage head and a mechanical skin lifting mechanism arranged on the therapy head outside the massage head, the touch sensing part automatically or manually starts the mechanical skin lifting mechanism according to the facial skin contacting the massage head, so as to realize the multi-directional extension effect on the skin level at the same time as the therapy; The handheld intelligent physiotherapy instrument also includes a high-definition camera module, which can be used to capture human faces, and a sub-shell that is detachably extended from one side of the handheld shell and is provided with a high-definition touch screen with a front camera. There is a gripping finger groove between the sub-shell and the extended handheld shell on one side to facilitate gripping and operating the high-definition touch screen. When the high-definition camera module is started, a real-time face image appears on the high-definition touch screen. At this time, the holding hand does not move, and the other hand can zoom in on the real-time face image, circle the wrinkle area, and determine to upload it to the backend server for storage. When the face is lifted next time, the high-definition camera module recognizes the current real-time face image through the face recognition function in the smart chip, and calls out the saved face image of the circled wrinkle area to indicate the user's desired face lift area. The user can delete the area of ​​action on the high-definition camera module and confirm to upload it to the backend server again to save and update the face image, wherein the optimization of the face recognition function is performed by the backend server and the user selectively chooses whether to OTA download it to the smart chip for update; A plurality of physiotherapy agent discharge holes are arranged on the side of the physiotherapy head away from the mechanical facelift mechanism. The physiotherapy agent discharge holes are connected through conduits to a plurality of physiotherapy agent receiving chambers inside the handheld shell, which are sealed by a transparent material body and one side of which passes through the surface of the handheld shell to display the piston position therein. Each of the plurality of physiotherapy agent receiving chambers can be pushed by a piston push rod to squeeze out the physiotherapy agent contained in the physiotherapy agent receiving chamber. A push portion arranged at one end of the piston push rod protrudes from the guide groove on the outer surface of the handheld shell. When the push portion is moved along the guide groove, the push portion is pushed out of the guide groove. When the guide groove moves, the current pushed position of the piston can be observed through the transparent material body, and the corresponding physiotherapy agent can be discharged from the physiotherapy agent receiving chamber, discharged from the corresponding physiotherapy agent discharge hole through the conduit and applied to the finger or the face to be treated, and then applied by means of the finger or the side of the physiotherapy head respectively; protective caps are provided on the multiple physiotherapy agent discharge holes, so that the protective caps can be covered when not in use to prevent the physiotherapy agent components from volatilizing and / or deteriorating; the piston push rod can be pulled out by disassembling the handheld housing to add the corresponding physiotherapy agent into the physiotherapy agent receiving chamber; The smart chip arranged inside the handheld housing is used to set parameters based on smart settings according to the skin image acquisition and one of the functions of cleaning, nourishing, lifting and firming, eye care, and blue light calming selected by the user, so that after the parameter setting is completed and the physiotherapy agent is applied, the mechanical skin-lifting mechanism is automatically or manually started by the contact between the touch sensing part and the facial skin, and the physiotherapy of the selected function is performed; when the facial skin or the skin of any other part contacts the touch sensing part and then leaves the touch sensing part to present a non-contact state, the mechanical skin-lifting mechanism is reversely moved and the physiotherapy of the selected function is automatically suspended. At this time, the user can forcibly press the switch / mode button for 2-3 seconds to terminate the physiotherapy and enter the mode of reselecting the function, and press the switch / mode button twice in succession to confirm the selected function; or press the switch / mode button for 4-5 seconds to shut down the handheld smart physiotherapy instrument. And the age input part, the age input part button or voice input method, for the button input method, that is, cyclically switching among multiple age groups, when selected, long press the age input part button for 1-2 seconds to confirm; for the voice input method, voice input can be performed multiple times and the most recent voice input is cyclically overwritten until no voice input is received within 2-5 seconds.

2. The system according to claim 1, characterized in that When the user finds that the called face image is incorrect, the user reports it to the backend server through the high-definition touch screen, and uses the uploaded registered account to let the backend server send the correct face image, so that the high-definition touch screen can be updated OTA, and the wrong recognition result will be automatically replaced with the OTA update result at the next recognition to make a correct recognition; The pause time of the treatment that automatically pauses the selected function is included in the compensation time after the next contact for treatment, and the compensation time shall not exceed 1 minute; The recalculation method is that, based on the current recommended position of the background server, the amount of physiotherapy agent usage corresponding to the recommended positions in the future shows a decreasing function trend; the OTA update also includes the user being able to choose whether to make the following updates: that is, when the deletion operation is performed on the high-definition touch screen, a dialog box will pop up to display a message reminding the user that the face lift needs to be consolidated and persisted, and asking whether it is really necessary to delete; The reduction function is linear, and a scale is provided on the handheld housing passing through part of the edge, which can read the position of the piston on the scale by comparing it with the piston position. After the smart chip completes the recalculation, it can display the recommended scale position indication for multiple future uses on the high-definition touch screen for user reference.

3. The system according to claim 1, characterized in that The handheld housing comprises a detachable front part and a rear part based on a partition, and the partition divides the space surrounded by the installed front part and the rear part into a front cavity and a rear cavity that are independently sealed from each other, and the rear cavity contains the multiple physiotherapy agent accommodating cavities, the corresponding piston push rod, part of the push part, and at least part of the catheter, and the physiotherapy agent discharge hole is located on the side of the physiotherapy head opposite to the mechanical skin lifting mechanism; the front cavity is used to accommodate the battery and the smart chip in the handheld housing; the switch / mode button, mode display and charging display are located in the front part, and the charging hole is arranged at the bottom of the front cavity and belongs to one end of the front part; the multiple physiotherapy agent accommodating cavities are detachably fixed on the partition; The handheld intelligent physiotherapeutic instrument further comprises a gear button arranged at the front part, which is used to set the frequency and intensity of electric pulses, and / or the vibration frequency, and / or the intensity of light emitted by the phototherapy care source, and / or the rotation angle of the motor; the mode display further comprises a manual gear adjustment panel, which is used to switch and display the adjustment modes among the electric pulses, the intensity of light emitted by the phototherapy care source, and the rotation angle of the motor by pressing the switch / mode button for 1-2 seconds multiple times, and then the gear is selected by using the gear button, and finally the switch / mode button is pressed for a long time again to successfully set the gear; The mode display and charging display can be displayed on the high-definition touch screen, the switch / mode button, the front gear button, the standby button, the age input button, and the OTA button all form touch buttons on the high-definition touch screen, and a face image acquisition button is provided on the high-definition touch screen; the smart chip also calls a pre-trained wrinkle recognition model to perform identification marking on a face image based on a face image captured by the user pressing the face image acquisition button.

4. The system according to claim 3, characterized in that The wrinkle recognition model is a convolutional neural network model with a residual mechanism. The training method is to obtain volunteers of different age groups, and for each age group, take photos of multiple different parts that the volunteers themselves identify as needing a facelift, and divide the unacceptable degree of wrinkles into three levels: negligible, non-negligible, and deep processing according to the volunteers' own identification. The high-definition camera module is used to collect multiple high-definition images of each part of the three levels for different age groups, and the multiple high-definition images of the parts are divided into training sets and verification sets according to different parts, and uploaded to the background server by the high-definition touch screen. The background server forms a sub-convolutional neural network with a residual mechanism for each part, which is used to The training set is used for training, the loss function is calculated to optimize the model parameters, and the model accuracy is verified by the validation set to obtain the final wrinkle recognition model. At this time, the high-definition touch screen downloads the trained wrinkle recognition model to the smart chip through the OTA method; during recognition, the user selects his own age group and clicks on the desired face-lifting part on the collected face image, so that the smart chip can take a screenshot and enlarge the image part, or the user imports the saved face image of the wrinkle part circled by the user through the high-definition touch screen operation, clicks on the desired face-lifting part on the collected face image, and inputs it into the sub-convolutional neural network with residual mechanism corresponding to the trained corresponding part, so as to finally obtain the classification level of wrinkle recognition in each age group, which is displayed on the high-definition touch screen; Both sides of the sub-shell have interfaces electrically connected to the handheld shell. When one of the sides is connected to the handheld shell, the high-definition touch screen is turned on; the high-definition touch screen is independently powered by the battery in the sub-shell, and a sub-shell battery charging port is provided on the sub-shell. When the electrical connection is disconnected, the captured facial image can still be enlarged and the front camera can be controlled to capture the image of the push-up position.

5. The system according to claim 1, characterized in that The intelligent setting method comprises the following steps: S1 set up five test groups: cleaning group, nourishing group, lifting and firming group, eye care group, and blue light calming group. Each test group was divided into six groups: 18-24 years old, 25-35 years old, 35-45 years old, 45-60 years old, 60-75 years old, and over 75 years old. Each group was set up with a training set, a validation set, and a test set, and the ratio of the three was 5-3:1-2:

1. All subjects followed the preset work and rest routine for 1-3 months. The work and rest schedule is to get up at 7:30 am for those aged 18-24, 7 am for those aged 25-35, 7 am for those aged 35-45, 6:30 am for those aged 45-60, 6 am for those aged 60-75, and 6 am for those aged 75 and above. All test groups go to bed between 10-11 pm. Three meals a day, breakfast, lunch, and dinner, start within 30 minutes after getting up, between 11:30-12:30, and between 17:30-18:30 respectively. The five experimental groups in S2 were trained with the following parameters for the artificial intelligence model: Cleaning group, low frequency vibration low, medium and high three gears, amber light intensity low, medium and high three gears, total cleaning time under warm effect 4min, seven parameters, Nourishing group, high-frequency vibration low, medium, high three gears, red light intensity low, medium, high three gears, total nourishing time under warming effect 4min, seven parameters, Lifting and firming group, low frequency vibration low, medium and high three gears, high frequency vibration low, medium and high three gears, MFIP pulse frequency high, medium and low three gears, pulse intensity high, medium and low three gears, deep red light intensity, amber light intensity, total lifting and firming time under warm effect 4min, fifteen parameters, Eye care group, MFIP pulse frequency high, medium and low three gears, pulse intensity high, medium and low three gears, low frequency vibration low, medium and high three gears, high frequency vibration low, medium and high three gears, high and low frequency vibration interval, total eye care time under warming effect 4min, fourteen parameters, Blue light calms, blue light intensity, ice compress effect is to cool down the massage head for 4 minutes, one parameter; When S3 is turned on, it uses a pinhole camera to collect images of the face to be treated and uploads them to the backend server. The backend server identifies whether the skin is sensitive based on the preset sensitive skin recognition model. If it is, the action time of all groups is halved. The training sets of each group are subjected to the parameter selection cross-test scheme of the five major functional treatments, and the top N parameter configurations are obtained through overall evaluation, N≤5, and the classification scores of the top three treatment results of each parameter configuration are taken; The corresponding collected images are respectively input into the corresponding artificial intelligence model for training, and the accuracy is verified using the validation set. The network parameters of the model are adjusted using the loss function until the accuracy and the loss function value are stable, and the training is stopped, thereby obtaining the classification of the top three scores of each parameter configuration of each functional physiotherapy under each group as good, medium, and poor; by randomly selecting the middle parameter configuration of each parameter configuration corresponding to the good or medium prediction result of each parameter configuration as the corresponding functional physiotherapy under the group, the parameter configuration with the highest score among the middle parameter configurations of N parameter configurations is compared as the best parameter configuration of the corresponding functional physiotherapy under the group, if there are multiple highest scores with the same score, one of the parameter configurations is randomly selected as the best parameter configuration of the corresponding functional physiotherapy under the group, thereby forming a trained artificial intelligence model; the artificial intelligence model is a convolutional neural network CNN, or a ResNet based on a residual mechanism; The S4 high-definition touch screen downloads the artificial intelligence model trained in step S3 from the background server via OTA, and inputs the collected images into the corresponding trained artificial intelligence model to obtain five sets of optimal parameter configurations predicted under each functional therapy. In this way, the corresponding optimal parameter configuration is selected according to the function selected by the subject for therapy preparation, and therapy is performed according to the subject's facial contact with the touch-sensitive part to be treated.

6. The system according to any one of claims 1 to 5, characterized in that: The mechanical facelift mechanism includes a back plate fixedly connected to the physiotherapy head and having a center column, a slave gear sleeved on the center column of the back plate, a main gear meshing with the slave gear, a motor accommodated in the internal cavity of the physiotherapy head and connected to the main gear through a reducer or directly connected, and a plurality of push heads, wherein the central hole of the main gear is connected to the reducer shaft through a through hole on the back plate, the slave gear has a plurality of rotary grooves whose number is the same as the number of the push heads, the push head has a push rod, the push rod can be slidably embedded in the slide groove of the back plate, one end of the push rod has a convex rod passing through the rotary groove, when the motor drives the main gear to rotate clockwise Or when rotating counterclockwise, the convex rod drives the convex rod to slide in the rotating groove due to the rotation of the slave gear, thereby pushing the push head rods of the multiple push heads radially outward in the slide groove to make the multiple push heads open, and thereafter at any time when the motor drives the main gear to rotate in the opposite direction, the push head rod moves radially inward in the slide groove to make the multiple push heads converge in the opposite direction, thereby achieving external auxiliary pulling effect on the skin, the motor is communicatively connected to the smart chip, and the back plate has at least one wire hole between the push head rods for passing the components and / or wires of the touch sensing part, massage head, and light therapy care source to communicate with the smart chip.

7. The system according to any one of claims 1 to 5, characterized in that: The mechanical facelift mechanism includes a facelift scissors, the front end of which has a pair of push arcs arranged on the side where the massage head is located and can be pressed against the skin, and the rear end handle passes through the internal cavity of the physiotherapy head and passes through the outer shell of the physiotherapy head so that the hand can hold it and press the handle relatively to perform a shearing operation. After the skin is pressed, the handle is released to achieve a skin tightening operation, and the front end push arc pushes and pulls the skin in the reverse state of tightening. The part of the physiotherapy head that is penetrated forms a pair of guide grooves for guiding the handle to perform the shearing operation and the skin tightening operation. At this time, when the user chooses to push the push part, the physiotherapy agent will be discharged from the physiotherapy agent discharge hole and applied to the fingers or other application materials to apply the physiotherapy agent to the treatment area; and / or, The physiotherapy head is also provided with a microphone for receiving voice control sound, and the front end also includes at least one sound outlet for voice prompts to issue age input prompts, respond to user voice commands, user operations, and voice prompts for function execution status; There are two switch / mode buttons, one of which is a spare button. The user can select one of them for operation at any time when the device is turned on. When one of the buttons fails, the spare button can still be used for operation.

8. A facial skin treatment method using the system according to any one of claims 1 to 7, characterized in that: The steps include: (1) Turn on the device and input age, then face the pinhole camera to collect images and complete parameter setting based on intelligent settings; (2) Select the therapy function by using the switch / mode button; (3) discharging the corresponding physiotherapy agent through the physiotherapy agent discharge hole to act on the facial skin to be treated; (4) contacting the facial skin to be treated with the therapeutic agent in step (3) with the touch sensitive part to perform the selected therapeutic function; or, After powering on, start directly from step (2) by using the switch / mode button to wake up the manual gear adjustment panel; then long press the switch / mode button to select manual adjustment of the electric pulse frequency and intensity, and / or the vibration frequency, and / or the intensity of the light emitted by the phototherapy care source, and / or the rotation angle of the motor, use the gear button to select the gear, and finally long press the switch / mode button again to successfully set; When image acquisition fails, a voice prompt of image acquisition failure can be given through the sound outlet every 3-5 seconds until the user succeeds in image acquisition, or the manual adjustment panel is awakened to enter the next step or prompted to enter the manual adjustment parameter mode and then perform steps (3) and (4) in sequence.

9. The facial skin treatment method according to claim 8, characterized in that: After long pressing the light / mode button for 4-5 seconds to turn on the instrument, enter the age into the beauty instrument. The user can cycle through the functions by short pressing the light / mode button. If it is judged that the light / mode button is pressed twice in a row, the function is selected and it is further judged whether it is long pressed for 2-3 seconds. If it is judged that it is not pressed twice in a row, the function can be cycled through short pressing. If the long press is continued for 2-3 seconds, the selected function will be exited, and then it will be determined whether it is long pressed for 4-5 seconds. If so, the device will be shut down, otherwise, the function cycle will continue; If it is judged that the button is not pressed for 2-3 seconds, the selected function will be treated through contact sensing. If it is judged that the button is pressed for 2-3 seconds, the treatment will be terminated and the function will be switched in a loop. Otherwise, it will be judged whether it is non-contact every 1-2 seconds. If it is, the compensation time will be calculated. Otherwise, the selected function will be treated. If the non-treatment part is touched, the user will generally move away. At this time, if it is judged that the button is not pressed for 2-3 seconds, it will continue to be judged as non-contact, so as to calculate the compensation time, until it is judged that the skin is touched again, the selected function will be treated and the treatment time will be compensated. During the calculation of the compensation time, it is determined every 1-2 seconds whether the skin is touched. If it is still not touched, it is also determined at 1-2 second intervals whether it is pressed for 2-3 seconds. If so, the physical therapy is terminated and the function cycle is continued. Otherwise, it is determined whether it is pressed for 4-5 seconds. If so, the device is shut down. Otherwise, it continues to determine whether the skin is touched.

10. The facial skin treatment method according to claim 9, characterized in that: It also includes a wrinkle tightening treatment method, which specifically includes starting the high-definition touch screen on the sub-shell, facing the high-definition camera module to collect real-time high-definition images of the user, manually zooming in on the real-time face image, circling the wrinkle area, and confirming to save. When doing a face lift next time, the high-definition camera module recognizes the current real-time face image through the face recognition function in the smart chip, and prompts on the high-definition touch screen whether to call out the saved face image of the circled wrinkle area. When "Yes" is selected, it is asked again whether model recognition is required. When "Not required" is selected, the user is indicated on the image that is displayed where the face lift is required; when "Required" is selected, the wrinkle recognition model step is entered; when "No" is selected, the wrinkle recognition model step is also entered, and the wrinkle recognition model step is entered. During the step, a face image is collected by pressing the face image collection button, and a pre-trained wrinkle recognition model is called to perform recognition marking on the face image. During specific recognition, the user first selects his own age group, and clicks on the desired face-lifting part on the collected face image, so that the smart chip can take a screenshot and enlarge the image part, or the user imports a saved face image of the circled wrinkle part through the high-definition touch screen operation, clicks on the desired face-lifting part on the collected face image, and inputs the input into the sub-convolutional neural network with residual mechanism corresponding to the trained corresponding part, so as to finally obtain the classification level of wrinkle recognition in each age group, and display the classification level on the high-definition touch screen. The user determines the type, dosage and tightening time of the physiotherapy agent according to the classification level.

Images