Skin care clock-in method and electronic device

Through electronic devices, intelligently judge the user's status and automatically remind and complete skin care check-in. Using the camera to identify action matching, the problems of inaccurate skin care check-in in the existing technology are solved, the problems of inaccurate skin care check-in, large user burden and insufficient supervision in the existing technology are improved, and the skin care experience and effect are improved.

CN114816195BActive Publication Date: 2024-12-03HUAWEI TECH CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
CN202110116954.9
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-28
Publication Date
2024-12-03
Estimated Expiration
2041-01-28

AI Technical Summary

Technical Problem

The existing skin care check-in solution cannot be intelligently reminded when users do not meet the skin care conditions, and requires users to manually check in, which increases the user's burden and cannot supervise the user's skin care behavior in real time, resulting in poor results.

Method used

Obtain the user's current status information through electronic devices, such as location, sports status and schedule, determine whether the conditions are met to implement a skin care check-in plan, intelligently remind the user and automatically complete the check-in, use the camera to identify the user's actions and the demonstration actions, and postpone or adjust the reminder. Time, supervise users' skin care behavior.

Benefits of technology

It improves the user experience, reduces the time cost of skin care check-in, ensures that users can take skin care under appropriate conditions, and enhances supervision and guidance of user behavior.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114816195B_ABST
    Figure CN114816195B_ABST
Patent Text Reader

Abstract

The present application provides a skin care punch-in method and electronic device, which relates to the field of terminal technology. The method includes: receiving a first operation input by a user; in response to the first operation, displaying at least one skin care punch-in plan in which the user participates; obtaining first target information, the first target information including time, location of the electronic device, movement status of the user, and schedule of the electronic device; based on the first target information, judging whether the preset implementation conditions for implementing at least one skin care punch-in plan are met; if the judgment result is that the preset implementation conditions are met, displaying first reminder information, the first reminder information is used to prompt the user to implement at least one skin care punch-in plan. The method can automatically check in the user's skin care behavior, reduce the user's burden, and improve the user experience.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present application relates to the field of terminal technology, and in particular to a skin care clock-in method and electronic device. Background Art

[0002] Nowadays, users have an urgent need for skin care methods. In order to help users develop facial care habits and guide users to perform correct care, existing technical solutions have designed a variety of care check-in plans and care video tutorials for users. In addition to guiding users on skin care functions, reminder functions can also be set manually. Summary of the invention

[0003] In a first aspect, the present application provides a skin care punch-in method, a skin care punch-in method applied to an electronic device, comprising:

[0004] Receiving a first operation input by a user;

[0005] In response to the first operation, displaying at least one skin care check-in plan in which the user participates;

[0006] Acquire first target information, where the first target information includes one or more of time, location of the electronic device, motion status of the user, and schedule of the electronic device;

[0007] Based on the first target information, determining whether the preset implementation conditions for implementing at least one skin care punch-in plan are met;

[0008] If the judgment result is that the preset implementation conditions for implementing at least one skin care punch-in plan are met, a first reminder message is displayed, and the first reminder message is used to prompt the user to implement at least one skin care punch-in plan.

[0009] In the skin care check-in method provided in the present application, the electronic device determines the current state of the user based on the first target information, and determines whether the user has the conditions to perform the skin care check-in behavior according to the current state of the user. If the skin care conditions are met, the user is prompted to check in for skin care; if the skin care conditions are not met, the check-in is postponed to a time period when the user has the conditions, thereby reducing the burden on the user and improving the user experience.

[0010] In a possible implementation, the skin care clock-in method further includes:

[0011] receiving a second operation input by a user;

[0012] In response to the second operation, obtaining at least one behavior action of the user;

[0013] Determine whether at least one behavioral action matches a corresponding demonstration action, wherein the corresponding demonstration action is a demonstration action in at least one skin care check-in plan;

[0014] If the judgment result is that at least one behavioral action matches the corresponding demonstration action, a second reminder message is displayed, and the second reminder message is used to prompt that at least one skin care check-in plan has been completed;

[0015] If the judgment result is that at least one behavioral action does not match the corresponding demonstration action, a third reminder message is displayed, and the third reminder message is used to prompt that at least one skin care check-in plan is not completed.

[0016] In an embodiment, the second operation instructs the user to turn on the camera. The electronic device can obtain the user's behavior according to the user's operation, and match the user's behavior with the demonstration behavior of the skin care punch-in plan. In the case of a match, the punch-in is automatically completed without the need for the user to manually punch in, thereby improving the user experience. In a possible implementation, the skin care punch-in method also includes,

[0017] If the judgment result is that the preset implementation conditions for implementing at least one skin care punch-in plan are not met, a fourth reminder message is displayed, and the fourth reminder message is used to prompt the user whether to postpone the implementation of at least one skin care punch-in plan.

[0018] In this embodiment, if the user does not meet the skin care check-in conditions, the user can be reminded to check in during the time period when skin care check-in is possible, thereby further improving the user experience.

[0019] In a possible implementation, the skin care clock-in method further includes:

[0020] receiving a third operation input by a user;

[0021] In response to the third operation, the first target information is obtained again after a predetermined time, and based on the first target information obtained again, it is determined whether the preset implementation conditions for implementing at least one skin care punch-in plan are met.

[0022] In this embodiment, the third operation instructs the user to adjust the reminder time so that the user can obtain the first target information again after the user's preset time, determine whether the preset implementation conditions are met, and remind the user to check in for skin care again. This solution improves the user experience while supervising the user's check-in.

[0023] In a possible implementation, the skin care clock-in method further includes:

[0024] If the judgment result is that the preset implementation conditions are not met, the first target information is obtained again after a predetermined time, and based on the first target information obtained again, it is judged whether the preset implementation conditions for implementing at least one skin care check-in plan are met.

[0025] In this implementation, the user does not need to adjust the time, but the electronic device automatically obtains the first target information at a predetermined time, determines whether the user meets the preset implementation conditions, and determines whether to remind the user to check in for skin care, thereby further improving the user experience. In a possible implementation, the skin care check-in method also includes:

[0026] Acquire second target information, where the second target information includes at least one of time, location of the electronic device, and content of an application program;

[0027] Based on the second target information, determining whether the user has implemented the prohibited behavior in the at least one skin care check-in plan;

[0028] If the judgment result is that the prohibited behavior has been implemented, a fifth reminder message is displayed, and the fifth reminder message is used to remind the user that the prohibited behavior has been implemented or the skin care check-in plan has not been completed.

[0029] In this embodiment, the electronic device can determine whether the user has performed prohibited actions in the skin care check-in plan based on the acquired second target information, and can remind or punish the user based on the judgment result, thereby achieving user supervision.

[0030] In one possible implementation, the skin care clock-in method further includes:

[0031] receiving a fourth operation input by a user;

[0032] In response to a fourth operation, acquiring a facial image of a user;

[0033] Based on the facial image, obtaining a facial image analysis result, and based on the facial image analysis result, displaying at least one skin care check-in plan;

[0034] receiving a fifth operation input by the user, where the fifth operation is used to select a skin care check-in plan that the user has not participated in;

[0035] In response to the received fifth operation, a skin care check-in plan is added.

[0036] In this embodiment, the user can participate in the skin care check-in plan as needed based on the skin test results of the electronic device, thereby improving the user experience.

[0037] In a second aspect, the present application provides an electronic device, including a processor and a storage device, wherein the storage device stores an application program, and when the application program is executed by the processor, the electronic device executes the method shown in the first aspect.

[0038] In a third aspect, the present application provides a computer-readable storage medium, in which a computer program is stored. When the computer-readable storage medium is run on a computer, the computer executes the method described in the first aspect.

[0039] In a fourth aspect, the present application provides a computer program, which, when executed by a computer, is used to execute the method described in the first aspect. BRIEF DESCRIPTION OF THE DRAWINGS

[0040] Figure 1 A schematic diagram of the structure of an electronic device 100 provided in one embodiment of the present application;

[0041] Figure 2 is a software structure block diagram of the electronic device 100 according to an embodiment of the present application;

[0042] Figure 3 (a)-(c) are graphical interfaces of the skin care clock-in method provided in the embodiments of the present application;

[0043] Figure 4 (a)-(e) are graphical interfaces of another skin care check-in method provided in an embodiment of the present application;

[0044] Figure 5 (a)-(l) are graphical interfaces of another skin care check-in method provided in an embodiment of the present application;

[0045] Figure 6 (a)-(e) are graphical interfaces of another skin care check-in method provided in an embodiment of the present application;

[0046] Figure 7 (a)-(b) are graphical interfaces of another skin care check-in method provided in an embodiment of the present application;

[0047] Figure 8 (a)-(b) are graphical interfaces of another skin care check-in method provided in an embodiment of the present application;

[0048] Fig. 9 (a)-(b) are graphical interfaces of another skin care check-in method provided in an embodiment of the present application;

[0049] Fig.10 (a)-(b) are graphical interfaces of another skin care check-in method provided in an embodiment of the present application;

[0050] Fig.11 is a flow chart of the skin care clock-in method provided in an embodiment of the present application;

[0051] Fig.12 is a flow chart of a skin care clock-in method provided by another embodiment of the present application;

[0052] Fig.13 This is a flow chart of a skin care clock-in method provided in another embodiment of the present application. DETAILED DESCRIPTION

[0053] The technical solution in the embodiment of the present application will be described below in conjunction with the drawings in the embodiment of the present application. In the description of the embodiment of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is only a description of the association relationship of associated objects, indicating that there can be three relationships, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone.

[0054] In the following, the terms "first" and "second" are used for descriptive purposes only and are not to be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of the features. In the description of the embodiments of the present application, unless otherwise specified, "plurality" means two or more.

[0055] Skin detection activities are to detect fine lines, nasolabial folds, dark circles, red areas, acne, pores, spots, blackheads and other features of the user's facial skin through means such as photographing and imaging, and evaluate, score and grade the user's facial skin through pattern recognition, image analysis, machine learning, deep learning and other methods to give corresponding care suggestions. While detecting the skin, users also have an urgent need for skin care methods.

[0056] In order to help users develop facial care habits and guide users to perform correct care, a variety of care plans and care video tutorials have been designed. After users join a skin care check-in plan, they are prompted to enter a reminder time, and a message is pushed to the user at the set time to remind them to perform skin care. After receiving the reminder, the user performs skin care operations according to the skin care video tutorial. After completing these skin care operations, the user needs to check in on the designated page to complete the check-in process, otherwise the system will consider that the user has not completed the check-in for the day.

[0057] In the above skin care punch-in scheme, the reminder time is too fixed. At the set time, the user may be driving or on the way to work, and does not have the conditions for skin care, so the effect of reminding the user of skin care is not good. In addition, after completing the skin care, the user needs to punch in on the guidance page, which puts a certain burden on the user. Not only that, the above skin care punch-in scheme does not track the user's skin care behavior, and cannot detect whether the user has implemented unreasonable skin care behavior, and thus cannot prompt the user to terminate the unreasonable skin care in time.

[0058] The embodiment of the present application provides a skin care punch-in method, in which a user can select a skin care punch-in plan to participate in, and judge whether the skin care punch-in behavior conditions are met according to the user's current state. If the skin care conditions are met, the user is prompted to punch in for skin care, and if the skin care conditions are not met, the prompt to the user is postponed to a time period when the skin care conditions are met; when the user punches in for skin care, the user's actions are identified to judge whether the user's skin care behavior meets the action requirements, and the skin care punch-in is automatically completed if the action requirements are met. The technical solution provided by the present application can intelligently remind the user to take care of the skin according to the user's current state and supervise the user's skin care behavior; at the same time, the skin care behavior implemented by the user can also be automatically checked in, reducing the time cost incurred by the user in implementing the skin care behavior and improving the user's satisfaction.

[0059] The skin care clock-in method provided in the embodiment of the present application can be applied to electronic devices such as mobile phones, tablet computers, wearable devices, vehicle-mounted devices, augmented reality (AR) / virtual reality (VR) devices, laptop computers, ultra-mobile personal computers (UMPC), netbooks, personal digital assistants (PDA), etc.

[0060] Figure 1 Schematic diagram of the structure of an electronic device 100 according to an embodiment of the present application.

[0061] The electronic device 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, an antenna 1, an antenna 2, a mobile communication module 150, a wireless communication module 160, an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, a sensor module 180, a button 190, a motor 191, an indicator 192, a camera 193, a display screen 194, and a subscriber identification module (SIM) card interface 195, etc. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, an ambient light sensor 180L, a bone conduction sensor 180M, etc.

[0062] It is to be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the electronic device 100. In other embodiments of the present application, the electronic device 100 may include more or fewer components than shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0063] The processor 110 may include one or more processing units, for example, the processor 110 may include an application processor (AP), a modem processor, a graphics processor (GPU), an image signal processor (ISP), a controller, a video codec, a digital signal processor (DSP), a baseband processor, and / or a neural-network processing unit (NPU), etc. Among them, different processing units may be independent devices or integrated into one or more processors. The controller may generate an operation control signal according to the instruction opcode and the timing signal to complete the control of fetching and executing instructions.

[0064] A memory may also be provided in the processor 110 for storing instructions and data. It is understood that the memory in the processor may store one or more instructions, and when the processor executes the one or more instructions, the electronic device may determine whether the user currently meets the preset implementation conditions for implementing the skin care punch-in plan described below, or determine whether the user's behavior matches the demonstration action in the skin care punch-in plan, or determine whether the user has implemented a prohibited behavior, etc., based on information received by other electronic devices or information reported by various sensors of the electronic device 100.

[0065] In some embodiments, the memory in the processor 110 is a cache memory. The memory can store instructions or data that have just been used or are used cyclically by the processor 110. If the processor 110 needs to use the instruction or data again, it can be directly called from the memory. This avoids repeated access, reduces the waiting time of the processor 110, and thus improves the efficiency of the system.

[0066] The wireless communication function of the electronic device 100 can be implemented through the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modulation and demodulation processor, and the baseband processor. The electronic device 100 can use the wireless communication function to communicate with other peripherals and exchange information. For example, the electronic device 100 uses the wireless communication function to communicate with devices such as beauty mirrors, car machines, or sports bracelets to obtain information obtained by devices such as beauty mirrors or sports bracelets.

[0067] Antenna 1 and antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in electronic device 100 can be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve the utilization of antennas. For example, antenna 1 can be reused as a diversity antenna for a wireless local area network.

[0068] The wireless communication module 160 can provide wireless communication solutions including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) networks), bluetooth (BT), global navigation satellite system (GNSS), frequency modulation (FM), near field communication (NFC), infrared (IR), etc., which are applied to the electronic device 100. The wireless communication module 160 can be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2, modulates the frequency of the electromagnetic wave signal and performs filtering, and sends the processed signal to the processor 110. The wireless communication module 160 can also receive the signal to be sent from the processor 110, modulate the frequency of it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2.

[0069] The electronic device 100 implements the display function through a GPU, a display screen 194, and an application processor. The GPU is a microprocessor for image processing, which connects the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. The processor 110 may include one or more GPUs that execute program instructions to generate or change display information.

[0070] The display screen 194 is used to display images, videos, etc. The display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (AMOLED), a flexible light-emitting diode (FLED), Miniled, MicroLed, Micro-oLed, a quantum dot light-emitting diode (QLED), etc. In some embodiments, the electronic device 100 may include 1 or N display screens 194, where N is a positive integer greater than 1.

[0071] The electronic device 100 can realize the shooting function through ISP, camera 193, video codec, GPU, display screen 194 and application processor.

[0072] ISP is used to process the data fed back by camera 193. For example, when taking a photo, the shutter is opened, and the light is transmitted to the camera photosensitive element through the lens. The light signal is converted into an electrical signal, and the camera photosensitive element transmits the electrical signal to ISP for processing and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on the noise, brightness, and skin color of the image. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, ISP can be set in camera 193.

[0073] The camera 193 is used to capture still images or videos. The object generates an optical image through the lens and projects it onto the photosensitive element. The photosensitive element can be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to be converted into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. The DSP converts the digital image signal into an image signal in a standard RGB, YUV or other format. In some embodiments, the electronic device 100 may include 1 or N cameras 193, where N is a positive integer greater than 1.

[0074] The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 100. The external memory card communicates with the processor 110 through the external memory interface 120 to implement a data storage function, such as storing music, video and other files in the external memory card.

[0075] The internal memory 121 can be used to store computer executable program codes, which include instructions. The internal memory 121 may include a program storage area and a data storage area. Among them, the program storage area may store an operating system, an application required for at least one function (such as a sound playback function, an image playback function, etc.), etc. The data storage area may store data created during the use of the electronic device 100 (such as audio data, a phone book, etc.), etc. In addition, the internal memory 121 may include a high-speed random access memory, and may also include a non-volatile memory, such as at least one disk storage device, a flash memory device, a universal flash storage (UFS), etc. The processor 110 executes various functional applications and data processing of the electronic device 100 by running instructions stored in the internal memory 121, and / or instructions stored in a memory provided in the processor.

[0076] The electronic device 100 can implement audio functions such as music playing and recording through the audio module 170, the speaker 170A, the receiver 170B, the microphone 170C, the headphone jack 170D, and the application processor.

[0077] The audio module 170 is used to convert digital audio information into analog audio signal output, and is also used to convert analog audio input into digital audio signals. The audio module 170 can also be used to encode and decode audio signals. In some embodiments, the audio module 170 can be arranged in the processor 110, or some functional modules of the audio module 170 can be arranged in the processor 110.

[0078] The speaker 170A, also called a "speaker", is used to convert an audio electrical signal into a sound signal. The electronic device 100 can listen to music or listen to a hands-free call through the speaker 170A.

[0079] The receiver 170B, also called a "earpiece", is used to convert audio electrical signals into sound signals. When the electronic device 100 receives a call or voice message, the voice can be received by placing the receiver 170B close to the human ear.

[0080] Microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can speak by putting their mouth close to microphone 170C to input the sound signal into microphone 170C. The electronic device 100 can be provided with at least one microphone 170C. In other embodiments, the electronic device 100 can be provided with two microphones 170C, which can not only collect sound signals but also realize noise reduction function. In other embodiments, the electronic device 100 can also be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify the sound source, realize directional recording function, etc.

[0081] The earphone interface 170D is used to connect a wired earphone and can be a USB interface 130 or a 3.5 mm open mobile terminal platform (OMTP) standard interface or a cellular telecommunications industry association of the USA (CTIA) standard interface.

[0082] The pressure sensor 180A is used to sense the pressure signal and can convert the pressure signal into an electrical signal. In some embodiments, the pressure sensor 180A can be set on the display screen 194. There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, etc. The capacitive pressure sensor can be a parallel plate including at least two conductive materials. When a force acts on the pressure sensor 180A, the capacitance between the electrodes changes. The electronic device 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the electronic device 100 detects the touch operation intensity according to the pressure sensor 180A. The electronic device 100 can also calculate the touch position according to the detection signal of the pressure sensor 180A. In some embodiments, touch operations acting on the same touch position but with different touch operation intensities can correspond to different operation instructions. For example: when a touch operation with a touch operation intensity less than the first pressure threshold acts on the short message application icon, an instruction to view the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, an instruction to create a new short message is executed.

[0083] The gyro sensor 180B can be used to determine the motion posture of the electronic device 100. In some embodiments, the angular velocity of the electronic device 100 around three axes (i.e., x, y, and z axes) can be determined by the gyro sensor 180B. The gyro sensor 180B can be used for anti-shake shooting. For example, when the shutter is pressed, the gyro sensor 180B detects the angle of the electronic device 100 shaking, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shaking of the electronic device 100 through reverse movement to achieve anti-shake. The gyro sensor 180B can also be used for navigation and somatosensory game scenes.

[0084] The air pressure sensor 180C is used to measure air pressure. In some embodiments, the electronic device 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist positioning and navigation.

[0085] The magnetic sensor 180D includes a Hall sensor. The electronic device 100 can use the magnetic sensor 180D to detect the opening and closing of the flip leather case. In some embodiments, when the electronic device 100 is a flip phone, the electronic device 100 can detect the opening and closing of the flip cover according to the magnetic sensor 180D. Then, according to the detected opening and closing state of the leather case or the opening and closing state of the flip cover, the flip cover can be automatically unlocked.

[0086] The accelerometer 180E can detect the magnitude of the acceleration of the electronic device 100 in all directions (generally three axes). When the electronic device 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the electronic device, and is applied to applications such as horizontal and vertical screen switching, pedometers, etc. The accelerometer can assist the electronic device 100 in obtaining at least one target information in the present application. For example, the amplitude and strength of the user's movement can be calculated by the magnitude of acceleration. After obtaining the target information, the accelerometer can report it to the application processor. The application processor determines whether the user meets the preset implementation conditions for implementing the skin care check-in plan, or whether the user's behavior matches the demonstration action of the skin care check-in plan based on the target information reported by the accelerometer.

[0087] The distance sensor 180F is used to measure the distance. The electronic device 100 can measure the distance by infrared or laser. In some embodiments, when shooting a scene, the electronic device 100 can use the distance sensor 180F to measure the distance to achieve fast focusing.

[0088] The proximity light sensor 180G may include, for example, a light emitting diode (LED) and a light detector, such as a photodiode. The light emitting diode may be an infrared light emitting diode. The electronic device 100 emits infrared light outward through the light emitting diode. The electronic device 100 uses a photodiode to detect infrared reflected light from nearby objects. When sufficient reflected light is detected, it can be determined that there is an object near the electronic device 100. When insufficient reflected light is detected, the electronic device 100 can determine that there is no object near the electronic device 100. The electronic device 100 can use the proximity light sensor 180G to detect that the user holds the electronic device 100 close to the ear to talk, so as to automatically turn off the screen to save power. The proximity light sensor 180G can also be used in leather case mode and pocket mode to automatically unlock and lock the screen.

[0089] The ambient light sensor 180L is used to sense the ambient light brightness. The electronic device 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness. The ambient light sensor 180L can also be used to automatically adjust the white balance when taking pictures. The ambient light sensor 180L can also cooperate with the proximity light sensor 180G to detect whether the electronic device 100 is in a pocket to prevent accidental touches.

[0090] The fingerprint sensor 180H is used to collect fingerprints. The electronic device 100 can use the collected fingerprint characteristics to implement fingerprint unlocking, access application locks, fingerprint photography, fingerprint call answering, etc.

[0091] The temperature sensor 180J is used to detect temperature. In some embodiments, the electronic device 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold, the electronic device 100 reduces the performance of a processor located near the temperature sensor 180J to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 heats the battery 142 to avoid abnormal shutdown of the electronic device 100 due to low temperature. In other embodiments, when the temperature is lower than another threshold, the electronic device 100 performs a boost on the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

[0092] The touch sensor 180K is also called a "touch control device". The touch sensor 180K can be set on the display screen 194, and the touch sensor 180K and the display screen 194 form a touch screen, also called a "touch screen". The touch sensor 180K is used to detect touch operations acting on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to the touch operation can be provided through the display screen 194. In other embodiments, the touch sensor 180K can also be set on the surface of the electronic device 100, which is different from the position of the display screen 194. The touch sensor can assist the electronic device 100 in obtaining at least one target information in the present application. For example, the touch sensor can detect the user's touch action to determine whether the user is currently using the electronic device 100, and report the user's touch information to the application processor. The application processor determines whether the user meets the preset implementation conditions for implementing the skin care punch card plan, or whether the user's behavior matches the demonstration action of the skin care punch card plan, or whether the user's behavior matches the prohibited behavior of the skin care punch card plan, etc. according to the target information reported by the touch sensor.

[0093] The bone conduction sensor 180M can obtain a vibration signal. In some embodiments, the bone conduction sensor 180M can obtain a vibration signal of a vibrating bone block of the vocal part of the human body. The bone conduction sensor 180M can also contact the human pulse to receive a blood pressure beat signal. In some embodiments, the bone conduction sensor 180M can also be set in an earphone and combined into a bone conduction earphone. The audio module 170 can parse out a voice signal based on the vibration signal of the vibrating bone block of the vocal part obtained by the bone conduction sensor 180M to realize a voice function. The application processor can parse the heart rate information based on the blood pressure beat signal obtained by the bone conduction sensor 180M to realize a heart rate detection function. The bone conduction sensor 180M can assist the electronic device 100 in obtaining at least one target information in the present application. For example, the bone conduction sensor 180M can detect the user's heart rate information to determine whether the user is currently exercising and the intensity of the exercise, and report the target to the application processor. The application processor determines whether the user meets the preset implementation conditions for implementing the skin care check-in plan based on the target information reported by the bone conduction sensor 180M, or whether the user's behavior matches the demonstration action of the skin care check-in plan, or whether the user's behavior is inconsistent with the prohibited behavior of the skin care check-in plan, etc.

[0094] The key 190 includes a power key, a volume key, etc. The key 190 may be a mechanical key or a touch key. The electronic device 100 may receive key input and generate key signal input related to user settings and function control of the electronic device 100.

[0095] Motor 191 can generate vibration prompts. Motor 191 can be used for incoming call vibration prompts, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as taking pictures, audio playback, etc.) can correspond to different vibration feedback effects. For touch operations acting on different areas of the display screen 194, motor 191 can also correspond to different vibration feedback effects. Different application scenarios (for example: time reminders, receiving messages, alarm clocks, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

[0096] Indicator 192 may be an indicator light, which may be used to indicate charging status, power changes, messages, missed calls, notifications, etc.

[0097] The software system of the electronic device 100 may adopt a layered architecture, an event-driven architecture, a micro-core architecture, a micro-service architecture, or a cloud architecture. In the embodiment of the present invention, the Android system of the layered architecture is taken as an example to exemplify the software structure of the electronic device 100.

[0098] It is understandable that Figure 1 The illustrated structure does not constitute a specific limitation on the electronic device 100. In other embodiments of the present invention, the electronic device 100 may include more or fewer components than those shown in the figure, or combine some components, or separate some components, or arrange the components differently. The components shown in the figure may be implemented in hardware, software, or a combination of software and hardware.

[0099] Figure 2 1 is a software structure block diagram of the electronic device 100 according to an embodiment of the present invention.

[0100] The layered architecture divides the software into several layers, each with clear roles and division of labor. The layers communicate with each other through software interfaces. In some embodiments, the Android system is divided into four layers, from top to bottom: the application layer, the application framework layer, the Android runtime and system library, and the kernel layer.

[0101] The application layer can include a series of application packages.

[0102] like Figure 2 As shown, the application package may include camera, gallery, calendar, call, skin care, navigation, WLAN, Bluetooth, music, video, short message and other applications.

[0103] The application framework layer provides an application programming interface (API) and a programming framework for the applications in the application layer. The application framework layer includes some predefined functions.

[0104] like Figure 2 As shown, the application framework layer may include a window manager, a content provider, a view system, a phone manager, a resource manager, a notification manager, and the like.

[0105] The window manager is used to manage window programs. The window manager can obtain the display screen size, determine whether there is a status bar, lock the screen, capture the screen, etc.

[0106] Content providers are used to store and retrieve data and make it accessible to applications. The data may include videos, images, audio, calls made and received, browsing history and bookmarks, phone books, etc.

[0107] The view system includes visual controls, such as controls for displaying text, controls for displaying images, etc. The view system can be used to build applications. A display interface can be composed of one or more views. For example, a display interface including a text notification icon can include a view for displaying text and a view for displaying images.

[0108] The phone manager is used to provide communication functions of the electronic device 100, such as management of call status (including connecting, hanging up, etc.).

[0109] The resource manager provides various resources for applications, such as localized strings, icons, images, layout files, video files, and so on.

[0110] The notification manager enables applications to display notification information in the status bar. It can be used to convey notification-type messages and can disappear automatically after a short stay without user interaction. For example, the notification manager is used to notify download completion, message reminders, etc. The notification manager can also be a notification that appears in the system top status bar in the form of a chart or scroll bar text, such as notifications of applications running in the background, or a notification that appears on the screen in the form of a dialog window. For example, a text message is displayed in the status bar, a prompt sound is emitted, an electronic device vibrates, an indicator light flashes, etc.

[0111] Android Runtime includes core libraries and virtual machines. Android runtime is responsible for scheduling and management of the Android system.

[0112] The core library consists of two parts: one part is the function that needs to be called by the Java language, and the other part is the Android core library.

[0113] The application layer and the application framework layer run in a virtual machine. The virtual machine executes the Java files of the application layer and the application framework layer as binary files. The virtual machine is used to perform functions such as object life cycle management, stack management, thread management, security and exception management, and garbage collection.

[0114] The system library may include multiple functional modules, such as surface manager, media library, 3D graphics processing library (such as OpenGL ES), 2D graphics engine (such as SGL), etc.

[0115] The surface manager is used to manage the display subsystem and provide the fusion of 2D and 3D layers for multiple applications.

[0116] The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc.

[0117] The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, compositing, and layer processing.

[0118] A 2D graphics engine is a drawing engine for 2D drawings.

[0119] The kernel layer is the layer between hardware and software. The kernel layer contains at least display driver, camera driver, audio driver, and sensor driver.

[0120] The following is an example of the workflow of the software and hardware of the electronic device 100, using the scenario of taking photos to test the skin.

[0121] When the touch sensor 180K receives a touch operation, the corresponding hardware interrupt is sent to the kernel layer. The kernel layer processes the touch operation into an original input event (including touch coordinates, timestamp of the touch operation, and other information). The original input event is stored in the kernel layer. The application framework layer obtains the original input event from the kernel layer and identifies the control corresponding to the input event. For example, the touch operation is a touch single-click operation, and the control corresponding to the single-click operation is the control of the "Skin Care Application 301" application icon in the following embodiment (see Figure 3 a), the skin care application calls the interface of the application framework layer to start the skin care application; if the user clicks the "skin test" option 4031 (see Figure 4 a), the skin care application calls the interface of the application framework layer, and then starts the camera driver by calling the kernel layer, and captures static images or videos through the camera 193.

[0122] For ease of understanding, the following Figure 1 and Figure 2 Taking the mobile phone with the structure shown as an example, the skin care clock-in method disclosed in this application is explained and illustrated.

[0123] Figure 3: is a schematic diagram of a graphical user interface (GUI) of a skin care clock-in method provided in an embodiment of the present application. Figure 3 Figure (a) shows the interface content 30 output by the mobile phone when it is turned on, and the interface content 30 displays multiple applications (applications, Apps), such as clock, calendar, settings, memo, weather, application market, gallery, and skin care application 301. It should be understood that the interface content 30 may also include other more applications, which is not limited in the embodiment of the present application.

[0124] like Figure 3 As shown in (a) of FIG. 1 , the user clicks the icon of the skin care application 301, and the mobile phone responds to the user's click operation and opens the skin care application 301. After the skin care application 301 is installed, when the skin care application 301 is opened for the first time, some precautions for using the skin care application 301 may be displayed. Figure 3 Figure (b) shows the precautions for using skin care applications, which can be explained to users through images and texts, such as Figure 3 As shown in Figure (b), when using a mobile phone’s built-in camera to take a photo for skin testing, the distance should be about 30 cm.

[0125] The user can view more instructions for using the skin care application 301 by sliding in a specified direction on the mobile phone screen. Figure 3 As shown in (c), it is recommended to keep the face clean and try not to wear makeup when taking images, or the acquired skin detection data will not be used for other applications, etc. It can be understood that in order to further simplify the burden on users, the above precautions can also be automatically switched.

[0126] In a possible implementation, after the user opens the skin care application 301, when it is not the first time entering the skin care application 301, the user can view the skin care precautions in other ways, for example, by clicking other buttons on the interface to view the skin care precautions.

[0127] After reading the precautions, the user can click to enter the application 302 to display the main interface of the skin care application 301. Figure 4 It is a graphical interface of another skin care clock-in method provided in the embodiment of the present application. Figure 4 Figure (a) shows the main interface 400 of the skin care application. The main interface 400 of the skin care application may include a function name 402, a check-in list 404, and a navigation bar 403, wherein: the function name 402 may be used to indicate the application currently opened on the machine, such as the skin care application of the machine. The check-in list 404 indicates the check-in plan that the user has joined. The navigation bar 403 may include various function menus, such as Figure 4As shown in Figure (a), there is a "Home" key for viewing the main page of the skin care application, a "Record" key for viewing the user's skin care records, a Skin Test 406 key for acquiring and detecting images, and a My 408 key for personal account management.

[0128] Exemplarily, the user can click the skin test 406 button to enter the interface for obtaining the user image. Figure 4 Figure (b) in the figure shows an interface for acquiring user images. The user can click the capture button 412 in the interface to make the mobile phone respond to the user's click operation, capture the user's image, and analyze the captured image to recommend a skin care check-in plan to the user based on the analysis results. If the image displayed on the current interface is an image captured by the rear camera, and the user wants to take a selfie to capture a facial image, the user can click the swap button 414 to switch the rear camera to the front camera for shooting. Alternatively, the user can click the gallery 410 to make the mobile phone acquire the image selected by the user from the local gallery 410 and analyze the image to recommend a skin care check-in plan to the user based on the analysis results.

[0129] After the skin care application analyzes the image (the specific analysis method is detailed below), it displays an interface diagram of a recommended skin care check-in plan based on the analysis results. For example, if the analysis shows that the user has blackheads on his face, a blackhead removal check-in plan can be recommended in the display interface. Figure 4 The middle figure (c) exemplarily shows that check-in plans such as "removing blackheads", "removing acne", "lightening fine lines", "removing eye bags" and "moisturizing" are recommended to users. Users can choose according to their needs to join the check-in plan. Figure 4 In the middle (c) figure, the user clicks the add button 418 to add the "lighten fine lines" check-in plan, and clicks the add button 420 to add the "replenish water" check-in plan as needed. Figure 4 In the middle (d) picture, the status of "lighten fine lines" and "replenish moisture" in the check-in plan recommendation list have both changed to "added".

[0130] Continue to see Figure 4 In the middle (c) figure, the user can click the "Home" button 422 to return to the main interface of the skin care application 301 and view the punch-in plan that has been added in the punch-in list 404. Figure 4 Figure (e) shows the main interface of the skin care application 301 after the user adds a skin care check-in plan. Due to the user's above-mentioned addition operation, two check-in plans, "lighten fine lines" and "replenish moisture", are added to the check-in list.

[0131] It should be noted that skin care applications are not limited to recommending skin care check-in plans to users after "skin testing" and letting users choose the plans recommended by skin care applications. Skin care check-in plans can also be added in other ways. Figure 5, is a graphical interface of another skin care check-in method provided in an embodiment of the present application. Figure 5 In the middle (a) figure, the user can click the add plan 504 button to add a skin care check-in plan. Figure 5 In the middle (b) figure, after the user clicks on the new plan 504, the machine responds to the user's click operation, and the graphical interface displays all the skin care check-in plans included in the skin care application, and the user can select according to the needs. Figure 5 In Figure (b), the user can swipe down to view and add more skin care check-in plans. Among them, the two check-in plans of "lightening fine lines" and "hydrating" have been added. The user can click the add button to add other check-in plans except "lightening fine lines" and "hydrating" as needed. As shown in Figures (c) and (d), the user clicks the add button 506 of the "acne removal" check-in plan, making the status of "acne removal" in the check-in plan recommendation list become "added". After the user adds a skin care check-in plan, the check-in list of the main interface 400 of the skin care application will change accordingly. Figure 5 In the graphical interface shown in Figure (d), the user can click the home button to view the punch-in plan list on the main interface. For example, the user clicks the home button 508 and then jumps to Figure 5 In the graphical interface in Figure (e), the check-in plan list 404 of the main interface 40 displays the "acne removal", "lightening fine lines" and "hydration" skin care check-in plans that the user has added.

[0132] It should be noted that users can choose to delete the skin care check-in plan they have joined. Figure 5 As shown in Figure (e), the user clicks the edit button 510 to call up the interface for deleting the skin care check-in plan and delete the unnecessary skin care check-in plan. Figure 5 Figure (f) shows an exemplary interface for deleting a punch-in plan. The user clicks the delete button 512 corresponding to the "acne removal" skin care punch-in plan to delete the "acne removal" skin care punch-in plan that has been added. After deleting the "acne removal" punch-in plan, the user enters the Figure 5 The interface shown in Figure (g).

[0133] After adding a skin care check-in plan, users can view the check-in plan in the check-in list in real time. Figure 5In the graphical interface shown in (g), the user clicks the lighten fine lines button, and the skin care application responds to the user's click operation and displays the demonstration actions under the lighten fine lines punch-in plan. It should be noted that each skin care punch-in plan can be regarded as a skin care mode. For example, the "lighten fine lines" punch-in plan is regarded as a skin care mode, and the "remove blackheads" punch-in plan is regarded as a skin care mode. Each skin care mode includes at least one demonstration action, which is used to solve or improve the user's skin problems, or to maintain the user's skin. Each demonstration action includes, but is not limited to, a set of continuous action combinations, or, a behavior. For example, see Figure 5 In the interface shown in Figure (h), the demonstration actions under the fine lines reduction plan include "eye massage", "facial massage" and "early to bed and early to rise". It can be understood that "eye massage" and "facial massage" are a combination of continuous actions, and "early to bed and early to rise" is a behavior. For a combination of continuous actions, users can learn through videos. For example, users can click the learning button in "eye massage" to enter Figure 5 The interface shown in Figure (i) includes a video tutorial on eye massage. The user can click the play button corresponding to the canthus massage video to watch and learn the teaching video on canthus massage, or click the play button corresponding to the end of the eye massage video to watch and learn the corresponding teaching video on end of the eye massage.

[0134] After learning the demonstration actions in the skin care mode, users can click Figure 5 The start 514 key in (i) is used to implement the demonstration action associated with the eye massage for reducing fine lines. Of course, the user can also return to Figure 5 In the interface shown in Figure (h), click the start 502 key to implement the demonstration action associated with the eye massage under the fine lines reduction plan. Specifically, after the user clicks the start 514 / 502 key, the Figure 5 In the graphical interface shown in (j), the skin care application uses the camera of the mobile phone to detect and obtain the user's behavior and actions in real time, and then matches the user's behavior and actions with the demonstration actions related to eye massage under the plan for reducing fine lines. If the behavior and actions implemented by the user match the demonstration actions of eye massage, the demonstration action "eye massage" is checked in. In this skin care application, if the user's behavior and actions match at least one demonstration action, then after completing the eye massage, the status of the "reducing fine lines" plan in the skin care check-in plan on the main interface of the skin care application is changed to "checked in". For example, after the user completes the demonstration action "eye massage" under the plan for reducing fine lines, Figure 5 As shown in Figure (k), the graphical interface of the skin care application reminds the user that the eye massage action under "lightening fine lines" has been completed. After the user clicks the "home" button, it returns to the main page of the skin care application. For example, Figure 5As shown in the middle (l) figure, the status of the "lighten fine lines" plan is also changed to "checked in" accordingly. The skin care check-in method provided in this embodiment does not require the user to manually change the status to checked in on the main interface, but automatically matches the user's behavior and action, and helps the user complete the check-in when the user's behavior and action match the eye massage demonstration action, thereby improving the user experience.

[0135] It is understandable that since the "lighten fine lines" plan also includes the "facial massage" action, it can be set that the user needs to complete the facial massage after completing the eye massage, and the skin care application will change the status of the "lighten fine lines" plan to "checked in" accordingly. Although the user has joined the skin care check-in plan, the user cannot check in for skin care at any time and any place every day. For example, it is not suitable for the user to perform skin care while driving. In the related art, the method of reminding users to perform skin care by timing is not scientific and convenient. Therefore, the skin care application needs to be more intelligent.

[0136] In order to further reduce the user's punch-in burden, the skin care application in the embodiment of the present application can provide smart punch-in, which is executed according to the preset implementation conditions. The preset implementation conditions are pre-set by the skin care application and are used to indicate that the user currently has the conditions to implement the skin care punch-in plan. Each skin care punch-in plan joined by the user has a specific preset implementation condition, which is composed of the implementation conditions required for each demonstration action under the skin care punch-in plan. The preset implementation condition is determined according to the first target information, and the first target information includes but is not limited to the user's location, current time, content recorded in other applications (such as calendar schedule), and other related information. Exemplarily, the user sets a reminder to the user to perform skin care at a specified time in the skin care application. At the specified time, the skin care application obtains the user's location information, such as the user is currently in the office, and infers that the user is likely to be at work and is not suitable for skin care punch-in, so it can remind the user whether to postpone skin care. In addition, after setting up smart check-in, the skin care application can also turn on the camera in the background, or obtain images or other information of the user's movements and behaviors through the cameras of other electronic devices connected to this machine, to detect whether the user has implemented the demonstration actions under the skin care check-in plan. When it is detected that the user has completed the demonstration actions under the skin care check-in plan, the completed skin care check-in plan status will be automatically changed to checked in on the main page of the skin care application.

[0137] Figure 6 (a)-6(e) are schematic diagrams of the graphical interface of the skin care clock-in method provided in the embodiment of the present application. The user can set up smart clock-in in the skin care application. For example, the user can Figure 6 In the graphical interface described in (a), click the "My" button to enter Figure 6The graphical interface shown in (b) includes an indicator bar 602 for indicating the user account and experience value. Every time the user completes a check-in for a skin care plan, the experience value can be increased. Figure 6 (b) also includes a "Smart Check-in Settings" button for setting smart check-in. The smart check-in function in the skin care application requires permissions such as obtaining the location of the local device and accessing other applications. Users can click the "Smart Check-in Settings" button to enter Figure 6 The graphical interface shown in Figure (c) includes the "Location" key for obtaining location permissions, the "Voice Input and Reminder" key for obtaining voice input and reminder permissions, the "Access Other Applications" key for obtaining access to other applications, the "My Devices" key for managing external devices connected to the device, and the "Time Settings" key for setting time reminders for each skin care clock-in plan. The skin care application can implement smart clock-in only after obtaining the above permissions.

[0138] In order to better achieve the effect of smart clocking in, this machine can be combined with other external devices to provide users with a more intelligent experience. Figure 6 (c) The user can click the "My Device" button to manage the external devices connected to the machine. The machine responds to the user's click and jumps to Figure 6 The graphical interface shown in Figure (d) includes multiple display areas, such as the Add Device 604 area and the My Device 606 area, where the Add Device 604 area is used to add more connectable devices, such as sensor devices, etc. The My Device 606 area is used to display the devices that have been added and their connection status with the machine. For example, the devices that have been added to the machine include a beauty mirror and a bracelet, where the bracelet is disconnected from the mobile phone. When the bracelet is connected to the mobile phone, the acquired user-related data can be reported to the skin care application in the mobile phone, and the data includes but is not limited to pulse data, heart rate data, etc. The user can also click on the beauty mirror to view the status information and usage guide of the beauty mirror. For example, Figure 6 As shown in Figure (e), the beauty mirror is connected to the mobile phone, and the connection method between the beauty mirror and the mobile phone may include WiFi connection or Bluetooth connection. The user can view how to use the beauty mirror through the user guide, and can also turn on the Bluetooth disconnection reminder. These peripheral devices connected to the machine can assist the skin care application in the machine to detect and obtain the user's behavior and status information. For example, when the user performs skin care actions, the user's image information can be obtained through the camera in the beauty mirror, and then sent to the machine for analysis and matching. Through these external devices, the user does not have to use the camera of the machine to obtain the user's image and other information.

[0139] It should be noted that more devices can be added to detect or obtain the information required for skin care applications, and there is no limitation here.

[0140] continue Figure 6 In the middle (c) figure, the user can click "Time Settings" to set the reminder time, and the machine responds to the user's click operation to enter Figure 7 The interface shown in Figure (a) is a graphical interface where users can set time reminders for skin care check-in plans that have been added. For example, the time reminder for the fine lines reduction check-in plan has been enabled, and a reminder is set to be made at 15:00 on Monday and Tuesday every week to reduce fine lines. Users can click the "adjust time" button 608 to enter Figure 7 (b) The interface shown in Figure 3 is used to adjust the time. In Figure 3, the user can click the week button 610 to increase or decrease the number of days per week to check in for the fine lines reduction plan, or click the time button 612 to adjust the daily reminder time. The user can confirm whether to adjust the daily reminder time by pressing the confirm button 614 or the cancel button 616.

[0141] Skin care applications in the above Figure 6 After setting the permissions required for smart punching in the interface (c), the first target information can be obtained at any time based on these permissions to determine whether the demonstration actions under each skin care punching plan meet the required specific preset implementation conditions. For example, the skin care application can determine whether the user meets the specific preset implementation conditions for implementing the fine line lightening punching plan by obtaining the location information and time information of the machine. For example, the machine can remind the user whether to implement the fine line lightening punching plan in the skin care application by obtaining the location of the machine as the user's home and the time as the reminder time set by the user. For another example, the skin care application can read the information of other devices connected to the machine to determine the user's status. For example, the user can read the user's heart rate, pulse and other information through a connected bracelet or a connectable device to determine the user's status. For example, if the user's heart rate is too fast and the pulse is beating violently, the user is likely to be exercising at this time, and it is not suitable to perform some demonstration actions under the skin care punching plan of the skin care application. For another example, the reminder time set by the user for a skin care clock-in for reducing fine lines is 15:00. If the location information obtained by the skin care application is the user's workplace or the skin care application finds out through accessing the user's calendar application that the user has a meeting scheduled at 15:00, then the user is likely to not have the conditions to perform the "eye massage" and "facial massage" demonstration actions in the clock-in plan for reducing fine lines. At this time, the skin care application will not remind the user to perform the clock-in plan for reducing fine lines in the skin care application, or remind the user whether to perform skin care at the next time node.

[0142] See also Figure 8, is another graphical interface of a skin care clock-in method provided in an embodiment of the present application, specifically, it relates to an example of a graphical interface for reminding a user whether to postpone clocking in when a skin care application determines that a demonstration action under a skin care clock-in plan does not meet a preset implementation condition. Figure 8 In the middle figure (a), suppose the reminder time for the "lighten fine lines" clock-in plan set by the user is 15:00. The skin care application accesses the schedule in the calendar application to determine that the user has a meeting scheduled at 15:00, and prompts the user in the local graphical interface whether to postpone the "lighten fine lines" clock-in. Figure 8 As shown in (a), the user clicks "Yes" to postpone the fine line check-in. After the user clicks "Yes" to postpone the check-in, the skin care application can display a graphical interface for adjusting the time, see Figure 8 (b) Users can Figure 8 In the graphical interface shown in (b), by clicking on time 812, the time for the next reminder to check in for fine lines is set. For example, the user sets the skin care application to remind the user to check in at 16:00. Of course, there may be other intelligent settings, for example, the user Figure 8 In (a), after confirming to postpone the clock-in, the skin care application will remind the user whether to clock-in for fine lines reduction after a preset time period. For example, the skin care application will remind the user whether to clock-in for fine lines reduction every half an hour or an hour.

[0143] In one example, the skin care application obtains the first target information again one hour later to determine whether the user meets the preset implementation conditions for implementing the fine lines lightening clock-in plan. Assuming that the user is at home by accessing the location information of the local device, and the beauty mirror detects that the user is in front of the beauty mirror, the beauty mirror can report this information to the skin care application. Fig. 9 (a), the skin care application can remind the user in the local graphical interface whether to check in for lightening fine lines through the beauty mirror. At this time, the user can click Yes 902 to confirm that the beauty mirror will be used to capture the user's skin care actions for skin care check-in. The beauty mirror can send the captured actions to the local machine, and the local machine can match the user's behavior actions received from the beauty mirror with the demonstration behavior actions under the lightening fine lines check-in. If they match, the check-in is completed. Fig. 9 (b) The skin care application prompts the user to complete the fine line reduction check-in in the graphical interface of the local machine. In this embodiment, the user does not need to open the skin care application in the local machine, and the user's actions can be captured by the camera of the local machine, which further improves the user experience.

[0144] It should be noted that the skin care application can also remind the user through voice whether to check in for fine lines reduction. The user can interact with the machine through voice to implement the fine lines reduction check-in plan. It can be found that after the user starts the smart check-in, the user does not need to enter the check-in page in the skin care application to operate, and according to the user's current state, the user is intelligently reminded whether to check in, which further improves the user experience.

[0145] In order to encourage users to actively complete the check-in, the skin care application can also detect whether the user has implemented prohibited behaviors, or whether the user's behavior is qualified relative to the demonstration behavior, wherein the prohibited behavior indicates the behavior or action other than the demonstration action under each skin care check-in plan, and specifically indicates the behavior that the user is not allowed to perform during the implementation of the check-in plan. Figure 5 In the middle (i) figure, the prohibited behavior under the fine lines reduction check-in plan is the behavior of "eating spicy" food. If it is detected that the user has performed the prohibited behavior, a certain number of points can be deducted to indicate the punishment for the user. At the same time, the user can be prompted in the graphical interface that the prohibited behavior has been performed. If the user performs the prohibited behavior, it can be regarded that the user has not completed the check-in for the fine lines reduction plan.

[0146] Skin care applications can determine whether a user has performed prohibited behaviors in a variety of ways. For example, skin care applications can determine whether a user has performed prohibited behaviors by accessing other applications. For example, for the behavior of eating spicy food, skin care applications can access the user's platform for social applications and determine whether the user has performed spicy food based on the food pictures and content posted by the user on the social application platform. Alternatively, skin care applications can determine whether a user has performed prohibited behaviors based on information obtained from other devices or the local device. For example, if the prohibited behavior is staying up late, the skin care application can obtain the time the user uses the local device to determine whether the user stays up late, or the skin care application can obtain information such as the user's pulse through a bracelet or other wearable device to determine whether the user stays up late, etc.

[0147] See also Fig.10 , shows a graphical interface diagram of an embodiment of the present application, assuming that the prohibited behavior in the hydration plan added by the user is sleeping late, and the sleeping time is after 22:00. Fig.10 (a) When the skin care application detects that the current time is 22:00, it can remind the user to go to sleep. The user can click Yes in the picture and go to sleep, thus completing the check-in for the hydration plan. However, the user may continue to do other things without going to sleep, that is, the user has implemented the prohibited behavior under the hydration plan. Exemplarily, the skin care application can confirm whether the user has implemented the behavior of staying up late by accessing the usage status of the machine. If the user is still using the machine after 22:00, the user can be reminded in the graphical interface of the machine that the corresponding prohibited behavior has been implemented. See Fig.10(b) If the skin care application detects that the user is still using the device at 00:00, it can remind the user that he / she has stayed up late, and the application will be regarded as checking in for the user who has not completed the hydration plan today.

[0148] It should be noted that when the skin care application detects that the user has performed a prohibited action, or the user's action is not up to standard compared to the demonstration action, the user can be reminded on the mobile phone's graphical interface. The reminder method includes but is not limited to voice reminder, such as Fig.10 Text reminders shown, etc.

[0149] In combination with the above embodiments and related drawings, the skin care check-in method is introduced from the user interaction level. Fig.11 , from the perspective of software implementation strategy, the skin care clock-in method provided by the embodiment of the present application is introduced. It should be understood that the method can be used in a system having Figure 1 The hardware structure shown in Figure 2 The software system architecture is implemented in electronic devices (such as mobile phones, tablet computers, etc.). Fig.11 is a schematic flow chart of a skin care clock-in method implemented by the electronic device provided in an embodiment of the present application, such as Fig.11 As shown, the method may include the following steps:

[0150] Step 1102, open the skin care application.

[0151] See also Figure 3 After installing the skin care application, when the user opens the skin care application for the first time, some precautions for using the skin care application can be displayed. Or when the skin care application is not entered for the first time, the precautions can be viewed from other interfaces of the skin care application. In response to the user's operation of opening the skin care application, the electronic device displays the following Figure 4 (a) or Figure 5 (a) Graphical user interface shown.

[0152] Step 1104, determine whether the user has completed the skin test.

[0153] After the skin care application is opened, the electronic device detects that the skin care application is opened for the first time by the user or Figure 4 (a) shows that the user has not participated in any skin care check-in plan, etc., and it is determined that the user has not completed the skin test. The electronic device can prompt the user to perform the skin test according to the fact that the user has not completed the skin test, and the prompt method includes a card reminder or a dynamic magnification display of the skin test 406 key. Figure 4 In the graphical interface shown, the user can also click the skin test 406 button without prompting to enter the skin test interface and obtain the user's facial image. The skin care application in the machine can analyze the user's facial image and generate a skin test result. The skin test result can indicate the user's skin problems.

[0154] Specifically, the user's skin test results can be obtained through deep learning or image comparison methods, and the user's skin problems can be determined.

[0155] Taking deep learning as an example, skin care applications can directly input the acquired images into a trained neural network model to analyze skin problems in the image. A method for training a neural network for analyzing images is given below, obtaining at least one image to be analyzed and a standard analysis image for each image to be analyzed, wherein each pixel in each standard analysis image is marked with a category label corresponding to the pixel. Among them, the category label corresponding to any pixel can be the unique identification information corresponding to the pixel. At least one image to be analyzed is input into the neural network to be trained to obtain at least one training analysis image, and at least one standard analysis image is input into the neural network to be trained for image analysis, wherein each pixel in each training analysis image is marked with a category label corresponding to the pixel. Among them, the neural network to be trained for image analysis includes a convolution part, a deconvolution part and an output part, the convolution part includes at least one layer of convolution neural network, each layer of convolution neural network includes a convolution layer, an activation layer and a pooling layer, the deconvolution part includes at least one layer of deconvolution neural network, each layer of deconvolution neural network includes a deconvolution layer and a convolution layer, the output part includes a convolution layer and an output layer, and the output layer outputs the result using a classifier. For each training analysis image, the category label of each pixel of the training analysis image is obtained, and for each standard analysis image, the category label of each pixel of the standard analysis image is obtained. For each training analysis image, according to the difference in the category label of each pixel between the image feature of the training analysis image and the standard analysis image of the training analysis image, the neural network to be trained for image analysis is trained to obtain the target neural network for image analysis. Specifically, the value of the loss function of the neural network to be trained for image analysis can be obtained according to the difference in the category label of each pixel between the training analysis image and the standard analysis image of the training analysis image, and the model parameters of the neural network to be trained for image analysis can be updated according to the value of the loss function. In general, the smaller the value of the loss function, the more accurate the output result of the neural network. The value of the loss function obtained each time can be compared with the preset value. If the absolute value of the difference between the two values ​​is less than the preset standard value, the model parameters of the neural network to be trained for image analysis are updated according to the value of the loss function. It should be noted that this embodiment only shows a training method for a neural network for image analysis, and there are other training methods, which will not be repeated here.

[0156] Taking the skin care application analyzing the user's skin through image comparison as an example, illustratively, after obtaining the image of the user's face and other areas, the skin care application first pre-processes the image through the mobile phone to remove image noise and irrelevant background, thereby obtaining a binary image. Then, the binary image is subjected to Euclidean distance transformation to obtain the Euclidean distance transformation highlight line, and the image after the Euclidean distance transformation is vertically analyzed to extract the texture features of the area of ​​interest, and the extracted texture features are compared with the texture features of the skin image with related skin problems, and then the image is identified or classified by a classifier to obtain the skin test results of the user's skin and determine the user's skin problems.

[0157] It can be understood that obtaining the user's skin test results through analysis is not limited to being completed locally, but can also be analyzed through other computing devices, and the skin test results obtained through analysis can be sent back to the local machine.

[0158] After the user completes the skin test, proceed to step 1106.

[0159] Step 1106, the skin care application recommends a skin care check-in plan based on the user's skin test results.

[0160] Specifically, the skin care application displays a skin care check-in plan recommended to the user on the display interface of the local device based on the skin test results. For example, if the user's skin is dehydrated, a hydration check-in plan is recommended to the user. Or, if the user's skin has fine lines, a fine line lightening check-in plan can be recommended to the user.

[0161] Step 1108, determine the skin care check-in plan based on the user's selection.

[0162] After the skin care application recommends the skin care check-in plan to the user, the process proceeds to step 1108. It should be noted that the user can also add the skin care check-in plan as needed in other pages of the skin care application without going through the above steps 1104 and 1106, such as Figure 5 In the graphical interface shown in (a)-(b), a skin care check-in plan is directly added. After the user adds the skin care check-in plan, the electronic device determines the skin care check-in plan that the user is about to implement according to the user's selection.

[0163] Step 1110, obtaining first target information, and determining whether the user has preset implementation conditions for implementing the skin care check-in plan based on the first target information.

[0164] The preset implementation condition is pre-set by the skin care application and is used to indicate that the user currently has the conditions to implement the skin care check-in plan he / she has joined. Each skin care check-in plan joined by the user has specific preset implementation conditions. The specific preset implementation conditions are composed of the implementation conditions required for each demonstration action under the skin care check-in plan. The preset implementation conditions are determined based on the first target information obtained by the skin care application.

[0165] The first target information includes, but is not limited to, the user's motion status information, the user's device location information, the user's calendar information, the user's biological sign information, the user's life behavior information, etc. The first target information can be obtained through the local device, wearable devices, smart home, accessories and other devices.

[0166] In one example, after the user joins the skin care punch-in plan, the user's exercise status and other information are detected by the machine, wearable devices connected to the machine, smart home, peripherals, mobile phones, car-mounted devices, etc. For example, the machine and other devices can obtain the amplitude and frequency of the user's arm movement through acceleration sensors, etc., to determine whether the user is currently in motion, or obtain the user's heart rate and other vital signs through the built-in heart rate sensor in other peripherals. It can be understood that if the amplitude and frequency of the user's arm movement are too large and the heart rate is fast, it can be judged that the user is exercising. If the user is in motion, the skin care application can determine that the user is not suitable for or cannot implement the skin care punch-in plan, that is, the user does not have the preset implementation conditions for implementing the skin care punch-in plan. However, if it is detected that the user's heartbeat is slow at this time and the body is in a relatively quiet state, the user can be prompted to punch in for skin care.

[0167] In one example, after a user joins the skin care check-in plan, the device interacts with the vehicle computer in a vehicle or other means of transportation to determine whether the user is driving the vehicle. If the user is driving the vehicle, it can be determined that the user is not suitable for the skin care check-in plan, that is, the user does not have the conditions to implement the skin care check-in plan.

[0168] In one example, a skin care application can obtain the user's first target information by accessing the application installed on the local machine. For example, the skin care application can access the calendar schedule in the local machine. By accessing the calendar schedule, it can be determined whether the user can implement the skin care punch-in plan. For example, if it is determined by accessing the calendar schedule that the user is currently in a meeting, then the user is not suitable for implementing the skin care punch-in plan, that is, the skin care application may not remind the user to punch in for skin care, or ask the user whether to postpone the skin care punch-in. When the skin care application determines that the user currently has no scheduled tasks by accessing the user's current calendar schedule, the user can be prompted to implement the skin care punch-in plan.

[0169] In one example, the smart home appliance can identify whether the user is at home and the user's current status. For example, the user may be doing housework in the kitchen or resting in the living room. If the user is currently doing housework, the skin care application can determine that the user is not suitable for implementing the skin care plan. If the user is resting in the living room, the skin care application can determine that the user is suitable for implementing the skin care plan and can remind the user to implement the skin care plan.

[0170] In one example, a skin care application can access the location information and time information of the local machine to determine whether the user is suitable for implementing a skin care punch-in plan. For example, if the current time is 10:00 a.m. on a weekday and the user is in the user's office, the user may not be suitable for implementing a skin care punch-in plan at this time, and the skin care application may not remind the user to implement the skin care punch-in plan. It should be noted that the above location information includes but is not limited to GPS or Bluetooth location information.

[0171] It is understandable that the skin care application can make decisions based on more first target information to determine whether the user is currently suitable for implementing the skin care punch-in plan. For example, at the first moment, the skin care application detects that the user is outdoors and in motion, and does not remind the user to implement the skin care punch-in plan. At the second moment, when it is detected that the user's body is in a relatively static state and the heart rate is slow, the current location of the device is the user's home, and it is determined by accessing the calendar schedule application that the user has no schedule in the next preset time period, it is determined that the current user state is suitable for the skin care punch-in plan.

[0172] In one embodiment, when the skin care application determines that the user does not meet the conditions for implementing the skin care check-in plan based on the above-mentioned first target information, it can automatically re-acquire the user's first target information at one or more preset time periods to determine whether the user meets the preset implementation conditions for implementing the skin care check-in plan (see step 1112). When the user meets the conditions for implementing the skin care check-in, the user is reminded to implement the skin care check-in plan.

[0173] Alternatively, when the skin care application determines that the user does not have the conditions to implement the skin care clock-in plan based on the above-mentioned first target information, it can prompt the user whether to postpone the clock-in for a period of time based on the user's set time.

[0174] In one embodiment, when the user meets the preset implementation conditions of the skin care clock-in plan, step 1114 is entered.

[0175] Step 1114, prompting the user to implement a skin care check-in plan.

[0176] When the skin care application determines, based on the first target information, that the user has the preset implementation conditions for implementing the skin care punch-in plan, the user may be prompted to implement the skin care punch-in plan. Fig. 9 (a) and Fig.10(a) exemplarily shows a graphical interface for reminding the user to implement a skin care check-in plan.

[0177] It is understandable that more types of reminder methods can be set, which are not limited here.

[0178] Step 1116, obtaining the user's behavior and action, and determining whether the user's behavior and action match the demonstration action of the skin care check-in plan.

[0179] In one embodiment, when the user confirms to implement the skin care punch-in plan, the skin care application obtains and identifies the user's behavior through the local device, wearable device, beauty mirror, smart screen or mobile phone and other devices. Specifically, it can identify the user's gesture posture, gesture position, step duration of skin care action, action amplitude, etc., and then match the user's behavior with the demonstration action of the skin care punch-in plan. It should be noted that the identification and matching process can be matched and identified through technical means such as deep learning or pattern recognition, which is not limited here.

[0180] For example, see Figure 5 In Figure (j), after the user clicks the start button, the corresponding skin care action begins. At the same time, the skin care application calls the camera of the local device, or the camera of other devices connected to the local device (such as a beauty mirror), to detect and obtain the user's behavior actions for matching.

[0181] It should be noted that the skin care application uses the camera to detect and obtain the user's behavior and actions, and is not limited to Figure 5 Click the start button in the interface shown in Figure (j) to trigger it. You can also trigger it in other interfaces and by other methods, such as Fig. 9 (a) In the interface shown in the figure, after the user clicks Yes, the skin care application is directly triggered to call the camera, without the user having to go to Figure 5 Alternatively, the user may input a command by voice to trigger the skin care application to call the camera. Specifically, when the skin care application determines that the skin care check-in plan meets the preset implementation conditions based on the first target information, the skin care application may prompt the user by voice whether to implement the skin care mode, and the user may input a command to implement the skin care mode to the skin care application by voice input.

[0182] Exemplarily, the skin care application can match each of the user's behavioral actions with the demonstration actions under the skin care punch-in plan. If the user's behavioral actions match the demonstration actions, the number of qualified actions is accumulated. If the total number of qualified actions meets the preset number, the punch-in is displayed as completed. If the total number of qualified actions does not meet the preset number, the punch-in is not displayed as completed. For example, a punch-in plan includes 10 action combinations. If more than 6 of the user's behavioral actions match the actions in the action combination, the user is considered to have completed the demonstration action. If less than 5 of the user's behavioral actions match the actions in the action combination, the user is considered to have not completed the demonstration action, and the user's completion of the punch-in is not displayed, or the user's action is prompted to be non-standard or wrong (step 1118).

[0183] In a non-limiting embodiment, the difference between the intensity of each action of the user and the intensity of the action movement in each demonstration action can also be compared. If the difference is less than a preset threshold, each action of the user is considered to match the demonstration action. Specifically, the intensity of the user's action movement can be detected by an acceleration sensor on a wearable device. Of course, the degree of match between the duration of each action of the user and the duration of the action movement in each demonstration action can also be determined by detecting the duration of the user's action. If the user's face washing time exceeds the preset time specified in the skin care punch-in plan, it is determined that the user's action and the specific action in the skin care mode have a low match, that is, the user's action behavior is unqualified.

[0184] In one example, if the user's behavioral action matches a demonstration action of the skin care check-in plan, proceed to step 1120.

[0185] Step 1120, display the completion of the check-in.

[0186] In one example, if the user's behavior matches any demonstration action in the skin care check-in plan, the skin care application displays that the check-in for the skin care mode is completed.

[0187] See also Figure 5 Medium (l) or Fig. 9 (b) The interface shown in FIG. 1 exemplarily shows that the skin care application displays the completion of checking in for the skin care mode.

[0188] The following will be combined Fig.12 , from the perspective of software implementation strategy, this article introduces a skin care check-in method provided by another embodiment of the present application.

[0189] Steps 1202-1208 are the same as the above-mentioned steps 1102-1108 and will not be repeated here.

[0190] Step 1210, obtaining the second target information, and based on the second target information, determining whether the user has implemented prohibited behaviors under the skin care check-in plan.

[0191] The second target information includes, but is not limited to, the user's biological sign information, the user's life behavior information, the location of the electronic device, the usage time, the content of the application, etc. The second target information can be obtained through the local device, wearable devices, smart home, accessories and other devices. The skin care application can determine whether the application has implemented the prohibited behavior under the skin care punch-in plan based on the second target information.

[0192] The prohibited behaviors may include behaviors that are not allowed to be implemented in each skin care plan except for the demonstration actions, and may also include irregular behaviors performed by users when performing demonstration actions, for example, the user's actions are unqualified, the user's actions exceed the time specified in the demonstration actions, etc.

[0193] Skin care applications can determine whether users have performed prohibited behaviors in a variety of ways. For example, skin care applications can determine whether users have performed prohibited behaviors by accessing other applications. For example, for the behavior of eating spicy food, skin care applications can access the user's platform for social applications and determine whether the user has performed spicy food based on the food pictures and content posted by the user on the social application platform. Alternatively, skin care applications can determine whether users have performed prohibited behaviors based on information obtained from other devices or the local device. For example, if the prohibited behavior is staying up late, the skin care application can obtain the time the user uses the local device to determine whether the user stays up late, or the skin care application can obtain the user's pulse and other information through a bracelet or other wearable device to determine whether the user stays up late, etc. Alternatively, the skin care application can also use wearable devices to determine whether the strength of the user's face washing meets the regulations for the behavior, etc.

[0194] Step 1212, remind the user that the prohibited behavior has been performed.

[0195] When a user is detected to have performed a prohibited behavior, the skin care application can remind the user of the prohibited behavior in the graphical interface. Fig.10 (b) shows a graphical interface of a skin care application reminding the user that a prohibited behavior has been performed.

[0196] It is understandable that the points obtained by users through skin care check-in can also be deducted, or the skin care check-in completed by the user on the same day can be revoked, so as to achieve the effect of supervising and encouraging users. The skin care check-in method proposed in this application does not require users to manually check in every time they implement a skin care check-in plan, and the skin care application can prompt users to check in when the skin care plan under the skin care plan meets the preset implementation conditions based on the user's current status. While supervising users, it reduces the burden on users and improves user experience.

[0197] Fig.13 : is a flow chart of a skin care clock-in method provided by another embodiment of the present application, the method comprising:

[0198] Step 1302, the electronic device receives a first operation input by a user;

[0199] In response to the first operation, displaying at least one skin care check-in plan in which the user participates;

[0200] Step 1304: the electronic device acquires first target information, where the first target information includes time, location of the electronic device, motion status of the user, and schedule of the electronic device;

[0201] Step 1306: The electronic device determines whether the preset implementation conditions for implementing the at least one skin care punch-in plan are met based on the first target information;

[0202] The preset implementation condition is pre-set by the skin care application and is used to indicate that the user currently has the conditions to implement the skin care check-in plan he / she has joined. Each skin care check-in plan joined by the user has specific preset implementation conditions. The specific preset implementation conditions are composed of the implementation conditions required for each demonstration action under the skin care check-in plan. The preset implementation conditions are determined based on the first target information obtained by the skin care application.

[0203] Step 1308: If the judgment result is that the preset implementation conditions for implementing the at least one skin care punch-in plan are met, the electronic device displays a first reminder message, and the first reminder message is used to prompt the user to implement the at least one skin care punch-in plan.

[0204] The embodiment of the present application further provides a computer-readable storage medium, which includes computer instructions. When the computer instructions are executed on the electronic device, the electronic device executes the operation of the present application. Fig.13 The method.

[0205] Each functional unit in the embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit may be implemented in the form of hardware or in the form of software functional units.

[0206] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the embodiment of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product, and the computer software product is stored in a storage medium, including a number of instructions to enable a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to perform all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: various media that can store program codes, such as flash memory, mobile hard disk, read-only memory, random access memory, disk or optical disk.

[0207] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions within the technical scope disclosed in the present application should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims

1. A skin care clock-in method, applied to a first electronic device, characterized in that: include: Receiving a first operation input by a user; In response to the first operation, displaying at least one skin care check-in plan in which the user participates; Acquire first target information, where the first target information includes one or more of the current time of the first electronic device, the current location of the first electronic device, the current motion state of the user, and the schedule of the first electronic device; the schedule of the first electronic device is used to indicate a task currently performed by the user; Based on the first target information, determining whether the preset implementation conditions for implementing the at least one skin care punch-in plan are met; If the judgment result is that the preset implementation condition for implementing the at least one skin care punch-in plan is met, a first reminder message is displayed, where the first reminder message is used to prompt the user to implement the at least one skin care punch-in plan; Receiving a skin care check-in action of a user collected by a second electronic device, wherein the second electronic device is a device at a current location of the first electronic device, and the second electronic device is used to assist the first electronic device in completing the skin care check-in action of the user; matching the skin care check-in action of the user collected by the second electronic device with the corresponding demonstration action; If the result is a match, the user will be prompted that the skin care check-in plan has been completed.

2. The clock-in method according to claim 1, characterized in that: The method further comprises, receiving a second operation input by the user; In response to the second operation, obtaining at least one behavior action of the user; Determining whether the at least one behavioral action matches a corresponding demonstration action, wherein the corresponding demonstration action is a demonstration action in the at least one skin care check-in plan; If the judgment result is that the at least one behavioral action matches the corresponding demonstration action, a second reminder message is displayed, where the second reminder message is used to prompt that the at least one skin care check-in plan has been completed; If the judgment result is that the at least one behavioral action does not match the corresponding demonstration action, a third reminder message is displayed, and the third reminder message is used to prompt that the at least one skin care check-in plan is not completed.

3. The clock-in method according to claim 1, characterized in that: The method further comprises, If the judgment result is that the preset implementation conditions for implementing the at least one skin care punch-in plan are not met, a fourth reminder message is displayed, and the fourth reminder message is used to prompt the user whether to postpone the implementation of the at least one skin care punch-in plan.

4. The clock-in method according to claim 3, characterized in that: The method further comprises, receiving a third operation input by the user; In response to the third operation, the first target information is acquired again after a predetermined time, and based on the first target information acquired again, it is determined whether the preset implementation conditions for implementing the at least one skin care punch-in plan are met.

5. The clock-in method according to claim 1, characterized in that: The method further comprises, If the judgment result is that the preset implementation conditions are not met, the first target information is obtained again after a predetermined time, and based on the first target information obtained again, it is judged whether the preset implementation conditions for implementing the at least one skin care check-in plan are met.

6. The clock-in method according to claim 1, characterized in that: The method further comprises, Acquire second target information, where the second target information includes at least one of time, location of the electronic device, and content of an application program; Based on the second target information, determining whether the user has implemented the prohibited behavior in the at least one skin care check-in plan; If the judgment result is that the prohibited behavior has been implemented, a fifth reminder message is displayed, and the fifth reminder message is used to remind the user that the prohibited behavior has been implemented or the skin care check-in plan has not been completed.

7. The clock-in method according to claim 1, characterized in that: The method further comprises: receiving a fourth operation input by the user; In response to the fourth operation, acquiring a facial image of the user; Based on the facial image, obtaining a facial image analysis result; Based on the facial image analysis result, display at least one skin care check-in plan; receiving a fifth operation input by the user, wherein the fifth operation is used to select a skin care check-in plan that the user has not participated in; In response to the received fifth operation, the skin care check-in plan is added.

8. A first electronic device, characterized in that: The electronic device comprises a processor and a storage device, wherein the storage device stores an application program, and when the application program is executed by the processor, the first electronic device executes the method as described in any one of claims 1 to 7.

9. A computer-readable storage medium, characterized in that: The method comprises computer instructions, which, when executed on the first electronic device, cause the first electronic device to execute the method as claimed in any one of claims 1 to 7.

10. A computer program product, characterized in that When the computer program product is run on a computer, the computer is enabled to execute the method according to any one of claims 1 to 7.

Citation Information

Patent Citations

  • Rehabilitation plan prompting method and device, storage medium and server

    CN107887006A

  • Exercise training reminding method, device and equipment and readable storage medium

    CN109248414A

  • Interaction method of electronic equipment for skin detection and electronic equipment

    CN111651040A

  • Method for automatically detecting skin, method for automatically guiding skin care and make-up, and terminal

    CN112000221A

  • Fitness management method, device, and computer readable storage medium

    US20210016136A1