Infant nursing method and device, electronic equipment and storage medium

Abstract

The invention provides an infant nursing method and device, electronic equipment and a storage medium, and the method comprises the steps: obtaining a target state of an infant, and obtaining a target control mode corresponding to the target state according to a preset corresponding relation between the state and a control mode, the household appliance comprises a device for infant nursing; and according to a corresponding relation between a preset control mode and the household appliance parameters, obtaining target household appliance parameters corresponding to the target control mode, and according to the target household appliance parameters, performing equipment parameter setting on the household appliance. The method can realize intelligent nursing of the infant.

Description

Technical Field

[0001] The present application belongs to the technical field of household appliances, and specifically relates to an infant care method, device, electronic device and storage medium. Background Art

[0002] In daily life, infants and young children need to be cared for.

[0003] In the related art, infants are cared for by manual care. This method of caring for infants has the problems of high labor costs, lack of intelligence, and inability to care for infants in real time. For example, infants cannot be cared for at night or during periods when it is inconvenient for the caregiver to care for them. Summary of the invention

[0004] The present application aims to provide an infant care method, device, electronic device and storage medium, which at least solves the problem that the infant care method in the prior art is labor-intensive and not intelligent enough.

[0005] In a first aspect, the present application discloses a method for caring for infants and young children, comprising:

[0006] Obtain the target status of infants and young children;

[0007] According to the correspondence between the preset state and the control mode, a target control mode corresponding to the target state is obtained; the control mode is a control mode of the central control device on the home appliance, and the home appliance includes a device for infant care;

[0008] According to the correspondence between the preset control mode and the parameters of the home appliance, obtaining the target home appliance parameters corresponding to the target control mode;

[0009] According to the target home appliance parameters, device parameters are set for the home appliance.

[0010] Optionally, obtaining the target state of the infant includes:

[0011] Acquiring location information and behavior information of the infant;

[0012] Acquiring a target state of the infant according to the position information and the behavior information;

[0013] The target state includes: sleeping state, awake state, or emergency state.

[0014] Optionally, acquiring the target state of the infant according to the position information and the behavior information includes:

[0015] Classify the location information to obtain the location type of the infant; the location type is a safe location or a dangerous location;

[0016] A target state of the infant is acquired according to the position type and the behavior information.

[0017] Optionally, the behavior information includes at least one of the following: the infant's limb movement amplitude, facial expression information, and sound information; obtaining the infant's target state according to the position type and the behavior information includes:

[0018] Obtaining a first classification result of the limb movement amplitude; the first classification result includes: the limb movement amplitude exceeds a preset limb movement amplitude threshold, or does not exceed a preset limb movement amplitude threshold;

[0019] Obtaining a second classification result of the facial expression information; the second classification result includes: the expression is eyes closed or eyes open;

[0020] Obtaining a third classification result of the sound information; the third classification result includes: the sound information is crying sound, or other sound;

[0021] The target state of the infant is acquired according to the position type and at least one of the first classification result, the second classification result and the third classification result.

[0022] Optionally, acquiring the target state of the infant according to the position type and at least one of the first classification result, the second classification result, and the second classification result includes:

[0023] If the position type is a safe position, and the first classification result is that the limb movement amplitude does not exceed a preset limb movement amplitude threshold, the second classification result is that the expression is eyes closed, and the third classification result is that the sound information is other sounds, then it is determined that the target state is a sleeping state;

[0024] If the location type is a safe location, and the first classification result is that the limb movement amplitude does not exceed a preset limb movement amplitude threshold, the second classification result is that the expression is eyes open, and the third classification result is that the sound information is other sounds, then it is determined that the target state is awake;

[0025] If the position type is a dangerous position, or the first classification result is that the limb movement amplitude exceeds a preset limb movement amplitude threshold, and the third classification result is that the sound information is a crying sound, then it is determined that the target state is a wakeful state.

[0026] Optionally, after obtaining the target state of the infant, the following is further included:

[0027] Displaying the target state in a display module of the central control device; and / or,

[0028] The target state is sent to a user terminal.

[0029] Optionally, the method further includes:

[0030] Determining a time to acquire the target state;

[0031] According to the correspondence between the preset state and the control mode, obtaining the target control mode corresponding to the target state includes:

[0032] If the target state is a sleep state, determining that the target control mode is a sleep mode;

[0033] If the target state is the awake state, and the acquisition time is within the preset sleep time period, then determining that the target control mode is the coaxing mode;

[0034] If the target state is an emergency state, the target control mode is determined to be an alarm mode.

[0035] In a second aspect, the present application discloses an infant care device, comprising:

[0036] A first acquisition module is used to acquire the target state of the infant;

[0037] a second acquisition module, configured to acquire a target control mode corresponding to the target state according to a correspondence between a preset state and a control mode; the control mode is a control mode of the central control device over the home appliance, and the home appliance includes a device for infant care;

[0038] A third acquisition module, configured to acquire target home appliance parameters corresponding to the target control mode according to a preset correspondence between the control mode and the home appliance parameters;

[0039] The setting module is used to set the device parameters of the home appliance according to the target home appliance parameters.

[0040] In a third aspect, an embodiment of the present application further discloses an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the program or instructions are executed by the processor, the steps of the method described in the first aspect are implemented.

[0041] In a fourth aspect, an embodiment of the present application further discloses a readable storage medium, on which a program or instruction is stored. When the program or instruction is executed by a processor, the steps of the method described in the first aspect are implemented.

[0042] In a fifth aspect, an embodiment of the present application further discloses a central control device, comprising the infant care device described in the second aspect, so as to implement the infant care method as described in any one of the first aspect.

[0043] In summary, in this embodiment, the target state of the infant is obtained, and according to the actual target state of the infant and the correspondence between the preset state and the control mode, a target control mode adapted to the target state of the infant can be obtained. After obtaining the target control mode, the target home appliance control mode corresponding to the target control mode is obtained according to the correspondence between the preset control mode and the parameters of the home appliance. The target home appliance parameters thus obtained are home appliance parameters suitable for the actual state of the infant, and the device parameters of the home appliance are automatically set according to the target home appliance parameters. In this way, the infant can be automatically cared for by home appliances. Based on the method of this embodiment, there is no need to take care of the infant manually, which saves the time cost and labor cost of manually caring for the infant, and realizes intelligent care for the infant. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In the attached picture:

[0045] Figure 1 is a flowchart of the steps of a method for caring for infants and young children provided in an embodiment of the present application;

[0046] Figure 2 is a flowchart of another method for caring for infants and young children provided in an embodiment of the present application;

[0047] Figure 3 This is a flowchart of the steps of another infant care method provided in an embodiment of the present application;

[0048] Figure 4 is a block diagram of an infant care device provided in an embodiment of the present application;

[0049] Figure 5 is a block diagram of an electronic device according to an embodiment of the present application;

[0050] Figure 6 It is a block diagram of an electronic device of another embodiment provided by the embodiments of the present application. DETAILED DESCRIPTION

[0051] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0052] The terms "first", "second", etc. in the specification and claims of the present application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable under appropriate circumstances, so that the embodiments of the present application can be implemented in an order other than those illustrated or described here, and the objects distinguished by "first", "second", etc. are generally of one type, and the number of objects is not limited. For example, the first object can be one or more. In addition, "and / or" in the specification and claims represents at least one of the connected objects, and the character " / " generally indicates that the objects associated with each other are in an "or" relationship.

[0053] Figure 1 is a flowchart of a method for caring for infants and young children provided in this embodiment, referring to Figure 1 , the method may include the following steps:

[0054] Step 101, obtaining the target state of the infant.

[0055] For example, the method of this embodiment is applied to a central control device. The central control device is connected to multiple home appliances in communication, and the home appliances connected to the central control device are used to collect sound information or motion information of infants and young children. The central control device collects the sound information, position information and motion information collected by each home appliance, and determines the target state of the infant and young child based on the sound information, position information and motion information. For example, the home appliance that collects sound information can be a microphone; the home appliance that collects motion information and position information can be a video acquisition device, an image acquisition device, etc.

[0056] In addition, the central control device is also connected to the home appliances to be controlled, including smart curtains, air conditioners, humidifiers, dehumidifiers, or other home appliances whose parameters can be configured through the central control device.

[0057] Furthermore, the microphone collects the infant's crying, ambient noise and other sound information; the camera collects the infant's location information, expression information, movement information and other information. Based on this information, the central control device determines whether the infant's target state is awake, asleep or dangerous.

[0058] Step 102: acquiring a target control mode corresponding to the target state according to a preset correspondence relationship between the state and the control mode.

[0059] Specifically, the target state is compared with a preset state in the corresponding relationship, the preset state in the corresponding relationship that is the same as the target state is obtained, and the control mode corresponding to the preset state is determined as the target control mode corresponding to the target state.

[0060] The control mode is a control mode of the central control device over the home appliances, and the home appliances include devices for infant care. For example, the devices for infant care may include smart air conditioners, smart curtains, smart humidifiers, and smart music playback devices.

[0061] Illustratively, the control modes may include a sleep mode, an alarm mode, and a lull mode.

[0062] Step 103 : acquiring target home appliance parameters corresponding to the target control mode according to the correspondence between the preset control mode and the home appliance parameters.

[0063] For example, the target control mode is compared with the preset control mode in the corresponding relationship, the preset control mode that is the same as the target control mode is obtained, and the home appliance parameters corresponding to the preset control mode are determined as the target home appliance equipment parameters corresponding to the target control mode.

[0064] For example, the parameters of home appliance equipment are parameters of the operation of home appliance equipment for infant care controlled by the central control device. For example, if the home appliance equipment includes an air conditioner, the parameters of the home appliance equipment include the temperature of the air conditioner; if the home appliance equipment includes a humidifier, the parameters of the home appliance equipment include the humidification level of the humidifier; if the home appliance equipment includes a music player, the parameters of the home appliance equipment include whether the music player equipment plays music and the type of music played.

[0065] Step 104, setting device parameters for the home appliance according to the target home appliance parameters.

[0066] For example, the target home appliance device parameter may include multiple target home appliance device parameters, and each target home appliance device parameter has a corresponding home appliance device.

[0067] Specifically, the method for setting device parameters for a home appliance according to target home appliance parameters includes: configuring the target home appliance parameters to the corresponding home appliance.

[0068] For example, the method of this embodiment can be applied to a central control device. The home appliance is a smart home appliance that can be controlled by the central control device, for example, it can include a smart speaker, a smart humidifier, a smart dehumidifier, a smart curtain, etc. The target home appliance parameters include whether the smart speaker plays music and the type of music played; the humidification gear of the smart humidifier; the dehumidification gear of the smart dehumidifier, whether the smart curtain is closed, and other parameters.

[0069] Furthermore, the central control device may be a voice intelligent central control device having a voice module and a display screen. As the core device of a smart home, the central control device may be applied to home applications. The infant intelligent care method of this embodiment may be applied to the central control device, and the target status of the infant may be displayed in real time through the display screen of the central control device.

[0070] By using the central control device for implementing the method of this embodiment, automatic care for infants and young children can be achieved. For example, it can be used to automatically coax infants and young children to sleep, so as to help parents monitor their infants and young children.

[0071] In daily life, a lot of time is needed to take care of infants and young children. Especially for new parents, how to effectively monitor and care for infants and young children has become an urgent problem to be solved. In the related art, infants and young children are usually taken care of manually, which not only requires a lot of manpower and is time-consuming, but also has the problem of not being able to take care of them at all times. For example, when resting at night or when parents are not present, it is impossible to take care of infants and young children in real time.

[0072] With the rapid development of smart home technology, more and more families are beginning to use smart devices to improve the quality of life and convenience of life through smart devices.

[0073] In this embodiment, the target state of the infant is obtained, and the target control mode adapted to the target state of the infant can be obtained according to the actual target state of the infant and the correspondence between the preset state and the control mode. After obtaining the target control mode, the target home appliance control mode corresponding to the target control mode is obtained according to the correspondence between the preset control mode and the parameters of the home appliance. The target home appliance parameters thus obtained are home appliance parameters suitable for the actual state of the infant, and the device parameters of the home appliance are automatically set according to the target home appliance parameters. In this way, the infant can be automatically cared for by the home appliance. Based on the method of this embodiment, there is no need to take care of the infant manually, which saves the time cost and labor cost of manually caring for the infant, and realizes intelligent care for the infant.

[0074] Reference Figure 2 This embodiment also provides a method for caring for infants and young children, which may include the following steps:

[0075] Step 201, obtaining the position information and behavior information of the infant.

[0076] For example, the image information of the infant can be obtained through an image acquisition device such as a camera, and the position information and behavior information of the infant can be identified based on the image information.

[0077] Further, the location information may include: the infant is in a safe area set by the user, or in an area outside the safe area. For example, the safe area is on the bed.

[0078] The behavior information may include at least one of the following: the infant's limb movement amplitude, facial expression information, and sound information.

[0079] Step 202, obtaining the target state of the infant based on the position information and behavior information.

[0080] The target state includes: sleeping state, awake state, or emergency state.

[0081] For example, step 202 may include the following sub-steps:

[0082] Sub-step A1, classifying the location information to obtain the location type of the infant.

[0083] Among them, the location type is a safe location or a dangerous location.

[0084] Images of areas where infants and young children are located, such as bedrooms, can be obtained through image acquisition equipment, and the images can be input into a trained position recognition model to obtain the position information of the infants and young children.

[0085] For example, the location recognition model can be obtained by the following method: collect images of the area where the infant is located, construct samples for training the location recognition model, and the area where the infant is located can include the bedroom, bed and other areas; calibrate the safe area in the sample image and the image area where the infant is located, and use the calibration result as the label of the data set. Use the samples and labels to train the location recognition model to obtain a trained location recognition model; for example, the location recognition model can be a target recognition (You Only Live Once, YOLO) model.

[0086] Furthermore, after acquiring the image to be identified, the image is input into a position recognition model to obtain the image portion corresponding to the safe area in the image and the image portion where the infant is located, and then the intersection and union ratio of the areas of the image portion in the safe area and the image portion where the infant is located is calculated. If the intersection and union ratio is greater than or equal to a preset intersection and union ratio threshold, the position information of the infant is determined to be in a safe area; otherwise, the position information of the infant is determined to be in a dangerous area.

[0087] For example, a video stream of the area where the infant is located is obtained in real time through a video acquisition device, and an image in the video stream is obtained, and a position recognition model is used to detect the image in the video stream for the safe area and the area where the infant is located. For example, if the safe area is a bed, the position recognition model is used to detect the area where the infant is located and the area of ​​the bed, respectively, to obtain a rectangular frame mark of the area where the infant is located and a rectangular frame mark of the bed, and the area of ​​the area where the infant is located and the area of ​​the bed are obtained according to the rectangular frame of the area where the infant is located and the rectangular frame of the bed, respectively, and then the overlapping area of ​​the area of ​​the infant and the area of ​​the bed is calculated, and the area ratio of the overlapping area to the safe area is calculated, and the ratio is the intersection-union ratio of the area where the infant is located and the safe area.

[0088] Step A2, obtaining the target state of the infant based on the position type and behavior information.

[0089] Furthermore, the behavior information includes at least one of the following: the infant's limb movement amplitude, facial expression information, and sound information.

[0090] Step A2 may include the following sub-steps:

[0091] Sub-step A21, obtaining a first classification result of the limb movement amplitude.

[0092] Among them, the first classification result includes: the limb movement amplitude exceeds the preset limb movement amplitude threshold, or does not exceed the preset limb movement amplitude threshold.

[0093] Images of areas where infants and young children are located, such as bedrooms, can be acquired through image acquisition equipment, and the images can be input into a trained limb movement amplitude detection model to obtain the limb movement amplitude of the infants and young children.

[0094] For example, the limb movement amplitude detection model can be obtained by the following method: collect images of infants in sleeping and non-sleeping states, construct samples for training the model, and then mark the key points of the infant's limbs in the image, and use the calibrated data as labels; wherein the key points may include the position of the head and limbs. Use the samples and labels to train the limb movement amplitude detection model to obtain a trained limb movement amplitude detection model. For example, the limb movement amplitude detection model can be a posture estimation model openpose. Among them, openpose is a 2D posture estimation model that can be used for human body key point detection.

[0095] Furthermore, the video stream of the camera is obtained, and the pictures in the video stream are input into the trained limb movement amplitude detection model. The position change information of the key points of the human body of the infant or young child within a preset time period is obtained, and the movement amplitude of the limbs is calculated based on the position change information. Specifically, the displacement of the key points of the human body within a preset time period and the movement amplitude of the infant or young child's limbs as a whole can be calculated.

[0096] By comparing the limb movement amplitude with the preset limb movement amplitude threshold, it is determined whether the limb movement amplitude exceeds the preset limb movement amplitude threshold. The upper limit value of the limb movement amplitude can be obtained through the key points calibrated in the image, and the upper limit value is determined as the preset limb movement amplitude threshold.

[0097] Sub-step A22, obtaining a second classification result of the facial expression information.

[0098] Among them, the second classification results include: the expression is eyes closed or eyes open.

[0099] The image of the infant can be obtained through an image acquisition device, and the image can be input into a trained facial expression recognition model to obtain the facial expression information of the infant.

[0100] For example, the trained facial expression recognition model can be obtained by the following method: collect images including infants' various eye states and facial expressions, and use them as samples for training the facial expression recognition model; label the closed and open states of infants' glasses to obtain sample labels; label the calm and active expression types of infants to obtain sample labels.

[0101] Using image samples including various eye states of infants and young children, and annotating the closed and open states of infants and young children's glasses, sample labels are obtained, and a facial expression recognition model is trained to obtain a first trained facial expression recognition model; using image samples including various facial expressions of infants and young children, and annotating the calm and active expression types of infants and young children, sample labels are obtained, and a facial expression recognition model is trained to obtain a second trained facial expression recognition model.

[0102] For example, a Haar cascade classifier may be used to detect the eye region in an image, and a convolutional neural network (CNN) may be used to detect whether the infant's glasses are open or closed.

[0103] The FaceNet deep learning network model can be used for extracting facial features and recognizing facial expressions. In this embodiment, a face recognition system based on the FaceNet deep learning network model can be used to extract facial features and recognize facial expressions. Specifically, by extracting features of a facial image, the extracted features are input into an expression classification model to obtain a second classification result of facial expression information. The expression classification model is the second facial expression recognition model in the aforementioned embodiment.

[0104] Furthermore, a video stream is acquired through a video acquisition device, an image in the video stream is acquired, and a facial expression recognition result of whether the eyes are open or not is acquired based on the image in the video stream and a trained first facial expression recognition model.

[0105] According to the image in the video stream and the trained second facial expression recognition model, the facial expression type of the infant or young child, whether the facial expression is calm or active, is obtained.

[0106] Sub-step A23, obtaining a third classification result of the sound information; the third classification result includes: the sound information is crying sound, or other sounds.

[0107] For example, the sound information extracted by the microphone is input into the trained sound recognition model to obtain the third classification result of the sound information.

[0108] For example, the sound is a sound feature in the sound information extracted by the model, and the sound information is classified according to the sound feature to obtain a third classification result of the sound information.

[0109] Specifically, the trained sound classification model can be obtained by the following method: the sounds of infants and young children in a crying state, in a non-crying state, and environmental sounds can be collected as sound samples, and the crying sounds and other sounds can be labeled to obtain labels. The sound recognition model is trained using the samples and labels to obtain the third classification result of the sound information.

[0110] Sub-step A24, obtaining a target state of the infant based on the position type and at least one of the first classification result, the second classification result and the third classification result.

[0111] Further, sub-step A24 may include the following sub-steps:

[0112] Sub-step A241, if the position type is a safe position, and the first classification result is that the limb movement amplitude does not exceed the preset limb movement amplitude threshold, the second classification result is that the expression is eyes closed, and the third classification result is that the sound information is other sounds, then determine that the target state is a sleeping state;

[0113] The target state is the sleeping state, indicating that the infant is currently asleep.

[0114] Sub-step A242, if the position type is a safe position, and the first classification result is that the limb movement amplitude does not exceed the preset limb movement amplitude threshold, the second classification result is that the expression is open eyes, and the third classification result is that the sound information is other sounds, then it is determined that the target state is awake.

[0115] Specifically, if the following conditions are met at the same time, the target state is determined to be the awake state: the image of the area where the infant is located is captured by a camera, and the infant is identified as being in a bed or other safe area based on the image; the infant's limb movement amplitude is obtained based on the captured image, and the limb movement amplitude does not exceed a preset limb movement amplitude threshold; based on the trained facial expression recognition model, it is determined that the infant's eyes are open and the expression is active; and the microphone detects babbling or other sounds in the infant's environment, but no crying.

[0116] Sub-step A243, if the location type is a dangerous location, or the first classification result is that the limb movement amplitude exceeds the preset limb movement amplitude threshold, and the third classification result is that the sound information is a crying sound, then the target state is determined to be an emergency state.

[0117] In another embodiment, if the following conditions are met at the same time, the target state is determined to be an emergency state: the camera recognizes that the baby is in a bed or other area; the camera captures that the baby's limbs move with a large amplitude; based on the infant image and facial expression recognition model, it is recognized that the baby's facial expression is not a calm expression, for example, an expression of dissatisfaction or pain; based on the sound information detected by the microphone, it is recognized that there is obvious crying sound of the baby in the environment where the baby is located.

[0118] For example, the method may further include the following steps:

[0119] A time stamp of an image used to identify a target state is acquired, and the time stamp is determined as a time when the target state is acquired.

[0120] Step 203: If the target state is the sleep state, determine that the target control mode is the sleep mode.

[0121] Specifically, when the target state of the infant is the sleeping state, the target control mode is determined to be the sleeping mode, so that the home appliance parameters of the home appliances such as lights and music playing devices are set according to the sleeping mode.

[0122] When the target control mode is determined to be the sleep mode, the central control device controls the operation of the home appliances to optimize the sleep environment. Specifically, the central control device automatically adjusts the environmental parameters to provide a suitable sleep environment, helping infants and young children fall asleep faster and improve their sleep quality.

[0123] Furthermore, how to automatically adjust the room's light, temperature, sound and other parameters according to the infant's physical condition and environmental data to create a suitable sleeping environment.

[0124] Environmental optimization system: automatically adjusts room lighting, temperature, sound and other environmental parameters to optimize the sleeping environment for infants and young children.

[0125] Step 204: If the target state is an emergency state, determine that the target control mode is an alarm mode.

[0126] Monitor the status of infants and young children in real time and issue timely alarms when abnormal conditions are detected.

[0127] Furthermore, through the real-time monitoring and intelligent alarm functions on the central control equipment, parents can be ensured to understand the status of infants and young children in a timely manner, respond quickly to any abnormal situations, and improve care efficiency.

[0128] Real-time alarm mechanism: Design a real-time alarm mechanism. When the central control device detects abnormal conditions of infants and young children, it will immediately notify parents through voice, text messages or mobile phone apps.

[0129] The control mode is a control mode in which the central control device controls the home appliances, and the home appliances include devices for infant care.

[0130] Step 205: If the target state is the awake state, the acquisition time of the target state is acquired.

[0131] For example, a video stream of the area where the infant is located is obtained through a video acquisition device, and each frame of the video stream has a corresponding timestamp.

[0132] Step 206: If it is determined that the acquisition time is within the preset sleep time period, the target control mode is determined to be the coaxing mode.

[0133] For example, if the target state is the awake state, and the acquisition time is within the preset sleep time period, then the target control mode is determined to be the coaxing mode.

[0134] If the target control mode is determined to be the coaxing-to-sleep mode, the smart central control device will be linked to other smart home appliances in the home to automatically coax the baby to sleep, reducing the workload of parents.

[0135] Furthermore, based on the crying and movement information of infants and young children collected by the central control device, soothing music or white noise is automatically played.

[0136] Step 207 : acquiring target home appliance parameters corresponding to the target control mode according to the preset correspondence between the control mode and the home appliance parameters.

[0137] The method of this step has been described in the aforementioned step 102 and will not be repeated here.

[0138] Step 208, setting device parameters for the home appliance according to the target home appliance parameters.

[0139] The method of this step has been described in the aforementioned step 104 and will not be repeated here.

[0140] Based on the method of this embodiment, the smart central control device is linked to the smart home appliances in the home to automatically coax the infants to sleep and monitor them, so as to significantly reduce the care burden of parents and allow users to have more rest time.

[0141] In one embodiment, the central control device is integrated with a temperature sensor and a humidity sensor, and based on the temperature sensor and the humidity sensor, the temperature and humidity of the room where the infant is located are monitored. The central control device may also be integrated with a light sensor, and the light intensity of the room is detected by the light sensor.

[0142] For example, the home appliances include lighting equipment, humidifiers, and smart air conditioners, the infant state is the sleeping state, and the control mode is the sleeping mode. In this case, the target home appliance parameters may include: reducing the light intensity, reducing the room humidity, and increasing the room temperature. The target home appliance parameters may also include: the light intensity, room humidity, and room temperature to be set.

[0143] For example, the central control device can connect to home appliances such as environmental control devices at home through wifi and Bluetooth to send target device parameters to the home appliances. Specifically, a Bluetooth wifi two-in-one chip is integrated on the central control device to achieve data transmission with smart home appliances at home, send control instructions to the home appliances, and control the opening and closing of curtains, the temperature adjustment of air conditioners, the opening / closing of humidifiers and dehumidifiers, and the playing / stopping of music by audio equipment according to the control instructions.

[0144] For example, the central control device combines the infant's physical state to decide the control mode. For example, when the infant is sleeping, the central control device directly enters the sleep mode and controls the home appliances related to infant care as follows: close the curtains, adjust the air conditioner to a suitable sleeping temperature (for example, around 25°C) according to the current ambient temperature; detect the ambient humidity in the room where the infant is located, if the ambient humidity is high, turn on the dehumidifier or turn off the humidifier, if the ambient humidity is low, turn off the dehumidifier or turn on the humidifier; stop playing music.

[0145] For example, if the central control device determines that the infant is awake, it determines whether the current time period is the coaxing time period. If it is, it enters the coaxing mode and controls the home appliances related to infant care as follows: collect the current light intensity in the room. If it is determined that the light intensity in the current room is too strong, close the curtains and adjust the air conditioner to an appropriate temperature according to the current ambient temperature; detect the ambient humidity in the room where the infant is located. If the ambient humidity is high, turn on the dehumidifier or turn off the humidifier; if the ambient humidity is low, turn off the dehumidifier or turn on the humidifier; play sleep-inducing music or white noise.

[0146] For example, if the central control device determines that the infant is in emergency mode, the alarm mode is turned on to notify the parents through a pre-set alarm method so that the parents can take care of the infant in time.

[0147] In one embodiment, after step 202, the method further includes:

[0148] Step 209: displaying the target status in the display module of the central control device; and / or sending the target status to the user terminal.

[0149] For example, the target status is displayed in the display module of the central control device; and / or the target status is sent to the user terminal, so that parents can easily set home appliance parameters for home appliances through the central control device, and view monitoring information of infants and young children through the central control device, thereby improving user experience.

[0150] For example, a module for monitoring data display and intelligent monitoring switch can be set in the central control device. Further, after the central control device obtains the infant's physical condition record and the central control device's care mode record, the collected infant's physical condition record and the central control device's care mode record can be displayed through the central control module.

[0151] For example, the user can turn on or off the smart monitoring on the central control device. When the smart monitoring mode is turned on, the user can also select the sleep time period and the alarm method. The alarm methods may include: voice alarm, SMS notification, application software (Application, APP) push, etc.

[0152] In one embodiment, data can be transmitted in an encrypted manner to ensure secure storage and transmission of data, thereby protecting the privacy of infants and families.

[0153] By displaying the monitoring data of infants and young children on the central control device, parents can conveniently view the monitoring data on the central control device.

[0154] Figure 3 is a flowchart of another method for caring for infants and young children provided by an embodiment of the present invention, referring to Figure 3As shown, the method may include the following steps:

[0155] Step S1, obtaining the position information, expression information and movement information of the infant through a camera.

[0156] The camera collects images of the area where the infant is located, and obtains the target state of the infant based on the image. Specifically, the camera is integrated on the central control device, and the movement information, expression information, and location information of the infant are monitored in real time through the camera.

[0157] Step S2: Acquiring infant sound information through a microphone

[0158] The central control device can be integrated with a microphone to detect the crying of infants and environmental noise.

[0159] Step S3, obtaining the target state of the infant based on the position information, expression information, movement information and sound information of the infant.

[0160] Specifically, a first classification result of the limb movement amplitude is obtained, wherein the first classification result includes: the limb movement amplitude exceeds a preset limb movement amplitude threshold, or does not exceed the preset limb movement amplitude threshold.

[0161] A second classification result of the facial expression information is obtained. The second classification result includes: the expression is eyes closed or eyes open. The image of the infant can be obtained through an image acquisition device, and the image is input into a trained facial expression recognition model to obtain the facial expression information of the infant.

[0162] A third classification result of the sound information may be obtained; the third classification result includes: the sound information is crying or other sounds. For example, the sound information extracted by the microphone is input into the trained sound recognition model to obtain the third classification result of the sound information.

[0163] After obtaining the first classification result of the limb movement amplitude, the second classification result of the facial expression information, and the third classification result of the sound information, the target state of the infant is obtained according to the position type and at least one of the first classification result, the second classification result and the third classification result.

[0164] Step S4: If the target state of the infant is the sleeping state, the control mode is determined to be the sleeping mode, and the process proceeds to step S5.

[0165] Specifically, in this embodiment, the data collected by the camera and the microphone can be used to classify the current physical state of the infant into: sleeping state, awake state, or emergency state.

[0166] If the camera recognizes that the baby is currently on the bed and the baby's limb movements are very small; and the facial recognition algorithm recognizes that the baby's eyes are closed and his expression is calm; and the microphone detects that there is no obvious crying or other sounds in the environment, only slight breathing sounds, then it is determined that the infant is in a sleeping state.

[0167] Step S5, close the curtains, adjust the air-conditioning temperature, turn on the humidifier or dehumidifier, and stop playing music.

[0168] Specifically, the air conditioner temperature can be set to a temperature suitable for sleeping, for example, it can be set to 25 degrees. The central control device obtains the humidity of the room where the infant is located. If it is determined that the humidity is too high, the dehumidifier is turned on; if it is determined that the humidity is too low, the humidifier is turned on.

[0169] Step S6: If the target state of the infant is an emergency state, the control mode is determined to be an alarm mode, and the process proceeds to step S7.

[0170] The method of this step has been described in the aforementioned sub-step A2 and will not be repeated here.

[0171] Step S7, sending the warning information to the user end.

[0172] For example, the warning information may be sent to a user terminal device such as a mobile phone of the user.

[0173] Step S8: if the target state of the infant is the awake state, the current time period is obtained.

[0174] If the target state of the infant is a wakeful state, the current time period is obtained; if the current time period is a sleeping time period, the sleeping mode is entered to lull the infant to sleep.

[0175] Step S9, determine whether the current time is in the coaxing sleep time period, if yes, go to step S10, otherwise return to step S3.

[0176] For example, the sleep-to-sleep time period can be determined based on the actual sleep habits of the infant being cared for, for example, it can be set from 10 pm to 6 am, or from 1 pm to 2 pm.

[0177] Step S10, determining that the control mode is a coaxing mode.

[0178] If the current time period is a time period for coaxing the baby to sleep, the control mode is determined to be a time period for coaxing the baby to sleep.

[0179] Step S11, close the curtains, adjust the air-conditioning temperature, turn on the humidifier or dehumidifier, and play sleep-aiding music or white noise.

[0180] By way of example, the present application proposes a method of integrating an intelligent infant care mode into a home voice intelligent central control device, and the central control device is used to implement the method of the above embodiment.

[0181] refer to Figure 4 , which shows an infant care device 30 provided in an embodiment of the present application, the infant care device 30 comprises:

[0182] The first acquisition module 301 is used to acquire the target state of the infant;

[0183] The second acquisition module 302 is used to acquire a target control mode corresponding to the target state according to a preset correspondence between the state and the control mode; the control mode is a control mode of the central control device over the home appliance, and the home appliance includes a device for infant care;

[0184] The third acquisition module 303 is used to acquire the target home appliance parameters corresponding to the target control mode according to the correspondence between the preset control mode and the home appliance parameters;

[0185] The setting module 304 is used to set device parameters of the home appliance according to the target home appliance parameters.

[0186] Optionally, the first acquisition module 301 includes:

[0187] The first acquisition submodule is used to acquire the position information and behavior information of the infant;

[0188] The second acquisition submodule is used to acquire the target state of the infant based on the position information and behavior information; wherein the target state includes: sleeping state, awake state, or emergency state.

[0189] Optionally, the second acquisition submodule includes:

[0190] The first acquisition submodule is used to classify the location information and obtain the location type of the infant's location; the location type is a safe location or a dangerous location;

[0191] The second acquisition submodule is used to acquire the target state of the infant according to the position type and behavior information.

[0192] Optionally, the behavior information includes at least one of the following: the infant's limb movement amplitude, facial expression information, and sound information; the second acquisition submodule may include:

[0193] A first acquisition unit is used to acquire a first classification result of the limb movement amplitude; the first classification result includes: the limb movement amplitude exceeds a preset limb movement amplitude threshold, or does not exceed the preset limb movement amplitude threshold;

[0194] The second acquisition unit is used to acquire a second classification result of the facial expression information; the second classification result includes: the expression is eyes closed or eyes open;

[0195] A third acquisition unit is used to acquire a third classification result of the sound information; the third classification result includes: the sound information is crying sound, or other sound;

[0196] The fourth acquisition unit is used to acquire the target state of the infant according to the position type and at least one of the first classification result, the second classification result and the third classification result.

[0197] Optionally, the fourth acquisition unit includes:

[0198] A first determination subunit is configured to determine that the target state is a sleeping state if the position type is a safe position, and the first classification result is that the limb movement amplitude does not exceed a preset limb movement amplitude threshold, the second classification result is that the expression is eyes closed, and the third classification result is that the sound information is other sounds;

[0199] A second determination subunit is configured to determine that the target state is a wakeful state if the position type is a safe position, and the first classification result is that the limb movement amplitude does not exceed a preset limb movement amplitude threshold, the second classification result is that the expression is eyes open, and the third classification result is that the sound information is other sounds;

[0200] The third determination subunit is used to determine that the target state is a wakeful state if the position type is a dangerous position, or the first classification result is that the limb movement amplitude exceeds a preset limb movement amplitude threshold, and the third classification result is that the sound information is a crying sound.

[0201] Optionally, the device 30 further includes:

[0202] A first display module is used to display the target state in the display module of the central control device after acquiring the target state of the infant; and / or,

[0203] The sending module is used to send the target status to the user terminal.

[0204] Optionally, the second acquisition module may include:

[0205] a first determining unit, configured to determine the target control mode to be the sleep mode if the target state is the sleep state;

[0206] A second determining unit is used to obtain the acquisition time of the target state if the target state is the awake state, and determine the target control mode to be the coaxing mode if the acquisition time is determined to be within a preset sleeping time period;

[0207] The third determining unit is configured to determine the target control mode to be an alarm mode if the target state is an emergency state.

[0208] In this embodiment, the target state of the infant is obtained, and the target control mode adapted to the target state of the infant can be obtained according to the actual target state of the infant and the correspondence between the preset state and the control mode. After the target control mode is obtained, the target home appliance control mode corresponding to the target control mode is obtained according to the correspondence between the preset control mode and the parameters of the home appliance. The target home appliance parameters thus obtained are home appliance parameters suitable for the actual state of the infant, and the device parameters of the home appliance are automatically set according to the target home appliance parameters. In this way, the infant can be automatically cared for by the home appliance. Based on the method of this embodiment, there is no need to take care of the infant manually, which saves the time cost and labor cost of manually caring for the infant, and realizes intelligent care for the infant.

[0209] Reference Figure 5 , the electronic device 500 may include one or more of the following components: a processing component 502 , a memory 504 , a power component 506 , a multimedia component 508 , an audio component 510 , an input / output (I / O) interface 512 , a sensor component 514 , and a communication component 516 .

[0210] The processing component 502 generally controls the overall operation of the electronic device 500, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 502 may include one or more processors 520 to execute instructions to complete all or part of the steps of the above-mentioned method. In addition, the processing component 502 may include one or more modules to facilitate the interaction between the processing component 502 and other components. For example, the processing component 502 may include a multimedia module to facilitate the interaction between the multimedia component 508 and the processing component 502.

[0211] The memory 504 is used to store various types of data to support the operation of the electronic device 500. Examples of such data include instructions for any application or method operating on the electronic device 500, contact data, phone book data, messages, pictures, multimedia, etc. The memory 504 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM), erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

[0212] The power supply component 506 provides power to the various components of the electronic device 500. The power supply component 506 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to the electronic device 500.

[0213] The multimedia component 508 includes an interface that provides an output interface between the electronic device 500 and the user. In some embodiments, the interface may include a liquid crystal display (LCD) and a touch panel (TP). If the interface includes a touch panel, the interface may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundaries of the touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 508 includes a front camera and / or a rear camera. When the electronic device 500 is in an operating mode, such as a shooting mode or a multimedia mode, the front camera and / or the rear camera may receive external multimedia data. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.

[0214] The audio component 510 is used to output and / or input audio signals. For example, the audio component 510 includes a microphone (MIC), and when the electronic device 500 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is used to receive an external audio signal. The received audio signal can be further stored in the memory 504 or sent via the communication component 516. In some embodiments, the audio component 510 also includes a speaker for outputting audio signals.

[0215] The input / output I / O interface 512 provides an interface between the processing component 502 and the peripheral interface module, which may be a keyboard, a click wheel, buttons, etc. These buttons may include but are not limited to: a home button, a volume button, a start button, and a lock button.

[0216] The sensor assembly 514 includes one or more sensors for providing various aspects of status assessment for the electronic device 500. For example, the sensor assembly 514 can detect the open / closed state of the electronic device 500, the relative positioning of components, such as the display and keypad of the electronic device 500, and the sensor assembly 514 can also detect the position change of the electronic device 500 or a component of the electronic device 500, the presence or absence of user contact with the electronic device 500, the orientation or acceleration / deceleration of the electronic device 500, and the temperature change of the electronic device 500. The sensor assembly 514 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor assembly 514 may also include an optical sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 514 may also include an accelerometer, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

[0217] The communication component 516 is used to facilitate wired or wireless communication between the electronic device 500 and other devices. The electronic device 500 can access a wireless network based on a communication standard, such as WiFi, a carrier network (such as 2G, 3G, 4G or 5G), or a combination thereof. In an exemplary embodiment, the communication component 516 receives a broadcast signal or broadcast-related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 516 also includes a near field communication (NFC) module to facilitate short-range communication. For example, the NFC module can be implemented based on radio frequency identification (RFID) technology, infrared data association (IrDA) technology, ultra-wideband (UWB) technology, Bluetooth (BT) technology and other technologies.

[0218] In an exemplary embodiment, the electronic device 500 can be implemented by one or more application-specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, microcontrollers, microprocessors or other electronic components to implement an infant care method provided in an embodiment of the present application.

[0219] In an exemplary embodiment, a non-transitory computer-readable storage medium including instructions is also provided, such as a memory 504 including instructions, and the instructions can be executed by a processor 520 of an electronic device 500 to perform the above method. For example, the non-transitory storage medium can be a ROM, a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, etc.

[0220] Figure 6600 is a block diagram of an electronic device 600 according to another embodiment of the present invention. For example, the electronic device 600 may be provided as a server. Figure 6 The electronic device 600 includes a processing component 622, which further includes one or more processors, and a memory resource represented by a memory 632 for storing instructions executable by the processing component 622, such as an application. The application stored in the memory 632 may include one or more modules, each corresponding to a set of instructions. In addition, the processing component 622 is configured to execute instructions to perform an infant care method provided in an embodiment of the present application.

[0221] The electronic device 600 may also include a power supply component 626 configured to perform power management of the electronic device 600, a wired or wireless network interface 650 configured to connect the electronic device 600 to a network, and an input / output (I / O) interface 658. The electronic device 600 may operate based on an operating system stored in the memory 632, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™ or the like.

[0222] The embodiment of the present application further provides a central control device, including an infant care device or an electronic device as in the aforementioned embodiment, to implement the infant care method in the aforementioned embodiment.

[0223] Those skilled in the art will readily appreciate other embodiments of the present application after considering the specification and practicing the application disclosed herein. The present application is intended to cover any modification, use or adaptation of the present application, which follows the general principles of the present application and includes common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present application are indicated by the following claims.

[0224] It should be understood that the present application is not limited to the precise structures that have been described above and shown in the drawings, and that various modifications and changes may be made without departing from the scope thereof. The scope of the present application is limited only by the appended claims.

Claims

1. A method for caring for infants and young children, characterized in that: Applied to a central control device, the method comprises: Obtain the target status of infants and young children; According to the correspondence between the preset state and the control mode, a target control mode corresponding to the target state is obtained; the control mode is a control mode of the central control device on the home appliance, and the home appliance includes a device for infant care; According to the correspondence between the preset control mode and the parameters of the home appliance, obtaining the target home appliance parameters corresponding to the target control mode; According to the target home appliance parameters, device parameters are set for the home appliance.

2. The method according to claim 1, characterized in that The obtaining of the target state of the infant comprises: Acquiring location information and behavior information of the infant; Acquiring a target state of the infant according to the position information and the behavior information; The target state includes: sleeping state, awake state, or emergency state.

3. The method according to claim 2, characterized in that The acquiring the target state of the infant according to the position information and the behavior information includes: Classify the location information to obtain the location type of the infant; the location type is a safe location or a dangerous location; A target state of the infant is acquired according to the position type and the behavior information.

4. The method according to claim 3, characterized in that: The behavior information includes at least one of the following: the range of motion of the infant's limbs, facial expression information, and sound information; obtaining the target state of the infant according to the position type and the behavior information includes: Obtaining a first classification result of the limb movement amplitude; the first classification result includes: the limb movement amplitude exceeds a preset limb movement amplitude threshold, or does not exceed a preset limb movement amplitude threshold; Acquire a second classification result of the facial expression information; the second classification result includes: the facial expression information is eyes closed or eyes open; Obtaining a third classification result of the sound information; the third classification result includes: the sound information is crying sound, or other sound; The target state of the infant is acquired according to the position type and at least one of the first classification result, the second classification result and the third classification result.

5. The method according to claim 4, characterized in that Acquiring a target state of the infant according to the position type and at least one of the first classification result, the second classification result, and the second classification result includes: If the position type is a safe position, and the first classification result is that the limb movement amplitude does not exceed a preset limb movement amplitude threshold, the second classification result is that the facial expression information is eyes closed, and the third classification result is that the sound information is other sounds, then it is determined that the target state is a sleeping state; If the location type is a safe location, and the first classification result is that the limb movement amplitude does not exceed a preset limb movement amplitude threshold, the second classification result is that the facial expression information is eyes open, and the third classification result is that the sound information is other sounds, then it is determined that the target state is a wakeful state; If the position type is a dangerous position, or the first classification result is that the limb movement amplitude exceeds a preset limb movement amplitude threshold, and the third classification result is that the sound information is a crying sound, then it is determined that the target state is a wakeful state.

6. The method according to claim 2, characterized in that After obtaining the target state of the infant, it also includes: Displaying the target state in a display module of the central control device; and / or, The target state is sent to a user terminal.

7. The method according to claim 1, characterized in that According to the correspondence between the preset state and the control mode, obtaining the target control mode corresponding to the target state includes: If the target state is a sleep state, determining that the target control mode is a sleep mode; If the target state is the awake state, then the acquisition time of the target state is acquired, and if it is determined that the acquisition time is within the preset sleep time period, then the target control mode is determined to be the coaxing sleep mode; If the target state is an emergency state, the target control mode is determined to be an alarm mode.

8. An infant care device, characterized in that: The device is located in the central control equipment, and the device includes: A first acquisition module is used to acquire the target state of the infant; a second acquisition module, configured to acquire a target control mode corresponding to the target state according to a correspondence between a preset state and a control mode; the control mode is a control mode of the central control device over the home appliance, and the home appliance includes a device for infant care; A third acquisition module, configured to acquire target home appliance parameters corresponding to the target control mode according to a preset correspondence between the control mode and the home appliance parameters; The setting module is used to set device parameters of the home appliance according to the target home appliance parameters.

9. An electronic device, characterized in that: The method comprises a processor and a memory, wherein the memory stores a program or instruction that can be run on the processor, and when the program or instruction is executed by the processor, the steps of the method according to any one of claims 1 to 7 are implemented.

10. A readable storage medium, characterized in that: The readable storage medium stores a program or instruction, and when the program or instruction is executed by a processor, the steps of the method according to any one of claims 1 to 7 are implemented.

Images