Infant nursing system with shooting function

Abstract

The invention discloses an infant nursing system with a shooting function, and relates to the technical field of nursing, the infant nursing system comprises a shooting module, a sound acquisition module, a display, a storage module and a control unit, and the control unit is configured to mark the occurrence time of a smiling face when identifying that the facial expression of an infant is the smiling face; whether crying sound is recognized at the smiling face occurrence time and at the approaching moment of the smiling face occurrence time or not is determined; when it is confirmed that no cry exists, a snapshot instruction is generated, and a smiling face image corresponding to the generation time of the smiling face is generated into a snapshot picture; storing the snapshot image in a storage module to generate an electronic photo album; when the display is in the picture display mode, the generated electronic photo album is displayed through the display, in the video monitoring process, the happy dynamic state of the baby is automatically captured, the electronic photo album is generated, and manual shooting by a user is not needed; and during snapshot, dual verification of smiling face recognition and cry discrimination is carried out, so that the situation of wrong snapshot is reduced, and the recording accuracy is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of care, and in particular to a baby care system with a shooting function. Background Art

[0002] Existing baby monitoring devices (such as ordinary cameras or sound monitors) have single functions and can only realize real-time monitoring and soothing functions. They lack records of the baby's happy growth. Users need to manually take photos or videos of the baby's happy growth, which has the defects of cumbersome operation and easy to miss important moments. Summary of the invention

[0003] In order to overcome the above-mentioned shortcomings, the present invention aims to provide a technical solution that can solve the above-mentioned problems.

[0004] To achieve the above object, the present invention provides the following technical solution: a baby care system with a photographing function, comprising: A camera module, used to collect baby video data in real time; A sound collection module is used to obtain environmental sound data; Display, with switchable monitoring mode and picture display mode; Storage module; A control unit receives the baby video data collected by the camera module and receives the environmental sound data acquired by the sound collection module; The control unit is configured to, when recognizing that the facial expression of the baby is a smile, mark the time when the smile occurs, and confirm whether crying is recognized at the time when the smile occurs and at a moment close to the time when the smile occurs; When it is confirmed that there is no crying sound, a snapshot instruction is generated, and a smiling face image corresponding to the time when the smiling face occurs is generated as a snapshot image; The captured images are stored in a storage module to generate an electronic photo album; When the display is in a picture display mode, the electronic photo album generated above is displayed through the display.

[0005] As a further solution of the present invention: an additional storage module is electrically connected to the control unit; When the crying sound is recognized, the time when the crying sound occurs is recorded, and the information of the time when the crying sound occurs is stored in the additional storage module; When the facial expression of the baby is recognized as a smile, the time when the smile occurs is marked, and it is confirmed from the crying record library in the additional storage module whether crying is recognized at the time when the smile occurs and at a moment close to the time when the smile occurs.

[0006] As a further solution of the present invention: the adjacent moment includes the moment before the smile occurs and / or the moment after the smile occurs.

[0007] As a further solution of the present invention: the control unit is further configured to collect facial feature data of the baby through the baby video data collected by the camera module to form facial recognition of the monitoring target; Before performing smile recognition, first confirm whether the baby in the video is the monitoring target. After confirming that the baby in the video is the monitoring target, perform smile recognition on the monitoring target.

[0008] As a further solution of the present invention: after confirming that the baby in the video is the monitoring target, the stored facial feature data of the monitoring target is re-corrected according to the collected baby video data, and the re-corrected facial feature data of the monitoring target is used as the recognition data for the next facial similarity judgment.

[0009] As a further solution of the present invention: after confirming that the baby in the video is the monitoring target, the smiling face recognition and crying voice recognition of the monitoring target are performed.

[0010] As a further solution of the present invention: when the surveillance video is acquired, crying sound recognition is started; After confirming that the baby in the video is the monitoring target, the smiling face of the monitoring target is recognized.

[0011] As a further solution of the present invention: it also includes a first device housing and a second device housing; The camera module, the sound collection module, and the control unit are all arranged on the first device housing, and the control unit is electrically connected to the first wireless module; The display and the storage module are both arranged on the second device housing, the display is provided with an additional control unit, and the additional control unit is electrically connected to the second wireless module; The control unit is connected to the additional control unit by signals via the first wireless module and the second wireless module; The additional control unit receives the baby video data transmitted by the control unit, and displays the baby video through the display when the additional control unit is in the monitoring mode; The additional control unit receives the captured image transmitted by the control unit, stores the captured image in the storage module, generates an electronic photo album, and displays the generated electronic photo album through the display when the additional control unit is in the picture display mode.

[0012] As a further solution of the present invention: when the additional control unit is successfully wirelessly connected to the control unit via the second wireless module and the first wireless module, the additional control unit is correspondingly switched to the monitoring mode.

[0013] As a further solution of the present invention: when the wireless connection between the additional control unit and the control unit is disconnected, the additional control unit is correspondingly switched to the picture display mode.

[0014] Compared with the prior art, the beneficial effects of this technical solution are: it is designed to automatically capture the baby's happy movements and generate an electronic photo album during the video monitoring process, automatically recording the baby's happy growth moments without the need for users to take manual photos; and when capturing, dual verification of smile recognition and crying voice identification is performed to reduce the occurrence of accidental captures and improve the accuracy of records.

[0015] Additional aspects and advantages of the present invention will be given in part in the following description and in part will be obvious from the following description, or will be learned through practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0016] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative labor.

[0017] Figure 1 is a circuit block diagram of the present invention; Figure 2 It is a snapshot flow chart of the present invention; Figure 3 is another snapshot flow chart of the present invention; Figure 4 It is another capture flow chart of the present invention.

[0018] The corresponding reference numerals in the accompanying drawings are described as follows: Camera module-1, sound collection module-2, display-3, storage module-4, control unit-5, additional storage module-6, first wireless module-7, additional control unit-8, second wireless module-9. DETAILED DESCRIPTION

[0019] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0020] See also Figure 1-4 , a baby care system with shooting function, including a camera module 1, a sound collection module 2, a display 3, a storage module 4 and a control unit 5.

[0021] The camera module 1 is used to collect baby video data in real time. The sound collection module 2 is used to obtain environmental sound data. The display 3 has a switchable monitoring mode and a picture display mode. The control unit 5 receives the baby video data collected by the camera module 1 and receives the environmental sound data collected by the sound collection module 2.

[0022] The control unit 5 is configured to, when recognizing that the baby's facial expression is a smile, mark the time when the smile occurs, and confirm whether crying is recognized at the time when the smile occurs and at a moment close to the time when the smile occurs; when it is confirmed that there is no crying, generate a snapshot instruction, and generate a smiling face image corresponding to the time when the smile occurs as a snapshot picture; store the snapshot image in the storage module 4 to generate an electronic photo album.

[0023] When the display 3 is in the picture display mode, the electronic photo album generated above is displayed through the display 3.

[0024] The system is designed to automatically capture the baby's happy movements and generate an electronic photo album during video surveillance, automatically recording the baby's happy growth moments without the user having to take pictures manually. When capturing, it performs double verification of smile recognition and crying voice identification to reduce the possibility of accidental capture and improve the accuracy of the record.

[0025] In some embodiments, the camera module 1 includes a camera, which is used to capture and collect baby video data.

[0026] In some embodiments, the camera module 1 includes a camera capable of night vision with built-in infrared light technology.

[0027] In some embodiments, the sound collection module 2 includes a microphone, and the ambient sound data is acquired through the microphone.

[0028] In some embodiments, the control unit 5 is provided with an AI algorithm module, and the AI ​​algorithm deployment adopts, for example, a convolutional neural network (CNN) training model, and the data set includes baby smiling face samples and crying sound samples.

[0029] When the baby smiles in the crib (within the shooting range), the control unit 5 obtains the baby monitoring video through the camera, and recognizes the smiling face features through the AI ​​algorithm module, combines the crying detection to eliminate interference, and after confirming and generating the snapshot picture, transmits it to the storage module for storage and generates an electronic photo album.

[0030] In some embodiments, the generation logic of the electronic photo album is to sort the multiple snapshots by time axis, such as sorting them in ascending or descending order of the storage time. When playing, for example, it can be set to play them in a loop according to the sorting.

[0031] In this embodiment, an additional storage module 6 is electrically connected to the control unit 5 .

[0032] When the control unit 5 recognizes that there is crying sound, it records the time when the crying sound occurs, and stores the crying sound occurrence time record information in the additional storage module 6.

[0033] When the facial expression of the baby is identified as a smile, the time when the smile occurs is marked, and the crying record library in the additional storage module 6 is used to confirm whether crying is identified at the time when the smile occurs and at a time close to the time when the smile occurs.

[0034] Correspondingly, when it is confirmed that there is no crying at the time when the smile occurs and at a time close to the time when the smile occurs, a snapshot instruction is generated, and the smiling face image corresponding to the time when the smile occurs is generated as a snapshot picture; the snapshot image is stored in the storage module 4 to generate an electronic photo album.

[0035] That is, during the video monitoring process, the control unit 5 always identifies whether there is crying, and records it when it identifies crying, so that when a smile is identified, it can confirm the time when the smile occurs and whether there is crying at a close moment when the smile occurs.

[0036] In some embodiments, the adjacent moment includes, for example, the moment before the smiling face occurs, such as 5 seconds before the smiling face occurs.

[0037] In some embodiments, the adjacent time includes, for example, a time after the smiling face occurs, such as 5 seconds before the smiling face occurs.

[0038] In some embodiments, the near time includes, for example, the time after the smile occurrence time and the time after the smile occurrence time, such as 3 seconds before the smile occurrence time and 3 seconds after the smile occurrence time.

[0039] The dual-track operation of smile recognition and crying recognition is realized, so that when the smile is not recognized, the time of crying can still be recognized and recorded, forming a crying record library for subsequent multiple confirmations. Then, when a smile is recognized, further confirmation can be performed based on the crying record library, for example, confirming whether there is crying 3s before and after the smile occurs, so as to reduce the situation of miscapturing and improve the accuracy of the record.

[0040] In this embodiment, the control unit 5 is further configured to collect facial feature data of the baby through the baby video data collected by the camera module 1 to perform facial recognition of the monitored target.

[0041] Before performing smile recognition, first confirm whether the baby in the video is the monitoring target. After confirming that the baby in the video is the monitoring target, perform smile recognition on the monitoring target.

[0042] Further improve the automatic capture of the happy dynamics of the designated baby, automatically record the happy growth moments of the designated baby, avoid mistakenly recording and capturing other babies when the designated baby is not in the monitoring range, and make the generated electronic photo album more specialized.

[0043] In some embodiments, after confirming that the baby in the video is a monitoring target, smile recognition and crying recognition are performed on the monitoring target.

[0044] In some embodiments, when the monitoring video is acquired, crying recognition begins; after confirming that the baby in the video is the monitoring target, smiling face recognition is performed on the monitoring target.

[0045] In this embodiment, after confirming that the baby in the video is the monitoring target, the stored facial feature data of the monitoring target is re-corrected according to the collected baby video data, and the re-corrected facial feature data of the monitoring target is used as the recognition data for the next facial similarity judgment.

[0046] Taking the setting of the similarity threshold of face recognition to 80% as an example, when it is confirmed that the similarity between the facial features of the baby in the video and the facial feature data of the stored monitoring target is greater than 80%, the baby is confirmed as the monitoring target and the smiling face recognition is performed on it; wherein, the facial feature data of the baby is recollected through the collected video and updated. When performing the next face recognition, the updated facial feature data is used for comparison. Through dynamic updating, the problem of large span of facial feature changes caused by rapid changes in the baby's face can be better dealt with.

[0047] In this embodiment, the infant care system further includes a first device housing and a second device housing.

[0048] The camera module 1, the sound collection module 2, and the control unit 5 are all arranged on the first device housing, and the control unit 5 is electrically connected to the first wireless module 7. The display 3 and the storage module 4 are all arranged on the second device housing, and the display 3 is provided with an additional control unit 8, and the additional control unit 8 is electrically connected to the second wireless module 9. The control unit 5 is connected to the additional control unit 8 by signals through the first wireless module 7 and the second wireless module 9.

[0049] The additional control unit 8 receives the baby video data transmitted by the control unit 5 , and displays the baby video through the display 3 when the additional control unit is in the monitoring mode.

[0050] The additional control unit 8 also receives the captured images transmitted by the control unit 5, stores the captured images in the storage module 4, and generates an electronic photo album; when the additional control unit 8 is in the picture display mode, the electronic photo album generated above is displayed through the display 3.

[0051] In some embodiments, the first device housing can be kept set in the baby monitoring area, such as being fixed on a wall, and the second device housing can be moved within the range of the wireless connection. For example, if the second device housing is taken by a caregiver, when the caregiver leaves the baby, the caregiver can continue to care for the baby through the display on the second device housing. Therefore, after the display is set on the second device housing, it can actually be called a mobile care device, and the caregiver can monitor and care for the baby more conveniently through the mobile care device.

[0052] In some embodiments, the wireless connection method is, for example, Wi-Fi or Bluetooth.

[0053] In some embodiments, the mobile nursing device is equipped with an independent power module so that it can be used mobile.

[0054] In some embodiments, a power module is also provided on the first device housing to supply power to electrical components.

[0055] In this embodiment, the switching mode between the monitoring mode and the picture display mode is as follows: when the additional control unit 8 successfully connects to the control unit 5 wirelessly through the second wireless module 9 and the first wireless module 7, the additional control unit 8 switches to the monitoring mode accordingly; when the additional control unit 8 disconnects the wireless connection with the control unit 5, the additional control unit 8 switches to the picture display mode accordingly. This forms an automatic response switching of the modes, and forms a differentiated display in the monitoring mode and the non-monitoring mode (picture display mode).

[0056] It will be apparent to those skilled in the art that the invention is not limited to the details of the exemplary embodiments described above and that the invention can be implemented in other specific forms without departing from the spirit or essential features of the invention. Therefore, the embodiments should be considered exemplary and non-limiting in all respects, and the scope of the invention is defined by the appended claims rather than the foregoing description, and it is intended that all variations falling within the meaning and scope of the equivalent elements of the claims be included in the invention. Any reference numeral in a claim should not be considered as limiting the claim to which it relates.

Claims

1. A baby care system with a photographing function, characterized in that: include A camera module, used to collect baby video data in real time; A sound collection module is used to obtain environmental sound data; Display, with switchable monitoring mode and picture display mode; Storage module; A control unit receives the baby video data collected by the camera module and receives the environmental sound data acquired by the sound collection module; The control unit is configured to, when recognizing that the facial expression of the baby is a smile, mark the time when the smile occurs, and confirm whether crying is recognized at the time when the smile occurs and at a moment close to the time when the smile occurs; When it is confirmed that there is no crying sound, a snapshot instruction is generated, and a smiling face image corresponding to the time when the smiling face occurs is generated as a snapshot image; The captured images are stored in a storage module to generate an electronic photo album; When the display is in a picture display mode, the electronic photo album generated above is displayed through the display.

2. The infant care system according to claim 1, characterized in that: An additional storage module is electrically connected to the control unit; When the crying sound is recognized, the time when the crying sound occurs is recorded, and the information of the time when the crying sound occurs is stored in the additional storage module; When the facial expression of the baby is recognized as a smile, the time when the smile occurs is marked, and it is confirmed from the crying record library in the additional storage module whether crying is recognized at the time when the smile occurs and at a moment close to the time when the smile occurs.

3. The infant care system according to claim 1 or 2, characterized in that: The near time includes a time before the smiling face occurrence time and / or a time after the smiling face occurrence time.

4. The infant care system according to claim 1 or 2, characterized in that: The control unit is also configured to collect facial feature data of the baby through the baby video data collected by the camera module to form facial recognition of the monitoring target; Before performing smile recognition, first confirm whether the baby in the video is the monitoring target. After confirming that the baby in the video is the monitoring target, perform smile recognition on the monitoring target.

5. The infant care system according to claim 4, characterized in that: After confirming that the baby in the video is the monitoring target, the stored facial feature data of the monitoring target is re-corrected according to the collected baby video data, and the re-corrected facial feature data of the monitoring target is used as the recognition data for the next facial similarity judgment.

6. The infant care system according to claim 4, characterized in that: After confirming that the baby in the video is the monitoring target, the smiling face recognition and crying voice recognition of the monitoring target are performed.

7. The infant care system according to claim 4, characterized in that: When the surveillance video is collected, cry recognition begins; After confirming that the baby in the video is the monitoring target, the smiling face of the monitoring target is recognized.

8. The infant care system according to claim 1 or 2 or 5 or 6, characterized in that: Also includes a first device housing and a second device housing; The camera module, the sound collection module, and the control unit are all arranged on the first device housing, and the control unit is electrically connected to the first wireless module; The display and the storage module are both arranged on the second device housing, the display is provided with an additional control unit, and the additional control unit is electrically connected to the second wireless module; The control unit is connected to the additional control unit by signals via the first wireless module and the second wireless module; The additional control unit receives the baby video data transmitted by the control unit, and displays the baby video through the display when the additional control unit is in the monitoring mode; The additional control unit receives the captured image transmitted by the control unit, stores the captured image in the storage module, generates an electronic photo album, and displays the generated electronic photo album through the display when the additional control unit is in the picture display mode.

9. The infant care system according to claim 8, characterized in that: When the additional control unit is successfully wirelessly connected to the control unit via the second wireless module and the first wireless module, the additional control unit is correspondingly switched to the monitoring mode.

10. The infant care system according to claim 9, characterized in that: When the wireless connection between the additional control unit and the control unit is disconnected, the additional control unit is correspondingly switched to the picture display mode.

Images