Infant care methods, devices, and equipment based on optically shielded privacy information
By combining optical shielding methods with camera video images and infrared sensor thermal imaging images, the problem of privacy information leakage in AI care devices has been solved, achieving privacy protection and continuity in infant and toddler care, and improving user experience.
Patent Information
- Application Number
- CN202210911167.8
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-07-29
- Publication Date
- 2026-11-17
- Estimated Expiration
- 2042-07-29
AI Technical Summary
Existing AI-powered childcare devices often include other people's private information when collecting video images of infants and toddlers, leading to poor user experience and privacy leaks.
The system employs a combination of first-type image sources (camera video images) and second-type image sources (infrared sensor thermal imaging images) for infant and toddler care. It uses optically shielded camera lenses to block privacy information and switches to infrared sensor monitoring when needed until the privacy information shielding is lifted.
It effectively prevents the leakage of privacy information, while ensuring uninterrupted care for infants and young children, thus improving the user experience.
Smart Images

Figure CN115391816B_ABST
Abstract
Description
Technical Field
[0001] This invention relates to the field of video data processing technology, and in particular to infant care methods, devices, and equipment based on optical shielding of privacy information. Background Technology
[0002] As urbanization continues, young parents are unable to care for their infants and toddlers themselves, so grandparents often take over. This results in young parents not being able to pay enough attention to their infants' growth. To address this issue, young parents are choosing to use AI-assisted childcare devices.
[0003] However, in existing technologies, AI care devices mainly rely on real-time video images of infants and toddlers captured by cameras to analyze the target and determine the infant's condition. However, infant care is inseparable from the care of guardians, and other people are often present in the infant's environment. As a result, the video images of infants and toddlers captured by AI care devices often contain the private information of other people. Whether the video images are sent back to the server for technical analysis or disseminated on other platforms, privacy will be leaked. This not only causes visual discomfort to viewers but also brings a bad experience to those whose privacy is involved. Summary of the Invention
[0004] In view of this, embodiments of the present invention provide a method, apparatus, and device for transmitting and playing privacy-preserving videos with target detection, in order to solve the technical problem that the video images of infant products collected by existing AI care devices involve the privacy information of other people, resulting in a poor user experience.
[0005] The technical solution adopted in this invention is:
[0006] This invention provides a method for infant and toddler care based on optically shielding privacy information, the method comprising:
[0007] S1: Obtain the privacy information shielding signal generated when using the first type of image source for real-time infant care;
[0008] S2: Based on the shielding signal, optical shielding is applied to the first lens used to acquire the first type of image source, and the second type of image source is used to continue real-time care of the infant until a shielding release signal for removing privacy information is obtained.
[0009] S3: Based on the shielding removal information, continue to provide real-time care for infants and young children using the first type of image source;
[0010] The first type of image source is video images of infant care scenes captured in real time by a camera under the first lens, and the second type of image source is thermal imaging images captured by an infrared sensor.
[0011] Preferably, S1 includes:
[0012] S101: Obtain the first type of image source;
[0013] S102: Perform privacy information detection on the first type of image source, and generate the shielding signal based on the privacy information.
[0014] Preferably, S2 further includes:
[0015] S201: Based on the shielding signal, obtain each target frame image containing privacy information in the first type of image source and each original frame header information of the target frame image;
[0016] S202: Encode and encrypt the privacy information in each of the target frame images and the corresponding original frame header information to obtain the target frame header information of each of the target frame images;
[0017] S203: Replace the original frame header information of each target frame image with the target frame header information.
[0018] Preferably, S1 includes:
[0019] S111: Acquire real-time external control signals for infant and toddler care scenarios;
[0020] S112: Generate the shielding signal based on the external control signal corresponding to the privacy information;
[0021] The external control signals include: gesture control signals, voice control signals, and button control signals.
[0022] Preferably, S1 includes:
[0023] S121: Obtain the blocking control signal for privacy information sent by the App / server;
[0024] S122: Generate the shielding signal according to the shielding control signal.
[0025] Preferably, S2 includes:
[0026] S211: Based on the shielding signal, switch the imaging lens of the camera from the first lens to the second lens, and generate a shielding prompt signal and a care mode switching signal;
[0027] S212: Based on the care mode switching signal, continue to provide real-time care for the infant using the second type of image source;
[0028] The imaging distance of the second lens is less than that of the first lens, resulting in a blurry image of the infant scene captured by the camera.
[0029] Preferably, the shielding prompt signal includes: a visual action signal and / or a voice signal and / or a light signal for switching between the first lens and the second lens.
[0030] The present invention also provides a care device based on the infant care method based on optical shielding privacy information as described in any one of the above claims, comprising:
[0031] Signal acquisition module: used to acquire the shielding signal generated during real-time monitoring of infants and young children using the first type of image source to shield privacy information;
[0032] Image shielding module: used to optically shield the first lens used to acquire the first type of image source according to the shielding signal, and continue to provide real-time care for the infant with the second type of image source until a privacy information shielding release signal is received;
[0033] The loop control module is used to continue real-time monitoring of infants and young children using the first type of image source based on the shielding release information.
[0034] The first type of image source is video images of infant care scenes captured in real time by a camera under the first lens, and the second type of image source is thermal imaging images captured by an infrared sensor.
[0035] The present invention also provides an electronic device, comprising: at least one processor, at least one memory, and computer program instructions stored in the memory, wherein the computer program instructions, when executed by the processor, implement the method described in any of the preceding embodiments.
[0036] The present invention also provides a medium having computer program instructions stored thereon, which, when executed by a processor, implement the method described in any of the preceding claims.
[0037] In summary, the beneficial effects of the present invention are as follows:
[0038] This invention provides a method, apparatus, and device for infant and toddler care based on optical shielding of privacy information. It employs a combination of a first type of image source and a second type of image source for real-time infant and toddler care. The first type of image source is a video image, and the second type of image source is a thermal imaging image. When using the first type of image source for infant and toddler care, upon receiving a shielding signal for privacy information shielding, optical shielding is applied to the first lens corresponding to the first type of image source, and care continues using the second type of image source until a signal indicating the removal of the privacy information shielding is received. Then, care resumes using the first type of image source. This invention, by combining the first and second type of image sources for real-time infant and toddler care, not only prevents privacy leaks to other personnel caused by directly using the first type of image source but also ensures uninterrupted care for infants and toddlers, improving the user experience. Attached Figure Description
[0039] To more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings used in the embodiments of the present invention will be briefly introduced below. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort, and these are all within the protection scope of the present invention.
[0040] Figure 1 This is a flowchart illustrating the infant care method based on optical shielding of privacy information in Embodiment 1 of the present invention.
[0041] Figure 2 This is a schematic diagram of the process of generating a shielding signal based on a first type of image source in Embodiment 1 of the present invention;
[0042] Figure 3 This is a schematic diagram of the process for masking privacy information in a first type of image source in Embodiment 1 of the present invention;
[0043] Figure 4 This is a flowchart illustrating the shielding signal corresponding to the external control signal in the infant scenario in Embodiment 1 of the present invention.
[0044] Figure 5 This is a schematic diagram of the process of a shielding signal sent from a remote end in Embodiment 1 of the present invention;
[0045] Figure 6 This is a schematic diagram of the process based on care mode switching in Embodiment 1 of the present invention;
[0046] Figure 7 This is a schematic diagram of the infant care device based on optical shielding privacy information in Embodiment 2 of the present invention;
[0047] Figure 8 This is a schematic diagram of the electronic device in Embodiment 3 of the present invention. Detailed Implementation
[0048] To make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. It should be noted that, in this document, relational terms such as "first" and "second" are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any such actual relationship or order between these entities or operations. In the description of the present invention, it should be understood that the terms "center," "upper," "lower," "front," "rear," "left," "right," "vertical," "horizontal," "top," "bottom," "inner," and "outer," etc., indicate orientations or positional relationships based on the orientations or positional relationships shown in the accompanying drawings, and are only for the convenience of describing this application and simplifying the description, and do not indicate or imply that the referred device or element must have a specific orientation, or be constructed and operated in a specific orientation, and therefore should not be construed as a limitation of the present invention. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Unless otherwise specified, an element defined by the phrase "comprising..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element. Where there is no conflict, the various features of this invention and its embodiments can be combined with each other, all of which are within the scope of protection of this invention.
[0049] Example 1
[0050] Please see Figure 1 , Figure 1 An infant care method based on optically shielded privacy information, as described in Embodiment 1 of the present invention, includes:
[0051] S1: Obtain the privacy information shielding signal generated when using the first type of image source for real-time infant care;
[0052] S2: Based on the shielding signal, optical shielding is applied to the first lens used to acquire the first type of image source, and the second type of image source is used to continue real-time care of the infant until a shielding release signal for removing privacy information is obtained.
[0053] S3: Based on the shielding removal information, continue to provide real-time care for infants and young children using the first type of image source;
[0054] The first type of image source is video images of infant care scenes captured in real time by a camera under the first lens, and the second type of image source is thermal imaging images captured by an infrared sensor.
[0055] Specifically, the AI-powered childcare device provides real-time monitoring of infants and toddlers. During the monitoring process using a first-type image source captured by a camera, when a shielding signal is present that requires privacy protection, the first lens corresponding to the first image source captured by the camera optically shields it, thus rendering the monitoring of infants and toddlers using the first-type image source ineffective. This shielding signal can be generated through target detection of the first-type image source, generating a shielding signal when privacy information is detected; it can also be generated when other targets are about to enter the infant care area via a remote app or server, or it can be generated through external control when privacy shielding needs to be activated. External control includes button control, gesture control, and voice control. During the period when the first-type image source monitoring is ineffective, the infant and toddler are monitored using a second-type image source to ensure continuity of monitoring. The first-type image source is a video image captured by an image sensor, while the second-type image source is a non-video image, such as a thermal image corresponding to heat source information captured by an infrared sensor.
[0056] In one embodiment, please refer to Figure 2 S1 includes:
[0057] S101: Obtain the first type of image source;
[0058] S102: Perform privacy information detection on the first type of image source, and generate the shielding signal based on the privacy information.
[0059] Specifically, when using the first type of image source for infant care, privacy information is detected in each frame of the basic video composed of the first type of image source. When an image frame containing privacy information is detected, a shielding signal is generated, and the second type of image source is used for infant care.
[0060] In one embodiment, please refer to Figure 3 S2 further includes:
[0061] S201: Based on the shielding signal, obtain each target frame image containing privacy information in the first type of image source and each original frame header information of the target frame image;
[0062] S202: Encode and encrypt the privacy information in each of the target frame images and the corresponding original frame header information to obtain the target frame header information of each of the target frame images;
[0063] S203: Replace the original frame header information of each target frame image with the target frame header information.
[0064] Specifically, when target detection is performed using the first type of image source, privacy information is detected, and a masking signal is generated. At this time, the privacy information in the target frame image also needs to be masked to avoid privacy leakage caused by the existing video image. The original frame header information and the privacy information in the target frame image are extracted, and the privacy information and the original frame header information are encoded and encrypted to form new target frame header information. The original frame header information is replaced with the new target frame header information to obtain each target frame image after the privacy information is encrypted. By encrypting the privacy information, the playback can be masked when the video is played, thus avoiding privacy leakage. At the same time, since the encryption of the privacy information does not destroy the original basic video image data, users can also choose not to mask and play in full screen on the playback end, improving the user experience.
[0065] In one embodiment, S201 includes:
[0066] S2011: Obtain a first interval time and a second interval time for object detection on the basic video composed of the first type of image sources, wherein the first interval time is less than the second interval time;
[0067] S2012: Based on the first interval time, perform other live targets detection on the base video that are not the target infants to obtain the first frame target image;
[0068] S2013: After obtaining the first frame target image, continue to check the basic video for other live targets other than the target infants at the second interval time to obtain other frame target images;
[0069] The target frame image includes the first frame target image and the other frame target images.
[0070] Specifically, target detection is performed on each frame of the base video using a frame-sampling detection method. This reduces the computing power required for privacy information screening. Specifically, a first interval and a second interval are set for frame-sampling detection of the base video. Before any privacy information is detected, each frame of the base video is detected using the first interval until the first image corresponding to the privacy information is detected, which is recorded as the first target image. Then, according to the second interval, frame-sampling detection continues on the remaining frames of the base video until the last image corresponding to the privacy information is detected. All images between the first and last detected privacy information images are recorded as target frame images. All target frame images other than the first target image are recorded as other frame target images. The frame-sampling detection method reduces computing power consumption, and the first interval is shorter than the second interval, further accelerating the screening of target frame images.
[0071] In one embodiment, the first interval and the second interval are integer multiples of a unit time, where the unit time is the interval between two adjacent frames.
[0072] In one embodiment, if the first interval time is n times the unit time, where n is a positive integer greater than or equal to 1, step S2012 includes:
[0073] Based on the first interval time, perform other live targets (non-target infants and young children) detection on the base video to obtain the first target frame image;
[0074] If n equals 1, then the first target frame image is the first frame target image;
[0075] If n equals 2, then the frame image preceding the first target frame image is taken as the first target frame image;
[0076] If n is greater than 2, then target detection is performed on other frame images between the first target frame image and the previously selected detection frame image at a third interval time to obtain the first target frame image, wherein the third interval time is less than or equal to 2 units of time.
[0077] Specifically, when the first interval is one unit of time, each frame of the basic video is checked to obtain the first target frame image, which is also the first target frame image. When the first interval is two units of time, the basic video is checked once every one frame, which reduces the amount of data processing and improves detection efficiency. Using the frame preceding the detected first target frame image as the first target frame image avoids incomplete privacy information and eliminates the need for secondary detection, saving computer resources. When the first interval is greater than two units of time, the other frames between the last two frames detected by the first interval are sampled and detected at a third interval, preferably one or two units of time, to determine the first target frame image. By setting a third interval, after quickly completing the detection of each frame image without privacy information, the last target image can be located in a small range of multiple frames, further saving computer resources and improving detection efficiency.
[0078] In one embodiment, if the first interval is n times the unit time, where n is a positive integer greater than or equal to 1, step S2013 includes:
[0079] Based on the second interval, perform other live targets (non-target infants and young children) detection on the base video to obtain the last target frame image;
[0080] If n equals 1, then the last target frame image is the final frame target image;
[0081] If n equals 2, then the next frame image after the last target frame image is taken as the last target frame image;
[0082] If n is greater than 2, then target detection is performed on other image frames between the last target frame image and the next selected detection frame image at the second interval time, with a third interval time, to obtain the last frame target image, wherein the third interval time is less than or equal to 2 units of time.
[0083] Specifically, when the second interval is one unit of time, each frame of the base video is checked to obtain the last target frame image, which is also the final target frame image. When the second interval is two units of time, the base video is checked once every one frame, which reduces data processing and improves detection efficiency. Using the frame following the detected last target frame image as the final target frame image avoids incomplete privacy information and eliminates the need for secondary detection, saving computer resources. When the second interval is greater than two units of time, the last target frame image in which privacy information was detected during the second interval and the frame between the detected last target frame image and the frame following the last target frame image are obtained. The next detection frame image corresponding to a second interval is recorded as the reference frame image. For example, if the last detected privacy information is frame 180 and the second interval is 10 units of time, then the reference frame image is frame 190. The other frames between the last target frame image and the reference frame image are sampled and detected at a third interval, preferably 1 or 2 units of time, to determine the last target frame image. By setting the third interval, after quickly completing the detection of each frame image without privacy information, the last target image can be located in a small range of multiple frames, further saving computer resources and improving detection efficiency.
[0084] In one embodiment, S202 includes:
[0085] Target detection is performed on each of the target frame images to obtain the category information and location information of the privacy information of each target frame image;
[0086] The category information, location information, and original frame header information of each target frame image are encoded and encrypted to obtain the target frame header information.
[0087] Specifically, target detection is performed on each target frame image to determine the category information and location information corresponding to the privacy information of each target frame image. The location information is the location of the detection box of the target corresponding to the privacy information detected by the machine, and the category information is which privacy of the target to which the privacy information belongs, such as the face, other parts of the body, information carried by the privacy target, etc. The category information and location information of the privacy information are encoded and encrypted together with the frame header of the target frame image to serve as the target frame header information of the target frame image.
[0088] In one embodiment, please refer to Figure 4 S1 includes:
[0089] S111: Acquire real-time external control signals for infant and toddler care scenarios;
[0090] S112: Generate the shielding signal based on the external control signal corresponding to the privacy information;
[0091] The external control signals include: gesture control signals, voice control signals, and button control signals.
[0092] Specifically, the AI care device's switching between the first type of image source and the second type of image source includes not only passive switching when the target frame image of the first type of image source contains privacy information, but also switching by the user actively issuing control signals as needed. These control signals can be controlled by the user through voice, gestures, or buttons. User operation control can eliminate psychological barriers and improve the user experience.
[0093] In one embodiment, please refer to Figure 5 S1 includes:
[0094] S121: Obtain the blocking control signal for privacy information sent by the App / server;
[0095] S122: Generate the shielding signal according to the shielding control signal.
[0096] Specifically, with the rapid development of smart devices, AI care devices can monitor infant care in real time via server-side and mobile app. For example, when an infant cries, the user needs to enter the infant scene to soothe the infant. If directly entering or using external control as described in the previous embodiment to switch the infant care mode to achieve privacy shielding is cumbersome and does not conform to the handling logic when an infant is crying, then a privacy shielding signal can be remotely sent through the app. When the user enters the infant scene to soothe the infant, the scene has already switched to the second type of image source care mode, preventing privacy information leakage and improving the user experience.
[0097] In one embodiment, please refer to Figure 6 S2 includes:
[0098] S211: Based on the shielding signal, switch the imaging lens of the camera from the first lens to the second lens, and generate a shielding prompt signal and a care mode switching signal;
[0099] S212: Based on the care mode switching signal, continue to provide real-time care for the infant using the second type of image source;
[0100] The imaging distance of the second lens is less than that of the first lens, resulting in a blurry image of the infant scene captured by the camera.
[0101] In one embodiment, the shielding prompt signal includes: a visual action signal and / or a voice signal and / or a light signal indicating the switching between the first lens and the second lens.
[0102] Specifically, when privacy information blocking is required, the camera lens of the AI care device is switched from the first lens to the second lens. The first lens is a normal focal length lens, and the second lens is a near-focal length lens. The first lens captures a clear image of the area where the infant is located, while the second lens captures a blurry image of the same area. However, a clear image will be captured at close range with the second lens. For example, the second lens can only capture a clear image of objects about 10cm away from the camera. In this way, when caring for infants with the second type of image source, the camera can still capture a blurry video of the infant's area. When the privacy blocking needs to be manually removed, the switching between the first and second lenses can be controlled by gestures at a close distance from the camera. When switching between the first and second lenses, the AI care device will generate corresponding prompts, such as visualizing the mechanical process of switching between the first and second lenses, or issuing voice prompts or light prompts, thus clearly informing the user that no privacy information of other targets will be collected at this time, allowing them to provide peace of mind while caring for the infant, eliminating psychological barriers, and improving the user experience.
[0103] This invention provides a method for infant and toddler care based on optically shielding privacy information. It employs a combination of a first type of image source and a second type of image source for real-time infant and toddler care. The first type of image source is a video image, and the second type of image source is a thermal imaging image. When using the first type of image source for infant and toddler care, upon receiving a shielding signal for privacy information shielding, optical shielding is applied to the first lens corresponding to the first type of image source, and care continues using the second type of image source until a signal indicating the removal of the privacy information shielding is received. Then, care resumes using the first type of image source. This invention, by combining the first and second type of image sources for real-time infant and toddler care, prevents privacy leaks to other individuals caused by directly using the first type of image source, while ensuring uninterrupted care for the infant and toddler, thus improving the user experience.
[0104] Example 2
[0105] This invention also provides an infant care device based on optically shielding privacy information; please refer to [link / reference]. Figure 7 ,include:
[0106] Signal acquisition module: used to acquire the shielding signal generated during real-time monitoring of infants and young children using the first type of image source to shield privacy information;
[0107] Image shielding module: used to optically shield the first lens used to acquire the first type of image source according to the shielding signal, and continue to provide real-time care for the infant with the second type of image source until a privacy information shielding release signal is received;
[0108] The loop control module is used to continue real-time monitoring of infants and young children using the first type of image source based on the shielding release information.
[0109] The first type of image source is video images of infant care scenes captured in real time by a camera under the first lens, and the second type of image source is thermal imaging images captured by an infrared sensor.
[0110] In one embodiment, the signal acquisition module includes:
[0111] Image acquisition unit: Acquires the first type of image source;
[0112] Image analysis unit: performs privacy information detection on the first type of image source and generates the shielding signal based on the privacy information.
[0113] In one embodiment, the image masking module further includes:
[0114] Target frame acquisition unit: Based on the shielding signal, acquire each target frame image containing privacy information in the first type of image source and each original frame header information of the target frame image;
[0115] Image encoding unit: Encodes and encrypts the privacy information in each target frame image and the corresponding original frame header information to obtain the target frame header information of each target frame image;
[0116] Data update unit: Replaces the original frame header information of each target frame image with the target frame header information.
[0117] In one embodiment, the signal acquisition module includes:
[0118] External signal acquisition unit: Acquires real-time external control signals in infant and toddler care scenarios;
[0119] External signal analysis unit: Generates the shielding signal based on the external control signal corresponding to the privacy information shielding;
[0120] The external control signals include: gesture control signals, voice control signals, and button control signals.
[0121] In one embodiment, the signal acquisition module includes:
[0122] Remote signal acquisition unit: Acquires the blocking control signals for privacy information sent by the App / server;
[0123] Shielding signal processing unit: Generates the shielding signal based on the shielding control signal.
[0124] In one embodiment, the image masking module includes:
[0125] Signal switching unit: Based on the shielding signal, switches the imaging lens of the camera from the first lens to the second lens, and generates a shielding prompt signal and a care mode switching signal;
[0126] Infant and toddler care unit: Based on the care mode switching signal, it continues to provide real-time care for infants and toddlers using a second type of image source;
[0127] The imaging distance of the second lens is less than that of the first lens, resulting in a blurry image of the infant scene captured by the camera.
[0128] In one embodiment, the shielding prompt signal includes: a visual action signal and / or a voice signal and / or a light signal indicating the switching between the first lens and the second lens.
[0129] This invention provides an infant care device based on optically shielding privacy information. It employs a combination of a first type of image source and a second type of image source for real-time infant care. The first type of image source is a video image, and the second type of image source is a thermal imaging image. When using the first type of image source for infant care, upon receiving a privacy information shielding signal, optical shielding is applied to the first lens corresponding to the first type of image source, and care continues using the second type of image source until a privacy information shielding release signal is received. Then, care resumes using the first type of image source. This invention, by combining the first and second type of image sources for real-time infant care, prevents privacy leaks to other individuals caused by directly using the first type of image source, while ensuring uninterrupted infant care and improving user experience.
[0130] Example 3
[0131] This invention provides an electronic device and a medium, such as Figure 8 As shown, it includes at least one processor, at least one memory, and computer program instructions stored in the memory.
[0132] Specifically, the processor may include a central processing unit (CPU), or an application-specific integrated circuit (ASIC), or one or more integrated circuits that can be configured to implement the embodiments of the present invention. The electronic device includes at least one of the following: a camera, a mobile device with a camera, or a wearable device with a camera.
[0133] The memory may include a large-capacity storage device for data or instructions. For example, and not limitingly, the memory may include a hard disk drive (HDD), a floppy disk drive, flash memory, an optical disk drive, a magneto-optical disk drive, magnetic tape, or a Universal Serial Bus (USB) drive, or a combination of two or more of these. Where appropriate, the memory may include removable or non-removable (or fixed) media. Where appropriate, the memory may be internal or external to a data processing device. In a particular embodiment, the memory is a non-volatile solid-state memory. In a particular embodiment, the memory includes a read-only memory (ROM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), an electrically rewritable ROM (EAROM), or flash memory, or a combination of two or more of these.
[0134] The processor reads and executes computer program instructions stored in the memory to implement any of the target detection privacy video transmission and playback methods in Embodiment 1 above.
[0135] In one example, the electronic device may also include a communication interface and a bus. The processor, memory, and communication interface are connected via the bus and communicate with each other.
[0136] The communication interface is mainly used to enable communication between various modules, devices, units and / or equipment in the embodiments of the present invention.
[0137] A bus, including hardware, software, or both, couples components of an electronic device together. For example, and not limitingly, a bus may include an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industry Standard Architecture (EISA) bus, a Front Side Bus (FSB), HyperTransport (HT) interconnect, an Industry Standard Architecture (ISA) bus, an Infinite Bandwidth Interconnect, a Low Pin Count (LPC) bus, a memory bus, a Microchannel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local (VLB) bus, or other suitable buses, or combinations of two or more of these. Where appropriate, a bus may include one or more buses. While specific buses are described and illustrated in embodiments of the invention, the invention contemplates any suitable bus or interconnect.
[0138] In summary, the embodiments of the present invention provide a method, apparatus, and device for infant and toddler care based on optical shielding of privacy information. It employs a combination of a first type of image source and a second type of image source for real-time infant and toddler care. The first type of image source is a video image, and the second type of image source is a thermal imaging image. When using the first type of image source for infant and toddler care, upon receiving a shielding signal for privacy information shielding, optical shielding is applied to the first lens corresponding to the first type of image source, and care continues using the second type of image source until a signal indicating the removal of the privacy information shielding is received. Then, care resumes using the first type of image source. This invention, by combining a first type of image source with a second type of image source for real-time infant and toddler care, can prevent privacy leaks to other personnel caused by directly using the first type of image source, while ensuring uninterrupted care for infants and toddlers and improving user experience.
[0139] It should be clarified that the present invention is not limited to the specific configurations and processes described above and shown in the figures. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications, and additions, or change the order of steps, after understanding the spirit of the present invention.
[0140] The functional blocks shown in the above-described structural diagram can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc. When implemented in software, the elements of this invention are programs or code segments used to perform the required tasks. The programs or code segments can be stored on a machine-readable medium or transmitted over a transmission medium or communication link via data signals carried in a carrier wave. "Machine-readable medium" can include any medium capable of storing or transmitting information. Examples of machine-readable media include electronic circuits, semiconductor memory devices, ROM, flash memory, erasable ROM (EROM), floppy disks, CD-ROMs, optical disks, hard disks, fiber optic media, radio frequency (RF) links, etc. Code segments can be downloaded via computer networks such as the Internet, intranets, etc.
[0141] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, and not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of the present invention.
Claims
1. A baby care method based on optical shielding of private information, characterized by, The method includes: S1: Obtain a privacy-masking signal generated during real-time infant monitoring using a first type of image source; based on the masking signal, obtain target frame images containing privacy information in the first type of image source and the original frame header information of each target frame image; wherein, obtaining target frame images containing privacy information in the first type of image source includes: obtaining a first interval time and a second interval time for target detection on a basic video composed of the first type of image source, wherein the first interval time is less than the second interval time; performing other live targets other than the target infant on the basic video according to the first interval time to obtain a first frame target image; after obtaining the first frame target image, continuing to perform other live targets other than the target infant on the basic video according to the second interval time to obtain other frame target images; the target frame images include the first frame target image and the other frame target images; Target detection is performed on each of the target frame images to obtain category information and location information of privacy information for each target frame image; the category information, location information and original frame header information of each target frame image are encoded and encrypted to obtain target frame header information for each target frame image; the original frame header information of each target frame image is replaced with the target frame header information. S2: According to the shielding signal, the imaging lens of the camera is switched from the first lens to the second lens, and a shielding prompt signal and a care mode switching signal are generated to optically shield the first lens used to collect the first type of image source. According to the care mode switching signal, the second type of image source is used to continue to provide real-time care for the infant until the shielding release signal for privacy information is obtained. S3: Based on the shielding removal information, continue to provide real-time care for infants and young children using the first type of image source; The first type of image source is a video image of an infant care scene captured in real time by a camera under the first lens, and the second type of image source is a thermal imaging image captured by an infrared sensor. The imaging distance of the second lens is less than that of the first lens, resulting in a blurred image of the infant scene captured by the camera.
2. The infant care method based on optically shielded privacy information according to claim 1, characterized in that, S1 includes: S101: Obtain the first type of image source; S102: Perform privacy information detection on the first type of image source, and generate the shielding signal based on the privacy information.
3. The infant care method based on optically shielded privacy information according to claim 1, characterized in that, S1 includes: S111: Acquire real-time external control signals for infant and toddler care scenarios; S112: Generate the shielding signal based on the external control signal corresponding to the privacy information; The external control signals include: gesture control signals, voice control signals, and button control signals.
4. The infant care method based on optically shielded privacy information according to claim 1, characterized in that, S1 includes: S121: Obtain the blocking control signal for privacy information sent by the App / server; S122: Generate the shielding signal according to the shielding control signal.
5. The infant care method based on optically shielded privacy information according to claim 1, characterized in that, The shielding prompt signal includes: a visual action signal and / or a voice signal and / or a light signal indicating the switching between the first lens and the second lens.
6. A childcare device based on optically shielding privacy information, characterized in that, include: Signal acquisition module: used to acquire the shielding signal generated during real-time monitoring of infants and young children using the first type of image source to shield privacy information; A frame header processing module is used to acquire, based on the shielding signal, target frame images containing privacy information from the first type of image source and original frame header information of each target frame image; wherein, acquiring target frame images containing privacy information from the first type of image source includes: acquiring a first interval time and a second interval time for target detection on a base video composed of the first type of image source, wherein the first interval time is less than the second interval time; performing other live targets other than the target infant on the base video according to the first interval time to obtain a first frame target image; after obtaining the first frame target image, continuing to perform other live targets other than the target infant on the base video according to the second interval time to obtain other frame target images; the target frame images include the first frame target image and the other frame target images; performing target detection on each target frame image to obtain category information and location information of privacy information of each target frame image; encoding and encrypting the category information, location information and original frame header information of each target frame image to obtain target frame header information of each target frame image; and replacing the original frame header information of each target frame image with the target frame header information. Image shielding module: Used to switch the imaging lens of the camera from the first lens to the second lens according to the shielding signal, and generate a shielding prompt signal and a care mode switching signal to optically shield the first lens used to collect the first type of image source, and continue to provide real-time care for the infant and toddler with the second type of image source according to the care mode switching signal, until a privacy information shielding release signal is obtained; Loop control module: used to continue real-time care of infants and young children using the first type of image source according to the shielding release information; The first type of image source is a video image of an infant care scene captured in real time by a camera under the first lens, and the second type of image source is a thermal imaging image captured by an infrared sensor. The imaging distance of the second lens is less than that of the first lens, resulting in a blurred image of the infant scene captured by the camera.
7. An electronic device, characterized in that, include: At least one processor, at least one memory, and computer program instructions stored in the memory, which, when executed by the processor, implement the method as described in any one of claims 1-5.
8. A medium having computer program instructions stored thereon, characterized in that, When the computer program instructions are executed by a processor, the method as described in any one of claims 1-5 is implemented.
Citation Information
Patent Citations
Video encryption method and device
CN104581201A
Community wireless video monitoring system
CN111768586A
KR20210072201A
