A Method and System for Intelligent Lock Collaborative Monitoring of Baby Carriages

Abstract

The present invention discloses a method and system for collaborative monitoring of an intelligent lock and a baby stroller. The method includes: when the baby stroller leaves home, the intelligent door lock acquires and reports the baby stroller information; the intelligent light pole recognizes the external shape characteristics of the baby stroller through video images and associates and pairs them with the baby stroller information; the intelligent light pole cruises and searches for single or multiple baby stroller targets in the warning area, and through scheduling, single or multiple baby strollers are joined to form a closed-loop relay monitoring to monitor and give early warnings to the baby stroller; when a baby stroller leaves the monitoring area, the intelligent light pole reschedules the remaining baby strollers to reconstruct the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area. By using the embodiments of the present invention, efficient collaborative monitoring of the intelligent lock and the baby stroller can be achieved.

Description

Technical Field

[0001] The present invention belongs to the technical field of intelligent locks, and particularly relates to a method and system for collaborative monitoring of an intelligent lock and a baby stroller. Background Art

[0002] When a babysitter or an adult family member pushes a baby stroller out to take the baby for a walk and is in the community or park, they often reach areas that are very dangerous for babies, such as the edges of ditches, ponds, bridges, guardrails, etc. The adults pushing the stroller often relax their vigilance and leave the baby stroller alone in the dangerous area without supervision, which brings great safety risks. The existing method is to install electronic devices on children or baby strollers for tracking, but it does not fundamentally solve the safety problem of the baby stroller losing supervision when moving in a dangerous area. Summary of the Invention

[0003] The purpose of the present invention is to provide a method and system for collaborative monitoring of an intelligent lock and a baby stroller to solve the deficiencies in the prior art and enable efficient collaborative monitoring of the intelligent lock and the baby stroller.

[0004] An embodiment of the present application provides a method for collaborative monitoring of an intelligent lock and a baby stroller, the method comprising:

[0005] When the baby stroller leaves home, the intelligent door lock acquires and reports the baby stroller information;

[0006] The intelligent light pole identifies the external shape characteristics of the baby stroller through video images and associates and pairs them with the baby stroller information;

[0007] The intelligent light pole cruises and searches for single or multiple baby stroller targets in the warning area, and monitors and warns the baby stroller by dispatching single or multiple baby strollers to join the closed-loop relay monitoring;

[0008] When a baby stroller leaves the monitoring area, the intelligent light pole reschedules the remaining baby strollers and reconstructs the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area.

[0009] Optionally, the step of when the baby stroller leaves home, the intelligent door lock acquires and reports the baby stroller information includes:

[0010] After the baby stroller is started, it connects to the intelligent door lock through WiFi;

[0011] The intelligent door lock extracts the baby stroller ID and WiFi-MAC address and compares them with the baby stroller list;

[0012] If it is a new baby stroller, the baby stroller list is updated and the information is synchronized to the park management platform.

[0013] Optionally, the step of the intelligent light pole identifying the external shape characteristics of the baby stroller through video images and associating and pairing them with the baby stroller information includes:

[0014] The intelligent lamp post listens to the nearby WiFi-MAC addresses through a WiFi-MAC listener and compares them with the list of platform baby carriages;

[0015] If the detected WiFi-MAC address matches the platform list, the corresponding baby carriage ID is extracted;

[0016] The external shape features of the baby carriage are identified through intelligent video image analysis, and the external shape features are uniquely associated and paired with the WiFi-MAC address and updated to the platform baby carriage list.

[0017] Optionally, the monitoring and warning of the baby carriage include:

[0018] The intelligent lamp post rotates the pan-tilt camera for video target tracking according to the external shape features of the baby carriage;

[0019] Judge whether the baby carriage enters a preset warning area;

[0020] If it enters the warning area, it notifies the baby carriage to adjust the wheel damping value through WiFi networking to limit or lock the movement of the baby carriage.

[0021] Optionally, the addition of closed-loop relay monitoring includes:

[0022] When the intelligent lamp post discovers the second baby carriage, it schedules the two baby carriages to monitor each other;

[0023] Send the external shape features of the first baby carriage to the second baby carriage, and notify it to rotate the pan-tilt camera to track the first baby carriage;

[0024] Send the external shape features of the second baby carriage to the first baby carriage, and notify it to rotate the pan-tilt camera to track the second baby carriage;

[0025] The intelligent lamp post receives the video images of multiple baby carriage pan-tilt cameras, enhances the monitoring ability, and at the same time releases the pan-tilt camera for cruising in other areas.

[0026] Another embodiment of the present application provides a system for collaborative monitoring of an intelligent lock and a baby carriage, and the system includes:

[0027] An acquisition module, configured to obtain and report baby carriage information when the baby carriage leaves home by the intelligent door lock;

[0028] An identification module, configured to identify the external shape features of the baby carriage by the intelligent lamp post through video images and associate and pair them with the baby carriage information;

[0029] A monitoring module, which is used to cruise the intelligent light pole and search for single or multiple baby carriage targets in the warning area, and dispatch single or multiple baby carriages to join the closed-loop relay monitoring, so as to monitor and give early warnings to the baby carriages;

[0030] A reconstruction module, which is used to reschedule the remaining baby carriages by the intelligent light pole when a baby carriage leaves the monitoring area, and reconstruct the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area.

[0031] Another embodiment of the present application provides a storage medium, in which a computer program is stored, and the computer program is set to execute the method described in any one of the above when running.

[0032] Another embodiment of the present application provides an electronic device, including a memory and a processor. A computer program is stored in the memory, and the processor is set to run the computer program to execute the method described in any one of the above.

[0033] Compared with the prior art, a method for collaborative monitoring of an intelligent lock and a baby carriage provided by the present invention. When the baby carriage leaves home, the intelligent door lock acquires and reports the baby carriage information; the intelligent light pole identifies the external shape characteristics of the baby carriage through video images and associates and pairs them with the baby carriage information; the intelligent light pole cruises and searches for single or multiple baby carriage targets in the warning area, and dispatches single or multiple baby carriages to join the closed-loop relay monitoring to monitor and give early warnings to the baby carriages; when a baby carriage leaves the monitoring area, the intelligent light pole reschedules the remaining baby carriages and reconstructs the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area, so as to realize the efficient collaborative monitoring of the intelligent lock and the baby carriage. BRIEF DESCRIPTION OF THE DRAWINGS

[0034] Figure 1 It is a hardware structure block diagram of a computer terminal for a method of collaborative monitoring of an intelligent lock and a baby carriage provided by an embodiment of the present invention;

[0035] Figure 2 It is a flow schematic diagram of a method for collaborative monitoring of an intelligent lock and a baby carriage provided by an embodiment of the present invention;

[0036] Figure 3 It is a structural schematic diagram of a system for collaborative monitoring of an intelligent lock and a baby carriage provided by an embodiment of the present invention. DETAILED DESCRIPTION OF THE EMBODIMENTS

[0037] The embodiments described below by referring to the drawings are exemplary and are only used to explain the present invention, and cannot be construed as limiting the present invention.

[0038] An embodiment of the present invention first provides a method for collaborative monitoring of an intelligent lock and a baby carriage. This method can be applied to an electronic device, such as a computer terminal, specifically, such as an ordinary computer, etc.

[0039] The following takes the operation on a computer terminal as an example for a detailed description. Figure 1 The following is a hardware structure block diagram of a computer terminal for a method of intelligent lock collaborative baby stroller monitoring provided by an embodiment of the present invention. As Figure 1 shown, the computer device includes a processor, a memory, and a network interface connected through a system bus. Among them, the memory may include a non-volatile storage medium and an internal memory.

[0040] The non-volatile storage medium can store an operating system and a computer program. The computer program includes program instructions, and when the program instructions are executed, the processor can execute any method of intelligent lock collaborative baby stroller monitoring.

[0041] The processor is used to provide computing and control capabilities to support the operation of the entire computer device.

[0042] The internal memory provides an environment for the operation of the computer program in the non-volatile storage medium. When the computer program is executed by the processor, the processor can execute any method of intelligent lock collaborative baby stroller monitoring.

[0043] The network interface is used for network communication, such as sending assigned tasks, etc. Those skilled in the art can understand that Figure 1 the structure shown in is only a block diagram of some structures related to the solution of the present application, and does not constitute a limitation on the computer device to which the solution of the present application is applied. The specific computer device may include more or fewer components than those shown in the figure, or combine some components, or have different component arrangements.

[0044] It should be understood that the processor may be a central processing unit (CPU), and the processor may also be other general-purpose processors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc. Among them, the general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc.

[0045] See Figure 2 , an embodiment of the present invention provides a method of intelligent lock collaborative baby stroller monitoring, which may include the following steps:

[0046] S201. When the stroller leaves home, the smart door lock acquires and reports stroller information. Specifically, the process of the smart door lock acquiring and reporting stroller information when the stroller leaves home includes:

[0047] After the stroller is started, it connects to the smart door lock via WiFi.

[0048] The smart door lock extracts the stroller ID and WiFi-MAC address and compares them with the stroller list.

[0049] If it is a new stroller, the stroller list is updated and the information is synchronized to the park management platform.

[0050] S202. The smart light pole identifies the external shape features of the stroller through video images and associates and pairs them with the stroller information. Specifically, the process of the smart light pole identifying the external shape features of the stroller through video images and associating and pairing them with the stroller information includes:

[0051] The smart light pole listens for nearby WiFi-MAC addresses through a WiFi-MAC listener and compares them with the stroller list on the platform.

[0052] If the detected WiFi-MAC address matches the platform list, the corresponding stroller ID is extracted.

[0053] The external shape features of the stroller are identified through intelligent video analysis, and the external shape features are uniquely associated and paired with the WiFi-MAC address and updated to the stroller list on the platform.

[0054] S203. The smart light pole cruises and searches for single or multiple stroller targets in the warning area, and dispatches single or multiple strollers to join the closed-loop relay monitoring to monitor and warn the strollers. Specifically, the monitoring and warning of the strollers includes:

[0055] The smart light pole rotates the pan-tilt camera for video target tracking according to the external shape features of the stroller.

[0056] Determine whether the stroller enters the preset warning area.

[0057] If it enters the warning area, it notifies the stroller to adjust the wheel damping value via WiFi to restrict or lock the movement of the stroller.

[0058] S204. When a stroller leaves the monitoring area, the smart light pole re-dispatches the remaining strollers to reconstruct the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area. Specifically, the process of joining the closed-loop relay monitoring includes:

[0059] When the smart light pole discovers the second stroller, it dispatches the two strollers to monitor each other.

[0060] Send the external shape features of the first stroller to the second stroller, and notify it to rotate the pan-tilt camera to track the first stroller;

[0061] Send the external shape features of the second stroller to the first stroller, and notify it to rotate the pan-tilt camera to track the second stroller;

[0062] The intelligent light pole receives the video images of multiple stroller pan-tilt cameras, enhances the monitoring ability, and at the same time releases the pan-tilt camera for cruising in other areas.

[0063] The present invention proposes a method for monitoring strollers by using the cooperation of a household intelligent lock, a park intelligent light pole and a stroller. When the stroller leaves the house, it reports its own wifi-mac through the intelligent door lock. In the park, the intelligent light pole is used to match the external shape features of the stroller with the wifi-mac address, and then the intelligent light pole is used to schedule the closed-loop relay tracking and monitoring between multiple strollers, dynamically adding multiple virtual cameras to the intelligent light pole. The purpose of the present invention is to provide a method for monitoring strollers by using the cooperation of a household intelligent lock, a park intelligent light pole and a stroller, so as to monitor and control the dangerous moving behavior of strollers in high-risk areas of the park. Among them, the intelligent door lock: also called the intelligent lock, refers to an improvement based on the traditional mechanical lock, and is a more intelligent and simpler lock in terms of user security, identification and management. The intelligent door lock referred to in this article has the function of video image AI recognition.

[0064] Stroller: It refers to a tool vehicle designed to provide convenience for infants' outdoor activities with networking and monitoring functions, which can be networked with intelligent locks, etc., and is equipped with a spherical pan-tilt camera installed on a raised vertical pole to monitor the surrounding area.

[0065] Intelligent light pole: It refers to a device arranged in the park, equipped with a spherical pan-tilt camera and capable of performing preset position automatic inspection, networking with the platform, and supporting networking communication with the stroller through WIFI.

[0066] In practical applications, the complete process of a technical implementation is as follows:

[0067] (1) Pre-set conditions:

[0068] Baby stroller installed with intelligent vehicle lock: The intelligent vehicle lock includes functions such as wifi communication, pan-tilt camera, and vehicle damping control. It is connected to the intelligent door lock or intelligent light pole through wifi networking (each baby intelligent vehicle lock has a unique ID, wifi-mac, and intelligent door lock ID). When at home, it is connected to the intelligent lock. The baby stroller is connected to the intelligent door lock through wifi at home, and the intelligent door lock updates the list of baby strollers in this household (baby stroller ID, wifi-mac). When in the park, it is connected to the intelligent light pole. The baby stroller is connected to the intelligent light pole through wifi in the park, and the intelligent light pole updates the list of baby strollers under this light pole (baby stroller ID, wifi-mac, baby stroller shape characteristics, etc.).

[0069] Intelligent door lock: Also known as an intelligent lock, it refers to a lock improved on the basis of a traditional mechanical lock, which is more intelligent and convenient in terms of user security, identification, and management. The intelligent door lock mentioned in this article has the function of video image AI recognition.

[0070] Baby stroller: It refers to a tool vehicle designed to facilitate outdoor activities for babies, with functions such as networking and monitoring. It can be connected to an intelligent lock, etc., and is equipped with a pick-up vertical pole to install a spherical camera to monitor the surrounding area.

[0071] Intelligent light pole: It refers to a device arranged in the park, equipped with a spherical pan-tilt camera and capable of performing preset position automatic inspection, connected to the platform, and supporting wifi connection and communication with baby strollers.

[0072] Note: The intelligent vehicle lock of the baby stroller is equipped with a wheel damping controller to control the rotation or braking of the wheels. The baby stroller has a telescopic vertical pole about 1 meter high, and a pan-tilt camera is installed at the top of the vertical pole for video image monitoring. The rotation and braking of the wheels of the baby stroller are controlled by adjusting the damping amplitude value. For example, there are 3 gears. When the damping value is the largest (3rd gear), the baby stroller is locked / stopped by the brake. When the damping value is in the middle gear (2nd gear), it is partially locked / moving the baby stroller is difficult. When the damping value is in the 1st gear, the baby stroller is completely released from the brake. For the sake of convenience of description, the baby stroller installed with an intelligent vehicle lock will be uniformly referred to as a baby stroller later. The baby stroller shape characteristics are the structured feature description information of the baby stroller shape image collected by the intelligent light pole and analyzed by video image intelligence. For the sake of convenience of description, the feature information of the baby stroller shape after structuring is simply referred to as the baby stroller shape characteristics.

[0073] An intelligent door lock is installed on the household entrance door: Each intelligent door lock has an independent door lock ID, door lock IP address, door lock geographical location, etc., and is connected to the park management platform and registered with the platform. The platform records the door lock list, including door lock ID, door lock IP address, door lock geographical location, baby stroller ID, wifi-mac, etc.

[0074] Description: For the sake of convenience in description, hereinafter, the intelligent door lock for household entrance doors will be simply referred to as the intelligent door lock; when the intelligent door lock is connected to the baby carriage via Wi-Fi, it obtains the baby carriage ID and Wi-Fi - MAC.

[0075] Intelligent lamp posts are installed in the park: Each intelligent lamp post has a unique lamp post ID, IP address, and lamp post geographical location, and is connected to the park management platform and registers with the platform. The platform records the list of intelligent lamp posts, including the lamp post ID, IP address, lamp post geographical location, etc.

[0076] Description: The intelligent lamp post is equipped with a pan-tilt camera that is set at fixed preset points according to the park management. Usually, the pan-tilt camera conducts automatic cruising and can also be switched to video image target search and tracking when a target is detected; for the sake of convenience in description, hereinafter, the intelligent lamp posts in the park will be uniformly simply referred to as intelligent lamp posts).

[0077] Park management platform: Hereinafter, it will be uniformly simply referred to as the platform, which records the list of baby carriages on the platform (data items include door lock ID, door lock IP address, door lock geographical location, baby carriage ID, baby carriage Wi-Fi - MAC, baby carriage appearance characteristics, etc.) and the list of intelligent lamp posts (data items include lamp post ID, IP address, lamp post geographical location, etc.);

[0078] (2) When the baby carriage leaves home, the intelligent door lock obtains and reports the baby carriage ID and Wi-Fi - MAC;

[0079] Before going out, the person pushing the baby carriage starts the baby carriage (Note: For power saving, the baby carriage is in a shutdown state when parked at home). After self-check, the baby carriage sets the wheel damping value to gear 1 (releases the wheel brake of the baby carriage). When leaving the intelligent door lock, the baby carriage connects to the intelligent door lock via Wi-Fi. The intelligent door lock extracts the baby carriage ID and Wi-Fi - MAC information and compares it with the list of baby carriages. If it is a new baby carriage, the ID and Wi-Fi - MAC of this baby carriage are updated to the list of baby carriages and synchronized with the platform for update.

[0080] Description: When the intelligent door lock does not detect a new baby carriage and the list of baby carriages on the intelligent lock remains unchanged, no update message is actively sent.

[0081] (3) The intelligent lamp post identifies the appearance characteristics of the baby carriage through video images and associates and pairs them with the baby carriage Wi-Fi - MAC: The appearance characteristics of the baby carriage and the baby carriage Wi-Fi - MAC form a unique association;

[0082] The smart light pole identifies the baby carriage wifi-mac through a wifi-mac listener: The smart light pole continuously listens for the wifi-mac near the light pole through the wifi-mac listener. When the wifi-mac is detected, it queries the baby carriage wifi-mac in the baby carriage list maintained by the platform. When the detected wifi-mac is the same as a certain baby carriage wifi-mac in the platform baby carriage list, it extracts the baby carriage ID of this baby carriage wifi-mac for caching; if it is not the same as all the baby carriage wifi-macs in the baby carriage list, (indicating that the detected wifi-mac is not the wifi-mac of a baby carriage), it discards this wifi-mac.

[0083] The smart light pole identifies the baby carriage through video intelligent analysis:

[0084] When the smart light pole successfully detects 1 baby carriage wifi-mac, it immediately rotates the pan-tilt camera to find the baby carriage through video image intelligent analysis. If only one baby carriage is identified, it pairs this baby carriage with the baby carriage wifi-mac, extracts the baby carriage shape characteristics and caches them together with the baby carriage wifi-mac and the baby carriage ID. At the same time, it updates the baby carriage shape characteristics to the platform baby carriage list;

[0085] If there are multiple baby carriages and multiple baby carriage wifi-macs appearing at the scene at the same time, direct pairing cannot be successful. At this time, if the platform already has successfully paired and saved baby carriage shape characteristics, it first pairs and excludes them through the comparison of the baby carriage shape characteristics saved by the platform. For the remaining ones that cannot be paired through the baby carriage shape characteristics stored by the platform, there are the following several processing methods:

[0086] 1) If the platform does not have successfully paired and saved baby carriage shape characteristics (it may be that the baby carriage goes out for the first time and is captured and identified by the smart light pole), it sends the characteristics of the multiple unpaired baby carriages and the multiple baby carriage wifi-macs of this light pole (assumed to be pole 1#) to the surrounding light poles (assumed to be pole 2#); Pole 2# compares the baby carriage characteristics and the multiple baby carriage wifi-macs of pole 1# and this light pole. If there is only one pair of baby carriage characteristics and baby carriage wifi-macs that appear in both pole 2# and pole 1#, then this pair of baby carriage characteristics and baby carriage wifi-macs is determined to be successfully paired; after excluding one pair, at this time, if there is only one pair of unpaired baby carriage characteristics and multiple baby carriage wifi-macs remaining in either pole 2# or pole 1#, then this remaining pair of baby carriage characteristics and multiple baby carriage wifi-macs is determined to be successfully paired.

[0087] 2) If the pairing still fails after the above methods, continue to expand to more lamp posts and continue the pairing according to the above methods, or wait for the opportunity when the baby carriage appears alone under a certain lamp post to achieve pairing. This matching process continues until all pairings are successful.

[0088] Note: The listening of the wifi-mac is based on the principle that the wifi wireless network card will send its own wifi-mac address during communication; since many other mobile terminals may also turn on the wifi, in order to distinguish whether the obtained wifi-mac is the wifi-mac of the baby carriage, it is necessary to compare it with the list of baby carriage wifi-macs saved by the platform; the video intelligent analysis technology for identifying the baby carriage can use the description information of the baby carriage shape features trained by NLP for comparison.

[0089] Example of many-to-many pairing: When the combination relationship between the baby carriage shape features and the baby carriage wifi-mac collected by the #1 lamp post is (shape 1, shape 2, mac1, mac2), and the combination relationship between the baby carriage shape features and the baby carriage wifi-mac collected by the #2 lamp post is (shape 2, shape 3, mac2, mac3), then the #2 lamp post uses the exclusion method to exclude those that only appear once among the two lamp posts of the #1 and #2 lamp posts (the #1 lamp post excludes shape 1 and mac1, and the remaining are shape 2 and mac2; the #2 lamp post excludes shape 3 and mac3, and the remaining are shape 2 and mac2). The remaining and identical (shape 2, mac2) of the #1 and #2 can be successfully paired. Then, the remaining (shape 1, mac1) of the #1 is successfully paired, and the remaining (shape 3, mac3) of the #2 is successfully paired. If the remaining of the #1 and #2 after the exclusion method is not a pair, then the pairing of the #2 fails this time; if the remaining of the #1 and #2 after the exclusion method is a pair and is successfully paired, and the remaining of the #1 and #2 is not a pair, then the remaining that is not a pair cannot be successfully paired and must continue to wait or cooperate with other lamp posts.

[0090] (4) The intelligent lamp post cruises and searches for a single baby carriage target in the warning area: The intelligent lamp post discovers the monitoring and warning of a single baby carriage.

[0091] The intelligent lamp post in the park identifies the Wi-Fi MAC of a baby carriage (for the sake of convenience, assume it is baby carriage A) through a Wi-Fi MAC listener, and associates the external shape characteristics of baby carriage A from the baby carriage list of the lamp post according to the Wi-Fi MAC. The intelligent lamp post stops the regular cruise of the pan-tilt camera at the preset points, rotates the pan-tilt camera according to the external shape characteristics of A to detect and identify A in the video image. After detecting and identifying A at a certain position, the pan-tilt camera enters the video target tracking mode for A, and judges whether to enter or leave the preset warning area based on the position of A. If it enters the warning area, the pre-plan is activated (for example, after entering the warning area, the intelligent lamp post notifies baby carriage A to adjust the wheel damping value to 2 through Wi-Fi networking to increase the moving resistance. If it reaches the boundary of the warning line, it notifies the baby carriage to adjust the wheel damping value to 3 to lock the wheels of the baby carriage to prevent further danger);

[0092] Note: The warning area is a video warning area set in the video monitoring scene at a certain cruise point of the pan-tilt camera. It is a relatively dangerous area for infants and young children, such as the areas by ditches, ponds, bridges, and guardrail edges. The virtual line of the area boundary is delimited in the video image of this area. This area is the warning area preset by the intelligent lamp post; The adjustment of the wheel damping of the baby carriage is realized by the intelligent lamp post through Wi-Fi networking with the baby carriage; In the closed-loop relay monitoring mode formed by multiple baby carriages, according to the same monitoring, warning and linkage pre-plan for controlling the wheel damping of the baby carriage in this step, it will not be repeated later;

[0093] (5)The pan-tilt camera of the intelligent lamp post discovers the second baby carriage: Establish mutual monitoring between the two baby carriages to enhance the video image acquisition ability of the intelligent lamp post;

[0094] When the smart light pole finds a second baby carriage (for the sake of convenience, it is assumed to be baby carriage B) during the tracking and monitoring process of A, according to the method of step (4), the smart light pole queries the baby carriage appearance features of B from the list of baby carriages on the platform through the baby carriage wifi-mac detected, and uses the baby carriage appearance features of B to rotate the pan-tilt camera to perform video image target detection and recognition, and identify B's position, and judge whether B is in the warning area (assuming that B has entered the warning area at this time; if it is not in the warning area, the video target tracking will not be performed. When the closed-loop relay monitoring is established and the preset position cruise is executed, the position of B will be further judged). At this time, the smart light pole sends the baby carriage appearance features of A to B through the wifi network, and notifies B to rotate the baby carriage pan-tilt camera to find A according to A's baby carriage appearance features. After B finds A, it starts video target tracking of A. At the same time, it sends the baby carriage appearance features of B to A, and notifies A to rotate the baby carriage pan-tilt camera to find B according to B's baby carriage appearance features. After A finds B, it starts video tracking of B. The smart light pole receives the video images collected by the A and B PTZ cameras (at this time, the smart light pole has three cameras collecting video: the light pole's PTZ camera, and the PTZ cameras A and B). At this time, the smart light pole can use the mutual monitoring of the two strollers to ensure monitoring of the area, and then cruise the PTZ camera to monitor other areas.

[0095] Note: When the smart light pole implements the PTZ cameras of A and B to monitor each other, if other abnormal events occur, the light pole can rotate the PTZ (such as looking for other strollers, cruising, or forced position switching by the platform operator) without causing A and B to lose monitoring.

[0096] (6) Smart light poles dispatch multiple baby carriages to join closed-loop relay monitoring: When multiple baby carriages appear, the video image acquisition capability of the smart light poles is enhanced by building a monitoring queue of closed-loop relays with the baby carriages connected head to tail.

[0097] When the smart light pole finds the third baby carriage (for the sake of convenience, let's assume it's baby carriage C), according to the method in step (4), the smart light pole determines the existence of C. At this time, A and B are monitoring each other. Based on the order of identifying the baby carriages ABC, the smart light pole sends B's baby carriage appearance features to C via Wi-Fi, and notifies C to rotate the baby carriage's PTZ camera to find B based on B's baby carriage appearance features. After C finds B, it starts video tracking B. At the same time, it sends C's baby carriage appearance features to A, and notifies A to rotate the baby carriage's PTZ camera to find C based on C's baby carriage appearance features. After A finds C, it starts video tracking C. At this point, the three baby carriages are in a closed-loop relay monitoring mode, with B monitoring A, C monitoring B, and A monitoring C (at this point, the smart light pole has four cameras collecting video: the light pole's PTZ camera, and the PTZ cameras of A, B, and C).

[0098] When the smart light pole in the park detects a fourth stroller (for ease of illustration, let's assume it's stroller D), the above steps will establish a closed-loop relay monitoring mode for the four strollers, with B monitoring A, C monitoring B, D monitoring C, and A monitoring D. If more strollers appear, the same steps will be repeated to add each new stroller. The smart light pole will then utilize the closed-loop relay of multiple strollers to ensure monitoring of the entire area, allowing the PTZ camera to patrol and monitor other areas.

[0099] (7) Reconstruction of the closed-loop relay monitoring queue when multiple baby carriages leave the smart light pole: When one or more baby carriages leave, the video image acquisition capability of the smart light pole is maintained by reconstructing the monitoring queue of the closed-loop relay with the baby carriages connected head to tail.

[0100] Assume that there are already four strollers in a closed-loop relay monitoring pattern: B monitors A, C monitors B, D monitors C, and A monitors D. If B leaves the area, the smart light pole will reconfigure according to the established order: A monitors B, B monitors C, C monitors D, and D monitors A (this means A has lost B's target and C has lost B's monitoring). The smart light pole will then send stroller A's profile to C, instructing C to find and track A; C's profile to D, instructing D to find and track C; and D's profile to A, instructing A to find and track D. This reconfiguration will create a closed-loop relay monitoring pattern for the remaining three strollers: B monitors A, D monitors B, and A monitors D. The smart light pole can then utilize the closed-loop relay of the remaining strollers to maintain surveillance in the area, while still allowing the PTZ camera to patrol and monitor other areas.

[0101] After all strollers have left the campus smart light, the smart light pole continues to listen, ending the process.

[0102] Note: If more strollers leave, continue to delete the newly departed strollers according to this step to form a ring relay monitoring mode consisting of the remaining strollers.

[0103] The smart light pole uses the pairing relationship between the baby stroller's WiFi-MAC and the baby stroller's appearance features to accurately dispatch multiple baby strollers in the warning area according to the closed-loop relay monitoring mode. The baby stroller's pan-tilt camera uses the baby stroller's appearance features to find the baby stroller to be tracked and monitored, and transmits the video images collected by each to the smart light pole. This allows the smart light pole to obtain multiple virtual cameras that are dynamically increased or decreased to supplement the shortcomings of the smart light pole's single camera, without delaying the cruising of the pan-tilt preset position.

[0104] It can be seen that when the stroller leaves home, the intelligent door lock acquires and reports stroller information; the intelligent light pole recognizes the external shape features of the stroller through video images and associates and pairs them with the stroller information; the intelligent light pole cruises and searches for single or multiple stroller targets in the warning area, and monitors and warns the stroller by dispatching single or multiple strollers to join the closed-loop relay monitoring; when a stroller leaves the monitoring area, the intelligent light pole reschedules the remaining strollers and reconstructs the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area, so as to realize the efficient collaborative monitoring of the intelligent lock and the stroller.

[0105] Another embodiment of the present invention provides a system for collaborative monitoring of an intelligent lock and a stroller. Refer to Figure 3 , the system may include:

[0106] An acquisition module 301, configured to when the stroller leaves home, the intelligent door lock acquires and reports stroller information;

[0107] An identification module 302, configured to the intelligent light pole recognizes the external shape features of the stroller through video images and associates and pairs them with the stroller information;

[0108] A monitoring module 303, configured to the intelligent light pole cruises and searches for single or multiple stroller targets in the warning area, and monitors and warns the stroller by dispatching single or multiple strollers to join the closed-loop relay monitoring;

[0109] A reconstruction module 304, configured to when a stroller leaves the monitoring area, the intelligent light pole reschedules the remaining strollers and reconstructs the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area.

[0110] It can be seen that when the stroller leaves home, the intelligent door lock acquires and reports stroller information; the intelligent light pole recognizes the external shape features of the stroller through video images and associates and pairs them with the stroller information; the intelligent light pole cruises and searches for single or multiple stroller targets in the warning area, and monitors and warns the stroller by dispatching single or multiple strollers to join the closed-loop relay monitoring; when a stroller leaves the monitoring area, the intelligent light pole reschedules the remaining strollers and reconstructs the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area, so as to realize the efficient collaborative monitoring of the intelligent lock and the stroller.

[0111] The embodiment of the present invention also provides a storage medium, in which a computer program is stored, and the computer program is configured to execute the steps in any one of the above method embodiments when running.

[0112] Specifically, in this embodiment, the above storage medium may be configured to store a computer program for executing the following steps:

[0113] S201, when the stroller leaves the house, the smart door lock obtains and reports the stroller information;

[0114] S202, the smart light pole recognizes the appearance features of the baby stroller through the video image and associates and pairs it with the baby stroller information;

[0115] S203: The smart light pole patrols and searches for one or more baby strollers in the warning zone. It dispatches one or more baby strollers to join the closed-loop relay monitoring to monitor and issue warnings for the baby strollers.

[0116] S204, when a stroller leaves the monitoring area, the smart light pole re-dispatches the remaining strollers and reconstructs the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area.

[0117] It can be seen that when the stroller leaves the house, the smart door lock obtains and reports the stroller information; the smart light pole recognizes the appearance features of the stroller through video images and associates and pairs it with the stroller information; the smart light pole cruises and searches for single or multiple stroller targets in the warning area, and dispatches single or multiple strollers to join the closed-loop relay monitoring to monitor and issue early warnings for the strollers; when a stroller leaves the monitoring area, the smart light pole re-dispatches the remaining strollers and reconstructs the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area, thereby enabling efficient collaborative monitoring of smart locks and strollers.

[0118] An embodiment of the present invention further provides an electronic device, comprising a memory and a processor, wherein the memory stores a computer program, and the processor is configured to run the computer program to perform the steps in any one of the above method embodiments.

[0119] Specifically, the electronic device may further include a transmission device and an input / output device, wherein the transmission device is connected to the processor, and the input / output device is connected to the processor.

[0120] Specifically, in this embodiment, the processor may be configured to execute the following steps through a computer program:

[0121] S201, when the stroller leaves the house, the smart door lock obtains and reports the stroller information;

[0122] S202, the smart light pole recognizes the appearance features of the baby stroller through the video image and associates and pairs it with the baby stroller information;

[0123] S203: The smart light pole patrols and searches for one or more baby strollers in the warning zone. It dispatches one or more baby strollers to join the closed-loop relay monitoring to monitor and issue warnings for the baby strollers.

[0124] S204, when a stroller leaves the monitoring area, the smart light pole re-dispatches the remaining strollers and reconstructs the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area.

[0125] It can be seen that when the stroller leaves the house, the smart door lock obtains and reports the stroller information; the smart light pole recognizes the appearance features of the stroller through video images and associates and pairs it with the stroller information; the smart light pole cruises and searches for single or multiple stroller targets in the warning area, and dispatches single or multiple strollers to join the closed-loop relay monitoring to monitor and issue early warnings for the strollers; when a stroller leaves the monitoring area, the smart light pole re-dispatches the remaining strollers and reconstructs the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area, thereby enabling efficient collaborative monitoring of smart locks and strollers.

[0126] The above describes in detail the structure, features and effects of the present invention based on the embodiments shown in the drawings. The above is only a preferred embodiment of the present invention, but the scope of implementation of the present invention is not limited to what is shown in the drawings. Any changes made in accordance with the concept of the present invention, or modifications to equivalent embodiments with equivalent changes, which do not exceed the spirit covered by the description and drawings, should be within the scope of protection of the present invention.

Claims

1. A method for intelligent lock collaborative baby stroller monitoring, characterized in that, The method includes: When the stroller leaves home, the smart door lock acquires and reports stroller information; The smart light pole identifies the stroller's external shape features through video images and associates and pairs them with the stroller information; The smart light pole cruises and searches for single or multiple stroller targets in the warning area, and schedules single or multiple strollers to join the closed-loop relay monitoring to monitor and give early warnings to the strollers. Among them, the joining of the closed-loop relay monitoring includes: when the smart light pole discovers the second stroller, schedules the two strollers to monitor each other; sends the external shape features of the first stroller to the second stroller, and notifies the second stroller to rotate the pan-tilt camera to track the first stroller; sends the external shape features of the second stroller to the first stroller, and notifies the first stroller to rotate the pan-tilt camera to track the second stroller; when the smart light pole receives the video images of multiple stroller pan-tilt cameras, releases the pan-tilt cameras at the same time to cruise in other areas to enhance the monitoring ability; When a stroller leaves the monitoring area, the smart light pole reschedules the remaining strollers to reconstruct the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area.

2. The method according to claim 1, characterized in that The step of when the stroller leaves home, the smart door lock acquires and reports stroller information includes: After the stroller starts, it connects to the smart door lock through WiFi; The smart door lock extracts the stroller ID and WiFi-MAC address and compares them with the stroller list; If it is a new stroller, updates the stroller list and synchronizes the information to the park management platform.

3. The method according to claim 2, wherein The step of the smart light pole identifying the stroller's external shape features through video images and associating and pairing them with the stroller information includes: The smart light pole listens for nearby WiFi-MAC addresses through a WiFi-MAC listener and compares them with the platform stroller list; If the listened WiFi-MAC address matches the platform list, extracts the corresponding stroller ID; Identifies the stroller's external shape features through intelligent video image analysis, uniquely associates and pairs the external shape features with the WiFi-MAC address, and updates them to the platform stroller list.

4. The method according to claim 3, wherein The monitoring and early warning of the stroller includes: The smart light pole rotates the pan-tilt camera for video target tracking according to the stroller's external shape features; Judges whether the stroller enters a preset warning area; If it enters the warning area, notifies the stroller to adjust the wheel damping value through WiFi networking to restrict or lock the movement of the stroller.

5. An intelligent lock collaborative baby stroller monitoring system, characterized in that, [[ID= ​ ​ A monitoring module is used to cruise the intelligent light pole and search for single or multiple baby carriage targets in the warning area, and dispatch single or multiple baby carriages to join the closed-loop relay monitoring to monitor and give early warnings to the baby carriages. Among them, the "joining the closed-loop relay monitoring" includes: when the intelligent light pole discovers the second baby carriage, dispatch the two baby carriages to monitor each other; send the external shape features of the first baby carriage to the second baby carriage, and notify the second baby carriage to rotate the pan-tilt camera to track the first baby carriage; send the external shape features of the second baby carriage to the first baby carriage, and notify the first baby carriage to rotate the pan-tilt camera to track the second baby carriage; when the intelligent light pole receives the video images of multiple baby carriage pan-tilt cameras, release the pan-tilt cameras simultaneously for cruising in other areas to enhance the monitoring ability; A reconstruction module is used to, when a baby carriage leaves the monitoring area, the intelligent light pole re-dispatch the remaining baby carriages to reconstruct the closed-loop relay monitoring queue to ensure continuous coverage of the monitoring area.

6. The system according to claim 5, characterized in that, The obtaining module is specifically used for: After the baby carriage is started, it is connected to the intelligent door lock through WiFi; The intelligent door lock extracts the baby carriage ID and WiFi-MAC address and compares them with the baby carriage list; If it is a newly added baby carriage, update the baby carriage list and synchronize the information to the park management platform.

7. The system according to claim 6, characterized in that, The identification module is specifically used for: The intelligent light pole listens for nearby WiFi-MAC addresses through a WiFi-MAC listener and compares them with the platform baby carriage list; If the listened WiFi-MAC address matches the platform list, extract the corresponding baby carriage ID; Identify the external shape features of the baby carriage through intelligent video image analysis, uniquely associate and pair the external shape features with the WiFi-MAC address, and update them to the platform baby carriage list.

8. A storage medium, characterized in that, A computer program is stored in the storage medium, wherein the computer program is set to execute the method according to any one of claims 1-4 when running.

9. An electronic device, comprising a memory and a processor, characterized in that, A computer program is stored in the memory, and the processor is set to run the computer program to execute the method according to any one of claims 1-4.

Images