Intelligent Cabinet Monitoring Method, Device, Computer Equipment and Storage Medium

Abstract

The present invention relates to the technical field of unmanned retail. The present invention discloses an intelligent cabinet monitoring method, device, computer device and storage medium. The method obtains the current state of the cabinet door of the intelligent cabinet. When the current state of the cabinet door is that the cabinet door is open, the camera module is called by using the monitoring call permission. Based on different call permissions, the camera call result of the camera module is confirmed. When the camera module can be called and the corresponding camera call result is that the monitoring call is successful, it is considered that the opening of the cabinet door is illegal. The camera module is controlled to collect monitoring camera data, and the monitoring camera data and an alarm for illegal opening of the cabinet door are sent to the management platform to ensure the security of the intelligent cabinet, thereby improving the reliability of anti-theft of the intelligent cabinet.

Description

Technical Field

[0001] The present invention relates to the technical field of unmanned retail, and particularly to an intelligent cabinet monitoring method, device, computer device, and storage medium. Background Art

[0002] In the prior art, by equipping an unmanned retail device with a camera, real-time video recording is carried out using the camera, and the recorded information is uploaded to a cloud server. The administrator of the unmanned retail device queries behaviors such as theft or damage by watching the video, and at the same time, it can also be used as corresponding video evidence to prevent the unmanned retail cabinet from being damaged. However, this method has certain limitations. When encountering a damage behavior, it requires the management personnel to identify or operate in a timely manner, resulting in a reduction in the reliability of the anti-theft of the unmanned retail cabinet; moreover, this method also needs to upload a large amount of monitoring data, wasting a large amount of computing resources, increasing the wear and tear of the device. As can be seen from the above, the existing anti-theft of unmanned retail cabinets has a poor degree of intelligence, and thus there is a problem of insufficient reliability in the anti-theft of unmanned retail cabinets. Summary of the Invention

[0003] Embodiments of the present invention provide an intelligent cabinet monitoring method, device, computer device, and storage medium, which solve the problem of insufficient reliability in the anti-theft strategy of intelligent cabinets in the prior art.

[0004] Embodiments of the present invention provide an intelligent cabinet monitoring method, including:

[0005] Obtain the current state of the cabinet door;

[0006] If the current state of the cabinet door is that the cabinet door is open, then call the camera module using the monitoring call permission to obtain the camera call result of the camera module;

[0007] If the camera call result is a successful monitoring call, then control the camera module to collect monitoring video data, and send the monitoring video data and an alarm for illegal opening of the cabinet door to the management platform.

[0008] Embodiments of the present invention further provide an intelligent cabinet monitoring device, including:

[0009] A current state acquisition module of the cabinet door, which obtains the current state of the cabinet door;

[0010] A camera call result acquisition module, if the current state of the cabinet door is that the cabinet door is open, then call the camera module using the monitoring call permission to obtain the camera call result of the camera module;

[0011] A monitoring video data acquisition module, if the camera call result is a successful monitoring call, then control the camera module to collect monitoring video data, and send the monitoring video data and an alarm for illegal opening of the cabinet door to the management platform.

[0012] An embodiment of the present invention further provides a computer device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the above-mentioned intelligent cabinet monitoring method is implemented.

[0013] An embodiment of the present invention further provides a computer-readable storage medium. The computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the above-mentioned intelligent cabinet monitoring method is implemented.

[0014] The above-mentioned intelligent cabinet monitoring method, device, computer device, and storage medium obtain the current state of the cabinet door of the intelligent cabinet. When the current state of the cabinet door is that the cabinet door is open, the camera module is called using the monitoring call permission. Based on different call permissions, the camera call result of the camera module is confirmed. When the camera module can be called and the corresponding camera call result is a successful monitoring call, it is considered that the opening of the cabinet door is illegal. The camera module is controlled to collect monitoring video data, and the monitoring video data and an alarm for illegal opening of the cabinet door are sent to the management platform to ensure the security of the intelligent cabinet, thereby improving the reliability of the anti-theft strategy of the intelligent cabinet. BRIEF DESCRIPTION OF THE DRAWINGS

[0015] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings required for the description of the embodiments of the present invention will be briefly introduced below. Obviously, the drawings in the following description are only some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative efforts.

[0016] Figure 1 It is a schematic diagram of an application environment of the intelligent cabinet monitoring method in an embodiment of the present invention;

[0017] Figure 2 It is a flowchart of the intelligent cabinet monitoring method in an embodiment of the present invention;

[0018] Figure 3 It is another flowchart of the intelligent cabinet monitoring method in an embodiment of the present invention;

[0019] Figure 4 It is another flowchart of the intelligent cabinet monitoring method in an embodiment of the present invention;

[0020] Figure 5 It is another flowchart of the intelligent cabinet monitoring method in an embodiment of the present invention;

[0021] Figure 6 It is another flowchart of the intelligent cabinet monitoring method in an embodiment of the present invention;

[0022] Figure 7It is another flowchart of the intelligent cabinet monitoring method in an embodiment of the present invention;

[0023] Figure 8 It is a schematic diagram of an intelligent cabinet monitoring device in an embodiment of the present invention;

[0024] Figure 9 It is a schematic diagram of a computer device in an embodiment of the present invention. Detailed implementation manners

[0025] Next, the technical solutions in the embodiments of the present invention will be clearly and completely described in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, rather than all the embodiments. All other embodiments obtained by those of ordinary skill in the art based on the embodiments of the present invention without creative efforts shall fall within the protection scope of the present invention.

[0026] The intelligent cabinet monitoring method provided by the embodiments of the present invention can be applied in, for example Figure 1 the application environment shown. As Figure 1 shown, the client (computer device) communicates with the server through the network. Among them, the client, also known as the user side, refers to the program that provides local services corresponding to the server. The client (computer device) includes, but is not limited to, various personal computers, laptop computers, smart phones, tablet computers, cameras, and portable wearable devices. The server can be an independent server or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware services, domain name services, security services, content delivery networks (CDNs), and big data and artificial intelligence platforms.

[0027] The intelligent cabinet monitoring method provided by the embodiments of the present invention can be applied in the application environment as Figure 1 shown. Specifically, the intelligent cabinet monitoring method is applied in the intelligent cabinet monitoring subsystem. The intelligent cabinet monitoring subsystem includes a client and a server as Figure 1 shown. The client and the server communicate through the network to monitor the intelligent cabinet corresponding to the client, so as to improve the reliability of the intelligent cabinet monitoring method.

[0028] In an embodiment, as Figure 2 shown, a kind of intelligent cabinet monitoring method is provided. Taking the method applied in the Figure 1 server as an example for illustration, it includes the following steps:

[0029] S201: Obtain the current state of the cabinet door;

[0030] S202: If the current state of the cabinet door is that the cabinet door is open, the camera module is called using the monitoring call permission to obtain the camera call result of the camera module;

[0031] S203: If the camera call result is a successful monitoring call, control the camera module to collect monitoring camera data and send the monitoring camera data and an alarm for illegal opening of the cabinet door to the management platform.

[0032] Among them, the intelligent cabinet is an unmanned retail cabinet with functions such as image recognition, network payment, and gravity sensing. Compared with traditional unmanned retail cabinets, it increases the convenience, intelligence, and applicability of the unmanned retail cabinet.

[0033] In this example, the intelligent cabinet system includes a monitoring subsystem and a service subsystem. The monitoring subsystem is used to ensure the security of the intelligent cabinet, and the service subsystem is used to ensure the normal business behavior of the intelligent cabinet. By setting different call permissions for different business behaviors and monitoring behaviors for the camera module, the use of the camera module of the intelligent cabinet is ensured.

[0034] In this example, the business behaviors of the intelligent cabinet include but are not limited to administrator replenishment behavior, user purchase behavior, and technician maintenance behavior, while the monitoring behaviors include goods monitoring and abnormal cabinet door monitoring. Among them, the business call permission of the camera module corresponding to the business behavior is higher than the monitoring call permission of the camera module corresponding to the monitoring behavior. Different call permission levels can also be set to distinguish call permissions for different requirements.

[0035] Among them, when a business behavior is performed, the service subsystem will call the camera module through the business call permission to ensure the normal progress of the business behavior. Since the business behavior will use the camera module to identify changes in goods, or perform face recognition on the purchaser to perform corresponding face payment and other behaviors, during the period when the camera module is called due to a business behavior, there is no need for the monitoring subsystem to call the camera module to monitor the business behavior accordingly.

[0036] As an example, in step S201, the server determines the current state of the cabinet door by receiving the cabinet door state of the intelligent cabinet system queried, so as to monitor the intelligent cabinet. In this example, the current state of the cabinet door is periodically queried to obtain the current state of the cabinet door of the intelligent cabinet, or the current state of the cabinet door can be determined by receiving the update of the current state of the cabinet door generated by the change of the intelligent cabinet door.

[0037] In this example, each intelligent cabinet has at least one cabinet door. When one or more cabinet doors are opened, the current state of the corresponding cabinet door will be updated to the cabinet door is open; or, when one or more cabinet doors are damaged, the monitored current state of the cabinet door will also be updated to the cabinet door is open. For example, the pick-up door in the intelligent cabinet can be used as a cabinet door, and the loading door can also be used as a cabinet door.

[0038] As an example, in step S202, after the server obtains the current state of the cabinet door, when the obtained current state of the cabinet door is that the cabinet door is open, based on the monitoring call permission corresponding to the monitoring subsystem, the camera module is called to obtain the camera call result of the camera module according to the monitoring call permission, so as to determine whether the cabinet door of the intelligent cabinet is normally opened based on the business behavior according to the camera call result.

[0039] Among them, the intelligent cabinet is provided with one or more camera modules to meet business requirements. The internal environment camera module monitors the internal environment of the intelligent cabinet to complete the change of goods. The external environment camera module can also monitor the external environment of the intelligent cabinet or be used for business behaviors such as face payment by users.

[0040] In this example, when the user performs normal business behavior, the business subsystem will call the camera module through the business call permission. The current state of the cabinet door is open due to the business behavior of opening the door. Since the business call permission is higher than the monitoring call permission, the camera call result at this time is that the monitoring call fails. Correspondingly, when the user does not perform normal business behavior, the business subsystem will not call the camera module through the business call permission. That is to say, the current state of the cabinet door is open due to non-business behavior of opening the door. Since the camera module has not been called by the business call permission corresponding to the business behavior, the camera module can be called through the monitoring call permission, and the camera call result at this time is that the monitoring call is successful.

[0041] As an example, in step S203, after the server obtains the camera call result, if the camera call result is that the monitoring call is successful, it is confirmed that the cabinet door is opened due to non-business behavior, and a corresponding alarm for illegal opening of the cabinet door is generated. Then, the camera module is controlled to collect monitoring camera data, and the collected monitoring camera data and the alarm for illegal opening of the cabinet door are sent to the management platform. In this example, all camera modules of the intelligent cabinet can be called to perform monitoring camera shooting from multiple perspectives to collect corresponding monitoring camera data.

[0042] In this example, the alarm for illegal opening of the cabinet door can include but is not limited to sending it to the administrator, directly accessing the alarm system, and after generating the alarm for illegal opening of the cabinet door, corresponding broadcasts can be made through the intelligent cabinet for warning, so as to take corresponding countermeasures in time after the cabinet door of the intelligent cabinet is opened due to non-business behavior.

[0043] In this embodiment, when the current state of the cabinet door of the smart cabinet is that the cabinet door is open, the camera module is called using the monitoring call permission to obtain the camera call result of the camera module. When the camera module can be called and the corresponding camera call result is a successful monitoring call, it indicates that the camera module can be called for monitoring at this time. The camera module can be controlled to collect monitoring video data and send the monitoring video data and an alarm for illegal opening of the cabinet door to the management platform to ensure the security of the smart cabinet, thereby improving the reliability of anti-theft of the smart cabinet.

[0044] In one embodiment, as Figure 3 shown, in step S202, if the current state of the cabinet door is that the cabinet door is open, the camera module is called using the monitoring call permission to obtain the camera call result of the camera module, including:

[0045] S301: Obtain the camera running state of the camera module;

[0046] S302: If the camera running state is that the camera is running, determine the current call permission corresponding to the camera module;

[0047] S303: If the current call permission is not lower than the monitoring call permission, the camera call result is a failed monitoring call;

[0048] S304: If the current call permission is lower than the monitoring call permission, the camera call result is a successful monitoring call.

[0049] As an example, in step S301, after the server confirms that the current state of the cabinet door is that the cabinet door is open, it first detects the camera running state of the camera module to ensure the normal operation of the camera module for subsequent monitoring calls.

[0050] Among them, the current call permission refers to the call permission for which the camera module is currently called.

[0051] As an example, in step S302, after the server obtains the camera running state, if the camera running state is that the camera is running, it is considered that the camera module has been running normally, and the current call permission corresponding to the running camera module is obtained for comparison with the monitoring call permission.

[0052] As an example, in step S303, the server compares the current call permission of the camera module with the monitoring call permission. If the current call permission is not lower than the monitoring call permission, that is, when the current call permission is greater than or equal to the monitoring call permission, it indicates that the camera module is currently called by a function module with a higher call permission than the monitoring call permission. For example, it is called by a business subsystem corresponding to a business call permission with a higher call permission than the monitoring call permission, and the camera module cannot be called by the monitoring subsystem corresponding to the monitoring call permission, and the corresponding camera call result is output as a failed monitoring call.

[0053] In this example, if the camera call result is a failed monitoring call, it indicates that the camera module is currently being called by a function module with a higher permission than the monitoring call permission. For example, it is called by a business subsystem corresponding to a business call permission with a higher permission than the monitoring call permission. At this time, it is determined that the cabinet door opening method is called by a business behavior, which is a legal door opening method.

[0054] As an example, in step S304, the server compares the current call permission of the camera module with the monitoring call permission. If the current call permission is lower than the monitoring call permission, it indicates that the camera module is currently being called by a function module with a lower permission than the monitoring call permission. The camera module is directly called by the monitoring call permission, and the corresponding camera call result is output as a successful monitoring call.

[0055] In this example, if the camera call result is a successful monitoring call, it is initially determined that the cabinet door opening method is not called by a business behavior, which is an illegal door opening method.

[0056] In this example, when the current state of the cabinet door is that the cabinet door is open and the running state of the camera is that the camera is running, the current call permission corresponding to the camera module is compared with the monitoring call permission. If the current call permission is not lower than the monitoring call permission, the camera call result is a failed monitoring call; if the current call permission is lower than the monitoring call permission, the camera call result is a successful monitoring call. According to the current call permission of the camera module, it is determined whether the camera module is called by a business subsystem, and then the reason for the cabinet door opening is initially inferred.

[0057] In one embodiment, as Figure 4 shown, in step S203, if the camera call result is a successful monitoring call, then control the camera module to collect monitoring video data and send the monitoring video data and an alarm for illegal opening of the cabinet door to the management platform, including:

[0058] S401: Control the camera module to record the visible environment of the intelligent cabinet to obtain monitoring video data;

[0059] S402: Determine the cabinet door opening method according to the monitoring video data;

[0060] S403: If the cabinet door opening method is an illegal door opening method, send the monitoring video data and an alarm for illegal opening of the cabinet door to the management platform.

[0061] As an example, in step S401, after the server confirms that the camera call result is a successful monitoring call, it is considered that the camera module is currently being called by a function module with a lower permission than the monitoring call permission. By controlling the camera module to record the visible environment of the intelligent cabinet, monitoring video data is obtained for more accurate behavior recognition.

[0062] Among them, the visible environment is the perspective range that can be monitored by the camera module of the intelligent cabinet. By controlling the camera module, the visible environment of the intelligent cabinet is recorded to ensure the quality of the recorded monitoring camera data.

[0063] As an example, in step S402, after the server obtains the monitoring camera data, it performs image recognition based on the monitoring camera data to determine the current cabinet door opening method. In this example, if after the monitoring subsystem calls the camera module, illegal behaviors such as cargo changes, cabinet door damage, or suspicious personnel opening the door are found through the monitoring camera data recorded by the camera module, it can be determined that the cabinet door opening method is an illegal opening method.

[0064] If no illegal behaviors such as cargo changes, cabinet door damage, or suspicious personnel opening the door are found through the monitoring camera data, it is possible that the cabinet door was not properly closed after the previous business operation. Then, an alarm for abnormal cabinet door closing is sent to the management platform, and the intelligent cabinet makes corresponding prompts to close the cabinet door again.

[0065] As an example, in step S403, after the server confirms the cabinet door opening method, if the cabinet door opening method is an illegal opening method, it sends the monitoring camera data and an alarm for illegal cabinet door opening to the management platform to implement corresponding protection strategies.

[0066] In this example, after the monitoring call is successful, the camera module is controlled to record the visible environment of the intelligent cabinet to obtain the monitoring camera data to determine the cabinet door opening method. When the cabinet door opening method is an illegal opening method, the monitoring camera data and an alarm for illegal cabinet door opening are sent to the management platform to implement corresponding protection strategies.

[0067] Among them, the protection strategies include triggering the alarm reminder of the intelligent cabinet for broadcasting, displaying the alarm reminder on the corresponding display of the intelligent cabinet, or directly alarming through this status, etc. After the protection strategy is completed, the call to the camera module will be released.

[0068] In an embodiment, step S402, determining the cabinet door opening method according to the monitoring camera data includes:

[0069] S4011: Identify based on the external monitoring image in the monitoring camera data to obtain the environmental recognition result;

[0070] S4012: Identify based on the internal monitoring image in the monitoring camera data to obtain the cargo change result;

[0071] S4013: Determine the cabinet door opening method according to the environmental recognition result and the cargo change result.

[0072] As an example, in step S4011, after the server obtains the monitoring camera data, it performs image recognition processing on the external monitoring image corresponding to the external environment of the intelligent cabinet recorded by the camera module to determine whether there are suspicious persons and identify the behaviors of the suspicious persons, so as to determine the environmental recognition result.

[0073] As an example, in step S4012, after the server obtains the monitoring camera data, it performs image recognition processing on the internal monitoring image corresponding to the internal environment of the intelligent cabinet recorded by the camera module to confirm the changes of the goods, so as to determine the goods change result.

[0074] As an example, in step S4013, after the server confirms the environmental recognition result and the goods change result, it determines a more accurate way to open the cabinet door according to the environmental recognition result and the goods change result.

[0075] In this example, if it is found through the monitoring camera data that the goods change result is illegal goods change, or there are illegal behaviors such as damaged cabinet doors and suspicious persons opening the doors in the environmental recognition result, then it is determined that the way to open the cabinet door is an illegal way to open the door; if the goods change result is legal goods change and there are no illegal behaviors such as damaged cabinet doors and opening the doors in the environmental recognition result, then it is determined that the way to open the cabinet door is a legal way to open the door.

[0076] In this example, the external monitoring image and the internal monitoring image in the monitoring camera data are respectively recognized to obtain the environmental recognition result and the goods change result, and a judgment is made according to the environmental recognition result and the goods change result to determine the final way to open the cabinet door, so as to improve the recognition accuracy of the way to open the cabinet door.

[0077] In another embodiment, as Figure 5 shown, before step S201 of obtaining the current state of the cabinet door, the intelligent cabinet monitoring method further includes:

[0078] S501: Detect the state of the cabinet door by using the cabinet door detection period to obtain the current state of the cabinet door;

[0079] S502: If a cabinet door opening instruction is received, update the current state of the cabinet door.

[0080] As an example, in step S501, the server detects the state of the cabinet door by using the cabinet door detection period to confirm the current state of the cabinet door. When the current state of the cabinet door is updated, the corresponding monitoring operation is triggered.

[0081] In this example, the monitoring subsystem is started when the device is powered on, and polls the current state of the cabinet door through the serial port program according to the cabinet door detection period. Among them, the cabinet door detection period can be set according to business requirements, such as setting the cabinet door detection period to one second.

[0082] As an example, in step S502, when the server receives the cabinet door opening instruction, the business subsystem triggers the cabinet door opening instruction according to the business behavior, and then updates the current state of the cabinet door for subsequent triggering of corresponding monitoring operations.

[0083] In this example, by adopting the cabinet door detection period, the state of the cabinet door is detected to confirm the current state of the cabinet door. At the same time, if the cabinet door opening instruction is received, the current state of the cabinet door is updated to ensure that the current state of the cabinet door is updated in a timely manner.

[0084] In another embodiment, as Figure 6 shown, in step S303, if the current call permission is not lower than the monitoring call permission, after the camera call result is a monitoring call failure, the intelligent cabinet monitoring method further includes:

[0085] S601: Control the camera module to record the internal environment of the intelligent cabinet to obtain internal monitoring images;

[0086] S602: Identify the internal monitoring images to obtain the current state of the goods;

[0087] S603: Check according to the current state of the goods and the business order information to obtain the goods change result and send it to the management platform.

[0088] As an example, in step S601, after the camera call result is a monitoring call failure, that is, when the current state of the cabinet door is caused by business behavior, after the business call permission corresponding to the camera module is released, the server controls the camera module to record the internal environment of the intelligent cabinet to obtain internal monitoring images for determining the goods change.

[0089] In another example, after the camera call result is a monitoring call failure, the camera module called by the business call permission can also be used to control the camera module to record the internal environment of the intelligent cabinet to obtain internal monitoring images.

[0090] As an example, in step S602, after the server obtains the internal monitoring images, it performs image recognition on the internal monitoring images to judge the goods and thus obtain the current state of the goods. Among them, the current state of the goods includes the quantity and type of goods in the intelligent cabinet at the current moment.

[0091] As an example, in step S603, after the server confirms the current state of the goods, it checks according to the current state of the goods and the business order information to confirm the difference between the changes in the quantity and type of goods in the current state of the goods and the changes in the quantity and type of goods in the business order information, so as to confirm the goods change result and send it to the management platform.

[0092] In this example, the cargo change results include illegal cargo changes and legal cargo changes. An illegal cargo change means that the current state of the cargo is different from the state after the change of the business order information. In this case, the corresponding smart cabinet malfunctions, or there are differences between the user operation and the business order information. Then, this cargo change result is sent to the management platform. A legal cargo change means that the current state of the cargo is the same as the state after the change of the business order information, and it may not be sent to the management platform.

[0093] In another example, corresponding storage confirmation can be performed according to the current state of the cargo. When the quantity of the cargo is lower than the inventory threshold, a replenishment reminder is sent to the management platform.

[0094] In this example, after the camera call result is a failed monitoring call, the homogeneous control camera module records the internal environment of the smart cabinet, obtains the internal monitoring images for recognition, and determines the current state of the cargo. By comparing the current state of the cargo with the business order information, the cargo change result is obtained, thereby judging the operation of the user corresponding to the business behavior and improving the management efficiency of the smart cabinet.

[0095] In another embodiment, as Figure 7 shown, after obtaining the camera operation state of the camera module in step S301, the smart cabinet monitoring method further includes:

[0096] S701: If the camera operation state is that the camera is not running, start control is performed on the camera module;

[0097] S702: If the camera module starts successfully, update the camera operation state to the camera is running;

[0098] S703: If the camera module fails to start, perform a fault detection on the camera module, obtain the fault detection result, and send it to the management platform.

[0099] As an example, in step S701, after the server confirms the camera operation state of the camera module, if the camera operation state is that the camera is not running, start control is performed on the camera module. In this example, the started camera module has the lowest call permission, that is, it can be interrupted by the monitoring call permission and the business call permission.

[0100] As an example, in step S702, after the camera module starts successfully, the server can update the camera operation state to the camera is running to wait for calls from other call permissions and perform corresponding operations.

[0101] As an example, in step S703, after the camera module fails to start, the server can perform a fault detection on the camera module, obtain the fault detection result, and send it to the management platform. In this example, by performing a fault detection on the camera module, such as detecting the power-on state and communication state corresponding to the current camera module, the fault detection result corresponding to the camera module is confirmed, and the fault detection result is sent to the management platform for processing. At the same time, the smart cabinet performs a restart operation according to the fault detection result and suspends the business use of the smart cabinet. Among them, the power-on state of the camera module indicates whether the camera module can be normally powered, and the communication state of the camera module is to check whether the corresponding ports of the camera module can perform input and output.

[0102] In this example, if the camera running state is that the camera is not running, the camera module is controlled to start, and the camera running state is updated to the camera is running to wait for the call of other call permissions; if the camera module fails to start, the camera module is subjected to a fault detection, the fault detection result is obtained, and sent to the management platform to timely handle the failure of the smart cabinet camera module and improve the security of the smart cabinet management.

[0103] It should be understood that the magnitudes of the sequence numbers of the steps in the above embodiments do not mean the order of execution. The execution order of each process should be determined according to its function and internal logic, and should not constitute any limitation to the implementation process of the embodiments of the present invention.

[0104] In one embodiment, a smart cabinet monitoring device is provided, and the smart cabinet monitoring device corresponds one-to-one to the smart cabinet monitoring method in the above embodiment. As Figure 8 shown, the smart cabinet monitoring device includes a cabinet door current state acquisition module 801, a camera call result acquisition module 802, and a monitoring camera data acquisition module 803. The detailed description of each functional module is as follows:

[0105] The cabinet door current state acquisition module 801 acquires the current state of the cabinet door;

[0106] The camera call result acquisition module 802, if the current state of the cabinet door is that the cabinet door is open, then calls the camera module with the monitoring call permission to obtain the camera call result of the camera module;

[0107] The monitoring camera data acquisition module 803, if the camera call result is a successful monitoring call, then controls the camera module to collect monitoring camera data and sends the monitoring camera data and an alarm for illegal opening of the cabinet door to the management platform.

[0108] In one embodiment, the camera call result acquisition module 802 includes:

[0109] The camera running state acquisition unit acquires the camera running state of the camera module;

[0110] The current call permission determination unit determines the current call permission corresponding to the camera module if the running state of the camera is that the camera has been started.

[0111] The first camera call result confirmation unit determines that the camera call result is a monitoring call failure if the current call permission is not lower than the monitoring call permission.

[0112] The second camera call result confirmation unit determines that the camera call result is a monitoring call success if the current call permission is lower than the monitoring call permission.

[0113] In one embodiment, the monitoring camera data acquisition module 803 includes:

[0114] The monitoring camera data acquisition unit controls the camera module to record the visible environment of the intelligent cabinet and acquires the monitoring camera data.

[0115] The cabinet door opening method confirmation unit determines the cabinet door opening method according to the monitoring camera data.

[0116] The illegal cabinet door opening warning sending unit sends the monitoring camera data and the illegal cabinet door opening warning to the management platform if the cabinet door opening method is an illegal opening method.

[0117] In one embodiment, the cabinet door opening method confirmation unit includes:

[0118] The environmental recognition result acquisition subunit recognizes according to the external monitoring image in the monitoring camera data and acquires the environmental recognition result.

[0119] The goods change result acquisition subunit recognizes according to the internal monitoring image in the monitoring camera data and acquires the goods change result.

[0120] The cabinet door opening method determination subunit determines the cabinet door opening method according to the environmental recognition result and the goods change result.

[0121] In another embodiment, the intelligent cabinet monitoring device further includes:

[0122] The cabinet door current state acquisition module uses the cabinet door detection period to detect the cabinet door state and acquires the cabinet door current state.

[0123] The cabinet door current state update module updates the cabinet door current state if a cabinet door opening instruction is received.

[0124] In another embodiment, the intelligent cabinet monitoring device further includes:

[0125] The internal monitoring image acquisition module controls the camera module to record the internal environment of the intelligent cabinet and acquires the internal monitoring image.

[0126] The current status acquisition module of goods identifies the internal monitoring images to obtain the current status of the goods;

[0127] The goods change result sending module checks according to the current status of the goods and the business order information, obtains the goods change result, and sends it to the management platform.

[0128] In another embodiment, the intelligent cabinet monitoring device further includes:

[0129] The camera module startup module controls the startup of the camera module if the camera running status is that the camera is not running;

[0130] The camera running status update module updates the camera running status to that the camera is running if the camera module starts successfully;

[0131] The fault detection result sending module performs fault detection on the camera module if the camera module startup fails, obtains the fault detection result, and sends it to the management platform.

[0132] For the specific limitations of the intelligent cabinet monitoring device, reference can be made to the limitations of the intelligent cabinet monitoring method in the above text, which will not be elaborated here. Each module in the above intelligent cabinet monitoring device can be implemented in whole or in part by software, hardware and their combination. The above modules can be embedded in the processor in the computer device in the form of hardware or independent of it, or stored in the memory in the computer device in the form of software, so that the processor can call and execute the operations corresponding to the above modules.

[0133] In one embodiment, a computer device is provided. The computer device can be a server, and its internal structure diagram can be as Figure 9 shown. The computer device includes a processor, a memory, a network interface and a database connected through a system bus. Among them, the processor of the computer device is used to provide computing and control capabilities. The memory of the computer device includes a non-volatile storage medium and an internal memory. The non-volatile storage medium stores an operating system, a computer program and a database. The internal memory provides an environment for the operation of the operating system and the computer program in the non-volatile storage medium. The database of the computer device is used to execute the data used or generated during the process of the intelligent cabinet monitoring method. The network interface of the computer device is used to communicate with an external terminal through a network connection. The computer program, when executed by the processor, implements an intelligent cabinet monitoring method.

[0134] In one embodiment, a computer device is provided, including a memory, a processor, and a computer program stored on the memory and executable on the processor. When the processor executes the computer program, it implements the intelligent cabinet monitoring method in the above embodiment, such as Figure 2 shown S201 - S203, or Figures 3 to 7As shown, to avoid repetition, it will not be elaborated here. Alternatively, when the processor executes the computer program, it implements the functions of each module / unit in this embodiment of the intelligent cabinet monitoring device. For example Figure 8 the functions of the cabinet door current state acquisition module 801, the camera call result acquisition module 802, and the monitoring camera data acquisition module 803 shown. To avoid repetition, it will not be elaborated here.

[0135] In one embodiment, a computer-readable storage medium is provided. A computer program is stored on the computer-readable storage medium. When the computer program is executed by the processor, it implements the intelligent cabinet monitoring method in the above embodiment. For example Figure 2 S201 - S203 shown, or Figures 3 to 7 as shown, to avoid repetition, it will not be elaborated here. Alternatively, when the computer program is executed by the processor, it implements the functions of each module / unit in this embodiment of the above intelligent cabinet monitoring device. For example Figure 8 the functions of the cabinet door current state acquisition module 801, the camera call result acquisition module 802, and the monitoring camera data acquisition module 803 shown. To avoid repetition, it will not be elaborated here.

[0136] Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above methods. Among them, any reference to a memory, storage, database, or other medium used in the various embodiments provided by the present invention can include non-volatile and / or volatile memories. Non-volatile memories can include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM), or flash memory. Volatile memories can include random access memory (RAM) or external cache memory. By way of illustration and not limitation, RAM is available in various forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (RambuS) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM), etc.

[0137] Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the above division of each functional unit and module is used as an example. In actual applications, the above functions can be allocated to different functional units and modules according to needs, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above.

[0138] The above embodiments are only used to illustrate the technical solutions of the present invention, rather than to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements on some of the technical features; and these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention, and should all be included in the protection scope of the present invention.

Claims

1. An intelligent cabinet monitoring method, characterized in that, Including: Obtain the current state of the cabinet door of the smart cabinet; If the current state of the cabinet door is that the cabinet door is open, then call the camera module using the monitoring call permission to obtain the camera call result of the camera module; If the camera call result is a successful monitoring call, control the camera module to collect monitoring video data and send the monitoring video data and an alarm for illegal opening of the cabinet door to the management platform; Among them, the step of calling the camera module using the monitoring call permission to obtain the camera call result of the camera module includes: Obtain the camera running state of the camera module; If the camera running state is that the camera is running, determine the current call permission corresponding to the camera module; If the current call permission is not lower than the monitoring call permission, the camera call result is a failed monitoring call; If the current call permission is lower than the monitoring call permission, the camera call result is a successful monitoring call.

2. The intelligent cabinet monitoring method according to claim 1, characterized in that, The step of controlling the camera module to collect monitoring video data and send the monitoring video data and an alarm for illegal opening of the cabinet door to the management platform includes: Control the camera module to record the visible environment of the smart cabinet to obtain monitoring video data; Determine the cabinet door opening method according to the monitoring video data; If the cabinet door opening method is an illegal door opening method, send the monitoring video data and an alarm for illegal opening of the cabinet door to the management platform.

3. The intelligent cabinet monitoring method according to claim 2, characterized in that, The step of determining the cabinet door opening method according to the monitoring video data includes: Identify based on the external monitoring image in the monitoring video data to obtain an environment recognition result; Identify based on the internal monitoring image in the monitoring video data to obtain a goods change result; Determine the cabinet door opening method according to the environment recognition result and the goods change result.

4. The intelligent cabinet monitoring method according to claim 1, characterized in that, Before obtaining the current state of the cabinet door, the smart cabinet monitoring method further includes: Detect the cabinet door state using a cabinet door detection period to obtain the current state of the cabinet door; If a cabinet door opening instruction is received, update the current state of the cabinet door.

5. The intelligent cabinet monitoring method according to claim 1, characterized in that, After the camera call result is a failed monitoring call, the smart cabinet monitoring method further includes: Control the camera module to record the internal environment of the smart cabinet to obtain an internal monitoring image; Identify the internal monitoring image to obtain the current state of the goods; Check according to the current state of the goods and the business order information to obtain a goods change result and send it to the management platform.

6. The intelligent cabinet monitoring method according to claim 1, characterized in that, After obtaining the camera running state of the camera module, the smart cabinet monitoring method further includes: If the camera running state is that the camera is not running, perform start control on the camera module; If the camera module starts successfully, update the camera running state to that the camera is running; If the camera module fails to start, perform a fault detection on the camera module to obtain a fault detection result and send it to the management platform.

7. An intelligent cabinet monitoring device, characterized in that, Including: A cabinet door current state acquisition module that obtains the current state of the cabinet door; A camera call result acquisition module that, if the current state of the cabinet door is that the cabinet door is open, calls the camera module using the monitoring call permission to obtain the camera call result of the camera module; The monitoring camera data acquisition module, if the camera call result is a successful monitoring call, controls the camera module to collect monitoring camera data and sends the monitoring camera data and an alarm for illegal opening of the cabinet door to the management platform; The camera call result acquisition module is further configured to obtain the camera operation status of the camera module; if the camera operation status is that the camera is running, determine the current call permission corresponding to the camera module; If the current call permission is not lower than the monitoring call permission, the camera call result is a failed monitoring call; If the current call permission is lower than the monitoring call permission, the camera call result is a successful monitoring call.

8. A computer device, comprising a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein, When the processor executes the computer program, the intelligent cabinet monitoring method according to any one of claims 1 to 6 is implemented.

9. A computer-readable storage medium storing a computer program, wherein, When the computer program is executed by the processor, the intelligent cabinet monitoring method according to any one of claims 1 to 6 is implemented.

Images