A monitoring and early warning method and system for confined space
Through the micro-UAV and server system, the air conditioner observation window status and send early warnings are solved, and the problem of low monitoring and early warning efficiency of air conditioner monitoring and early warning in the existing technology is achieved, and efficient monitoring and early warning of the air conditioner active window is achieved.
Patent Information
- Application Number
- CN202311733326.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-12-15
- Publication Date
- 2024-11-12
- Estimated Expiration
- 2043-12-15
AI Technical Summary
The existing limited space monitoring methods are difficult to determine the status of the movable window of the air conditioner library, and cannot issue warning information outward when the movable window of the air conditioner library is in the open state, which affects the monitoring and early warning efficiency of the air conditioner library.
The monitoring system consisting of micro drones and servers is used to send limited space identifiers through micro drones. The server identifies the air conditioning library type and sends monitoring solutions. The micro drones shoot videos. The server uses the observation window to identify the plug-in to identify the window status. And generate early warning information and send early warning information through network mode.
The monitoring efficiency and early warning efficiency of the air conditioning database are improved, ensuring that early warnings can be issued in time when the air conditioning database observation window is opened to avoid air leakage.
Smart Images

Figure CN117934903B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the field of Internet technology, and in particular to a monitoring and early warning method and system for confined spaces. Background Art
[0002] The controlled atmosphere storage is a limited space. The observation window on the wall of the controlled atmosphere storage is referred to as the controlled atmosphere storage observation window. When the controlled atmosphere storage observation window is open for a long time, it will affect the sealing of the controlled atmosphere storage, and the controlled atmosphere storage is prone to air leakage, and a qualified controlled atmosphere environment cannot be formed.
[0003] However, the existing limited space monitoring method is difficult to determine the state of the active window of the controlled atmosphere storage, which is not conducive to improving the monitoring efficiency of the active window of the controlled atmosphere storage. The reason is that there are many active windows in the controlled atmosphere storage. If a manual method is adopted to manually monitor the state of the active windows of the controlled atmosphere storage one by one, the workload of monitoring will be very huge, and the time for monitoring the active windows of the controlled atmosphere storage is long. Therefore, it is difficult for the existing technology to determine the state of the active window of the controlled atmosphere storage, which is not conducive to improving the monitoring efficiency of the active window of the controlled atmosphere storage. In addition, the existing limited space monitoring method cannot send out warning information when the observation window of the controlled atmosphere storage is in the open state, so it is not conducive to improving the warning efficiency. Summary of the invention
[0004] The embodiments of the present application provide a monitoring and early warning method and system for confined spaces to solve the problem that the above-mentioned existing confined space monitoring method is difficult to determine the status of the active window of the controlled atmosphere storage and the existing confined space monitoring method is unable to issue early warning information when the observation window of the controlled atmosphere storage is in the open state.
[0005] In a first aspect, an embodiment of the present application provides a monitoring and early warning method for a limited space, which is applied to a monitoring system, wherein the monitoring system includes a server and a micro-UAV deployed in an indoor passage, and the monitoring and early warning method includes:
[0006] The micro drone sends the pre-stored limited space identifier to the server, where the limited space identifier is used to indicate the limited space type;
[0007] The server identifies whether the limited space type in the limited space identifier is a controlled atmosphere storage, and if the limited space type is identified as the controlled atmosphere storage, sends a controlled atmosphere storage monitoring plan to the micro-UAV, wherein the controlled atmosphere storage monitoring plan includes a controlled atmosphere storage monitoring range and a controlled atmosphere storage monitoring time;
[0008] The micro-UAV receives the controlled atmosphere storage monitoring plan, obtains the current coordinates and the current time, and if the current coordinates are within the controlled atmosphere storage monitoring range and the current time is within the controlled atmosphere storage monitoring time, shoots the current monitoring video of the controlled atmosphere storage in the indoor passage, calls the data sending interface, and sends the current monitoring video of the controlled atmosphere storage to the server through the data sending interface;
[0009] The server uses a preset observation window recognition plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video, and the observation window recognition plug-in is an image recognition plug-in for identifying the observation window;
[0010] If the server recognizes that the controlled atmosphere storage observation window is in an open state, the server writes a preset controlled atmosphere storage observation window identifier into a reserved field of the warning message template to generate a controlled atmosphere storage warning message;
[0011] The server sends the controlled atmosphere storage warning information to a preset mobile terminal, wherein the controlled atmosphere storage warning information carries the controlled atmosphere storage observation window identifier, and the controlled atmosphere storage observation window identifier is used to identify that the controlled atmosphere storage observation window is in an open state.
[0012] As an optional implementation, the server uses a preset observation window identification plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video, and the method includes:
[0013] The server obtains the historical monitoring video of the controlled atmosphere warehouse, obtains the source code of image recognition, packages the source code into an image recognition plug-in, identifies the controlled atmosphere warehouse observation window in the historical monitoring video through the image recognition plug-in, and records the recognition result of each image recognition plug-in;
[0014] Determine whether the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state. If the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, record the recognition time, recognition interruption number, recognition image data volume, and memory peak value of the image recognition plug-in;
[0015] Generate a plug-in applicability index for each image recognition plug-in according to a preset plug-in applicability index generation model, the recognition time, the number of recognition interruptions, the amount of recognized image data, the memory peak value, and a preset weight value of each image recognition plug-in, wherein the plug-in applicability index is used to indicate the applicability of the image recognition plug-in in recognizing the observation window of the controlled atmosphere storage;
[0016] The plug-in applicability index of each image recognition plug-in is sorted in order from large to small, and the image recognition plug-in corresponding to the largest plug-in applicability index is determined as the observation window recognition plug-in. In the current monitoring video, the observation window recognition plug-in is used to identify whether the observation window of the controlled atmosphere storage is in an open state.
[0017] As an optional implementation, the plug-in applicable index generation model is:
[0018] Pn=W*MIN(T / Tn, B / Bn)+(1-W)*MIN(K / Kn, S / Sn);
[0019] Among them, Pn represents the plug-in applicability index of the nth image recognition plug-in, n represents the serial number of the image recognition plug-in, the value range of n is 1 to N, and N represents the number of the image recognition plug-ins; W represents a preset weight value; Tn represents the recognition time of the nth image recognition plug-in, and T represents a preset time threshold; Bn represents the number of recognition interruptions of the nth image recognition plug-in, and B represents a preset interruption number threshold; Kn represents the memory peak value of the nth image recognition plug-in, and K represents a preset memory threshold; Sn represents the amount of recognized image data of the nth image recognition plug-in, and S represents a preset data amount threshold.
[0020] As an optional implementation, the server sends the controlled atmosphere storage warning information to a preset mobile terminal, including:
[0021] The server sends the controlled atmosphere storage warning information to a preset mobile terminal through a preset network mode, and the network mode includes any one or a combination of WIFI mode, 4G network mode and 5G network mode.
[0022] As an optional implementation, after the server sends the controlled atmosphere storage warning information to a preset mobile terminal, the monitoring and early warning method further includes:
[0023] The server obtains shooting instructions, fruits and vegetables to be shot in the controlled atmosphere storage, and location information of the fruits and vegetables to be shot in the controlled atmosphere storage, packages the shooting instructions, fruits and vegetables to be shot in the controlled atmosphere storage, and location information of the fruits and vegetables to be shot in the controlled atmosphere storage, generates a controlled atmosphere storage shooting event, and sends the controlled atmosphere storage shooting event to the micro drone to instruct the micro drone to shoot a video of the fruits and vegetables in the indoor area of the controlled atmosphere storage according to the controlled atmosphere storage shooting event.
[0024] In a second aspect, the embodiment of the present application further provides a monitoring and early warning system for a limited space, the monitoring and early warning system comprising a server and a micro-UAV deployed in an indoor passage; the server comprises a monitoring module, an identification module, and an early warning module; the micro-UAV comprises a sending module and a receiving module;
[0025] The sending module is used to send the pre-stored limited space identifier to the server, where the limited space identifier is used to indicate the limited space type;
[0026] The monitoring module is used to identify whether the limited space type in the limited space identifier is a controlled atmosphere storage, and if the limited space type is identified as the controlled atmosphere storage, send a controlled atmosphere storage monitoring plan to the micro-UAV, wherein the controlled atmosphere storage monitoring plan includes a controlled atmosphere storage monitoring range and a controlled atmosphere storage monitoring time;
[0027] The receiving module is used to receive the monitoring plan of the controlled atmosphere storage, obtain the current coordinates and the current time, and if the current coordinates are within the monitoring range of the controlled atmosphere storage and the current time is within the monitoring time of the controlled atmosphere storage, shoot the current monitoring video of the controlled atmosphere storage in the indoor passage, call the data sending interface, and send the current monitoring video of the controlled atmosphere storage to the server through the data sending interface;
[0028] The identification module is used to identify whether the observation window of the controlled atmosphere storage is in an open state by using a preset observation window identification plug-in in the current monitoring video, wherein the observation window identification plug-in is an image recognition plug-in for identifying the observation window;
[0029] The generating module is used to write a preset controlled atmosphere storage observation window identifier into a reserved field of the warning message template to generate a controlled atmosphere storage warning message if it is identified that the controlled atmosphere storage observation window is in an open state;
[0030] The warning module is used to send the controlled atmosphere storage warning information to a preset mobile terminal, and the controlled atmosphere storage observation window identifier is used to identify that the controlled atmosphere storage observation window is in an open state.
[0031] As an optional implementation, the identification module includes a recording unit, a judgment unit, a generation unit and an identification unit;
[0032] The recording unit is used to obtain the historical monitoring video of the controlled atmosphere storage, obtain the source code of image recognition, package the source code into an image recognition plug-in, identify the controlled atmosphere storage observation window in the historical monitoring video through the image recognition plug-in, and record the recognition result of each image recognition plug-in;
[0033] The judgment unit is used to judge whether the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, and if the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, record the recognition time, recognition interruption number, recognition image data volume, and memory peak value of the image recognition plug-in;
[0034] The generating unit is used to generate a plug-in applicability index of each image recognition plug-in according to a preset plug-in applicability index generating model, recognition time, recognition interruption times, recognition image data volume, memory peak value and preset weight value of each image recognition plug-in, wherein the plug-in applicability index is used to indicate the applicability of the image recognition plug-in in identifying the observation window of the controlled atmosphere storage;
[0035] The identification unit is used to sort the plug-in applicability index of each image recognition plug-in in descending order, determine the image recognition plug-in corresponding to the largest plug-in applicability index as the observation window identification plug-in, and use the observation window identification plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video.
[0036] As an optional implementation, the plug-in applicable index generation model is:
[0037] Pn=W*MIN(T / Tn, B / Bn)+(1-W)*MIN(K / Kn, S / Sn);
[0038] Among them, Pn represents the plug-in applicability index of the nth image recognition plug-in, n represents the serial number of the image recognition plug-in, the value range of n is 1 to N, and N represents the number of the image recognition plug-ins; W represents a preset weight value; Tn represents the recognition time of the nth image recognition plug-in, and T represents a preset time threshold; Bn represents the number of recognition interruptions of the nth image recognition plug-in, and B represents a preset interruption number threshold; Kn represents the memory peak value of the nth image recognition plug-in, and K represents a preset memory threshold; Sn represents the amount of recognized image data of the nth image recognition plug-in, and S represents a preset data amount threshold.
[0039] As an optional implementation, the early warning module is specifically used to send the controlled atmosphere storage early warning information to a preset mobile terminal through a preset network mode, and the network mode includes any one or a combination of WIFI mode, 4G network mode and 5G network mode.
[0040] As an optional implementation, the server further includes an indication module;
[0041] The indication module is used to obtain shooting instructions, fruits and vegetables to be photographed in the controlled atmosphere storage, and location information of the fruits and vegetables to be photographed in the controlled atmosphere storage, package the shooting instructions, fruits and vegetables to be photographed in the controlled atmosphere storage, and location information of the fruits and vegetables to be photographed in the controlled atmosphere storage, generate a controlled atmosphere storage shooting event, and send the controlled atmosphere storage shooting event to the micro drone to instruct the micro drone to shoot a video of the fruits and vegetables in the indoor area of the controlled atmosphere storage according to the controlled atmosphere storage shooting event.
[0042] The beneficial effects of the embodiments of the present application lie in two aspects. On the one hand, the server uses a preset observation window identification plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video, which solves the problem that the existing limited space monitoring method is difficult to determine the state of the active window of the controlled atmosphere storage, which is beneficial to improving the monitoring efficiency of the controlled atmosphere storage; on the other hand, if the server recognizes that the controlled atmosphere storage observation window is in an open state, it writes a preset controlled atmosphere storage observation window identifier in the reserved field of the early warning message template, generates a controlled atmosphere storage early warning information, and sends the controlled atmosphere storage early warning information to a preset mobile terminal, which solves the problem that the existing limited space monitoring method is unable to send out early warning information when the observation window of the controlled atmosphere storage is in an open state, which is beneficial to improving the early warning efficiency of the controlled atmosphere storage. BRIEF DESCRIPTION OF THE DRAWINGS
[0043] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For those skilled in the art, other drawings can be obtained based on these drawings without creative work.
[0044] Figure 1 It is a flowchart of the monitoring and early warning method provided in the embodiment of the present application;
[0045] Figure 2 is a flowchart of identifying the opening state provided by an embodiment of the present application;
[0046] Figure 3 It is a structural block diagram of a monitoring and early warning system provided by an embodiment of the present invention. DETAILED DESCRIPTION
[0047] In order to make the purpose, technical solutions and advantages of the present application more clearly understood, the present application is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present application and are not intended to limit the present application. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in the field without making creative work are within the scope of protection of the present application.
[0048] It should be noted that the descriptions of "first", "second", etc. in this application are only for descriptive purposes and cannot be understood as indicating or implying their relative importance or implicitly indicating the number of the indicated technical features. Therefore, the features defined as "first" or "second" may explicitly or implicitly include at least one of the features.
[0049] References to "one embodiment" or "some embodiments" etc. described in the specification of this application mean that one or more embodiments of the present application include specific features, structures or characteristics described in conjunction with the embodiment. Therefore, the statements "in one embodiment", "in some embodiments", "in some other embodiments", "in some embodiments", etc. that appear in different places in this specification do not necessarily refer to the same embodiment, but mean "one or more but not all embodiments", unless otherwise specifically emphasized in other ways. The terms "including", "comprising", "having" and their variations all mean "including but not limited to", unless otherwise specifically emphasized in other ways.
[0050] In addition, the technical solutions between the various embodiments can be combined with each other, but they must be based on the fact that they can be implemented by ordinary technicians in this field. When the combination of technical solutions is contradictory or cannot be implemented, it should be deemed that such combination of technical solutions does not exist and is not within the scope of protection required by this application.
[0051] The flowcharts shown in the accompanying drawings are only examples and do not necessarily include all the contents and operations / steps, nor must they be executed in the order described. For example, some operations / steps may also be decomposed, combined or partially merged, so the actual execution order may change according to actual conditions.
[0052] See also Figure 1 , Figure 1 is a flow chart of a monitoring and early warning method provided in an embodiment of the present application, which can be applied to a monitoring system. The monitoring system includes a server, a micro-UAV deployed in an indoor passage, such as Figure 1 As shown, the monitoring and early warning method includes:
[0053] S101, the micro drone sends the pre-stored limited space identifier to the server, where the limited space identifier is used to indicate the limited space type;
[0054] The limited space identifier is used to indicate the limited space type. Different limited space types correspond to different limited space identifiers.
[0055] Among them, confined space types include storage rooms, fermentation tanks, garbage stations, greenhouses, and controlled atmosphere storage.
[0056] The limited space identifier consists of the limited space abbreviation, a backslash and the limited space classification number.
[0057] The abbreviation of limited space is LS, the backslash is \, and the value range of limited space classification number is S1 to S5.
[0058] Among them, the confined space classification number is used to indicate the classification number of the confined space type, and different confined space types correspond to different classification numbers.
[0059] For the sake of illustration, an example is given below:
[0060] The classification number corresponding to the storage room is S1, and the limited space identifier of the limited space type being the storage room is: LS\S1.
[0061] The classification number corresponding to the fermentation tank is S1, and the limited space identifier of the limited space type fermentation tank is: LS\S2.
[0062] The classification code corresponding to the garbage station is S3, and the limited space identifier of the limited space type garbage station is: LS\S3.
[0063] The classification number corresponding to the greenhouse is S3, and the limited space identifier of the limited space type greenhouse is: LS\S4.
[0064] The classification number corresponding to the controlled atmosphere storage is S5, and the limited space identifier of the limited space type controlled atmosphere storage is: LS\S5.
[0065] Among them, by setting the limited space identifier, the subsequent server quickly identifies the type of the limited space through the limited space identifier.
[0066] Among them, after the micro drone is turned on, it will connect to the mobile terminal via Bluetooth. After the connection, the mobile terminal sends a limited space identifier to the micro drone, so that the micro drone will store the limited space identifier.
[0067] The server broadcasts a detection instruction to the micro-UAV connected to the network, wherein the detection instruction is used to instruct the micro-UAV to detect whether the limited space identifier is stored in the storage directory;
[0068] After receiving the detection instruction, the micro-UAV detects whether the limited space identifier is stored in the cache. If the limited space identifier is stored in the storage directory, a response message is returned to the server. The response message carries the limited space identifier and the device information of the micro-UAV. The device information includes one or a combination of the UAV manufacturer, the UAV model, and the UAV MAC address.
[0069] S102, the server identifies whether the limited space type in the limited space identifier is a controlled atmosphere storage, and if the limited space type is identified as the controlled atmosphere storage, sends a controlled atmosphere storage monitoring plan to the micro-UAV, wherein the controlled atmosphere storage monitoring plan includes a controlled atmosphere storage monitoring range and a controlled atmosphere storage monitoring time;
[0070] Among them, S102 includes:
[0071] The server obtains the limited space identifier and the limited space classification number after the backslash in the limited space identifier, matches the limited space classification number with the classification number corresponding to the controlled atmosphere storage, and if the match is successful, the limited space type is identified as the controlled atmosphere storage, and a controlled atmosphere storage monitoring plan is sent to the micro-UAV, and the controlled atmosphere storage monitoring plan includes the controlled atmosphere storage monitoring range and the controlled atmosphere storage monitoring time.
[0072] For the sake of explanation, the classification code corresponding to the controlled atmosphere storage is S5 as an example, and the details are as follows:
[0073] The server obtains the limited space identifier and the limited space classification number after the backslash in the limited space identifier, matches the limited space classification number with S5, and if the match is successful, identifies the limited space type as the controlled atmosphere storage, and sends a controlled atmosphere storage monitoring plan to the micro-UAV, wherein the controlled atmosphere storage monitoring plan includes the controlled atmosphere storage monitoring range and the controlled atmosphere storage monitoring time.
[0074] Among them, the monitoring range of the controlled atmosphere storage is the range of the indoor coordinates of the controlled atmosphere storage observation window.
[0075] Among them, the indoor coordinates of the controlled atmosphere storage observation window are obtained through the indoor positioning system, and the positioning system includes one or a combination of ultra-wideband positioning system, Wi-Fi positioning system, Bluetooth positioning system, RFID positioning system, and ultrasonic positioning system.
[0076] Among them, when the observation window of the controlled atmosphere storage is positioned using the RFID positioning system, the micro-UAV is also positioned using the RFID positioning system, that is, the observation window of the controlled atmosphere storage and the micro-UAV use the same positioning system, which can help reduce the positioning errors caused by different positioning systems.
[0077] Among them, the monitoring time of the controlled atmosphere storage is the monitoring time of the controlled atmosphere storage observation window.
[0078] Among them, the monitoring time of the controlled atmosphere storage can be set from 6 pm to 12 am and from 1 am to 8 am. The specific time can be set by the user and there is no restriction here.
[0079] Among them, the monitoring time of the controlled atmosphere storage can be set from 5 pm to 12 am and from 1 am to 7 am. The specific time can be set by the user and there is no restriction here.
[0080] S103, the micro-UAV receives the controlled atmosphere storage monitoring plan, obtains the current coordinates and the current time, and if the current coordinates are within the controlled atmosphere storage monitoring range and the current time is within the controlled atmosphere storage monitoring time, shoots the current monitoring video of the controlled atmosphere storage in the indoor passage, calls the data sending interface, and sends the current monitoring video of the controlled atmosphere storage to the server through the data sending interface;
[0081] S104, the server uses a preset observation window recognition plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video, wherein the observation window recognition plug-in is an image recognition plug-in for identifying the observation window;
[0082] S105, if the server recognizes that the controlled atmosphere storage observation window is in an open state, the server writes a preset controlled atmosphere storage observation window identifier into a reserved field of the warning message template to generate a controlled atmosphere storage warning message;
[0083] The warning message template includes: a device identifier of the server, a service message block protocol, a reserved field, and a warning identifier.
[0084] The device identifier of the server is the MAC address of the server.
[0085] The service message block protocol is SMB (Server Message Block protocol).
[0086] In the reserved field, MASviewport is written, and MASviewport is the identifier of the observation window of the controlled atmosphere storage. In the reserved field, the warning identifier is Warn.
[0087] Among them, by setting the format of the controlled atmosphere storage warning information, the client on the mobile terminal can quickly identify the controlled atmosphere storage observation window identifier in the controlled atmosphere storage warning information by parsing the format of the controlled atmosphere storage warning information.
[0088] Among them, the controlled atmosphere storage warning information is the warning information of the controlled atmosphere storage.
[0089] S106, the server sends the controlled atmosphere storage warning information to a preset mobile terminal, the controlled atmosphere storage warning information carries the controlled atmosphere storage observation window identifier, and the controlled atmosphere storage observation window identifier is used to identify that the controlled atmosphere storage observation window is in an open state.
[0090] Among them, after receiving the warning information of the controlled atmosphere storage, the client on the mobile terminal can identify that the controlled atmosphere storage observation window is open through the controlled atmosphere storage observation window identifier, and repair or close the controlled atmosphere storage observation window as soon as possible, so as to avoid gas leakage in the controlled atmosphere storage and prevent users from entering the indoor area of the controlled atmosphere storage through the controlled atmosphere storage observation window. Because the indoor area of the controlled atmosphere storage is also the area inside the controlled atmosphere storage, users cannot enter at will after the storage is sealed.
[0091] Among them, S106 includes:
[0092] The server sends the controlled atmosphere storage warning information to a preset mobile terminal through a preset network mode, and the network mode includes any one or a combination of WIFI mode, 4G network mode and 5G network mode.
[0093] After S106, the method includes:
[0094] S107, the server obtains shooting instructions, the fruits and vegetables to be shot in the controlled atmosphere storage, and the location information of the fruits and vegetables to be shot in the controlled atmosphere storage, packages the shooting instructions, the fruits and vegetables to be shot in the controlled atmosphere storage, and the location information of the fruits and vegetables to be shot in the controlled atmosphere storage, generates a controlled atmosphere storage shooting event, and sends the controlled atmosphere storage shooting event to the micro drone to instruct the micro drone to shoot a video of the fruits and vegetables in the indoor area of the controlled atmosphere storage according to the controlled atmosphere storage shooting event.
[0095] Among them, S107 includes:
[0096] The server displays a fruit and vegetable list in the controlled atmosphere storage and a shooting button, wherein the fruit and vegetable list includes a plurality of fruit and vegetable identifiers, and each fruit and vegetable identifier corresponds to a type of fruit and vegetable;
[0097] Obtaining a selection operation of the user in the fruit and vegetable list, obtaining the fruit and vegetable identifiers selected by the user according to the selection operation, using the fruits and vegetables corresponding to the fruit and vegetable identifiers selected by the user as the fruits and vegetables to be photographed in the controlled atmosphere library, and using the position information corresponding to the fruit and vegetable identifiers selected by the user as the position information of the fruits and vegetables to be photographed in the controlled atmosphere library;
[0098] Acquire a user's click operation on the shooting button, and generate a shooting instruction according to the click operation;
[0099] The shooting instruction, the fruits and vegetables to be shot in the controlled atmosphere storage, and the location information of the fruits and vegetables to be shot in the controlled atmosphere storage are packaged to generate a controlled atmosphere storage shooting event, and the controlled atmosphere storage shooting event is sent to the micro-drone to instruct the micro-drone to shoot a video of the fruits and vegetables in the indoor area of the controlled atmosphere storage according to the controlled atmosphere storage shooting event. The server stores the fruit and vegetable identifiers and the location information corresponding to the fruit and vegetable identifiers.
[0100] The fruit and vegetable labels are thumbnails of fruit and vegetable pictures, and each fruit and vegetable label corresponds to a type of fruit and vegetable. The fruit and vegetable pictures include fruit pictures and vegetable pictures.
[0101] Among them, the controlled atmosphere storage shooting event refers to the shooting event of the controlled atmosphere storage.
[0102] After S107, the method includes:
[0103] S108, the micro drone receives the controlled atmosphere storage shooting event, shoots the video of the fruits and vegetables in the indoor area of the controlled atmosphere storage according to the controlled atmosphere storage shooting event, and uploads the video of the fruits and vegetables to the server.
[0104] Among them, after the micro-UAV shoots the event in the controlled atmosphere storage, it flies into the indoor area of the controlled atmosphere storage through the observation window of the controlled atmosphere storage, shoots the video of the fruits and vegetables in the indoor area of the controlled atmosphere storage, and uploads the video of the fruits and vegetables to the server.
[0105] Among them, the mobile terminal can instruct the micro drone to shoot the video of the fruits and vegetables in the indoor area of the controlled atmosphere storage according to the shooting event of the controlled atmosphere storage by connecting to the server. Since the micro drone can shoot the video of the fruits and vegetables in all directions in the indoor area of the controlled atmosphere storage, the situation where the fruits and vegetables cannot be shot due to blind spots in monitoring is avoided. In addition, the mobile terminal can view the video of the fruits and vegetables on the server anytime and anywhere by connecting to the server.
[0106] The beneficial effects of the embodiments of the present application lie in two aspects. On the one hand, the server uses a preset observation window identification plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video, which solves the problem that the existing limited space monitoring method is difficult to determine the state of the active window of the controlled atmosphere storage, which is beneficial to improving the monitoring efficiency of the controlled atmosphere storage; on the other hand, if the server recognizes that the controlled atmosphere storage observation window is in an open state, it writes a preset controlled atmosphere storage observation window identifier in the reserved field of the early warning message template, generates a controlled atmosphere storage early warning information, and sends the controlled atmosphere storage early warning information to a preset mobile terminal, which solves the problem that the existing limited space monitoring method is unable to send out early warning information when the observation window of the controlled atmosphere storage is in an open state, which is beneficial to improving the early warning efficiency of the controlled atmosphere storage.
[0107] See also Figure 2 , Figure 2 This is a flowchart of identifying the opening state provided by an embodiment of the present application, which is described in detail as follows:
[0108] S201, the server obtains the historical monitoring video of the controlled atmosphere storage, obtains the source code of image recognition, packages the source code into an image recognition plug-in, identifies the controlled atmosphere storage observation window in the historical monitoring video through the image recognition plug-in, and records the recognition result of each image recognition plug-in;
[0109] The server is connected to a video library via a preset network mode; in the video library, historical monitoring videos of the controlled atmosphere library are obtained.
[0110] The server is connected to a database through a preset network mode, and the source code of image recognition is obtained from the database, and the source code is packaged into an image recognition plug-in.
[0111] Among them, the controlled atmosphere storage observation window is used as the target to be identified in the historical monitoring video, the controlled atmosphere storage observation window is identified in the historical monitoring video through the image recognition plug-in, and the identification result of each image recognition plug-in is recorded.
[0112] S202, determining whether the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, and if the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, recording the recognition time, recognition interruption times, recognition image data volume, and memory peak value of the image recognition plug-in;
[0113] S203, generating a plug-in applicability index of each image recognition plug-in according to a preset plug-in applicability index generation model, recognition time, recognition interruption times, recognition image data volume, memory peak value, and preset weight value of each image recognition plug-in, wherein the plug-in applicability index is used to indicate the applicability of the image recognition plug-in in identifying the observation window of the controlled atmosphere storage;
[0114] S204, sorting the plug-in applicability index of each image recognition plug-in in descending order, determining the image recognition plug-in corresponding to the largest plug-in applicability index as the observation window recognition plug-in, and using the observation window recognition plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video.
[0115] Among them, the higher the plug-in applicability index of the image recognition plug-in is, the better the applicability of the image recognition plug-in in identifying the observation window of the controlled atmosphere storage is.
[0116] For the sake of illustration, an example is given below:
[0117] Among them, the higher the plug-in applicability index of the image recognition plug-in is, the better the applicability of the image recognition plug-in in identifying the observation window of the controlled atmosphere storage is.
[0118] For the sake of illustration, an example is given below:
[0119] There are image recognition plug-in A, image recognition plug-in B, and image recognition plug-in C; the plug-in applicability index of image recognition plug-in A is A1, the plug-in applicability index of image recognition plug-in B is B1, and the plug-in applicability index of image recognition plug-in C is C1; A1, B1, and C1 are sorted in descending order, and if C1 is greater than A1, and C1 is greater than B1, image recognition plug-in C is used as the observation window recognition plug-in.
[0120] For ease of explanation, image recognition plug-in 1, image recognition plug-in 2, and image recognition plug-in 3 are taken as examples and described in detail as follows:
[0121] When the plug-in applicability index of the image recognition plug-in 1 is 80, the plug-in applicability index of the image recognition plug-in 2 is 60, and the plug-in applicability index of the image recognition plug-in 3 is 70, the image recognition plug-in 1 is used as the observation window recognition plug-in.
[0122] When the plug-in applicability index of the image recognition plug-in 1 is 80, the plug-in applicability index of the image recognition plug-in 2 is 90, and the plug-in applicability index of the image recognition plug-in 3 is 70, the image recognition plug-in 2 is used as the observation window recognition plug-in.
[0123] When the plug-in applicability index of the image recognition plug-in 1 is 50, the plug-in applicability index of the image recognition plug-in 2 is 60, and the plug-in applicability index of the image recognition plug-in 3 is 95, the image recognition plug-in 3 is used as the observation window recognition plug-in.
[0124] Among them, the plug-in applicable index generation model is:
[0125] Pn=W*MIN(T / Tn, B / Bn)+(1-W)*MIN(K / Kn, S / Sn);
[0126] Among them, Pn represents the plug-in applicability index of the nth image recognition plug-in, n represents the serial number of the image recognition plug-in, the value range of n is 1 to N, and N represents the number of the image recognition plug-ins; W represents a preset weight value; Tn represents the recognition time of the nth image recognition plug-in, and T represents a preset time threshold; Bn represents the number of recognition interruptions of the nth image recognition plug-in, and B represents a preset interruption number threshold; Kn represents the memory peak value of the nth image recognition plug-in, and K represents a preset memory threshold; Sn represents the amount of recognized image data of the nth image recognition plug-in, and S represents a preset data amount threshold.
[0127] Among them, the higher the plug-in applicability index of the image recognition plug-in is, the better the applicability of the image recognition plug-in in identifying the observation window of the controlled atmosphere storage is.
[0128] Among them, W is set by the user or the system default, and is not restricted here.
[0129] Among them, the minimum value between T / Tn and B / Bn is selected through the MIN function, and the minimum value between K / Kn and S / Sn is selected. In this way, the shortcomings of this image recognition plug-in in identifying the observation window of the controlled atmosphere storage can be quickly found. By comprehensively considering the shortcomings in various aspects, the plug-in applicability index obtained is highly representative.
[0130] For ease of understanding, the following describes the recognition time, number of recognition interruptions, memory peak value, and the amount of recognized image data. Details are as follows:
[0131] The description of recognition time is as follows:
[0132] Get the recognition time of the image recognition plug-in through the server's time function. For example, start recognizing historical surveillance videos at 3 o'clock, and at 3:30 o'clock, the observation window for calling the database is open when the historical surveillance video is recognized. Then the recognition time is 30 seconds.
[0133] Among them, relative to the preset time threshold, the shorter the recognition time is, the more time-saving it is, which means that the image recognition plug-in is more suitable for identifying the observation window of the controlled atmosphere storage.
[0134] The following are instructions for identifying the number of interruptions:
[0135] Among them, the number of identification interruptions is obtained through the interruption processing function of the server.
[0136] The number of identification interruptions refers to the number of interruptions when the server runs the image recognition plug-in to identify the observation window of the controlled atmosphere storage. This is because when the server runs the image recognition plug-in, if too many images are imported, it is easy to cause identification interruptions.
[0137] Among them, relative to the preset interruption number threshold, the smaller the interruption number, the better the compatibility, which means that the image recognition plug-in is more suitable for identifying the observation window of the controlled atmosphere storage.
[0138] The description of memory peak is as follows:
[0139] The memory peak value is obtained through the server's memory function.
[0140] The memory peak value refers to the maximum value of memory usage.
[0141] When the server runs the image recognition plug-in to identify the controlled atmosphere storage observation window, if the memory peak is too high, it is easy to cause server jams.
[0142] Among them, relative to the preset memory threshold, the smaller the memory peak value is, the less likely it is to cause server lag, which means that the image recognition plug-in is more suitable for identifying the observation window of the controlled atmosphere storage.
[0143] The following is an explanation of the amount of image data to be recognized:
[0144] The amount of image data to be recognized is obtained by the number of frames of the historical surveillance video. For example, when the historical surveillance video is first recognized, the number of frames of the video image is 1. After the historical surveillance video is recognized and the library observation window is open, the number of frames of the video image is 3600. The video image is about 1M, and the amount of image data to be recognized is 3600M.
[0145] Among them, relative to the preset data volume threshold, the smaller the image data volume is, the more CPU resources are saved, which means that the image recognition plug-in has a higher applicability in identifying the observation window of the controlled atmosphere storage.
[0146] In the embodiment of the present application, the observation window identification plug-in is used to identify whether the observation window of the controlled atmosphere storage is in an open state, which is conducive to improving the efficiency of identifying the observation window of the controlled atmosphere storage.
[0147] refer to Figure 3 , Figure 3 : is a structural block diagram of a monitoring and early warning system provided by an embodiment of the present invention, the monitoring and early warning system comprises a server and a micro-UAV deployed in an indoor passage; the server comprises a monitoring module, an identification module, and an early warning module; the micro-UAV comprises a sending module and a receiving module;
[0148] The sending module is used to send the pre-stored limited space identifier to the server, where the limited space identifier is used to indicate the limited space type;
[0149] The monitoring module is used to identify whether the limited space type in the limited space identifier is a controlled atmosphere storage, and if the limited space type is identified as the controlled atmosphere storage, send a controlled atmosphere storage monitoring plan to the micro-UAV, wherein the controlled atmosphere storage monitoring plan includes a controlled atmosphere storage monitoring range and a controlled atmosphere storage monitoring time;
[0150] The receiving module is used to receive the monitoring plan of the controlled atmosphere storage, obtain the current coordinates and the current time, and if the current coordinates are within the monitoring range of the controlled atmosphere storage and the current time is within the monitoring time of the controlled atmosphere storage, shoot the current monitoring video of the controlled atmosphere storage in the indoor passage, call the data sending interface, and send the current monitoring video of the controlled atmosphere storage to the server through the data sending interface;
[0151] The identification module is used to identify whether the observation window of the controlled atmosphere storage is in an open state by using a preset observation window identification plug-in in the current monitoring video, wherein the observation window identification plug-in is an image recognition plug-in for identifying the observation window;
[0152] The generating module is used to write a preset controlled atmosphere storage observation window identifier into a reserved field of the warning message template to generate a controlled atmosphere storage warning message if it is identified that the controlled atmosphere storage observation window is in an open state;
[0153] The warning module is used to send the controlled atmosphere storage warning information to a preset mobile terminal, and the controlled atmosphere storage observation window identifier is used to identify that the controlled atmosphere storage observation window is in an open state.
[0154] The beneficial effects of the embodiments of the present application lie in two aspects. On the one hand, the server uses a preset observation window identification plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video, which solves the problem that the existing limited space monitoring method is difficult to determine the state of the active window of the controlled atmosphere storage, which is beneficial to improving the monitoring efficiency of the controlled atmosphere storage; on the other hand, if the server recognizes that the controlled atmosphere storage observation window is in an open state, it writes a preset controlled atmosphere storage observation window identifier in the reserved field of the early warning message template, generates a controlled atmosphere storage early warning information, and sends the controlled atmosphere storage early warning information to a preset mobile terminal, which solves the problem that the existing limited space monitoring method is unable to send out early warning information when the observation window of the controlled atmosphere storage is in an open state, which is beneficial to improving the early warning efficiency of the controlled atmosphere storage.
[0155] In some embodiments, the identification module includes a recording unit, a determination unit, a generation unit, and an identification unit;
[0156] The recording unit is used to obtain the historical monitoring video of the controlled atmosphere storage, obtain the source code of image recognition, package the source code into an image recognition plug-in, identify the controlled atmosphere storage observation window in the historical monitoring video through the image recognition plug-in, and record the recognition result of each image recognition plug-in;
[0157] The judgment unit is used to judge whether the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, and if the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, record the recognition time, recognition interruption number, recognition image data volume, and memory peak value of the image recognition plug-in;
[0158] The generating unit is used to generate a plug-in applicability index of each image recognition plug-in according to a preset plug-in applicability index generating model, recognition time, recognition interruption times, recognition image data volume, memory peak value and preset weight value of each image recognition plug-in, wherein the plug-in applicability index is used to indicate the applicability of the image recognition plug-in in identifying the observation window of the controlled atmosphere storage;
[0159] The identification unit is used to sort the plug-in applicability index of each image recognition plug-in in descending order, determine the image recognition plug-in corresponding to the largest plug-in applicability index as the observation window identification plug-in, and use the observation window identification plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video.
[0160] In some embodiments, the plug-in applicable index generation model is:
[0161] Pn=W*MIN(T / Tn, B / Bn)+(1-W)*MIN(K / Kn, S / Sn);
[0162] Among them, Pn represents the plug-in applicability index of the nth image recognition plug-in, n represents the serial number of the image recognition plug-in, the value range of n is 1 to N, and N represents the number of the image recognition plug-ins; W represents a preset weight value; Tn represents the recognition time of the nth image recognition plug-in, and T represents a preset time threshold; Bn represents the number of recognition interruptions of the nth image recognition plug-in, and B represents a preset interruption number threshold; Kn represents the memory peak value of the nth image recognition plug-in, and K represents a preset memory threshold; Sn represents the amount of recognized image data of the nth image recognition plug-in, and S represents a preset data amount threshold.
[0163] In some embodiments, the early warning module is specifically used to send the controlled atmosphere storage early warning information to a preset mobile terminal through a preset network mode, and the network mode includes any one or a combination of WIFI mode, 4G network mode and 5G network mode.
[0164] In some embodiments, the server further comprises an indication module;
[0165] The indication module is used to obtain shooting instructions, fruits and vegetables to be photographed in the controlled atmosphere storage, and location information of the fruits and vegetables to be photographed in the controlled atmosphere storage, package the shooting instructions, fruits and vegetables to be photographed in the controlled atmosphere storage, and location information of the fruits and vegetables to be photographed in the controlled atmosphere storage, generate a controlled atmosphere storage shooting event, and send the controlled atmosphere storage shooting event to the micro drone to instruct the micro drone to shoot a video of the fruits and vegetables in the indoor area of the controlled atmosphere storage according to the controlled atmosphere storage shooting event.
[0166] The flowchart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to the embodiment of the present disclosure. In this regard, each box in the flowchart or block diagram can represent a module, a program segment or a part of the code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. In some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two consecutive boxes can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. In the description corresponding to the flowchart and the block diagram in the accompanying drawings, the operations or steps corresponding to different boxes can also occur in a different order from the order disclosed in the description, and sometimes there is no specific order between different operations or steps. For example, two consecutive operations or steps can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, which can depend on the functions involved. Each block in the block diagrams and / or flowcharts, and combinations of blocks in the block diagrams and / or flowcharts, may be implemented by a dedicated hardware-based system that performs the specified functions or actions, or may be implemented by a combination of dedicated hardware and computer instructions.
[0167] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent protection scope of the present application.
Claims
1. A limited space monitoring and early warning method, characterized in that: Applied to a monitoring system, the monitoring system includes a server and a micro-UAV deployed in an indoor passage, and the monitoring and early warning method includes: The micro drone sends the pre-stored limited space identifier to the server, where the limited space identifier is used to indicate the limited space type; The server identifies whether the limited space type in the limited space identifier is a controlled atmosphere storage, and if the limited space type is identified as the controlled atmosphere storage, sends a controlled atmosphere storage monitoring plan to the micro-UAV, wherein the controlled atmosphere storage monitoring plan includes a controlled atmosphere storage monitoring range and a controlled atmosphere storage monitoring time; The micro-UAV receives the controlled atmosphere storage monitoring plan, obtains the current coordinates and the current time, and if the current coordinates are within the controlled atmosphere storage monitoring range and the current time is within the controlled atmosphere storage monitoring time, shoots the current monitoring video of the controlled atmosphere storage in the indoor passage, calls the data sending interface, and sends the current monitoring video of the controlled atmosphere storage to the server through the data sending interface; The server uses a preset observation window recognition plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video, and the observation window recognition plug-in is an image recognition plug-in for identifying the observation window; If the server recognizes that the controlled atmosphere storage observation window is in an open state, the server writes a preset controlled atmosphere storage observation window identifier into a reserved field of the warning message template to generate a controlled atmosphere storage warning message; The server sends the controlled atmosphere storage warning information to a preset mobile terminal, wherein the controlled atmosphere storage warning information carries the controlled atmosphere storage observation window identifier, and the controlled atmosphere storage observation window identifier is used to identify that the controlled atmosphere storage observation window is in an open state; The server uses a preset observation window identification plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video, including: The server obtains the historical monitoring video of the controlled atmosphere warehouse, obtains the source code of image recognition, packages the source code into an image recognition plug-in, identifies the controlled atmosphere warehouse observation window in the historical monitoring video through the image recognition plug-in, and records the recognition result of each image recognition plug-in; Determine whether the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state. If the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, record the recognition time, recognition interruption number, recognition image data volume, and memory peak value of the image recognition plug-in; Generate a plug-in applicability index for each image recognition plug-in according to a preset plug-in applicability index generation model, the recognition time, the number of recognition interruptions, the amount of recognized image data, the memory peak value, and a preset weight value of each image recognition plug-in, wherein the plug-in applicability index is used to indicate the applicability of the image recognition plug-in in recognizing the observation window of the controlled atmosphere storage; The plug-in applicability index of each image recognition plug-in is sorted in descending order, and the image recognition plug-in corresponding to the largest plug-in applicability index is determined as the observation window recognition plug-in. In the current monitoring video, the observation window recognition plug-in is used to identify whether the observation window of the controlled atmosphere storage is in an open state; The plug-in applies the index generation model as follows: Pn=W*MIN(T / Tn, B / Bn)+(1-W)*MIN(K / Kn, S / Sn); Wherein, Pn represents the plug-in applicability index of the nth image recognition plug-in, n represents the serial number of the image recognition plug-in, the value range of n is 1 to N, and N represents the number of the image recognition plug-ins; W represents a preset weight value; Tn represents the recognition time of the nth image recognition plug-in, and T represents a preset time threshold; Bn represents the number of recognition interruptions of the nth image recognition plug-in, and B represents a preset interruption number threshold; Kn represents the memory peak value of the nth image recognition plug-in, and K represents a preset memory threshold; Sn represents the amount of recognized image data of the nth image recognition plug-in, and S represents a preset data amount threshold; The warning message template includes: the device identification of the server, the service message block protocol, the reserved field, and the warning identification; Among them, MASviewport is written in the reserved field, and MASviewport is the identifier of the observation window of the controlled atmosphere storage.
2. The monitoring and early warning method according to claim 1, characterized in that: The server sends the controlled atmosphere storage warning information to a preset mobile terminal, including: The server sends the controlled atmosphere storage warning information to a preset mobile terminal through a preset network mode, and the network mode includes any one or a combination of WIFI mode, 4G network mode and 5G network mode.
3. The monitoring and early warning method according to claim 1, characterized in that: After the server sends the controlled atmosphere storage warning information to the preset mobile terminal, the monitoring and early warning method further includes: The server obtains shooting instructions, fruits and vegetables to be shot in the controlled atmosphere storage, and location information of the fruits and vegetables to be shot in the controlled atmosphere storage, packages the shooting instructions, fruits and vegetables to be shot in the controlled atmosphere storage, and location information of the fruits and vegetables to be shot in the controlled atmosphere storage, generates a controlled atmosphere storage shooting event, and sends the controlled atmosphere storage shooting event to the micro drone to instruct the micro drone to shoot a video of the fruits and vegetables in the indoor area of the controlled atmosphere storage according to the controlled atmosphere storage shooting event.
4. A monitoring and early warning system for a limited space, characterized in that: The monitoring and early warning system includes a server and a micro-UAV deployed in an indoor passage; the server includes a monitoring module, an identification module, an early warning module, and a generation module; the micro-UAV includes a sending module and a receiving module; The sending module is used to send the pre-stored limited space identifier to the server, where the limited space identifier is used to indicate the limited space type; The monitoring module is used to identify whether the limited space type in the limited space identifier is a controlled atmosphere storage, and if the limited space type is identified as the controlled atmosphere storage, send a controlled atmosphere storage monitoring plan to the micro-UAV, wherein the controlled atmosphere storage monitoring plan includes a controlled atmosphere storage monitoring range and a controlled atmosphere storage monitoring time; The receiving module is used to receive the monitoring plan of the controlled atmosphere storage, obtain the current coordinates and the current time, and if the current coordinates are within the monitoring range of the controlled atmosphere storage and the current time is within the monitoring time of the controlled atmosphere storage, shoot the current monitoring video of the controlled atmosphere storage in the indoor passage, call the data sending interface, and send the current monitoring video of the controlled atmosphere storage to the server through the data sending interface; The identification module is used to identify whether the observation window of the controlled atmosphere storage is in an open state by using a preset observation window identification plug-in in the current monitoring video, wherein the observation window identification plug-in is an image recognition plug-in for identifying the observation window; The generating module is used to write a preset controlled atmosphere storage observation window identifier into a reserved field of the warning message template to generate a controlled atmosphere storage warning message if it is identified that the controlled atmosphere storage observation window is in an open state; The warning module is used to send the controlled atmosphere storage warning information to a preset mobile terminal, and the controlled atmosphere storage observation window identifier is used to identify that the controlled atmosphere storage observation window is in an open state; The identification module includes a recording unit, a judging unit, a generating unit and an identification unit; The recording unit is used to obtain the historical monitoring video of the controlled atmosphere storage, obtain the source code of image recognition, package the source code into an image recognition plug-in, identify the controlled atmosphere storage observation window in the historical monitoring video through the image recognition plug-in, and record the recognition result of each image recognition plug-in; The judgment unit is used to judge whether the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, and if the recognition result of the image recognition plug-in is that the controlled atmosphere storage observation window is in an open state, record the recognition time, recognition interruption number, recognition image data volume, and memory peak value of the image recognition plug-in; The generating unit is used to generate a plug-in applicability index of each image recognition plug-in according to a preset plug-in applicability index generating model, recognition time, recognition interruption times, recognition image data volume, memory peak value and preset weight value of each image recognition plug-in, wherein the plug-in applicability index is used to indicate the applicability of the image recognition plug-in in identifying the observation window of the controlled atmosphere storage; The recognition unit is used to sort the plug-in applicability index of each image recognition plug-in in descending order, determine the image recognition plug-in corresponding to the largest plug-in applicability index as the observation window recognition plug-in, and use the observation window recognition plug-in to identify whether the observation window of the controlled atmosphere storage is in an open state in the current monitoring video; The plug-in applies the index generation model as follows: Pn=W*MIN(T / Tn, B / Bn)+(1-W)*MIN(K / Kn, S / Sn); Wherein, Pn represents the plug-in applicability index of the nth image recognition plug-in, n represents the serial number of the image recognition plug-in, the value range of n is 1 to N, and N represents the number of the image recognition plug-ins; W represents a preset weight value; Tn represents the recognition time of the nth image recognition plug-in, and T represents a preset time threshold; Bn represents the number of recognition interruptions of the nth image recognition plug-in, and B represents a preset interruption number threshold; Kn represents the memory peak value of the nth image recognition plug-in, and K represents a preset memory threshold; Sn represents the amount of recognized image data of the nth image recognition plug-in, and S represents a preset data amount threshold; The warning message template includes: the device identification of the server, the service message block protocol, the reserved field, and the warning identification; Among them, MASviewport is written in the reserved field, and MASviewport is the identifier of the observation window of the controlled atmosphere storage.
5. The monitoring and early warning system according to claim 4, characterized in that: The early warning module is specifically used to send the controlled atmosphere storage early warning information to a preset mobile terminal through a preset network mode, and the network mode includes any one or a combination of WIFI mode, 4G network mode and 5G network mode.
6. The monitoring and early warning system according to claim 4, characterized in that: The server also includes an indication module; The indication module is used to obtain shooting instructions, fruits and vegetables to be photographed in the controlled atmosphere storage, and location information of the fruits and vegetables to be photographed in the controlled atmosphere storage, package the shooting instructions, fruits and vegetables to be photographed in the controlled atmosphere storage, and location information of the fruits and vegetables to be photographed in the controlled atmosphere storage, generate a controlled atmosphere storage shooting event, and send the controlled atmosphere storage shooting event to the micro drone to instruct the micro drone to shoot a video of the fruits and vegetables in the indoor area of the controlled atmosphere storage according to the controlled atmosphere storage shooting event.
