Tool disinfection monitoring method, device, equipment and storage medium

Abstract

The present application discloses a tool disinfection monitoring method, device and storage medium, the method comprising: upon receiving a disinfection monitoring request for a target tool, obtaining video information of the target area to determine the target use image of the target tool; locating the suspected disinfection label area in the target use image; identifying the suspected disinfection label area according to a preset disinfection label recognition model to determine whether the target tool has a preset disinfection label; if it is determined that the target tool has the preset disinfection label, determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions; if the disinfection information pointed to by the preset disinfection label meets the preset conditions, determining that the target tool meets the preset epidemic protection standards. The present application solves the technical problems in the prior art of manually monitoring tool disinfection, consuming too much human resources, and having low transparency and non-traceability.

Description

Technical Field

[0001] The present application relates to the field of artificial intelligence technology in financial technology (Fintech), and in particular to a tool disinfection monitoring method, device, equipment and storage medium. Background Art

[0002] With the continuous development of financial technology, especially Internet technology finance, more and more technologies are applied in the financial field, but the financial industry also puts forward higher requirements for technology. For example, the financial industry also has higher requirements for tool disinfection monitoring.

[0003] That is, during the outbreak of infectious diseases, in order to avoid the spread of viruses or bacteria and ensure personal safety, operations in all walks of life need to comply with epidemic prevention regulations, such as regular disinfection of office spaces or tools used, especially delivery boxes and electric bicycles used by couriers. However, in reality, due to certain reasons, such as the time limit for express delivery, some people do not regularly disinfect tools before using them in accordance with epidemic prevention regulations. Therefore, monitoring the disinfection of items or tools and making the disinfection of tools traceable is a very important part of the epidemic prevention process. At present, the disinfection of tools in various institutions or units is mainly monitored by the relevant person in charge through the inspection and disinfection records, that is, the disinfection of tools is monitored manually. Manual monitoring requires a lot of manpower costs, and the disinfection of tools is not transparent and cannot be traced. There will be a certain deviation between the monitoring results of tool disinfection and the actual situation. Summary of the invention

[0004] The main purpose of this application is to provide a tool disinfection monitoring method, device and storage medium, aiming to solve the technical problems in the prior art of tool disinfection monitoring through manual means, excessive human resource consumption, low transparency and non-traceability.

[0005] To achieve the above objectives, the present application provides a tool disinfection monitoring method, the tool disinfection monitoring method comprising:

[0006] monitoring video information of a target area to determine a target usage image of a target tool;

[0007] Locating the target using a suspected disinfection label area in the image;

[0008] Identifying the suspected disinfection label area to determine whether the target tool has a preset disinfection label;

[0009] If it is determined that the target tool has the preset disinfection label, determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions;

[0010] If the disinfection information pointed to by the preset disinfection label meets the preset conditions, it is determined that the target tool meets the preset epidemic protection standards.

[0011] Optionally, the step of identifying the suspected disinfection label area to determine whether the target tool has a preset disinfection label includes:

[0012] Identify the suspected disinfection label area according to a preset disinfection label recognition model to determine whether the target tool has a preset disinfection label;

[0013] The preset disinfection label recognition model is obtained by iteratively training a preset prediction model to be trained by executing a preset training process based on a preset image information set with a preset disinfection label.

[0014] Optionally, before the step of identifying the suspected disinfection label area according to a preset disinfection label recognition model to determine whether the target tool has a preset disinfection label, the method further includes:

[0015] Obtain a preset image information set with a preset disinfection label, transform the preset image information set to obtain a preset image information set after the transformation, and iteratively perform the following steps:

[0016] Extracting a feature matrix from the preset image information set after transformation based on the preset prediction model to be trained, and performing prediction processing on the feature matrix to obtain a predicted label set;

[0017] Comparing the predicted label set with the pre-stored actual label set of the preset image information set to obtain a comparison result;

[0018] According to the comparison result, the parameters of the preset prediction model to be trained are adjusted until the target similarity between the predicted label set and the actual label set after iteration is greater than a preset similarity threshold, so as to obtain the preset disinfection label recognition model.

[0019] Optionally, the step of locating the suspected disinfection label area in the target usage image includes:

[0020] Performing threshold segmentation on the target image using a preset threshold segmentation model to obtain a binary image;

[0021] Determine each connected area in the binary image, and obtain each circumscribed rectangular frame of each connected area;

[0022] If the length of the first circumscribed rectangular frame meets the preset length, and the width of the first circumscribed rectangular frame meets the preset width, it is determined that the connected area corresponding to the first circumscribed rectangular frame is a suspected disinfection label area.

[0023] Optionally, the disinfection information includes label disinfection time;

[0024] If it is determined that the target tool has the preset disinfection label, the step of determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions includes:

[0025] If it is determined that the target tool has the preset disinfection label, the label disinfection time recorded in the preset disinfection label is extracted, and it is determined whether the label disinfection time meets the preset conditions based on the disinfection record of the target tool recorded in the preset associated blockchain.

[0026] Optionally, if it is determined that the target tool has the preset disinfection label, the step of extracting the label disinfection time recorded in the preset disinfection label, and determining whether the label disinfection time meets the preset conditions according to the disinfection record of the target tool recorded in the preset associated blockchain includes:

[0027] If it is determined that the target tool has the preset disinfection label, extracting the label disinfection time recorded in the preset disinfection label;

[0028] Obtaining the disinfection record of the target tool recorded in the preset associated blockchain, extracting the recording time from the disinfection record, and comparing the recording time with the label disinfection time to determine whether the label disinfection time has been tampered with;

[0029] If the label disinfection time has not been tampered with, extracting the latest recorded sub-time from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time;

[0030] If the time interval is greater than a preset first time threshold, it is determined that the label disinfection time does not meet the preset conditions.

[0031] Optionally, after the step of extracting the latest recorded sub-time from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time if the label disinfection time has not been tampered with, the method includes:

[0032] If the time interval is less than or equal to the preset first time threshold, determine the time difference between the label disinfection time and the current time;

[0033] If the time difference is greater than a preset second time threshold, it is determined that the label disinfection time does not meet the preset conditions.

[0034] Optionally, after the step of identifying the suspected disinfection label area according to a preset disinfection label recognition model to determine whether the target tool has a preset disinfection label, the method includes:

[0035] If it is determined that the target tool does not have the preset disinfection label or the disinfection information pointed to by the preset disinfection label does not meet the preset conditions, it is determined that the target tool does not meet the preset epidemic protection standard;

[0036] If the target tool does not meet the preset epidemic protection standards, a prompt message indicating that the target tool needs to be disinfected is output.

[0037] The present application also provides a tool disinfection monitoring device, which is a physical device, and includes: a memory, a processor, and a program of the tool disinfection monitoring method stored in the memory and executable on the processor. When the program of the tool disinfection monitoring method is executed by the processor, the following steps can be implemented:

[0038] monitoring video information of a target area to determine a target usage image of a target tool;

[0039] Locating the target using a suspected disinfection label area in the image;

[0040] Identifying the suspected disinfection label area to determine whether the target tool has a preset disinfection label;

[0041] If it is determined that the target tool has the preset disinfection label, determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions;

[0042] If the disinfection information pointed to by the preset disinfection label meets the preset conditions, it is determined that the target tool meets the preset epidemic protection standards.

[0043] Optionally, the step of identifying the suspected disinfection label area to determine whether the target tool has a preset disinfection label includes:

[0044] Identify the suspected disinfection label area according to a preset disinfection label recognition model to determine whether the target tool has a preset disinfection label;

[0045] The preset disinfection label recognition model is obtained by iteratively training a preset prediction model to be trained by executing a preset training process based on a preset image information set with a preset disinfection label.

[0046] Optionally, before the step of identifying the suspected disinfection label area according to a preset disinfection label recognition model to determine whether the target tool has a preset disinfection label, the method further includes:

[0047] Obtain a preset image information set with a preset disinfection label, transform the preset image information set to obtain a preset image information set after the transformation, and iteratively perform the following steps:

[0048] Extracting a feature matrix from the preset image information set after transformation based on the preset prediction model to be trained, and performing prediction processing on the feature matrix to obtain a predicted label set;

[0049] Comparing the predicted label set with the pre-stored actual label set of the preset image information set to obtain a comparison result;

[0050] According to the comparison result, the parameters of the preset prediction model to be trained are adjusted until the target similarity between the predicted label set and the actual label set after iteration is greater than a preset similarity threshold, so as to obtain the preset disinfection label recognition model.

[0051] Optionally, the step of locating the suspected disinfection label area in the target usage image includes:

[0052] Performing threshold segmentation on the target image using a preset threshold segmentation model to obtain a binary image;

[0053] Determine each connected area in the binary image, and obtain each circumscribed rectangular frame of each connected area;

[0054] If the length of the first circumscribed rectangular frame meets the preset length, and the width of the first circumscribed rectangular frame meets the preset width, it is determined that the connected area corresponding to the first circumscribed rectangular frame is a suspected disinfection label area.

[0055] Optionally, the disinfection information includes label disinfection time;

[0056] If it is determined that the target tool has the preset disinfection label, the step of determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions includes:

[0057] If it is determined that the target tool has the preset disinfection label, the label disinfection time recorded in the preset disinfection label is extracted, and it is determined whether the label disinfection time meets the preset conditions based on the disinfection record of the target tool recorded in the preset associated blockchain.

[0058] Optionally, if it is determined that the target tool has the preset disinfection label, the step of extracting the label disinfection time recorded in the preset disinfection label, and determining whether the label disinfection time meets the preset conditions according to the disinfection record of the target tool recorded in the preset associated blockchain includes:

[0059] If it is determined that the target tool has the preset disinfection label, extracting the label disinfection time recorded in the preset disinfection label;

[0060] Obtaining the disinfection record of the target tool recorded in the preset associated blockchain, extracting the recording time from the disinfection record, and comparing the recording time with the label disinfection time to determine whether the label disinfection time has been tampered with;

[0061] If the label disinfection time has not been tampered with, extracting the latest recorded sub-time from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time;

[0062] If the time interval is greater than a preset first time threshold, it is determined that the label disinfection time does not meet the preset conditions.

[0063] Optionally, after the step of extracting the latest recorded sub-time from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time if the label disinfection time has not been tampered with, the method includes:

[0064] If the time interval is less than or equal to the preset first time threshold, determine the time difference between the label disinfection time and the current time;

[0065] If the time difference is greater than a preset second time threshold, it is determined that the label disinfection time does not meet the preset conditions.

[0066] Optionally, after the step of identifying the suspected disinfection label area according to a preset disinfection label recognition model to determine whether the target tool has a preset disinfection label, the method includes:

[0067] If it is determined that the target tool does not have the preset disinfection label or the disinfection information pointed to by the preset disinfection label does not meet the preset conditions, it is determined that the target tool does not meet the preset epidemic protection standard;

[0068] If the target tool does not meet the preset epidemic protection standards, a prompt message indicating that the target tool needs to be disinfected is output.

[0069] The present application also provides a storage medium, on which is stored a program for implementing the above-mentioned tool disinfection monitoring method. When the program of the tool disinfection monitoring method is executed by a processor, the steps of the above-mentioned tool disinfection monitoring method are implemented.

[0070] This application monitors the video information of the target area to determine the target use image of the target tool; locates the suspected disinfection label area in the target use image; identifies the suspected disinfection label area to determine whether the target tool has a preset disinfection label; if it is determined that the target tool has the preset disinfection label, then determine whether the disinfection information pointed to by the preset disinfection label meets the preset conditions; if the disinfection information pointed to by the preset disinfection label meets the preset conditions, then determine that the target tool meets the preset epidemic prevention standards. In this application, the target use image of the target tool is determined by monitoring the video information of the target area, and the suspected disinfection label area is located, and then the suspected disinfection label area is identified to accurately determine whether the target tool has a preset disinfection label, and further automatically determine whether the disinfection information pointed to by the preset disinfection label meets the preset conditions, and then determine whether the target tool meets the preset epidemic prevention standards. Since the above-mentioned monitoring and disinfection is automatically realized, human resources are saved, and since it is automatically realized through monitoring video, transparency and traceability are improved, solving the technical problems of excessive human resource consumption, low transparency, and non-traceability in the prior art of tool disinfection monitoring by manual means. BRIEF DESCRIPTION OF THE DRAWINGS

[0071] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present application and, together with the description, serve to explain the principles of the present application.

[0072] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0073] Figure 1 This is a flow chart of the first embodiment of the tool disinfection monitoring method of the present application;

[0074] Figure 2 A detailed flow chart of the step of locating the suspected disinfection label area in the target usage image in the first embodiment of the tool disinfection monitoring method of the present application;

[0075] Figure 3 This is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present application.

[0076] The purpose, features and advantages of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings. DETAILED DESCRIPTION

[0077] It should be understood that the specific embodiments described herein are only used to explain the present application and are not used to limit the present application.

[0078] The present application embodiment provides a tool disinfection monitoring method. In the first embodiment of the tool disinfection monitoring method of the present application, refer to Figure 1 , the tool disinfection monitoring method comprises:

[0079] Step S10, monitoring video information of the target area to determine a target use image of the target tool;

[0080] Step S20, locating the suspected disinfection label area in the target usage image;

[0081] Step S30, identifying the suspected disinfection label area to determine whether the target tool has a preset disinfection label;

[0082] Step S40, if it is determined that the target tool has the preset disinfection label, then determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions;

[0083] Step S50: If the disinfection information pointed to by the preset disinfection label meets the preset conditions, it is determined that the target tool meets the preset epidemic protection standards.

[0084] The specific steps are as follows:

[0085] Step S10, monitoring video information of the target area to determine a target use image of the target tool;

[0086] During the epidemic prevention and control period, it is necessary to disinfect the target tools. At present, the disinfection of target tools of various institutions or units is mainly monitored by the corresponding person in charge checking the disinfection records, that is, the tool disinfection is monitored manually. Manual monitoring requires more manpower costs, and the target tool disinfection is not transparent and traceable. The monitoring results of the target tool disinfection will also deviate from the actual situation. In this embodiment, a tool disinfection monitoring method is provided to automatically monitor the disinfection of target tools to save manpower and material resources. In addition, the disinfection process can be made transparent and traceable to avoid deviations between the monitoring results of the tool disinfection and the actual situation.

[0087] Specifically, the video information of the target area is monitored to determine the target use image of the target tool, wherein the target area is always under monitoring. The user can trigger a disinfection monitoring request for the target tool on the terminal, and the disinfection monitoring request can also be automatically triggered at a fixed time. After receiving the disinfection monitoring request for the target tool, the video information of the target area targeted by the disinfection monitoring request is obtained, wherein it should be noted that the target area is preset (determined by the disinfection monitoring request), and the video information of the target area can be collected by a camera at the tool use occasion. Specifically, the video information can be collected by a camera in a distribution warehouse, or by a camera near a distribution cabinet. After obtaining the video information of the target area targeted by the disinfection monitoring request, the target use image of the target tool is determined according to the video information. The method for determining the tool (use) image information can be: using a preset tool recognition model (pre-trained) and several consecutive video frame images in the video information to determine whether there is a dynamic target tool. If so, the last or any one of the video frame images is selected as the tool use image or the target use image. If not, a prompt message is generated.

[0088] Step S20, locating the suspected disinfection label area in the target usage image;

[0089] In this embodiment, after determining the target use image, the suspected disinfection label area in the target use image is located. In this embodiment, since the suspected disinfection label area in the target use image is located instead of identifying all areas in the target use image, the processing process is simplified and the monitoring efficiency is improved.

[0090] Reference Figure 2 , wherein the step of locating the suspected disinfection label area in the target usage image comprises:

[0091] Step S21, performing threshold segmentation on the target image using a preset threshold segmentation model to obtain a binary image;

[0092] Step S22, determining each connected area in the binary image, and obtaining each circumscribed rectangular frame of each connected area;

[0093] In this embodiment, the target image is firstly subjected to threshold segmentation by a preset threshold segmentation model (a trained model that can accurately perform binary segmentation) to obtain a binary image. After obtaining the binary image, each connected region in the binary image is determined by a preset connected region marking algorithm (connected points form a region, and disconnected points form different regions. A set of connected points is called a connected region). After obtaining each connected region, each circumscribed rectangular frame of each connected region is obtained, such as a circumscribed rectangular frame of a circular connected region and a circumscribed rectangular frame of a polygonal region. In this embodiment, the purpose of obtaining the circumscribed rectangular frame is that the existing disinfection label is generally in the form of a rectangular frame.

[0094] Step S23: if there is a first circumscribed rectangular frame whose length meets the preset length and whose width meets the preset width, determine that the connected area corresponding to the first circumscribed rectangular frame is a suspected disinfection label area.

[0095] If the length of a first circumscribed rectangular frame meets the preset length and the width of the first circumscribed rectangular frame meets the preset width, the connected area corresponding to the first circumscribed rectangular frame is determined to be a suspected disinfection label area. That is, if the length and width of a certain connected area meet the preset requirements, the connected area corresponding to the first circumscribed rectangular frame is determined to be a suspected disinfection label area.

[0096] If there is a second circumscribed rectangular box whose length only does not meet the preset length, or if there is a third circumscribed rectangular box whose width only does not meet the preset length, or if there is a fourth circumscribed rectangular box whose length does not meet the preset length and the width of the fourth circumscribed rectangular box also does not meet the preset width, determine that the connected area corresponding to the second circumscribed rectangular box, the connected area corresponding to the third circumscribed rectangular box, and the connected area corresponding to the fourth circumscribed rectangular box are not suspected disinfection label areas.

[0097] Step S30, identifying the suspected disinfection label area to determine whether the target tool has a preset disinfection label;

[0098] After obtaining the suspected disinfection label area, the suspected disinfection label area is identified to determine whether the target tool has a preset disinfection label, wherein the size of the label in the suspected disinfection label area can be determined for fuzzy identification to determine whether the target tool has a preset disinfection label.

[0099] The step of identifying the suspected disinfection label area to determine whether the target tool has a preset disinfection label includes:

[0100] Step S31, identifying the suspected disinfection label area according to a preset disinfection label recognition model to determine whether the target tool has a preset disinfection label;

[0101] The preset disinfection label recognition model is obtained by iteratively training a preset prediction model to be trained by executing a preset training process based on a preset image information set with a preset disinfection label.

[0102] The preset disinfection label recognition model is obtained by iteratively training a preset prediction model to be trained based on a preset image information set with a preset disinfection label by executing a preset training process. Therefore, the preset disinfection label recognition model can accurately identify the preset disinfection label. Therefore, after identifying the suspected disinfection label area according to the preset disinfection label recognition model, it can be determined whether the target tool has a preset disinfection label.

[0103] Wherein, before the step of identifying the suspected disinfection label area according to the preset disinfection label recognition model to determine whether the target tool has a preset disinfection label, the method further includes:

[0104] Before the step of identifying the suspected disinfection label area according to the preset disinfection label recognition model to determine whether the target tool has a preset disinfection label, the method further includes:

[0105] Step A1, obtaining a preset image information set with a preset disinfection label, transforming the preset image information set to obtain a transformed image information set, and iteratively performing the following steps:

[0106] Acquire a preset image information set with a preset disinfection label, and transform the preset image information set to obtain a transformed image information set, wherein the preset disinfection label includes a preset disinfection text label and / or a preset logo graphic label;

[0107] Obtain a preset image information set with a preset disinfection label, transform the preset image information set, and obtain the transformed image information set. Specifically, since the preset image information set may include manually marked text and / or logo graphics, it is necessary to transform the preset image information set to obtain the transformed image information. Transforming the preset image information set to obtain the transformed image information includes: 1. Obtaining a preset image information set containing the preset disinfection text label, and transforming the preset image information set to obtain the transformed image information; 2. Obtaining a preset image information set containing the preset logo graphic label, and transforming the preset image information set to obtain the transformed image information; 3. Obtaining a preset image information set containing the preset logo graphic label and the preset disinfection text label, and transforming the preset image information set to obtain the transformed image information. Among them, transforming the preset image information set refers to transforming the image with manually marked text and / or artificial logo graphics through a preset OCR transformation processing technology, etc., to obtain the transformed image information.

[0108] Step A2, extracting a feature matrix from the transformed image information set based on the preset prediction model to be trained, and performing prediction processing on the feature matrix to obtain a predicted label set;

[0109] Based on the preset prediction model to be trained, a feature matrix is ​​extracted from the transformed image information set, and the feature matrix is ​​predicted to obtain a predicted label set. Specifically, based on the preset convolution layer and the preset pooling layer of the preset prediction model to be trained, a feature matrix is ​​extracted from the transformed preset image information set, and the feature matrix is ​​predicted according to the preset activation layer of the preset prediction model to be trained to obtain a predicted label set, wherein the predicted label set includes a predicted text set and / or a predicted logo graphic set, and the feature matrix is ​​predicted according to the preset activation layer of the preset prediction model to be trained to obtain a predicted label set. The method comprises: predicting the feature matrix according to the preset activation layer of the preset prediction model to be trained to obtain a predicted text set, predicting the feature matrix according to the preset activation layer of the preset prediction model to be trained to obtain a predicted logo graphic set, and predicting the feature matrix according to the preset activation layer of the preset prediction model to be trained to obtain a predicted text set and a predicted logo graphic set.

[0110] Step A3, comparing the predicted label set with the actual label set of the pre-stored preset image information set to obtain a comparison result;

[0111] The predicted label set is compared with the actual label set of the pre-stored preset image information set to obtain a comparison result, that is, the predicted text set and / or the predicted logo graphic set is compared with the actual label set to obtain a comparison result, specifically including: comparing the predicted text set with the text sub-label set in the actual label set to obtain a comparison result, comparing the predicted logo graphic set with the logo graphic sub-label set in the actual label set to obtain a comparison result, comparing the predicted logo graphic set with the logo graphic sub-label set in the actual label set, and comparing the predicted text set with the text sub-label set in the actual label set to obtain a comparison result.

[0112] Step A4, according to the comparison result, adjust the parameters of the preset prediction model to be trained until the target similarity between the predicted label set and the actual label set after iteration is greater than the preset similarity threshold, so as to obtain the preset disinfection label recognition model.

[0113] According to the comparison result, the parameters of the preset prediction model to be trained are adjusted until the target similarity between the predicted label set and the actual label set after iteration is greater than the preset similarity threshold, so as to obtain the preset disinfection label recognition model. Specifically, according to the comparison result, the parameters of the preset initial convolution layer and the preset initial pooling layer are adjusted until the target similarity between the predicted text set / logo graphic set and the actual label set after iteration is greater than the preset similarity threshold, and the preset disinfection label recognition model is obtained, including: first, according to the comparison result obtained by comparing the predicted text set with the text sub-label set in the actual label set, the parameters of the preset initial convolution layer and the preset initial pooling layer are adjusted until the target similarity between the predicted text set and the actual label set after iteration is greater than the preset similarity threshold, and the preset disinfection label recognition model is obtained. The method comprises the following steps of: first, adjusting the parameters of the preset initial convolution layer and the preset initial pooling layer according to the comparison result of comparing the predicted logo graphic set with the logo graphic sub-tag set in the actual tag set, until the target similarity between the predicted logo graphic set and the actual tag set after iteration is greater than the preset similarity threshold, thereby obtaining the preset disinfection label recognition model; second, adjusting the parameters of the preset initial convolution layer and the preset initial pooling layer according to the comparison result of comparing the predicted logo graphic set with the logo graphic sub-tag set in the actual tag set, and comparing the predicted text set with the text sub-tag set in the actual tag set, until the target similarity between the predicted text set and logo graphic set and the actual tag set after iteration is greater than the preset similarity threshold, thereby obtaining the preset disinfection label recognition model.

[0114] It should be noted that the method of identifying whether the monitored tool has a disinfection label by using a preset disinfection label recognition model is not limited to the above examples. For example, it can be by calculating the Euclidean distance between feature matrix sets (using a preset Euclidean distance calculation method) or other similarity methods.

[0115] Step S40, if it is determined that the target tool has the preset disinfection label, then determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions;

[0116] If it is determined that the target tool has the preset disinfection label, it is also determined whether the disinfection information pointed to by the preset disinfection label meets the preset conditions; if it is determined that the target tool does not have the preset disinfection label, it is not determined whether the disinfection information pointed to by the preset disinfection label meets the preset conditions, wherein the preset conditions can be flexibly changed according to the severity of the current epidemic prevention.

[0117] Step S50: If the disinfection information pointed to by the preset disinfection label meets the preset conditions, it is determined that the target tool meets the preset epidemic protection standards.

[0118] If the disinfection information pointed to by the preset disinfection label meets the preset conditions, it is determined that the target tool meets the preset epidemic protection standards. If the disinfection information pointed to by the preset disinfection label does not meet the preset conditions, it is determined that the target tool does not meet the preset epidemic protection standards.

[0119] Wherein, after the step of identifying the suspected disinfection label area according to the preset disinfection label recognition model to determine whether the target tool has a preset disinfection label, the method includes:

[0120] Step S70: If it is determined that the target tool does not have the preset disinfection label or the disinfection information pointed to by the preset disinfection label does not meet the preset conditions, it is determined that the target tool does not meet the preset epidemic protection standard;

[0121] Step S80: If the target tool does not meet the preset epidemic protection standard, a prompt message indicating that the target tool needs to be disinfected is output.

[0122] If it is determined that the target tool does not have the preset disinfection label or the disinfection information pointed to by the preset disinfection label does not meet the preset conditions, then it is determined that the target tool does not meet the preset epidemic protection standards, and if the target tool does not meet the preset epidemic protection standards; and output a prompt message that the target tool needs to be disinfected, specifically, obtain the management terminal of the target tool, send a prompt message that the target tool needs to be disinfected to the tool user, or it can also be sent to the terminal device of the disinfection monitoring person in charge. In addition, the detection results of the tool disinfection situation can also be reported to the blockchain, such as recording the number of times the tool has not been disinfected according to the standard.

[0123] This application monitors the video information of the target area to determine the target use image of the target tool; locates the suspected disinfection label area in the target use image; identifies the suspected disinfection label area to determine whether the target tool has a preset disinfection label; if it is determined that the target tool has the preset disinfection label, then determine whether the disinfection information pointed to by the preset disinfection label meets the preset conditions; if the disinfection information pointed to by the preset disinfection label meets the preset conditions, then determine that the target tool meets the preset epidemic prevention standards. In this application, the target use image of the target tool is determined by monitoring the video information of the target area, and the suspected disinfection label area is located, and then the suspected disinfection label area is identified to accurately determine whether the target tool has a preset disinfection label, and further automatically determine whether the disinfection information pointed to by the preset disinfection label meets the preset conditions, and then determine whether the target tool meets the preset epidemic prevention standards. Since the above-mentioned monitoring and disinfection is automatically realized, human resources are saved, and since it is automatically realized through monitoring video, transparency and traceability are improved, solving the technical problems of excessive human resource consumption, low transparency, and non-traceability in the prior art of tool disinfection monitoring by manual means.

[0124] Further, refer to Figure 2 , based on the first embodiment of the present application, in another embodiment of the present application, the disinfection information includes the label disinfection time;

[0125] If it is determined that the target tool has the preset disinfection label, the step of determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions includes:

[0126] Step S41: If it is determined that the target tool has the preset disinfection label, the label disinfection time recorded in the preset disinfection label is extracted, and it is determined whether the label disinfection time meets the preset conditions based on the disinfection record of the target tool recorded in the preset associated blockchain.

[0127] In this embodiment, if it is determined that the target tool has the preset disinfection label, the label disinfection time recorded is extracted from the preset disinfection label. Specifically, the label disinfection time recorded is extracted by a preset OCR identification method, and the label disinfection time is determined to meet the preset conditions according to the disinfection record of the target tool recorded in the preset associated blockchain. That is, in this embodiment, the preset associated blockchain records the disinfection record of the target tool, wherein the records after each disinfection of each tool will be reported to the node of the blockchain, and the information recorded by the blockchain node includes tool information, tool disinfection information, etc. The tool information includes the unit or personal information of the tool user, the identification information of the tool itself, and the tool disinfection information may include the tool disinfection time, the disinfectant information used for disinfection, the disinfection personnel or disinfection machine information, etc. Regardless of whether it is an automatic disinfection machine or manual disinfection, after disinfection, a disinfection label will be attached to the tool, and then the above information will be reported to the blockchain, so that the tool disinfection information can be traced. The disinfection record is extracted to determine whether the label disinfection time meets the preset conditions.

[0128] Specifically, if it is determined that the target tool has the preset disinfection label, the step of extracting the label disinfection time recorded in the preset disinfection label, and determining whether the label disinfection time meets the preset conditions according to the disinfection record of the target tool recorded in the preset associated blockchain includes:

[0129] Step S411, if it is determined that the target tool has the preset disinfection label, extracting the label disinfection time recorded in the preset disinfection label;

[0130] Step S412, obtaining the disinfection record of the target tool recorded in the preset associated blockchain, extracting the recording time from the disinfection record, and comparing the recording time with the label disinfection time to determine whether the label disinfection time has been tampered with;

[0131] In this embodiment, whether the label meets the preset conditions is determined by the time factor. Of course, it can also be other factors, which will not be specifically described here. When determining whether the label meets the preset conditions by the time factor, first retrieve the disinfection record of the target tool recorded in the preset associated blockchain, and compare the recorded time with the label disinfection time to determine whether the label disinfection time has been tampered with. Specifically, since there may be multiple label disinfection sub-times in the label disinfection time, it is necessary to compare the multiple recorded times with the corresponding label disinfection sub-times to determine whether the label disinfection time has been tampered with. As long as any one of the label disinfection sub-times is tampered with, it is determined that the label disinfection time has been tampered with. If all the label disinfection sub-times are tampered with, it is determined that the label disinfection time has not been tampered with.

[0132] Step S413, if the label disinfection time has not been tampered with, extracting the latest recorded sub-time from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time;

[0133] Step S414: if the time interval is greater than the preset first time threshold, it is determined that the label disinfection time does not meet the preset conditions.

[0134] If the label disinfection time has not been tampered with, the latest recorded sub-time is extracted from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time. In this embodiment, the purpose of extracting the latest recorded sub-time from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time is to determine whether the latest recorded sub-time has not been recorded. If the time interval is greater than the preset first time threshold, it is determined that the label disinfection time does not meet the preset conditions.

[0135] In this embodiment, if it is determined that the target tool has the preset disinfection label, the label disinfection time recorded in the preset disinfection label is extracted, and whether the label disinfection time meets the preset conditions is determined based on the disinfection record of the target tool recorded in the preset associated blockchain. In this embodiment, disinfection detection is performed through blockchain, which improves the transparency and traceability of detection.

[0136] Further, based on the first and second embodiments of the present application, in another embodiment of the present application, if the label disinfection time has not been tampered with, after the step of extracting the latest recorded sub-time from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time, the method includes:

[0137] Step B1, if the time interval is less than or equal to the preset first time threshold, determine the time difference between the label disinfection time and the current time;

[0138] In this embodiment, if the time interval is less than or equal to the preset first time threshold, that is, the record meets the requirements, the time difference between the label disinfection time and the current moment is also determined. The purpose of determining the time difference between the label disinfection time and the current moment is to determine whether the disinfection time is too long and invalid.

[0139] Step B2: If the time difference is greater than a preset second time threshold, it is determined that the label disinfection time does not meet the preset conditions.

[0140] If the time difference is greater than the preset second time threshold, it is determined that the label disinfection time does not meet the preset conditions; if the time difference is less than or equal to the preset second time threshold, it is determined that the label disinfection time meets the preset conditions.

[0141] Among them, if it is determined that the label disinfection time does not meet the preset conditions, the automatic disinfection intelligent device is triggered to perform automatic disinfection. The process of automatic disinfection can be: receiving a disinfection request, which carries the identification information of the tool user and the tool identification information. When the tool identification information is recognized, the disinfection component switch is turned on to disinfect the tool; when the tool disinfection work is completed, the disinfection is controlled to be turned off, and the label sticking component is turned on to print the disinfection label and stick it to the corresponding position of the tool. In addition, according to the disinfection time, the identification information of the tool user, the tool identification information, the disinfectant information used for disinfection, etc., the disinfection record information is generated and reported to the blockchain.

[0142] In this embodiment, if the time interval is less than or equal to the preset first time threshold, the time difference between the label disinfection time and the current time is determined; if the time difference is greater than the preset second time threshold, it is determined that the label disinfection time does not meet the preset conditions. In this embodiment, whether the label disinfection time meets the preset conditions is accurately determined, laying the foundation for monitoring the disinfection status of the target tool.

[0143] Reference Figure 3 , Figure 3 It is a schematic diagram of the device structure of the hardware operating environment involved in the embodiment of the present application.

[0144] like Figure 3 As shown, the tool disinfection monitoring device may include: a processor 1001, such as a CPU, a memory 1005, and a communication bus 1002. The communication bus 1002 is used to realize the connection and communication between the processor 1001 and the memory 1005. The memory 1005 may be a high-speed RAM memory or a stable memory (non-volatile memory), such as a disk memory. The memory 1005 may also be a storage device independent of the aforementioned processor 1001.

[0145] Optionally, the tool disinfection monitoring device may also include a rectangular user interface, a network interface, a camera, an RF (Radio Frequency) circuit, a sensor, an audio circuit, a WiFi module, etc. The rectangular user interface may include a display screen (Display), an input submodule such as a keyboard (Keyboard), and the optional rectangular user interface may also include a standard wired interface and a wireless interface. The network interface may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface).

[0146] Those skilled in the art will understand that Figure 3 The structure of the tool sterilization monitoring device shown in the figure does not constitute a limitation on the tool sterilization monitoring device, and may include more or less components than shown in the figure, or combine certain components, or arrange the components differently.

[0147] like Figure 3 As shown, the memory 1005 as a computer storage medium may include an operating system, a network communication module and a tool disinfection monitoring program. The operating system is a program that manages and controls the hardware and software resources of the tool disinfection monitoring device, and supports the operation of the tool disinfection monitoring program and other software and / or programs. The network communication module is used to realize the communication between the components inside the memory 1005, and the communication with other hardware and software in the tool disinfection monitoring system.

[0148] exist Figure 3 In the tool disinfection monitoring device shown, the processor 1001 is used to execute the tool disinfection monitoring program stored in the memory 1005 to implement the steps of any of the tool disinfection monitoring methods described above.

[0149] The specific implementation of the tool disinfection monitoring device of the present application is basically the same as the various embodiments of the above-mentioned tool disinfection monitoring method, and will not be repeated here.

[0150] An embodiment of the present application provides a storage medium, and the storage medium stores one or more programs, and the one or more programs can also be executed by one or more processors to implement the steps of any of the above-mentioned tool disinfection monitoring methods.

[0151] The specific implementation methods of the storage medium of the present application are basically the same as the embodiments of the above-mentioned tool disinfection monitoring method, and will not be repeated here.

[0152] The above are only preferred embodiments of the present application, and are not intended to limit the patent scope of the present application. Any equivalent structure or equivalent process transformation made using the contents of the present application specification and drawings, or directly or indirectly applied in other related technical fields, are also included in the patent processing scope of the present application.

Claims

1. A tool disinfection monitoring method, characterized in that: The tool disinfection monitoring method comprises: Monitoring video information of a target area to determine a target use image of a target tool, wherein the target use image is determined by identifying continuous video frame images in the video information through a preset tool recognition model; Performing threshold segmentation on the target image using a preset threshold segmentation model to obtain a binary image; Determine each connected area in the binary image, and obtain each circumscribed rectangular frame of each connected area; If the length of the first circumscribed rectangular frame meets the preset length, and the width of the first circumscribed rectangular frame meets the preset width, determining that the connected area corresponding to the first circumscribed rectangular frame is a suspected disinfection label area; Identifying the suspected disinfection label area to determine whether the target tool has a preset disinfection label; If it is determined that the target tool has the preset disinfection label, determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions; If the disinfection information pointed to by the preset disinfection label meets the preset conditions, it is determined that the target tool meets the preset epidemic protection standards.

2. The tool disinfection monitoring method according to claim 1, characterized in that: The step of identifying the suspected disinfection label area to determine whether the target tool has a preset disinfection label includes: Identify the suspected disinfection label area according to a preset disinfection label recognition model to determine whether the target tool has a preset disinfection label; The preset disinfection label recognition model is obtained by iteratively training a preset prediction model to be trained by executing a preset training process based on a preset image information set with a preset disinfection label.

3. The tool disinfection monitoring method according to claim 2, characterized in that: Before the step of identifying the suspected disinfection label area according to the preset disinfection label recognition model to determine whether the target tool has a preset disinfection label, the method further includes: Obtain a preset image information set with a preset disinfection label, transform the preset image information set to obtain a preset image information set after the transformation, and iteratively perform the following steps: Extracting a feature matrix from the preset image information set after transformation based on the preset prediction model to be trained, and performing prediction processing on the feature matrix to obtain a predicted label set; Comparing the predicted label set with the pre-stored actual label set of the preset image information set to obtain a comparison result; According to the comparison result, the parameters of the preset prediction model to be trained are adjusted until the target similarity between the predicted label set and the actual label set after iteration is greater than a preset similarity threshold, so as to obtain the preset disinfection label recognition model.

4. The tool disinfection monitoring method according to claim 1, characterized in that: The disinfection information includes the label disinfection time; If it is determined that the target tool has the preset disinfection label, the step of determining whether the disinfection information pointed to by the preset disinfection label meets the preset conditions includes: If it is determined that the target tool has the preset disinfection label, the label disinfection time recorded in the preset disinfection label is extracted, and it is determined whether the label disinfection time meets the preset conditions based on the disinfection record of the target tool recorded in the preset associated blockchain.

5. The tool disinfection monitoring method according to claim 4, characterized in that: If it is determined that the target tool has the preset disinfection label, the step of extracting the label disinfection time recorded in the preset disinfection label, and determining whether the label disinfection time meets the preset conditions according to the disinfection record of the target tool recorded in the preset associated blockchain includes: If it is determined that the target tool has the preset disinfection label, extracting the label disinfection time recorded in the preset disinfection label; Obtaining the disinfection record of the target tool recorded in the preset associated blockchain, extracting the recording time from the disinfection record, and comparing the recording time with the label disinfection time to determine whether the label disinfection time has been tampered with; If the label disinfection time has not been tampered with, extracting the latest recorded sub-time from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time; If the time interval is greater than a preset first time threshold, it is determined that the label disinfection time does not meet the preset conditions.

6. The tool disinfection monitoring method according to claim 5, characterized in that: After the step of extracting the latest recorded sub-time from the recorded time to obtain the time interval between the label disinfection time and the latest recorded sub-time if the label disinfection time has not been tampered with, the method comprises: If the time interval is less than or equal to the preset first time threshold, determine the time difference between the tag disinfection time and the current time; If the time difference is greater than a preset second time threshold, it is determined that the label disinfection time does not meet the preset conditions.

7. The tool disinfection monitoring method according to any one of claims 2 to 3, characterized in that: After the step of identifying the suspected disinfection label area according to the preset disinfection label recognition model to determine whether the target tool has a preset disinfection label, the method further includes: If it is determined that the target tool does not have the preset disinfection label or the disinfection information pointed to by the preset disinfection label does not meet the preset conditions, it is determined that the target tool does not meet the preset epidemic protection standards; and a prompt message indicating that the target tool needs to be disinfected is output.

8. A tool disinfection monitoring device, characterized in that: The tool disinfection monitoring device comprises: a memory, a processor, and a program stored in the memory for implementing the tool disinfection monitoring method. The memory is used to store a program for implementing a tool disinfection monitoring method; The processor is used to execute a program for implementing the tool disinfection monitoring method to implement the steps of the tool disinfection monitoring method according to any one of claims 1 to 7.

9. A storage medium, characterized in that: The storage medium stores a program for implementing a tool disinfection monitoring method, and the program for implementing a tool disinfection monitoring method is executed by a processor to implement the steps of the tool disinfection monitoring method as claimed in any one of claims 1 to 7.

Images