Laboratory automatic alarm method and system based on deep learning

Abstract

The present invention proposes a laboratory automatic alarm method and system based on deep learning. The laboratory automatic alarm method includes: the intelligent camera component collects video images of laboratory items placed according to a preset video acquisition time interval, and obtains laboratory item information of the current laboratory items through the video image; the intelligent camera component uploads the laboratory item information of the current laboratory items to the management system, and after the management system performs laboratory item information detection, obtains the laboratory item information detection result sent back by the management system; after receiving the image information detection result sent back by the management system, the intelligent camera component determines whether to send alarm information and laboratory item position adjustment information to the staff terminal according to the information result. The system includes modules corresponding to the steps of the method.

Description

Technical Field

[0001] The present invention discloses a laboratory automatic alarm method and system based on deep learning, belonging to the technical field of automatic alarm. Background Art

[0002] Since drugs and items in biochemical laboratories are dangerous, their placement is strictly regulated, otherwise it will cause laboratory safety accidents. Existing laboratories do not have powerful monitoring and management equipment or systems to effectively alarm for experimental items that are mistakenly accessed by the laboratory. Summary of the invention

[0003] The present invention provides a laboratory automatic alarm method and system based on deep learning, which is used to solve the problem that the prior art cannot effectively alarm the wrong placement of items in the laboratory:

[0004] A laboratory automatic alarm method based on deep learning, the laboratory automatic alarm method comprising:

[0005] The smart camera component collects video images of laboratory items placed at a preset video collection time interval, and obtains laboratory item information of the current laboratory items placed through the video images; wherein the smart camera component is a 360° rotatable omnidirectional camera;

[0006] The smart camera component uploads the laboratory item information of the current laboratory item placement to the management system, and after the management system performs laboratory item information detection, obtains the laboratory item information detection result sent back by the management system;

[0007] After receiving the image information detection result sent back by the management system, the smart camera component determines whether to send an alarm message and laboratory item position adjustment information to the staff terminal according to the information result.

[0008] Furthermore, the intelligent camera component collects video images of laboratory items placed at a preset video collection time interval, and obtains laboratory item information of the current laboratory items placed through the video images, including:

[0009] Setting the video collection time interval and video collection duration of the laboratory item area monitored by the smart camera assembly according to the flow of people in each laboratory item area;

[0010] Control the smart camera assembly to turn the lens to the monitored laboratory item placement position according to the video acquisition time interval, and perform video acquisition on the laboratory item placement position within the time range of the video acquisition duration to obtain a video image;

[0011] Extracting current laboratory item information from the video image, wherein the current laboratory item information includes the item name of each laboratory item corresponding to the current laboratory item placement position and its current placement position information;

[0012] The video collection time interval and video collection duration of the laboratory item area monitored by the smart camera assembly are set according to the flow of people in each laboratory item area, including:

[0013] When the flow of people in the laboratory item area exceeds the preset flow threshold within a unit time, the video acquisition time interval is set to 30 minutes, and the video acquisition duration is set to 10 minutes; wherein the unit time is 24 hours;

[0014] When the flow of people in the laboratory item area per unit time does not exceed the preset flow threshold, the video acquisition time interval is set to 52 minutes, and the video acquisition duration is set to 8 minutes.

[0015] Furthermore, the laboratory item information test results are obtained in the following manner:

[0016] The management system retrieves original laboratory item information corresponding to the placement position of the laboratory items monitored by the smart camera assembly;

[0017] The management system compares the original image information with the current image information to determine whether they are consistent;

[0018] If the management system determines through comparative testing that the original image information is consistent with the current image information, it is determined that the current laboratory item information is correct and does not need to be adjusted, and this conclusion is fed back to the smart camera component as a laboratory item information detection result;

[0019] If the management system determines through comparative testing that the original image information is inconsistent with the current image information, it is determined that there is an error in the placement of laboratory items;

[0020] The management system extracts the names of laboratory items that are placed incorrectly and their original placement information, and feeds back the names of laboratory items that are placed incorrectly and their original placement information to the smart camera component as laboratory item information detection results.

[0021] Furthermore, after receiving the image information detection result sent back by the management system, the smart camera component determines whether to send an alarm message and laboratory item position adjustment information to the staff terminal according to the information result, including:

[0022] After receiving the image information detection result sent back by the management system, the smart camera component identifies whether there is a name of an item in the laboratory that is incorrectly placed and its original placement position information in the image information detection result;

[0023] After obtaining the name of the item placed incorrectly in the laboratory item position and its original placement position information, the smart camera component sends a laboratory item position adjustment instruction to the staff terminal, and sends the name of the item placed incorrectly in the laboratory item position and its original placement position information as laboratory item position adjustment information to the staff terminal, and uses the staff terminal to issue an alarm.

[0024] A laboratory automatic alarm system based on deep learning, the laboratory automatic alarm system comprising:

[0025] The video acquisition module is used for the intelligent camera component to collect video images of laboratory items placed at a preset video acquisition time interval, and obtain laboratory item information of the current laboratory items through the video images; wherein the intelligent camera component is a 360° rotatable omnidirectional camera;

[0026] A detection result acquisition module, used for the intelligent camera component to upload the laboratory item information of the current laboratory items to the management system, and after the management system performs laboratory item information detection, obtain the laboratory item information detection result sent back by the management system;

[0027] The alarm module is used for the intelligent camera component to determine whether to send alarm information and laboratory item position adjustment information to the staff terminal according to the information result after receiving the image information detection result sent back by the management system.

[0028] Furthermore, the video acquisition module includes:

[0029] A video acquisition setting module, used to set the video acquisition time interval and video acquisition duration of the laboratory item area monitored by the smart camera assembly according to the flow of people in each laboratory item area;

[0030] A lens control module, used to control the smart camera assembly to turn the lens to the monitored laboratory item placement position according to the video acquisition time interval, and to perform video acquisition of the laboratory item placement position within the time range of the video acquisition duration to obtain a video image;

[0031] An information extraction module, used to extract current laboratory item information from the video image, wherein the current laboratory item information includes the item name of each laboratory item corresponding to the current laboratory item placement position and its current placement position information;

[0032] Wherein, the video acquisition setting module includes:

[0033] The first setting module is used to set the video acquisition time interval to 30 minutes and the video acquisition duration to 10 minutes when the flow of people in the laboratory item area exceeds a preset flow threshold within a unit time; wherein the unit time is 24 hours;

[0034] The first setting module is used to set the video acquisition time interval to 52 minutes and the video acquisition duration to 8 minutes when the flow of people in the laboratory item area per unit time does not exceed a preset flow threshold.

[0035] Furthermore, the detection result acquisition module includes:

[0036] A retrieval module, used for the management system to retrieve original laboratory item information corresponding to the placement position of the laboratory items monitored by the smart camera assembly;

[0037] A consistency comparison module, used for the management system to compare the original image information with the current image information to determine whether they are consistent;

[0038] An adjustment judgment module is used to determine that the current laboratory item information is correct and does not need to be adjusted if the management system determines through comparative detection that the original image information is consistent with the current image information, and feeds this conclusion back to the smart camera component as a laboratory item information detection result;

[0039] A placement judgment module, used to judge that there is a placement error of laboratory items if the management system determines through comparison and detection that the original image information is inconsistent with the current image information;

[0040] The placement information extraction module is used for the management system to extract the names of laboratory items that are placed incorrectly and their original placement position information, and feed back the names of laboratory items that are placed incorrectly and their original placement position information as laboratory item information detection results to the smart camera component.

[0041] Furthermore, the alarm module comprises:

[0042] An information receiving module is used for the intelligent camera component to identify whether there is a name of an item whose position is incorrectly placed in the laboratory and its original placement position information in the image information detection result after receiving the image information detection result sent back by the management system;

[0043] The alarm judgment module is used for the intelligent camera component to send a laboratory item position adjustment instruction to the staff terminal after obtaining the name of the laboratory item placed incorrectly and its original placement position information, and send the name of the laboratory item placed incorrectly and its original placement position information as laboratory item position adjustment information to the staff terminal, and use the staff terminal to issue an alarm.

[0044] Furthermore, the alarm module comprises:

[0045] The alarm judgment module is also used for, if the number of items placed incorrectly in the laboratory item positions obtained by the intelligent camera component exceeds two, sending a laboratory item position adjustment instruction to the staff terminal, and adjusting and sorting the instructions according to the current position of each incorrectly placed item and the current position of the staff, so that the staff can take several incorrectly placed items in close proximity to the mobile vehicle for synchronous adjustment, thereby improving work efficiency. The specific steps include:

[0046] Step A1: Using formula (1), determine whether to enter the mode of sorting and sending laboratory item position adjustment instructions according to the number of items in the laboratory that are placed incorrectly obtained by the smart camera component and the relationship between the current staff and the mobile vehicle.

[0047] E=[1-Y(G)]×F(N>2)(1)

[0048] Wherein E represents the control value of entering the sorting and sending laboratory item position adjustment instruction mode; Y(G) represents the relationship value between the current staff member and the mobile car detected by the intelligent camera component, if the staff member is using the mobile car, the relationship value is 1, if the staff member is not using the mobile car, the relationship value is 0; N represents the total number of items in the wrong position of the laboratory items; F(), F[] both represent judgment functions, if the formula in the brackets is true, the function value is 1, if the formula in the brackets is not true, the function value is 0;

[0049] If E=1, it means that the current control needs to enter the order-sending laboratory item position adjustment instruction mode, and then continue with the subsequent steps;

[0050] If E=0, it means that the current control does not need to enter the ordering and sending laboratory item position adjustment instruction mode, and the laboratory item position adjustment instruction can be directly sent to the staff;

[0051] Step A2: If the mode of sending laboratory item position adjustment instructions is sorted, then use formula (2) to obtain the item number corresponding to the first laboratory item position adjustment instruction according to the current position of the wrongly placed items in each position and the current position of the staff member.

[0052]

[0053] Where A indicates that the object corresponding to the first laboratory item position adjustment instruction is the item placed incorrectly at the Ath position; [X(a), Y(a), Z(a)] indicates the spatial coordinate point of the item placed incorrectly at the ath position obtained by spatially constructing the laboratory; [X0, Y0, Z0] indicates the spatial coordinate point of the current staff member obtained by spatially constructing the laboratory;

[0054] Step A3: After step A2 is completed, formula (3) is used to obtain the sending ranking value of the laboratory item position adjustment instructions corresponding to all the items placed incorrectly according to the position of the item corresponding to the first item to send the laboratory item position adjustment instruction and the current position of the items placed incorrectly in other positions.

[0055]

[0056] Where P(a) represents the ranking value of the item placed incorrectly at the ath position; [X(A), Y(A), Z(A)] represents the spatial coordinate point of the item placed incorrectly at the Ath position obtained by spatially constructing the laboratory; S(a) and S(b) both represent intermediate values ​​of the calculation, the purpose of which is to simplify the display length of the formula;

[0057] The laboratory item position adjustment instructions are sent in order of the P(a) values ​​corresponding to the items from small to large. If the P(a) values ​​are the same, the laboratory item position adjustment instructions corresponding to the items with smaller a values ​​are sent first.

[0058] Beneficial effects of the present invention:

[0059] The present invention proposes a laboratory automatic alarm method and system based on deep learning, which can timely detect the wrongly placed items through video monitoring and image information recognition, thereby effectively improving the supervision of the wrong placement of items. At the same time, the laboratory safety is effectively improved through the accuracy of laboratory item placement monitoring and the timeliness of alarm. BRIEF DESCRIPTION OF THE DRAWINGS

[0060] Figure 1 is a flow chart of the method of the present invention;

[0061] Figure 2 The system block diagram of the system of the present invention. DETAILED DESCRIPTION

[0062] The preferred embodiments of the present invention are described below in conjunction with the accompanying drawings. It should be understood that the preferred embodiments described herein are only used to illustrate and explain the present invention, and are not used to limit the present invention.

[0063] The embodiment of the present invention proposes a laboratory automatic alarm method based on deep learning, such as Figure 1 As shown, the laboratory automatic alarm method includes:

[0064] S1, the intelligent camera component collects video images of laboratory items according to a preset video collection time interval, and obtains laboratory item information of the current laboratory items through the video images; wherein the intelligent camera component is a 360° rotatable omnidirectional camera;

[0065] S2, the intelligent camera component uploads the laboratory item information of the current laboratory items to the management system, and after the management system performs laboratory item information detection, obtains the laboratory item information detection result sent back by the management system;

[0066] S3. After receiving the image information detection result sent back by the management system, the smart camera component determines whether to send an alarm message and laboratory item position adjustment information to the staff terminal according to the information result.

[0067] The working principle of the above technical solution is: first, the smart camera component collects video images of laboratory item placement according to a preset video acquisition time interval, and obtains laboratory item information of the current laboratory item placement through the video image; wherein, the smart camera component is a 360° rotatable omnidirectional camera; then, the smart camera component uploads the laboratory item information of the current laboratory item placement to the management system, and after the management system performs laboratory item information detection, obtains the laboratory item information detection result sent back by the management system; finally, after receiving the image information detection result sent back by the management system, the smart camera component determines whether to send an alarm message and laboratory item position adjustment information to the staff terminal according to the information result.

[0068] The effect of the above technical solution is: this embodiment proposes a laboratory automatic alarm method based on deep learning, which can timely detect the wrong items through video monitoring and image information recognition, thereby effectively improving the supervision of wrong placement of items. At the same time, the accuracy of laboratory item placement monitoring and the timeliness of alarm can effectively improve laboratory safety.

[0069] In one embodiment of the present invention, the intelligent camera assembly collects video images of laboratory items placed at a preset video collection time interval, and obtains laboratory item information of the current laboratory items placed through the video images, including:

[0070] S101, setting the video collection time interval and video collection duration of the laboratory item area monitored by the smart camera assembly according to the flow of people in each laboratory item area;

[0071] S102, controlling the smart camera component to turn the lens to the monitored laboratory item placement position according to the video acquisition time interval, and performing video acquisition on the laboratory item placement position within the time range of the video acquisition duration to obtain a video image;

[0072] S103, extracting current laboratory item information from the video image, wherein the current laboratory item information includes the item name of each laboratory item corresponding to the current laboratory item placement position and its current placement position information;

[0073] The video collection time interval and video collection duration of the laboratory item area monitored by the smart camera assembly are set according to the flow of people in each laboratory item area, including:

[0074] When the flow of people in the laboratory item area exceeds the preset flow threshold within a unit time, the video acquisition time interval is set to 30 minutes, and the video acquisition duration is set to 10 minutes; wherein the unit time is 24 hours;

[0075] When the flow of people in the laboratory item area per unit time does not exceed the preset flow threshold, the video acquisition time interval is set to 52 minutes, and the video acquisition duration is set to 8 minutes.

[0076] The working principle of the above technical solution is: first, the video acquisition time interval and video acquisition duration of the laboratory item area monitored by the smart camera component are set according to the flow of people in each laboratory item area; then, the smart camera component is controlled to turn the lens to the monitored laboratory item placement position according to the video acquisition time interval, and the laboratory item placement position is video acquired within the time range of the video acquisition duration to obtain a video image; finally, the current laboratory item information is extracted from the video image, wherein the current laboratory item information includes the item name of each laboratory item corresponding to the current laboratory item placement position and its current placement position information.

[0077] The effect of the above technical solution is: effectively improving the accuracy of obtaining laboratory item information, thereby effectively improving the rationality and accuracy of subsequent management and monitoring. At the same time, setting the video collection time interval based on the flow of people can effectively improve the rationality of the time interval setting and its matching with the actual flow of people in the laboratory, thereby effectively improving the timeliness of obtaining item placement information.

[0078] In one embodiment of the present invention, the laboratory article information detection result is obtained by:

[0079] Step 1, the management system retrieves the original laboratory item information corresponding to the placement position of the laboratory items monitored by the smart camera assembly;

[0080] Step 2: The management system compares the original image information with the current image information to determine whether they are consistent;

[0081] Step 3: If the management system determines through comparative detection that the original image information is consistent with the current image information, it is determined that the current laboratory item information is correct and does not need to be adjusted, and this conclusion is fed back to the smart camera component as a laboratory item information detection result;

[0082] Step 4: If the management system determines through comparative testing that the original image information is inconsistent with the current image information, it is determined that there is an error in the placement of laboratory items;

[0083] Step 5: The management system extracts the names of laboratory items that are placed incorrectly and their original placement information, and feeds back the names of laboratory items that are placed incorrectly and their original placement information as laboratory item information detection results to the smart camera component.

[0084] The working principle of the above technical solution is: first, the management system retrieves the original laboratory item information corresponding to the laboratory item placement position monitored by the smart camera component; then, the management system compares the original image information with the current image information to determine whether they are consistent; subsequently, if the management system determines through comparative detection that the original image information is consistent with the current image information, it is determined that the current laboratory item information is correct and does not need to be adjusted, and this conclusion is fed back to the smart camera component as a laboratory item information detection result; thereafter, if the management system determines through comparative detection that the original image information is inconsistent with the current image information, it is determined that there is an error in the placement of the laboratory item; finally, the management system extracts the name of the item in the laboratory item position that is placed incorrectly and its original placement position information, and feeds back the name of the item in the laboratory item position that is placed incorrectly and its original placement position information as a laboratory item information detection result to the smart camera component.

[0085] The effect of the above technical solution is that it can timely detect the wrongly placed items through video monitoring and image information recognition, thereby effectively improving the supervision of wrongly placed items. At the same time, the accuracy of laboratory item placement monitoring and the timeliness of alarms can effectively improve laboratory safety.

[0086] In one embodiment of the present invention, after receiving the image information detection result sent back by the management system, the smart camera component determines whether to send an alarm message and laboratory item position adjustment information to the staff terminal according to the information result, including:

[0087] S301, after receiving the image information detection result sent back by the management system, the smart camera component identifies whether there is a name of an item in the laboratory that is incorrectly placed and its original placement position information in the image information detection result;

[0088] S302. After obtaining the name of the laboratory item that is placed incorrectly and its original placement position information, the smart camera component sends a laboratory item position adjustment instruction to the staff terminal, and sends the name of the laboratory item that is placed incorrectly and its original placement position information as laboratory item position adjustment information to the staff terminal, and uses the staff terminal to issue an alarm.

[0089] The working principle of the above technical solution is: first, after receiving the image information detection result sent back by the management system, the smart camera component identifies whether there is the name of the laboratory item placed incorrectly and its original placement position information in the image information detection result; then, after obtaining the name of the laboratory item placed incorrectly and its original placement position information, the smart camera component sends a laboratory item position adjustment instruction to the staff terminal, and sends the name of the laboratory item placed incorrectly and its original placement position information as laboratory item position adjustment information to the staff terminal, and uses the staff terminal to issue an alarm.

[0090] The effect of the above technical solution is that it can timely detect the wrongly placed items through video monitoring and image information recognition, thereby effectively improving the supervision of wrongly placed items. At the same time, the accuracy of laboratory item placement monitoring and the timeliness of alarms can effectively improve laboratory safety.

[0091] The embodiment of the present invention proposes a laboratory automatic alarm system based on deep learning, such as Figure 2 As shown, the laboratory automatic alarm system comprises:

[0092] The video acquisition module is used for the intelligent camera component to collect video images of laboratory items placed at a preset video acquisition time interval, and obtain laboratory item information of the current laboratory items through the video images; wherein the intelligent camera component is a 360° rotatable omnidirectional camera;

[0093] A detection result acquisition module, used for the intelligent camera component to upload the laboratory item information of the current laboratory items to the management system, and after the management system performs laboratory item information detection, obtain the laboratory item information detection result sent back by the management system;

[0094] The alarm module is used for the intelligent camera component to determine whether to send alarm information and laboratory item position adjustment information to the staff terminal according to the information result after receiving the image information detection result sent back by the management system.

[0095] The working principle of the above technical solution is: first, the video acquisition module is used to control the smart camera component to collect video images of the placement of laboratory items according to a preset video acquisition time interval, and the laboratory item information of the current laboratory items is obtained through the video image; wherein, the smart camera component is a 360° rotatable omnidirectional camera; then, the detection result acquisition module is used to control the smart camera component to upload the laboratory item information of the current laboratory items to the management system, and after the management system performs laboratory item information detection, the laboratory item information detection result sent back by the management system is obtained; finally, the alarm module is used to control the smart camera component to determine whether to send alarm information and laboratory item position adjustment information to the staff terminal according to the information result after receiving the image information detection result sent back by the management system.

[0096] The effect of the above technical solution is: this embodiment proposes a laboratory automatic alarm system based on deep learning, which can timely detect the wrong items through video monitoring and image information recognition, thereby effectively improving the supervision of wrong placement of items. At the same time, the laboratory safety is effectively improved through the accuracy of laboratory item placement monitoring and the timeliness of alarm.

[0097] In one embodiment of the present invention, the video acquisition module includes:

[0098] A video acquisition setting module, used to set the video acquisition time interval and video acquisition duration of the laboratory item area monitored by the smart camera assembly according to the flow of people in each laboratory item area;

[0099] A lens control module, used to control the smart camera assembly to turn the lens to the monitored laboratory item placement position according to the video acquisition time interval, and to perform video acquisition of the laboratory item placement position within the time range of the video acquisition duration to obtain a video image;

[0100] An information extraction module, used to extract current laboratory item information from the video image, wherein the current laboratory item information includes the item name of each laboratory item corresponding to the current laboratory item placement position and its current placement position information;

[0101] Wherein, the video acquisition setting module includes:

[0102] The first setting module is used to set the video acquisition time interval to 30 minutes and the video acquisition duration to 10 minutes when the flow of people in the laboratory item area exceeds a preset flow threshold within a unit time; wherein the unit time is 24 hours;

[0103] The first setting module is used to set the video acquisition time interval to 52 minutes and the video acquisition duration to 8 minutes when the flow of people in the laboratory item area per unit time does not exceed a preset flow threshold.

[0104] The working principle of the above technical solution is as follows: first, the video acquisition setting module is used to set the video acquisition time interval and video acquisition duration of the laboratory item area monitored by the intelligent camera component according to the flow of people in each laboratory item area; then, the lens control module is used to control the intelligent camera component to turn the lens to the monitored laboratory item placement position according to the video acquisition time interval, and perform video acquisition on the laboratory item placement position within the time range of the video acquisition duration to obtain a video image; finally, the information extraction module is used to extract the current laboratory item information from the video image, wherein the current laboratory item information includes the item name of each laboratory item corresponding to the current laboratory item placement position and its current placement position information;

[0105] The operation process of the video acquisition setting module includes:

[0106] First, when the flow of people in the laboratory item area exceeds a preset flow threshold within a unit time, the video acquisition time interval is set to 30 minutes, and the video acquisition duration is set to 10 minutes through the first setting module; wherein the unit time is 24 hours;

[0107] Subsequently, the first setting module is used to set the video acquisition time interval to 52 minutes and the video acquisition duration to 8 minutes when the flow of people in the laboratory item area per unit time does not exceed a preset flow threshold.

[0108] The effect of the above technical solution is: effectively improving the accuracy of obtaining laboratory item information, thereby effectively improving the rationality and accuracy of subsequent management and monitoring. At the same time, setting the video collection time interval based on the flow of people can effectively improve the rationality of the time interval setting and its matching with the actual flow of people in the laboratory, thereby effectively improving the timeliness of obtaining item placement information.

[0109] In one embodiment of the present invention, the detection result acquisition module includes:

[0110] A retrieval module, used for the management system to retrieve original laboratory item information corresponding to the placement position of the laboratory items monitored by the smart camera assembly;

[0111] A consistency comparison module, used for the management system to compare the original image information with the current image information to determine whether they are consistent;

[0112] An adjustment judgment module is used to determine that the current laboratory item information is correct and does not need to be adjusted if the management system determines through comparative detection that the original image information is consistent with the current image information, and feeds this conclusion back to the smart camera component as a laboratory item information detection result;

[0113] A placement judgment module, used to judge that there is a placement error of laboratory items if the management system determines through comparison and detection that the original image information is inconsistent with the current image information;

[0114] The placement information extraction module is used for the management system to extract the names of laboratory items that are placed incorrectly and their original placement position information, and feed back the names of laboratory items that are placed incorrectly and their original placement position information as laboratory item information detection results to the smart camera component.

[0115] The working principle of the above technical solution is as follows: first, the management system is controlled by the retrieval module to retrieve the original laboratory item information corresponding to the placement position of the laboratory items monitored by the smart camera component; then, the management system uses the consistency comparison module to compare the original image information with the current image information to determine whether they are consistent; finally, if the management system determines through comparative detection that the original image information is consistent with the current image information, the adjustment judgment module is used to determine that the current laboratory item information is correct and does not need to be adjusted, and this conclusion is fed back to the smart camera component as a laboratory item information detection result; then, if the management system determines through comparative detection that the original image information is inconsistent with the current image information, the placement judgment module is used to determine that there is an error in the placement of the laboratory item; finally, the management system uses the placement information extraction module to extract the name of the laboratory item position that is placed incorrectly and its original placement position information, and the name of the laboratory item position that is placed incorrectly and its original placement position information are fed back to the smart camera component as a laboratory item information detection result.

[0116] The effect of the above technical solution is that it can timely detect the wrongly placed items through video monitoring and image information recognition, thereby effectively improving the supervision of wrongly placed items. At the same time, the accuracy of laboratory item placement monitoring and the timeliness of alarms can effectively improve laboratory safety.

[0117] In one embodiment of the present invention, the alarm module comprises:

[0118] An information receiving module is used for the intelligent camera component to identify whether there is a name of an item whose position is incorrectly placed in the laboratory and its original placement position information in the image information detection result after receiving the image information detection result sent back by the management system;

[0119] The alarm judgment module is used for the intelligent camera component to send a laboratory item position adjustment instruction to the staff terminal after obtaining the name of the laboratory item placed incorrectly and its original placement position information, and send the name of the laboratory item placed incorrectly and its original placement position information as laboratory item position adjustment information to the staff terminal, and use the staff terminal to issue an alarm.

[0120] The working principle of the above technical solution is: first, the information receiving module is used to control the smart camera component to identify whether there is the name of the laboratory item placed incorrectly and its original placement position information in the image information detection result after receiving the image information detection result sent back by the management system; then, the alarm judgment module is used to control the smart camera component to send a laboratory item position adjustment instruction to the staff terminal after obtaining the name of the laboratory item placed incorrectly and its original placement position information, and send the name of the laboratory item placed incorrectly and its original placement position information as laboratory item position adjustment information to the staff terminal, and use the staff terminal to alarm.

[0121] The effect of the above technical solution is that it can timely detect the wrongly placed items through video monitoring and image information recognition, thereby effectively improving the supervision of wrongly placed items. At the same time, the accuracy of laboratory item placement monitoring and the timeliness of alarms can effectively improve laboratory safety.

[0122] In one embodiment of the present invention, the alarm module comprises:

[0123] The alarm judgment module is also used for, if the number of items placed incorrectly in the laboratory item positions obtained by the intelligent camera component exceeds two, sending a laboratory item position adjustment instruction to the staff terminal, and adjusting and sorting the instructions according to the current position of each incorrectly placed item and the current position of the staff, so that the staff can take several incorrectly placed items in close proximity to the mobile vehicle for synchronous adjustment, thereby improving work efficiency. The specific steps include:

[0124] Step A1: Using formula (1), determine whether to enter the mode of sorting and sending laboratory item position adjustment instructions according to the number of items in the laboratory that are placed incorrectly obtained by the smart camera component and the relationship between the current staff and the mobile vehicle.

[0125] E=[1-Y(G)]×F(N>2)(1)

[0126] Wherein E represents the control value of entering the sorting and sending laboratory item position adjustment instruction mode; Y(G) represents the relationship value between the current staff member and the mobile car detected by the intelligent camera component, if the staff member is using the mobile car, the relationship value is 1, if the staff member is not using the mobile car, the relationship value is 0; N represents the total number of items in the wrong position of the laboratory items; F(), F[] both represent judgment functions, if the formula in the brackets is true, the function value is 1, if the formula in the brackets is not true, the function value is 0;

[0127] If E=1, it means that the current control needs to enter the order-sending laboratory item position adjustment instruction mode, and then continue with the subsequent steps;

[0128] If E=0, it means that the current control does not need to enter the sorting and sending of laboratory item position adjustment instructions mode, and the laboratory item position adjustment instructions can be directly sent to the staff;

[0129] Step A2: If the mode of sending laboratory item position adjustment instructions is sorted, then use formula (2) to obtain the item number corresponding to the first laboratory item position adjustment instruction according to the current position of the wrongly placed items in each position and the current position of the staff member.

[0130]

[0131] Where A indicates that the object corresponding to the first laboratory item position adjustment instruction is the item placed incorrectly at the Ath position; [X(a), Y(a), Z(a)] indicates the spatial coordinate point of the item placed incorrectly at the ath position obtained by spatially constructing the laboratory; [X0, Y0, Z0] indicates the spatial coordinate point of the current staff member obtained by spatially constructing the laboratory;

[0132] Step A3: After step A2 is completed, formula (3) is used to obtain the sending ranking value of the laboratory item position adjustment instructions corresponding to all the items placed incorrectly according to the position of the item corresponding to the first item to send the laboratory item position adjustment instruction and the current position of the items placed incorrectly in other positions.

[0133]

[0134] Where P(a) represents the ranking value of the item placed incorrectly at the ath position; [X(A), Y(A), Z(A)] represents the spatial coordinate point of the item placed incorrectly at the Ath position obtained by spatially constructing the laboratory; S(a) and S(b) both represent intermediate values ​​of the calculation, the purpose of which is to simplify the display length of the formula;

[0135] The laboratory item position adjustment instructions are sent in order of the P(a) values ​​corresponding to the items from small to large. If the P(a) values ​​are the same, the laboratory item position adjustment instructions corresponding to the items with smaller a values ​​are sent first.

[0136] The beneficial effects of the above technical solution are as follows: using the formula (1) of step A1 to determine whether to enter the mode of sorting and sending laboratory item position adjustment instructions according to the number of items in the laboratory item position that are incorrectly placed obtained by the intelligent camera component and the relationship between the current staff and the mobile vehicle, so that the mode of sorting and sending laboratory item position adjustment instructions is turned on when it is needed, avoiding useless control and long-term opening to consume resources, thereby reducing the overall power consumption of the system; then using the formula (2) of step A2 to obtain the item number corresponding to the first laboratory item position adjustment instruction to be sent according to the current position of the incorrectly placed items in each position and the current position of the staff, thereby determining the first item to be adjusted, which is convenient for the subsequent sending sorting control of the laboratory item position adjustment instructions for the remaining items; finally, using the formula (3) of step A3 to obtain the sending sorting value of the laboratory item position adjustment instructions corresponding to all incorrectly placed items according to the position of the item corresponding to the first laboratory item position adjustment instruction to be sent and the current position of the incorrectly placed items in other positions, so that the staff can take the incorrectly placed items in several nearby positions to the mobile vehicle for synchronous adjustment, thereby improving work efficiency.

[0137] Obviously, those skilled in the art can make various changes and modifications to the present invention without departing from the spirit and scope of the present invention. Thus, if these modifications and variations of the present invention fall within the scope of the claims of the present invention and their equivalents, the present invention is also intended to include these modifications and variations.

Claims

1. The laboratory automatic alarm method based on deep learning is characterized by: The laboratory automatic alarm method comprises: The intelligent camera component collects video images of the placement of laboratory items according to a preset video collection time interval, and obtains laboratory item information of the current laboratory item placement through the video images; The smart camera component uploads the laboratory item information of the current laboratory item placement to the management system, and after the management system performs laboratory item information detection, obtains the laboratory item information detection result sent back by the management system; After receiving the image information detection result sent back by the management system, the smart camera component determines whether to send an alarm message and laboratory item position adjustment information to the staff terminal according to the information result; Among them, after receiving the image information detection result sent back by the management system, the smart camera component determines whether to send alarm information and laboratory item position adjustment information to the staff terminal according to the information result, including: After receiving the image information detection result sent back by the management system, the smart camera component identifies whether there is a name of an object in the laboratory that is placed incorrectly and its original placement position information in the image information detection result; After obtaining the name of the laboratory item that is incorrectly placed and its original placement position information, the smart camera component sends a laboratory item position adjustment instruction to the staff terminal, and sends the name of the laboratory item that is incorrectly placed and its original placement position information as laboratory item position adjustment information to the staff terminal, and uses the staff terminal to issue an alarm; The laboratory automatic alarm method also includes: if the intelligent camera component obtains that the number of items placed incorrectly in the laboratory item position exceeds two, the laboratory item position adjustment instruction is sent to the staff terminal, and the instructions are adjusted and sorted according to the current position of each incorrectly placed item and the current position of the staff, so that the staff can take several incorrectly placed items in close proximity to the mobile vehicle for synchronous adjustment, thereby improving work efficiency. The specific steps include: Step A1: Using formula (1), determine whether to enter the mode of sorting and sending laboratory item position adjustment instructions according to the number of items in the laboratory that are placed incorrectly obtained by the smart camera component and the relationship between the current staff and the mobile vehicle. E=[1-Y(G)]×F(N>2)(1) Wherein, e represents the control value for entering the sorting and sending laboratory item position adjustment instruction mode; Y(G) represents the relationship value between the current staff member and the mobile car detected by the intelligent camera component, if the staff member is using the mobile car, the relationship value is 1, if the staff member is not using the mobile car, the relationship value is 0; N represents the total number of items in the wrong position of the laboratory items; F(), F[] both represent judgment functions, if the formula in the brackets is true, the function value is 1, if the formula in the brackets is not true, the function value is 0; If E=1, it means that the current control needs to enter the order-sending laboratory item position adjustment instruction mode, and then continue with the subsequent steps; If E=0, it means that the current control does not need to enter the sorting and sending of laboratory item position adjustment instructions mode, and the laboratory item position adjustment instructions can be directly sent to the staff; Step A2: If the mode of sending laboratory item position adjustment instructions is sorted, then use formula (2) to obtain the item number corresponding to the first laboratory item position adjustment instruction according to the current position of the wrongly placed items in each position and the current position of the staff member. Where A indicates that the object corresponding to the first laboratory item position adjustment instruction is the item placed incorrectly at the Ath position; [X(a), Y(a), Z(a)] indicates the spatial coordinate point of the item placed incorrectly at the ath position obtained by spatially constructing the laboratory; [X0, Y0, Z0] indicates the spatial coordinate point of the current staff member obtained by spatially constructing the laboratory; Step A3: After step A2 is completed, formula (3) is used to obtain the sending ranking value of the laboratory item position adjustment instructions corresponding to all the items placed incorrectly according to the position of the item corresponding to the first item to send the laboratory item position adjustment instruction and the current position of the items placed incorrectly in other positions. Where P(a) represents the ranking value of the item placed incorrectly at the ath position; [X(A), Y(A), Z(A)] represents the spatial coordinate point of the item placed incorrectly at the Ath position obtained by spatially constructing the laboratory; S(a) and S(b) both represent intermediate values ​​of the calculation, the purpose of which is to simplify the display length of the formula; The laboratory item position adjustment instructions are sent in order of the P(a) values ​​corresponding to the items from small to large. If the P(a) values ​​are the same, the laboratory item position adjustment instructions corresponding to the items with smaller a values ​​are sent first.

2. The automatic laboratory alarm method according to claim 1, characterized in that: The intelligent camera component collects video images of the placement of laboratory items according to a preset video collection time interval, and obtains laboratory item information of the current laboratory item placement through the video images, including: Setting the video collection time interval and video collection duration of the laboratory item area monitored by the smart camera assembly according to the flow of people in each laboratory item area; Control the smart camera assembly to turn the lens to the monitored laboratory item placement position according to the video acquisition time interval, and perform video acquisition on the laboratory item placement position within the time range of the video acquisition duration to obtain a video image; Extracting current laboratory item information from the video image, wherein the current laboratory item information includes the item name of each laboratory item corresponding to the current laboratory item placement position and its current placement position information; The video collection time interval and video collection duration of the laboratory item area monitored by the smart camera assembly are set according to the flow of people in each laboratory item area, including: When the flow of people in the laboratory item area exceeds the preset flow threshold within a unit time, the video acquisition time interval is set to 30 minutes, and the video acquisition duration is set to 10 minutes; wherein the unit time is 24 hours; When the flow of people in the laboratory item area per unit time does not exceed the preset flow threshold, the video acquisition time interval is set to 52 minutes, and the video acquisition duration is set to 8 minutes.

3. The automatic laboratory alarm method according to claim 1, characterized in that: The laboratory article information test results are obtained in the following manner: The management system retrieves original laboratory item information corresponding to the placement position of the laboratory items monitored by the smart camera assembly; The management system compares the original image information with the current image information to determine whether they are consistent; If the management system determines through comparative testing that the original image information is consistent with the current image information, it is determined that the current laboratory item information is correct and does not need to be adjusted, and this conclusion is fed back to the smart camera component as a laboratory item information detection result; If the management system determines through comparative testing that the original image information is inconsistent with the current image information, it is determined that there is an error in the placement of laboratory items; The management system extracts the names of laboratory items that are placed incorrectly and their original placement information, and feeds back the names of laboratory items that are placed incorrectly and their original placement information to the smart camera component as laboratory item information detection results.

4. Laboratory automatic alarm system based on deep learning, characterized by: The laboratory automatic alarm system comprises: A video acquisition module, which is used for the intelligent camera component to collect video images of laboratory items placed at a preset video acquisition time interval, and obtain laboratory item information of the current laboratory items placed through the video images; A detection result acquisition module, used for the intelligent camera component to upload the laboratory item information of the current laboratory items to the management system, and after the management system performs laboratory item information detection, obtain the laboratory item information detection result sent back by the management system; An alarm module is used for the smart camera component to determine whether to send an alarm message and laboratory item position adjustment information to the staff terminal according to the information result after receiving the image information detection result sent back by the management system; Wherein, the alarm module comprises: An information receiving module is used for the intelligent camera component to identify whether there is a name of an item whose position is incorrectly placed in the laboratory and its original placement position information in the image information detection result after receiving the image information detection result sent back by the management system; An alarm judgment module, which is used for the intelligent camera component to send a laboratory item position adjustment instruction to the staff terminal after obtaining the name of the laboratory item that is placed incorrectly and its original placement position information, and send the name of the laboratory item that is placed incorrectly and its original placement position information as laboratory item position adjustment information to the staff terminal, and use the staff terminal to issue an alarm; Wherein, the alarm module comprises: The alarm judgment module is also used for, if the number of items placed incorrectly in the laboratory item positions obtained by the intelligent camera component exceeds two, sending a laboratory item position adjustment instruction to the staff terminal, and adjusting and sorting the instructions according to the current position of each incorrectly placed item and the current position of the staff, so that the staff can take several incorrectly placed items in close proximity to the mobile vehicle for synchronous adjustment, thereby improving work efficiency. The specific steps include: Step A1: Using formula (1), determine whether to enter the mode of sorting and sending laboratory item position adjustment instructions according to the number of items in the laboratory that are placed incorrectly obtained by the smart camera component and the relationship between the current staff and the mobile vehicle. E=[1-Y(G)]×F(N>2) (1) Wherein E represents the control value of entering the sorting and sending laboratory item position adjustment instruction mode; Y(G) represents the relationship value between the current staff member and the mobile car detected by the intelligent camera component, if the staff member is using the mobile car, the relationship value is 1, if the staff member is not using the mobile car, the relationship value is 0; N represents the total number of items in the wrong position of the laboratory items; F(), F[] both represent judgment functions, if the formula in the brackets is true, the function value is 1, if the formula in the brackets is not true, the function value is 0; If E=1, it means that the current control needs to enter the order-sending laboratory item position adjustment instruction mode, and then continue with the subsequent steps; If E=0, it means that the current control does not need to enter the ordering and sending laboratory item position adjustment instruction mode, and the laboratory item position adjustment instruction can be directly sent to the staff; Step A2: If the mode of sending laboratory item position adjustment instructions is sorted, then use formula (2) to obtain the item number corresponding to the first laboratory item position adjustment instruction according to the current position of the wrongly placed items in each position and the current position of the staff member. Where A indicates that the first item sent to adjust the position of the laboratory item corresponds to the item placed incorrectly at the Ath position; [X(a), Y(a), Z(a)] indicates the spatial coordinate point of the item placed incorrectly at the ath position obtained by spatially constructing the laboratory; [X0, Y0, Z o ] represents the spatial coordinate point of the current staff member obtained by spatially constructing the laboratory; Step A3: After step A2 is completed, formula (3) is used to obtain the sending ranking value of the laboratory item position adjustment instructions corresponding to all the items placed incorrectly according to the position of the item corresponding to the first item to send the laboratory item position adjustment instruction and the current position of the items placed incorrectly in other positions. Where P(a) represents the ranking value of the item placed incorrectly at the ath position; [X(A), Y(A), Z(A)] represents the spatial coordinate point of the item placed incorrectly at the Ath position obtained by spatially constructing the laboratory; S(a) and S(b) both represent intermediate values ​​of the calculation, the purpose of which is to simplify the display length of the formula; The laboratory item position adjustment instructions are sent in order of the P(a) values ​​corresponding to the items from small to large. If the P(a) values ​​are the same, the laboratory item position adjustment instructions corresponding to the items with smaller a values ​​are sent first.

5. The laboratory automatic alarm system according to claim 4, characterized in that: The video acquisition module comprises: A video acquisition setting module, used to set the video acquisition time interval and video acquisition duration of the laboratory item area monitored by the smart camera assembly according to the flow of people in each laboratory item area; A lens control module, used to control the smart camera assembly to turn the lens to the monitored laboratory item placement position according to the video acquisition time interval, and to perform video acquisition of the laboratory item placement position within the time range of the video acquisition duration to obtain a video image; An information extraction module, used to extract current laboratory item information from the video image, wherein the current laboratory item information includes the item name of each laboratory item corresponding to the current laboratory item placement position and its current placement position information; Wherein, the video acquisition setting module includes: The first setting module is used to set the video acquisition time interval to 30 minutes and the video acquisition duration to 10 minutes when the flow of people in the laboratory item area exceeds a preset flow threshold within a unit time; wherein the unit time is 24 hours; The first setting module is used to set the video acquisition time interval to 52 minutes and the video acquisition duration to 8 minutes when the flow of people in the laboratory item area per unit time does not exceed a preset flow threshold.

6. The laboratory automatic alarm system according to claim 4, characterized in that: The detection result acquisition module includes: A retrieval module, used for the management system to retrieve original laboratory item information corresponding to the placement position of the laboratory items monitored by the smart camera assembly; A consistency comparison module, used for the management system to compare the original image information with the current image information to determine whether they are consistent; An adjustment judgment module is used to determine that the current laboratory item information is correct and does not need to be adjusted if the management system determines through comparative detection that the original image information is consistent with the current image information, and feeds this conclusion back to the smart camera component as a laboratory item information detection result; A placement judgment module, used to judge that there is a placement error of laboratory items if the management system determines through comparison and detection that the original image information is inconsistent with the current image information; The placement information extraction module is used for the management system to extract the names of laboratory items that are placed incorrectly and their original placement position information, and feed back the names of laboratory items that are placed incorrectly and their original placement position information as laboratory item information detection results to the smart camera component.

Images