Intelligent management system for laboratory instruments

Abstract

The invention relates to the technical field of intelligent instrument management. The invention relates to an intelligent management system for laboratory instruments. The system comprises a platform establishment unit, an experiment data collection unit, an experiment monitoring unit, an instrument use analysis unit and an experiment ending unit, the platform establishing unit is used for establishing an experiment communication platform, acquiring a list of experiment instruments stored in a laboratory and accessing a video monitoring port of the laboratory; the experimental data collection unit is used for extracting a placement area of an experimental instrument from the video data, acquiring to-be-used image data of the experimental instrument, and collecting experimental records fed back by experimenters through the experimental communication platform; by tracking and updating the state of the experimental instrument in real time, it is ensured that an experimenter uses the latest instrument list, so that experimental result deviation caused by inaccurate instrument state can be avoided, human errors in manual updating and checking are reduced through automatic instrument management and state detection, and therefore the accuracy of experimental data is improved.

Description

Technical Field

[0001] The present invention relates to the technical field of intelligent instrument management, and in particular to an intelligent management system for laboratory instruments. Background Art

[0002] In most laboratories, laboratory personnel manage the use of instruments and equipment by manual registration management, which is difficult to achieve real-time and effective management, and requires a lot of manpower and generates a large number of record files. The management efficiency is low and prone to errors.

[0003] At present, the use record of the experimental instrument is determined by using induction during the experiment, so as to remind the experimenter to reset the experimental instrument according to the use list. However, during the use of this method, the experimenter needs to check one by one according to the use list to confirm that the experimental instrument has been reset, which increases the experimental time. Moreover, when the experimental materials in the experimental instrument are not cleaned up, automatic detection cannot be performed, resulting in the experimental materials being retained in the experimental instrument for a long time, posing a potential danger in the laboratory. In order to reduce this situation, an intelligent management system for laboratory instruments is proposed. Summary of the invention

[0004] The purpose of the present invention is to provide a laboratory instrument intelligent management system to solve the problems raised in the above background technology.

[0005] To achieve the above purpose, a laboratory instrument intelligent management system is provided, including a platform establishment unit, an experimental data collection unit, an experimental monitoring unit, an instrument use analysis unit and an experimental end unit;

[0006] The platform establishment unit is used to establish an experimental communication platform, collect a list of experimental instruments stored in the laboratory, and access the video monitoring port of the laboratory;

[0007] The experimental data collection unit is used to extract the placement area of ​​the experimental instrument from the video data, and at the same time obtain the image data to be used of the experimental instrument, and collect the experimental records fed back by the experimenters through the experimental communication platform;

[0008] The experiment monitoring unit is used to establish a list of instruments used in the experiment when the experimenter starts the experiment on the experiment communication platform, and to conduct video monitoring of the experimenter's experimental process, and to provide feedback to the experimenter on the placement area of ​​the corresponding experimental instruments according to the instrument usage requirements;

[0009] The instrument usage analysis unit is used to perform instrument usage analysis on the monitored experimental video, and then add the instruments obtained through the analysis to the list of used instruments;

[0010] The experiment ending unit is used to collect real-time image data of the experimental instrument placement area in the instrument list when the experimenter ends the experiment on the experiment communication platform, and then perform reset detection in combination with the real-time image data and the image data to be used, and remind the experimenter of the unreset experimental instruments through the experiment communication platform.

[0011] As a further improvement of the technical solution, the platform establishment unit establishes the experimental communication platform through an APP software method, and then opens registration rights to laboratory experimenters, and the laboratory's instrument management personnel upload the list of existing experimental instruments in the laboratory.

[0012] As a further improvement of the technical solution, the platform establishment unit establishes a data transmission connection channel between the experiment communication platform and the video monitoring port of the laboratory through the Internet of Things, so that the experiment communication platform can obtain the monitoring video data in the laboratory in real time.

[0013] As a further improvement of the technical solution, the experimental data collection unit includes a region extraction module and a record collection module;

[0014] The area extraction module is used to extract the placement area of ​​each experimental instrument from the monitoring video data in the laboratory according to the list of experimental instruments, and then save the image data of the experimental instruments in an unused state as unused images of the experimental instruments;

[0015] The record collection module is used to set two options of starting and ending the experiment in the experiment communication platform, when the experimenter needs to perform the experiment operation;

[0016] Choose to start the experiment in the experiment communication platform, and then provide an experiment record feedback window for experimenters to record the experimental process in real time.

[0017] As a further improvement of the technical solution, the experiment monitoring unit includes an experiment video detection module and an experiment auxiliary module;

[0018] The experiment video detection module is used to establish a list of instruments used in the experiment when it detects that the experimenter starts the experiment on the experiment communication platform, and to perform video detection on the experimenter during the experiment through video dynamic tracking technology to obtain experimental video data;

[0019] The experiment auxiliary module is used to analyze the instrument usage according to the experiment record when the experimenter inputs the experiment record to the experiment communication platform, obtain the experimental instrument used corresponding to the experiment record, and then feedback the placement area of ​​the experimental instrument to the experimenter through the experiment communication platform.

[0020] As a further improvement of the technical solution, when the experiment auxiliary module provides feedback to the experimenter through the experiment communication platform, it does not directly display it to the experimenter through a pop-up window, but only displays it when the experimenter needs to accept it.

[0021] As a further improvement of the present technical solution, the instrument usage analysis unit performs instrument usage analysis through the monitored experimental video, extracts the list of experimental instruments touched by the experimenter's hand, and after the experimenter's hand touches the instruments, uses the image data to be used in combination with the real-time image data for analysis. After the hand touches the instruments, the real-time image data and the image data to be used are the same, that is, the experimental instrument touched by the hand is not added to the list. Conversely, after the hand touches the instruments, the real-time image data and the image data to be used are the same, that is, the experimental instrument touched by the hand is added to the list.

[0022] As a further improvement of the technical solution, the experimental instrument obtained by the experimental auxiliary module is combined with the instrument use analysis unit to perform repeatability analysis. When the experimental instrument obtained by the experimental auxiliary module is not obtained by the instrument use analysis unit, the experimental instrument obtained by the experimental auxiliary module is added to the instrument use list;

[0023] The instrument uses the same contrast of the analysis unit and the experiment end unit, and automatically optimizes the settings through AI. When the similarity between the real-time image data and the image data to be used exceeds the same contrast, they are judged to be the same.

[0024] As a further improvement of the technical solution, the experiment ending unit includes a reset detection module and a personnel reminder module;

[0025] The reset detection module is used to collect real-time image data of the experimental instrument placement area in the instrument list when the experimenter ends the experiment on the experiment communication platform, and then perform reset detection on the real-time image data in combination with the image data to be used. When the real-time image data and the image data to be used are the same, the experimental instrument is deleted from the instrument list in use. On the contrary, when the real-time image data and the image data to be used are not the same, the experimental instrument is retained in the instrument list in use.

[0026] The personnel reminder module is used to remind the experimenter through the experiment communication platform of the instrument list updated by the reset detection module. After the reset, the experimenter chooses to end the experiment again until there is no experimental instrument in the instrument list, that is, the experiment is ended in the experiment communication platform.

[0027] Compared with the prior art, the present invention has the following beneficial effects:

[0028] 1. In the laboratory instrument intelligent management system, the status of experimental instruments is tracked and updated in real time to ensure that the experimenters use the latest instrument list, which can avoid the deviation of experimental results caused by inaccurate instrument status. Through automated instrument management and status detection, human errors in manual updates and inspections are reduced, thereby improving the accuracy of experimental data.

[0029] 2. In the laboratory instrument intelligent management system, by requiring experimenters to reset the instruments before ending the experiment, it ensures that all instruments are in a safe initial state after the experiment, reduces potential safety hazards caused by failure to reset the instruments, reduces cross-contamination between experiments or misuse of equipment, and ensures the reliability and effectiveness of the experimental results. BRIEF DESCRIPTION OF THE DRAWINGS

[0030] Figure 1 It is the overall structural principle diagram of the present invention.

[0031] The meaning of each number in the figure is:

[0032] 10. Platform establishment unit; 20. Experimental data collection unit; 30. Experimental monitoring unit; 40. Instrument use analysis unit; 50. Experimental end unit. DETAILED DESCRIPTION

[0033] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

[0034] See also Figure 1 As shown, the purpose of this embodiment is to provide a laboratory instrument intelligent management system, including a platform establishment unit 10, an experimental data collection unit 20, an experimental monitoring unit 30, an instrument use analysis unit 40 and an experiment ending unit 50;

[0035] The platform establishment unit 10 is used to establish an experimental communication platform, collect a list of experimental instruments stored in the laboratory, and access the video monitoring port of the laboratory;

[0036] The platform establishment unit 10 establishes the experimental communication platform through the APP software method, and then opens the registration authority to the laboratory's experimental personnel, and the laboratory's instrument management personnel upload the list of existing experimental instruments in the laboratory.

[0037] The platform establishment unit 10 establishes a data transmission connection channel between the experimental communication platform and the video monitoring port of the laboratory through the Internet of Things, so that the experimental communication platform can obtain the monitoring video data in the laboratory in real time. The specific working steps are as follows:

[0038] Demand analysis and planning: clarify the platform's goals such as experimental records and instrument management, and determine the platform's main functions such as registration, instrument management, and experimental records;

[0039] Design and development: design user interface UI and user experience UX, plan the backend database architecture, and select appropriate development framework and programming language;

[0040] User registration and authority management: Develop user registration function to allow experimenters and instrument managers to register;

[0041] Instrument management function: The instrument manager uploads the list of existing instruments in the laboratory, including the instrument name, model, status, etc., stores the instrument information in the database, and ensures the accuracy and completeness of the data.

[0042] The experimental data collection unit 20 is used to extract the placement area of ​​the experimental instrument in the video data, and at the same time obtain the image data of the experimental instrument to be used, and collect the experimental records fed back by the experimenters through the experimental communication platform;

[0043] The experimental data collection unit 20 includes a region extraction module and a record collection module;

[0044] The area extraction module is used to extract the placement area of ​​each experimental instrument from the surveillance video data in the laboratory according to the list of experimental instruments, and then save the image data of the experimental instruments in the unused state as the unused images of the experimental instruments. The specific working steps are as follows:

[0045] Preparation: Make sure the experimental communication platform has a detailed list of experimental instruments and reference information of their placement areas;

[0046] Experimental instrument detection: Use the labeled experimental instrument image data to train the object detection model, and apply the trained object detection model to each frame of the image to identify and locate the experimental instrument;

[0047] Extract the placement area of ​​the experimental instrument: Use the detection results of the model to determine the placement area of ​​each experimental instrument, and crop the image area of ​​the experimental instrument according to the placement area;

[0048] Save image data in the unused state: define a method to determine whether the experimental instrument is in the "unused" state. This judgment can be based on the image of the experimental instrument entering the laboratory for the first time;

[0049] Data Verification and Cleanup: Manual verification of saved images to ensure that all images meet the criteria for “unused” status.

[0050] The record collection module is used to set two options of starting and ending the experiment in the experimental communication platform, when the experimenter needs to perform experimental operations;

[0051] Choose to start the experiment in the experiment communication platform, and then provide an experiment record feedback window for experimenters to record the experimental process in real time.

[0052] The experiment monitoring unit 30 is used to establish a list of instruments used in the experiment when the experimenter starts the experiment on the experiment communication platform, and to conduct video monitoring of the experimenter's experiment process, and to provide feedback to the experimenter on the placement area of ​​the corresponding experiment instruments according to the instrument usage requirements;

[0053] The experiment monitoring unit 30 includes an experiment video detection module and an experiment auxiliary module;

[0054] The experimental video detection module is used to establish a list of instruments used in the experiment when it detects that the experimenter starts the experiment on the experimental communication platform, and to perform video detection on the experimenter during the experiment through video dynamic tracking technology to obtain experimental video data. The specific working steps are as follows:

[0055] Detecting the start of an experiment: Implement an event listener in the experiment exchange platform to monitor the click event of starting the experiment;

[0056] Establish an instrument list: provide a form or configuration interface for experimenters to input or select instruments and equipment used in the experiment, store the instrument information in the database, and associate it with the experimental records;

[0057] Dynamic tracking: Select appropriate video tracking technology and algorithms, such as target detection and object tracking, so that the hands of the experimenter can be kept clear in the video, and record them to form experimental video data.

[0058] The experimental auxiliary module is used to analyze the instrument usage according to the experimental records when the experimenter inputs the experimental records into the experimental communication platform, obtain the experimental instruments used corresponding to the experimental records, and then provide feedback on the placement area of ​​the experimental instruments to the experimenter through the experimental communication platform.

[0059] When the experimental auxiliary module gives feedback to the experimenter through the experimental communication platform, it does not directly display it to the experimenter through a pop-up window. It needs to be displayed when the experimenter accepts it. The specific working steps are as follows:

[0060] Input experimental records: Experimenters input experimental records through the experimental communication platform, including information such as experimental date, experimental purpose, instruments used, experimental steps and experimental results;

[0061] Data parsing and preprocessing: Parse the input experimental records to extract key information, such as the instruments used and experimental steps, using natural language processing technology or regular expressions to extract this information;

[0062] Instrument matching: According to the extracted instrument information, match it with the laboratory's instrument database, which should contain information such as the instrument's identification, placement area, and purpose;

[0063] Obtain instrument placement area: Obtain the placement area of ​​the corresponding instrument from the database. The database should contain the specific placement location of each instrument, such as a certain area in the laboratory;

[0064] Feedback to experimenters: Feedback the placement area of ​​the instrument to experimenters through the experimental communication platform, which can be provided through automatically generated messages or reports;

[0065] Verification and confirmation: After receiving the feedback, the experimenter confirms whether the placement area of ​​the instrument is correct. If there is an error or there are special requirements, the experimenter can make corrections in the experimental communication platform.

[0066] The instrument use analysis unit 40 is used to perform instrument use analysis on the monitored experimental video, and then add the instruments obtained through the analysis to the list of used instruments;

[0067] The instrument use analysis unit 40 performs instrument use analysis through the monitored experimental video, extracts the list of experimental instruments touched by the experimenter's hand, and uses the image data to be used in combination with the real-time image data for analysis after the experimenter's hand touches the instrument. When the real-time image data and the image data to be used are the same after the hand touches the instrument, the experimental instrument touched by the hand is not added to the list. On the contrary, when the real-time image data and the image data to be used are the same after the hand touches the instrument, the experimental instrument touched by the hand is added to the list. The specific working steps are as follows:

[0068] Data collection: record the experimental video to capture the whole process of the experimenter's hand contact, obtain real-time image data and image files of the image data to be used;

[0069] Preprocessing: extract the timestamp of the hand contact event from the video, and perform necessary image preprocessing on the real-time image data and the image data to be used, such as denoising, adjusting brightness and contrast, etc.;

[0070] Image matching: At each hand contact time point, extract real-time image data, and then compare the experimental instruments in the real-time image data with the image data to be used;

[0071] Instrument identification and recording: If the real-time image data matches the image data to be used, it is considered that the instrument does not need to be added to the list. If they do not match, the instrument is added to the list.

[0072] The experimental instruments obtained by the experimental auxiliary module are combined with the instrument use analysis unit 40 for repeatability analysis. When the experimental instruments obtained by the experimental auxiliary module are not obtained by the instrument use analysis unit 40, the experimental instruments obtained by the experimental auxiliary module are added to the instrument use list.

[0073] The instrument uses the same contrast of the analysis unit 40 and the experiment end unit 50, and automatically optimizes the settings through AI. When the similarity between the real-time image data and the image data to be used exceeds the same contrast, they are determined to be the same.

[0074] The experiment ending unit 50 is used to collect real-time image data of the experimental instrument placement area in the instrument list when the experimenter ends the experiment on the experiment communication platform, and then perform reset detection on the real-time image data in combination with the image data to be used, and remind the experimenter through the experiment communication platform of the experimental instruments that have not been reset.

[0075] The experiment ending unit 50 includes a reset detection module and a personnel reminder module;

[0076] The reset detection module is used to collect real-time image data of the experimental instrument placement area in the instrument list when the experimenter ends the experiment on the experiment communication platform, and then perform reset detection on the real-time image data combined with the image data to be used. When the real-time image data and the image data to be used are the same, the experimental instrument is deleted from the instrument list in use. Conversely, when the real-time image data and the image data to be used are different, the experimental instrument is retained in the instrument list in use. The specific working steps are as follows:

[0077] Image acquisition: At the end of the experiment, use a camera or other image acquisition device to collect real-time image data of the area where the current instrument is placed;

[0078] Image preprocessing: preprocess the collected real-time image data, including denoising, contrast adjustment, etc., to ensure that the image quality is suitable for subsequent comparison;

[0079] Image matching: Use image processing algorithms to compare real-time image data and image data to be used, and calculate image similarity indicators. Set a similarity threshold, the formula is as follows:

[0080]

[0081] Among them, μ x and μ y are the average brightness of images x and y, respectively, and is the odd variance, σ xy is the covariance, C1 and C2 are stability constants;

[0082] Similarity determination: If the similarity index is higher than the threshold, the real-time image is considered to be the same as the image to be used; if the similarity index is lower than the threshold, the real-time image is considered to be different from the image to be used;

[0083] List update: When the real-time image data is the same as the image data to be used, the experimental instrument is deleted from the list of used instruments; when the real-time image data is different from the image data to be used, the experimental instrument is retained in the list of used instruments.

[0084] The personnel reminder module is used to remind the experimenter through the experiment communication platform of the instrument list updated by the reset detection module. After the experimenter resets, he chooses to end the experiment again until there is no experimental instrument in the instrument list, that is, the experiment is ended in the experiment communication platform. The specific working steps are as follows:

[0085] Update instrument list: ensure that the instrument list is up to date in the system, add or delete the corresponding instruments;

[0086] Remind experimenters: send updated instrument lists to experimenters through the experiment communication platform, and set up automatic notification function for real-time reminders;

[0087] Experimenter reset: Requires the experimenter to confirm and reset the current experimental equipment to ensure that all experimental instruments are in the initial state;

[0088] Choose to end the experiment: The experimenter checks the updated instrument list and chooses whether to end the experiment. If all instruments in the list have been removed, continue to end the experiment;

[0089] Confirm the end of the experiment: Confirm whether the experiment is completed on the experiment communication platform, and ensure that all steps have been executed as required until there are no experimental instruments in the list.

[0090] The above shows and describes the basic principles, main features and advantages of the present invention. Those skilled in the art should understand that the present invention is not limited by the above embodiments. The above embodiments and descriptions are only preferred examples of the present invention and are not intended to limit the present invention. Without departing from the spirit and scope of the present invention, the present invention may have various changes and improvements, which fall within the scope of the present invention. The scope of protection of the present invention is defined by the attached claims and their equivalents.

Claims

1. Laboratory instrument intelligent management system, Features: It includes a platform establishment unit (10), an experimental data collection unit (20), an experimental monitoring unit (30), an instrument use analysis unit (40) and an experimental end unit (50); The platform establishment unit (10) is used to establish an experimental communication platform, collect a list of experimental instruments stored in the laboratory, and access the video monitoring port of the laboratory; The experimental data collection unit (20) is used to extract the placement area of ​​the experimental instrument in the video data, and simultaneously obtain the image data to be used of the experimental instrument, and collect the experimental records fed back by the experimenter through the experimental communication platform; The experiment monitoring unit (30) is used to establish a list of instruments used in the experiment when the experimenter starts the experiment on the experiment communication platform, and to perform video monitoring of the experimenter's experiment process, and to provide the experimenter with feedback on the placement area of ​​the corresponding experiment instruments according to the instrument usage requirements; The instrument usage analysis unit (40) is used to perform instrument usage analysis on the monitored experimental video, and then add the instruments obtained through the analysis to the list of used instruments; The experiment ending unit (50) is used to collect real-time image data of the experimental instrument placement area in the instrument list when the experimenter ends the experiment on the experiment communication platform, and then perform reset detection in combination with the real-time image data and the image data to be used, and remind the experimenter of the experimental instruments that have not been reset through the experiment communication platform.

2. The laboratory instrument intelligent management system according to claim 1, Features: The platform establishment unit (10) establishes an experimental communication platform through an APP software method, and then opens registration rights to laboratory personnel, and the laboratory instrument management personnel upload the list of existing experimental instruments in the laboratory.

3. The laboratory instrument intelligent management system according to claim 1, Features: The platform establishment unit (10) establishes a data transmission connection channel between the experimental communication platform and the video monitoring port of the laboratory through the Internet of Things, so that the experimental communication platform can obtain the monitoring video data in the laboratory in real time.

4. The laboratory instrument intelligent management system according to claim 1, Features: The experimental data collection unit (20) includes a region extraction module and a record collection module; The area extraction module is used to extract the placement area of ​​each experimental instrument from the monitoring video data in the laboratory according to the list of experimental instruments, and then save the image data of the experimental instruments in an unused state as unused images of the experimental instruments; The record collection module is used to set two options of starting and ending the experiment in the experiment communication platform, when the experimenter needs to perform the experiment operation; Choose to start the experiment in the experiment communication platform, and then provide an experiment record feedback window for experimenters to record the experimental process in real time.

5. The laboratory instrument intelligent management system according to claim 1, Features: The experiment monitoring unit (30) comprises an experiment video detection module and an experiment auxiliary module; The experiment video detection module is used to establish a list of instruments used in the experiment when it detects that the experimenter starts the experiment on the experiment communication platform, and to perform video detection on the experimenter during the experiment through video dynamic tracking technology to obtain experimental video data; The experiment auxiliary module is used to analyze the instrument usage according to the experiment record when the experimenter inputs the experiment record to the experiment communication platform, obtain the experimental instrument used corresponding to the experiment record, and then feedback the placement area of ​​the experimental instrument to the experimenter through the experiment communication platform.

6. The laboratory instrument intelligent management system according to claim 5, Features: When the experiment auxiliary module provides feedback to the experimenter through the experiment communication platform, it does not directly display the feedback to the experimenter through a pop-up window, but only displays the feedback when the experimenter accepts it.

7. The laboratory instrument intelligent management system according to claim 1, Features: The instrument use analysis unit (40) performs instrument use analysis through the monitored experimental video, extracts a list of experimental instruments touched by the experimenter's hand, and after the experimenter's hand touches the instrument, uses the image data to be used in combination with the real-time image data for analysis. When the real-time image data and the image data to be used are the same after the hand touches the instrument, the experimental instrument touched by the hand is not added to the list. Conversely, when the real-time image data and the image data to be used are the same after the hand touches the instrument, the experimental instrument touched by the hand is added to the list.

8. The laboratory instrument intelligent management system according to claim 1, Features: The experimental instrument obtained by the experimental auxiliary module is combined with the instrument use analysis unit (40) to perform repeatability analysis. When the experimental instrument obtained by the experimental auxiliary module is not obtained by the instrument use analysis unit (40), the experimental instrument obtained by the experimental auxiliary module is added to the instrument use list; The instrument uses the same contrast of the analysis unit (40) and the experiment end unit (50), and automatically optimizes the settings through AI. When the similarity between the real-time image data and the image data to be used exceeds the same contrast, they are determined to be the same.

9. The laboratory instrument intelligent management system according to claim 1, Features: The experiment ending unit (50) comprises a reset detection module and a personnel reminder module; The reset detection module is used to collect real-time image data of the experimental instrument placement area in the instrument list when the experimenter ends the experiment on the experiment communication platform, and then perform reset detection on the real-time image data in combination with the image data to be used. When the real-time image data and the image data to be used are the same, the experimental instrument is deleted from the instrument list in use. On the contrary, when the real-time image data and the image data to be used are not the same, the experimental instrument is retained in the instrument list in use. The personnel reminder module is used to remind the experimenter through the experiment communication platform of the instrument list updated by the reset detection module. After the reset, the experimenter chooses to end the experiment again until there is no experimental instrument in the instrument list, that is, the experiment is ended in the experiment communication platform.

Images