A product inspection-based visual monitoring service system and method

Abstract

The application discloses a kind of based on product detection's visual monitoring service system and method, it is related to abnormal loss monitoring technical field, the historical data of image record of reagent use in laboratory is collected, the action of reagent kind and operator using reagent in image record is marked, the duration of various action categories in action sequence of reference time period and the appearance frequency of adjacent two action combinations are calculated, the unit time threshold of action category and the frequency threshold of action combination are obtained, the difference of unit time threshold and frequency threshold is respectively acquired, the influence coefficient of action duration difference and appearance frequency difference on reagent abnormal loss amount is calculated, the duration of action in unit time period and the appearance frequency of action combination are identified, and the abnormal consumption of reagent in unit time period is predicted in combination with influence coefficient.

Description

Technical Field

[0001] This invention relates to the field of abnormal loss monitoring technology, specifically a visual monitoring service system and method based on product testing. Background Technology

[0002] The efficient operation of a product testing laboratory relies heavily on the effective management of various consumables. Product testing laboratory consumables are characterized by their wide variety, diverse specifications, and significant differences in usage frequency and quantity, making consumable management a highly challenging task. Traditional laboratory consumable management primarily depends on manual recording and experience-based judgment.

[0003] During the use of consumables, manual management makes it difficult to monitor and accurately trace their usage in real time. When waste, misuse, or even loss of consumables occurs, it is difficult to quickly identify the responsible party and the specific cause, making it impossible to effectively control costs and ensure experimental quality. Furthermore, under traditional management models, laboratory consumable management is inefficient, unable to promptly report abnormal usage, and prone to duplicate purchases and waste of resources. Summary of the Invention

[0004] The purpose of this invention is to provide a solution to the problems raised in the prior art.

[0005] To achieve the above objectives, the present invention provides the following technical solution: a visual monitoring service method based on product inspection, the method comprising:

[0006] Step S100: Collect historical data of image records of reagent use in the laboratory, and mark the types of reagents and the actions of operators using the reagents in the image records;

[0007] Step S200: Collect a reference time period in which no abnormal loss occurs, obtain image records within the reference time period, and compile the actions of the staff using reagents in the image records to obtain the action sequence of the reference time period;

[0008] Step S300: Calculate the duration of each type of action and the frequency of occurrence of two adjacent action combinations in the action sequence of the reference time period to obtain the unit time threshold of the action type and the frequency threshold of the action combination.

[0009] Step S400: Obtain the duration of the action and the frequency of the action combination in a unit detection cycle, obtain the difference between the unit time threshold and the frequency threshold respectively, and calculate the influence coefficient of the difference in action duration and the difference in frequency of occurrence on the abnormal reagent consumption.

[0010] Step S500: Collect the current image records of the laboratory, identify the duration of actions and the frequency of action combinations within a unit time period, and predict the abnormal consumption of reagents within a unit time period by combining the influence coefficient. When the predicted value of abnormal consumption is greater than the threshold, the relevant management personnel of the laboratory will be notified.

[0011] In a laboratory setting, improper operation and management of equipment by staff can lead to abnormal consumption of laboratory consumables.

[0012] Improper operation, such as failure to accurately weigh reagents, can lead to reagent loss. For example, failing to change the pipette tip when using the same pipette to transfer different reagents, or not thoroughly cleaning the pipette tip and leaving residue from the previous batch of reagents, can all lead to cross-contamination and loss of reagents.

[0013] Lack of effective management can increase the abnormal consumption of laboratory consumables. For example, consumables that are not classified in time or are placed randomly may not be found in time when needed, and consumables may be re-issued, resulting in extra consumption of consumables.

[0014] In addition, if the experimenter is unfamiliar with the experimental content, improper operation sequence or incorrect operation steps may lead to reagent contamination and accelerate the consumption of consumables.

[0015] Furthermore, step S100 includes:

[0016] Step S101: Set up a camera at the laboratory workbench to capture images of the reagent containers on the workbench and images of laboratory staff operating the reagent containers.

[0017] Step S102: Collect image records captured by the camera, mark the reagent containers and action images in the image records, obtain the correspondence between reagent containers and reagents, and obtain the reagent recognition database and action recognition database. The image records include pictures and video images.

[0018] Furthermore, step S200 includes:

[0019] Step S201: Collect the consumption of a certain reagent during a time period of duration T. If there is no abnormal loss of a certain reagent during the time period, the time period of duration T shall be used as a reference time period.

[0020] Step S202: Obtain image records captured by the camera during the reference time period, identify the reagent container corresponding to a certain reagent, take the reagent container as the target container, and obtain all video clips in the reference time period in which the target container appears;

[0021] Step S203: Identify the actions of laboratory staff operating the target container in the video clip, and collect the actions according to the chronological order of their appearance to obtain an action sequence.

[0022] The representational features of operator actions obtained from video images are structured and transformed into pattern codes, enabling the operation processing system to process these representational features.

[0023] Furthermore, step S300 includes:

[0024] Step S301: Based on the type of action, collect the action records in the action sequence separately, and accumulate the duration of each type of action within a time period of duration T to obtain the action reference duration;

[0025] Step S302: Obtain the reference duration tj of the j-th action type, and calculate the unit time threshold τj of the j-th action, τj=tj / T;

[0026] Step S303: Denote the i-th action in the action sequence as ai, and the (i+1)-th action as ai+1. Combine ai and ai+1 into a continuous action group.

[0027] Step S304: Gather all continuous action groups, group continuous action groups with the same previous action into one category, classify the action type of the next action in the same continuous action group, calculate the occurrence frequency of the next action type, and use the occurrence frequency as the frequency threshold of the next action type in the same continuous action group.

[0028] By recording the duration and combination of operational actions during periods of abnormal wear and tear, the behavioral habits of staff can be captured. Through external manifestations and internal correlations, namely the duration and combination of abnormal actions, the attributes of abnormal wear and tear can be captured and analyzed.

[0029] Furthermore, step S400 includes:

[0030] Step S401: Set a unit time period with a duration of T2, where T2 < T, obtain the usage records of a certain reagent for several unit time periods, and record the unit time period in which a certain reagent has abnormal consumption as the target time period.

[0031] Setting T2 to be less than T helps to obtain more objective threshold data;

[0032] Step S402: Acquire image records for the target time period, identify the actions that operate on the target container, and assemble the actions of each unit time period in the image records into a target action sequence;

[0033] Step S403: Accumulate the duration of actions in the target action sequence, obtain the cumulative duration kj of the j-th action in a certain target action sequence, and calculate the duration deviation value rtj, rtj=|kj-τj×T2|;

[0034] Step S404: Extract all continuous action groups of a target action sequence, group the continuous action groups with the same preceding action into one category, calculate the occurrence frequency of the next action in each category of continuous action groups, and compare it with the frequency threshold to obtain the frequency difference between the occurrence frequency and the frequency threshold.

[0035] Step S405: Obtain the amount of abnormal loss of a certain reagent in all target time periods, set the time influence coefficient of the duration deviation value and the frequency influence coefficient of the frequency difference value, and establish a linear equation between the duration deviation value, the frequency difference value and the amount of loss.

[0036] Step S406: Gather the linear equations corresponding to each target time period to form a system of linear equations, solve for the time influence coefficient and frequency influence coefficient, and obtain the time influence coefficient corresponding to the time difference of the duration of all types of actions and the frequency influence coefficient corresponding to the frequency difference of the occurrence frequency.

[0037] Instead of directly analyzing the error, the deviation from the reference threshold is calculated, and the resulting error is normalized to avoid the problem of inconsistent data structure caused by different reagent types or different operation procedures in the detection process.

[0038] Furthermore, step S500 includes:

[0039] Step S501: Collect the current image record of the laboratory operating table, obtain the image record of using a certain reagent in a unit time period, identify the actions in the image record, and collect the actions in the image record to form the current action sequence;

[0040] Step S502: Classify the actions in the current action sequence, obtain the continuous action groups in the current action sequence, obtain the duration of each action in the current action sequence, and the frequency of the next action in the continuous action group.

[0041] Step S503: Compare the duration of the action with the time threshold to obtain the time difference of various actions, compare the occurrence frequency with the frequency threshold to obtain the frequency difference, multiply the time difference with the time influence coefficient to obtain the first estimated value h1, and multiply the frequency difference with the frequency influence coefficient to obtain the second estimated value h2.

[0042] Step S504: Set an abnormal loss management threshold G. When G < h1 + h2, remind the laboratory management personnel to check the usage of a certain reagent.

[0043] By constructing a flexible alarm mechanism to cyclically detect abnormal losses that may occur per unit time, the occurrence and timing of abnormal losses can be promptly identified. This alerts relevant managers to promptly check the remaining reagent levels, replenish them in a timely manner, and check reagent usage, thereby improving the work efficiency of the testing laboratory and reducing waste.

[0044] To better implement the above methods, a product inspection-based visualization monitoring service system is proposed. The system includes: a feature management module, an action sequence management module, a threshold management module, an influence coefficient management module, and a real-time monitoring module. The feature management module manages the characteristics of reagent containers and the action characteristics of related personnel operating the reagent containers. The action sequence management module manages the action sequences within a time range. The threshold management module manages the unit time threshold for action types and the frequency threshold for action combinations. The influence coefficient management module manages the differences between the unit time threshold and the frequency threshold, and calculates the influence coefficients of the differences in action duration and frequency on the abnormal reagent loss. The real-time monitoring module manages the current image records, predicts abnormal loss values, and sends alarm information when alarm conditions are met.

[0045] Furthermore, the threshold management module includes: an action type management unit, a time threshold management unit, an action group management unit, and a frequency threshold management unit; wherein, the action type management unit is used to obtain the type of action, the time threshold management unit is used to calculate the unit time threshold of the action, the action group management unit is used to manage continuous action groups, and the frequency threshold management unit is used to calculate the frequency threshold.

[0046] Furthermore, the impact coefficient management module includes: a duration deviation management unit, a frequency difference management unit, a loss management unit, and a coefficient management unit; wherein, the duration deviation management unit is used to manage duration deviation, the frequency difference management unit is used to manage frequency difference, the loss management unit is used to manage loss during the target time period, and the coefficient management unit is used to manage time impact coefficient and frequency impact coefficient.

[0047] Furthermore, the real-time monitoring module includes: a current sequence management unit, a sequence feature management unit, a loss prediction unit, and an information reminder unit; wherein, the current sequence management unit is used to manage the action sequence in the current image, the sequence feature management unit is used to manage the duration of actions and the frequency of occurrence of action combinations in the current action sequence, the loss prediction unit is used to manage the predicted value of reagent loss, and the information reminder unit is used to provide alarm prompts to relevant management personnel when alarm conditions are met.

[0048] Compared with existing technologies, the beneficial effects of this invention are as follows: By extracting the surface features and inherent hidden features of abnormal consumption of consumables, the events causing abnormal consumption are modeled. Further feature analysis of these abnormal consumption events provides early warnings of abnormal consumption of consumables in testing laboratories. This invention, combined with a visualization platform, dynamically monitors abnormal consumption in the laboratory. Compared to manual registration, this shortens the monitoring cycle and increases the monitoring frequency, thus enabling timely detection of abnormal consumption of reagents and consumables. This helps reduce waste during laboratory operations and facilitates timely replenishment of missing consumables, ensuring the orderly operation of the laboratory. Attached Figure Description

[0049] Figure 1 This is a schematic diagram of the structure of a product inspection-based visual monitoring service system according to the present invention;

[0050] Figure 2 This is a flowchart illustrating a product testing-based visualization monitoring service method according to the present invention. Detailed Implementation

[0051] The technical solutions of the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present invention, and not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of the present invention.

[0052] Example: Figures 1-2 As shown, the present invention provides a technical solution, a visual monitoring service system and method based on product inspection, the method comprising:

[0053] Step S100: Collect historical data of image records of reagent use in the laboratory, and mark the types of reagents and the actions of operators using the reagents in the image records;

[0054] Step S100 includes:

[0055] Step S101: Set up a camera at the laboratory workbench to capture images of the reagent containers on the workbench and images of laboratory staff operating the reagent containers.

[0056] Step S102: Collect image records captured by the camera, mark the reagent containers and action images in the image records, obtain the correspondence between reagent containers and reagents, and obtain the reagent recognition database and action recognition database. The image records include pictures and video images.

[0057] In the embodiments, identifiable actions include, for example, pipetting, pipette aspiration, pipette pressing, drainage, pouring, and opening and closing of containers.

[0058] Step S200: Collect a reference time period in which no abnormal loss occurs, obtain image records within the reference time period, and compile the actions of the staff using reagents in the image records to obtain the action sequence of the reference time period;

[0059] Step S200 includes:

[0060] Step S201: Collect the consumption of a certain reagent during a time period of duration T. If there is no abnormal loss of a certain reagent during the time period, the time period of duration T shall be used as a reference time period.

[0061] Step S202: Obtain image records captured by the camera during the reference time period, identify the reagent container corresponding to a certain reagent, take the reagent container as the target container, and obtain all video clips in the reference time period in which the target container appears;

[0062] Step S203: Identify the actions of laboratory staff operating the target container in the video clip, and collect the actions according to the chronological order of their appearance to obtain an action sequence.

[0063] Step S300: Calculate the duration of each type of action and the frequency of occurrence of two adjacent action combinations in the action sequence of the reference time period to obtain the unit time threshold of the action type and the frequency threshold of the action combination.

[0064] Step S300 includes:

[0065] Step S301: Based on the type of action, collect the action records in the action sequence separately, and accumulate the duration of each type of action within a time period of duration T to obtain the action reference duration;

[0066] Step S302: Obtain the reference duration tj of the j-th action type, and calculate the unit time threshold τj of the j-th action, τj=tj / T;

[0067] Step S303: Denote the i-th action in the action sequence as ai, and the (i+1)-th action as ai+1. Combine ai and ai+1 into a continuous action group.

[0068] Step S304: Gather all continuous action groups, group continuous action groups with the same previous action into one category, classify the action type of the next action in the same continuous action group, calculate the occurrence frequency of the next action type, and use the occurrence frequency as the frequency threshold of the next action type in the same continuous action group.

[0069] In the embodiment, different actions are encoded. In the action sequence of a reference time period, the continuous action group with action A1 as the previous action is obtained and recorded as (A1, B1), (A1, B2), (A1, B1), (A1, B3), (A1, B2), (A1, B1).

[0070] The frequency of B1 after A1 is 3 / 6 = 0.5, the frequency of B2 after A1 is 2 / 6 = 0.33, and the frequency of B3 after A1 is 1 / 6 = 0.17.

[0071] The thresholds for actions B1, B2, and B3 following action A1 are set to 0.5, 0.33, and 0.17, respectively.

[0072] Step S400: Obtain the duration of the action and the frequency of the action combination in a unit detection cycle, obtain the difference between the unit time threshold and the frequency threshold respectively, and calculate the influence coefficient of the difference in action duration and the difference in frequency of occurrence on the abnormal reagent consumption.

[0073] Step S400 includes:

[0074] Step S401: Set a unit time period with a duration of T2, where T2 < T, obtain the usage records of a certain reagent for several unit time periods, and record the unit time period in which a certain reagent has abnormal consumption as the target time period.

[0075] Step S402: Acquire image records for the target time period, identify the actions that operate on the target container, and assemble the actions of each unit time period in the image records into a target action sequence;

[0076] Step S403: Accumulate the duration of actions in the target action sequence, obtain the cumulative duration kj of the j-th action in a certain target action sequence, and calculate the duration deviation value rtj, rtj=|kj-τj×T2|;

[0077] Step S404: Extract all continuous action groups of a target action sequence, group the continuous action groups with the same preceding action into one category, calculate the occurrence frequency of the next action in each category of continuous action groups, and compare it with the frequency threshold to obtain the frequency difference between the occurrence frequency and the frequency threshold.

[0078] Step S405: Obtain the amount of abnormal loss of a certain reagent in all target time periods, set the time influence coefficient of the duration deviation value and the frequency influence coefficient of the frequency difference value, and establish a linear equation between the duration deviation value, the frequency difference value and the amount of loss.

[0079] Step S406: Gather the linear equations corresponding to each target time period to form a system of linear equations, solve for the time influence coefficient and frequency influence coefficient, and obtain the time influence coefficient corresponding to the time difference of the duration of all types of actions and the frequency influence coefficient corresponding to the frequency difference of the occurrence frequency.

[0080] In this embodiment, four actions A1, B1, B2, and B3 within a target time period are acquired. The duration of each action is collected, and the duration of each action is aggregated according to the type of action. The duration of action A1 within the target time period is kA1, the duration of action B1 within the target time period is kB1, the duration of action B2 within the target time period is kB2, and the duration of action B3 within the target time period is kB3.

[0081] The unit time thresholds for the four actions are obtained respectively, and denoted as τA1, τB1, τB2 and τB3.

[0082] Calculate the time differences rA1=| kA1-τA1×T2|, rB1=| kB1-τB1×T2|, rB2=| kB2-τB2×T2|, rB3=| kB3-τB3×T2| respectively;

[0083] Calculate the consecutive action group consisting of A1, B1, B2, and B3 respectively. Taking A1 as the preceding action as an example, the frequency of occurrence of the following action type in the target cycle is recorded as fB1, fB2, and fB3 respectively.

[0084] The frequency thresholds are denoted as φB1, φB2 and φB3 respectively. The frequency differences are calculated as pB1=| fB1-φB1|, pB2=| fB2-φB2|, pB3=| fB3-φB3|.

[0085] Obtain the amount of abnormal loss d in a unit time period, set time influence coefficients α1, α2, α3 and α4, where the dimensions of α1, α2, α3 and α4 are all unit loss amount / unit time difference, set frequency influence coefficients β1, β2 and β3, where the dimensions of β1, β2 and β3 are all unit loss amount / unit frequency difference.

[0086] Construct a linear equation: α1×rA1+α2×rB1+α3×rB2+α4×rB3+β1×pB1+β2×pB2+β3×pB3=d;

[0087] Several linear equations are compiled to solve for the time influence coefficients α1, α2, α3 and α4, and the frequency influence coefficients β1, β2 and β3;

[0088] Preferably, if multiple solutions are obtained for the same coefficient through different sets of equations, interpolation, fitting, or cluster analysis can be used to find alternative values ​​for the coefficient to replace the time-influence coefficient or frequency-influence coefficient.

[0089] Step S500: Collect current image records of the laboratory, identify the duration of actions and the frequency of action combinations within a unit time period, and predict the abnormal consumption of reagents within a unit time period based on the influence coefficient. When the predicted value of abnormal consumption exceeds a threshold, provide an information alert to the relevant laboratory management personnel.

[0090] Step S500 includes:

[0091] Step S501: Collect the current image record of the laboratory operating table, obtain the image record of using a certain reagent in a unit time period, identify the actions in the image record, and collect the actions in the image record to form the current action sequence;

[0092] Step S502: Classify the actions in the current action sequence, obtain the continuous action groups in the current action sequence, obtain the duration of each action in the current action sequence, and the frequency of the next action in the continuous action group.

[0093] Step S503: Compare the duration of the action with the time threshold to obtain the time difference of various actions, compare the occurrence frequency with the frequency threshold to obtain the frequency difference, multiply the time difference with the time influence coefficient to obtain the first estimated value h1, and multiply the frequency difference with the frequency influence coefficient to obtain the second estimated value h2.

[0094] Step S504: Set an abnormal loss management threshold G. When G < h1 + h2, remind the laboratory management personnel to check the usage of a certain reagent.

[0095] Obtain the current action sequence and count the duration of each action in the current action sequence. A total of m actions are counted, where the duration of the nth action is c. n Calculate h1,

[0096] , where γ n τ represents the time influence coefficient of the nth action. n τ represents the unit time threshold for the nth action. n ×T2 represents the time threshold;

[0097] Given y consecutive action groups, let f be the frequency of the e-th action type in the l-th consecutive action group. le The l-th consecutive action group includes x types of actions. Calculate h2. , where η e φ represents the frequency influence coefficient of the e-th action type. le This represents the frequency threshold of the e-th action type in the l-th consecutive action group.

[0098] The system includes: a feature management module, an action sequence management module, a threshold management module, an influence coefficient management module, and a real-time monitoring module;

[0099] The feature management module is used to manage the features of reagent containers and the action features of related personnel and the operation of reagent containers;

[0100] The action sequence management module is used to manage action sequences within a time range;

[0101] The threshold management module is used to manage the unit time threshold of action types and the frequency threshold of action combinations. The threshold management module includes: action type management unit, time threshold management unit, action group management unit and frequency threshold management unit. The action type management unit is used to obtain the type of action, the time threshold management unit is used to calculate the unit time threshold of the action, the action group management unit is used to manage continuous action groups, and the frequency threshold management unit is used to calculate the frequency threshold.

[0102] The influence coefficient management module is used to manage the differences between unit time thresholds and frequency thresholds, and to calculate the influence coefficients of the differences in action duration and frequency on the abnormal reagent loss. The influence coefficient management module includes: duration deviation management unit, frequency difference management unit, loss management unit and coefficient management unit. The duration deviation management unit is used to manage duration deviation, the frequency difference management unit is used to manage frequency difference, the loss management unit is used to manage the loss of the target time period, and the coefficient management unit is used to manage the time influence coefficient and frequency influence coefficient.

[0103] The real-time monitoring module manages the current image recording, predicts abnormal loss values, and sends alarm information when alarm conditions are met. The real-time monitoring module includes a current sequence management unit, a sequence feature management unit, a loss prediction unit, and an information reminder unit. The current sequence management unit manages the action sequences in the current image, the sequence feature management unit manages the duration of actions and the frequency of action combinations in the current action sequences, the loss prediction unit manages the predicted value of reagent loss, and the information reminder unit provides alarm prompts to relevant management personnel when alarm conditions are met.

[0104] It will be apparent to those skilled in the art that the present invention is not limited to the details of the exemplary embodiments described above, and that the invention can be implemented in other specific forms without departing from its spirit or essential characteristics. Therefore, the embodiments should be considered in all respects as exemplary and non-limiting, and the scope of the invention is defined by the appended claims rather than the foregoing description. Thus, all variations falling within the meaning and scope of equivalents of the claims are intended to be included within the present invention. No reference numerals in the claims should be construed as limiting the scope of the claims.

Claims

1. A visual monitoring service method based on product inspection, characterized in that: The method includes the following steps: Step S100: Collect historical data of image records of reagent use in the laboratory, and mark the types of reagents and the actions of operators using the reagents in the image records; Step S200: Collect a reference time period in which no abnormal loss occurs, obtain image records within the reference time period, and compile the actions of the staff using reagents in the image records to obtain the action sequence of the reference time period; Step S300: Calculate the duration of each type of action and the frequency of occurrence of two adjacent action combinations in the action sequence of the reference time period to obtain the unit time threshold of the action type and the frequency threshold of the action combination. Step S400: Obtain the duration of the action and the frequency of the action combination in a unit detection cycle, obtain the difference between the unit time threshold and the frequency threshold respectively, and calculate the influence coefficient of the difference in action duration and the difference in frequency of occurrence on the abnormal reagent consumption. Step S500: Collect the current image records of the laboratory, identify the duration of actions and the frequency of action combinations within a unit time period, and predict the abnormal consumption of reagents within a unit time period by combining the influence coefficient. When the predicted value of abnormal consumption is greater than the threshold, the relevant management personnel of the laboratory will be notified.

2. The visualization monitoring service method based on product inspection according to claim 1, characterized in that: Step S100 includes: Step S101: Set up a camera at the laboratory workbench to capture images of the reagent containers on the workbench and images of laboratory staff operating the reagent containers. Step S102: Collect image records captured by the camera, mark the reagent containers and action images in the image records, obtain the correspondence between reagent containers and reagents, and obtain a reagent recognition database and an action recognition database. The image records include pictures and video images.

3. The visualization monitoring service method based on product inspection according to claim 2, characterized in that: Step S200 includes: Step S201: Collect the consumption of a certain reagent during a time period of duration T. When there is no abnormal loss of a certain reagent during the time period, the time period of duration T is used as a reference time period. Step S202: Obtain image records captured by the camera during the reference time period, identify the reagent container corresponding to a certain reagent, take the reagent container as the target container, and obtain all video clips in the reference time period in which the target container appears; Step S203: Identify the actions of laboratory staff operating the target container in the video clip, and collect the actions according to the chronological order of their appearance to obtain an action sequence.

4. The visualization monitoring service method based on product inspection according to claim 3, characterized in that: Step S300 includes: Step S301: According to the type of action, the action records in the action sequence are collected separately. In the time period of duration T, the duration of each type of action is accumulated to obtain the action reference duration. Step S302: Obtain the reference duration tj of the j-th action type, and calculate the unit time threshold τj of the j-th action, τj=tj / T; Step S303: Denote the i-th action in the action sequence as ai, and the (i+1)-th action as ai+1. Combine ai and ai+1 into a continuous action group. Step S304: Gather all continuous action groups, group continuous action groups with the same previous action into one category, classify the action type of the next action in the same continuous action group, calculate the occurrence frequency of the next action type, and use the occurrence frequency as the frequency threshold of the next action type in the same continuous action group.

5. The visualization monitoring service method based on product inspection according to claim 4, characterized in that: Step S400 includes: Step S401: Set a unit time period with a duration of T2, where T2 < T, obtain the usage records of a certain reagent for several unit time periods, and record the unit time period in which a certain reagent has abnormal consumption as the target time period. Step S402: Acquire image records for the target time period, identify the actions that operate on the target container, and assemble the actions of each unit time period in the image records into a target action sequence; Step S403: Accumulate the duration of actions in the target action sequence, obtain the cumulative duration kj of the j-th action in a certain target action sequence, and calculate the duration deviation value rtj, rtj=|kj-τj×T2|; Step S404: Extract all continuous action groups of a target action sequence, group the continuous action groups with the same preceding action into one category, calculate the occurrence frequency of the next action in each category of continuous action groups, and compare it with the frequency threshold to obtain the frequency difference between the occurrence frequency and the frequency threshold. Step S405: Obtain the amount of abnormal loss of a certain reagent in all target time periods, set the time influence coefficient of the duration deviation value and the frequency influence coefficient of the frequency difference value, and establish a linear equation between the duration deviation value, the frequency difference value and the amount of loss. Step S406: Gather the linear equations corresponding to each target time period to form a system of linear equations, solve for the time influence coefficient and frequency influence coefficient, and obtain the time influence coefficient corresponding to the time difference of the duration of all types of actions and the frequency influence coefficient corresponding to the frequency difference of the occurrence frequency.

6. The visualization monitoring service method based on product inspection according to claim 5, characterized in that: Step S500 includes: Step S501: Collect the current image record of the laboratory operating table, obtain the image record of using the reagent in a unit time period, identify the actions in the image record, and collect the actions in the image record to form the current action sequence; Step S502: Classify the actions in the current action sequence, obtain the continuous action groups in the current action sequence, obtain the duration of each action in the current action sequence, and the frequency of the next action in the continuous action group. Step S503: Compare the duration of the action with the time threshold to obtain the time difference of various actions, compare the occurrence frequency with the frequency threshold to obtain the frequency difference, multiply the time difference with the time influence coefficient to obtain the first estimated value h1, and multiply the frequency difference with the frequency influence coefficient to obtain the second estimated value h2. Step S504: Set an abnormal loss management threshold G. When G < h1 + h2, remind the laboratory management personnel to check the usage of a certain reagent.

7. A product inspection-based visual monitoring service system, used to execute the product inspection-based visual monitoring service method according to any one of claims 1-6, characterized in that: The system includes: The system comprises a feature management module, an action sequence management module, a threshold management module, an influence coefficient management module, and a real-time monitoring module. The feature management module manages reagent container features and the action features of personnel operating the containers. The action sequence management module manages action sequences within a time range. The threshold management module manages unit-time thresholds for action types and frequency thresholds for action combinations. The influence coefficient management module manages the differences between unit-time thresholds and frequency thresholds, and calculates the influence coefficients of differences in action duration and frequency on abnormal reagent loss. The real-time monitoring module manages current image records, predicts abnormal loss values, and sends alarm information when alarm conditions are met.

8. The product inspection-based visual monitoring service system according to claim 7, characterized in that: The threshold management module includes: action type management unit, time threshold management unit, action group management unit, and frequency threshold management unit; The action type management unit is used to obtain the type of action, the time threshold management unit is used to calculate the unit time threshold of the action, the action group management unit is used to manage continuous action groups, and the frequency threshold management unit is used to calculate the frequency threshold.

9. The product inspection-based visual monitoring service system according to claim 7, characterized in that: The impact coefficient management module includes: duration deviation management unit, frequency difference management unit, loss management unit, and coefficient management unit; Among them, the duration deviation management unit is used to manage duration deviation, the frequency difference management unit is used to manage frequency difference, the loss management unit is used to manage loss during the target time period, and the coefficient management unit is used to manage time influence coefficient and frequency influence coefficient.

10. A product inspection-based visual monitoring service system according to claim 7, characterized in that: The real-time monitoring module includes: a current sequence management unit, a sequence feature management unit, a loss prediction unit, and an information alert unit; The current sequence management unit manages the action sequence in the current image, the sequence feature management unit manages the duration of actions and the frequency of action combinations in the current action sequence, the loss prediction unit manages the predicted value of reagent loss, and the information reminder unit provides an alarm notification to relevant management personnel when alarm conditions are met.

Images