Protective clothing putting-on and taking-off evaluation system

Abstract

The invention discloses a protective clothing wearing and taking-off evaluation system. The system comprises video acquisition equipment, a host and display equipment, the video acquisition equipment is used for acquiring a protective clothing putting-on and taking-off video frame of a to-be-evaluated object; the host is used for inputting the protective clothing wearing and taking-off video frame of the to-be-evaluated object into a pre-trained object posture detection model to obtain object key point information; inputting the protective clothing putting-on and taking-off video frame of the to-be-evaluated object into a target detection model of a pre-trained protective clothing putting-on and taking-off process to obtain protective clothing putting-on and taking-off target information; generating a protective clothing wearing and taking-off detection report based on the object key point information and the protective clothing wearing and taking-off target information; the display device is used for displaying the protective clothing wearing and taking-off detection report. According to the technical scheme, interactive automatic real-time detection and report analysis of the wearing and taking-off of the protective clothing are realized through the video acquisition equipment, the host and the display equipment, so that the to-be-evaluated object is assisted in carrying out the wearing and taking-off exercise of the protective clothing, and the training efficiency of the wearing and taking-off of the protective clothing is improved.

Description

Technical Field

[0001] The invention relates to the technical field of automatic detection equipment, and in particular to a protective clothing donning and doffing evaluation system. Background Art

[0002] In order to ensure the work safety of medical workers, learning to put on and take off personal protective equipment (PPE) quickly and correctly is crucial to preventing the spread of pathogens and protecting the health and safety of medical workers and patients.

[0003] At present, the training on putting on and taking off protective clothing mainly relies on the traditional face-to-face teaching method, that is, experienced medical workers demonstrate and explain, and then nursing students imitate and practice. The traditional training method takes a lot of time and human resources, and the learning progress and understanding ability of each nursing student are different, resulting in low training efficiency. Summary of the invention

[0004] The present invention provides a protective clothing donning and doffing evaluation system to improve the training efficiency of protective clothing donning and doffing.

[0005] According to one aspect of the present invention, a protective clothing donning and doffing assessment system is provided, comprising: a video acquisition device, a host and a display device, wherein the host is electrically connected to the video acquisition device and the display device respectively;

[0006] The video acquisition device is used to acquire video frames of putting on and taking off protective clothing of the object to be evaluated;

[0007] The host is used to input the protective clothing donning and taking-off video frame of the object to be evaluated into a pre-trained object posture detection model to obtain object key point information; input the protective clothing donning and taking-off video frame of the object to be evaluated into a pre-trained target detection model of the protective clothing donning and taking-off process to obtain protective clothing donning and taking-off target information; generate a protective clothing donning and taking-off detection report based on the object key point information and the protective clothing donning and taking-off target information;

[0008] The display device is used to display the protective clothing putting on and taking off detection report.

[0009] Optionally, the generating a protective clothing putting on and taking off detection report based on the object key point information and the protective clothing putting on and taking off target information includes:

[0010] Generating real-time human body part posture indicators based on the object key point information;

[0011] Comparing the real-time human body part posture index with the standard human body part posture index to obtain the human body part posture deviation;

[0012] Based on the preset operation item detection rules, the protective clothing putting on and taking off target information is judged to obtain the protective clothing putting on and taking off process detection result;

[0013] The human body part posture deviation and the protective clothing putting on and taking off process detection results are input into a preset detection report template to obtain a protective clothing putting on and taking off detection report.

[0014] Optionally, the object key point information includes one or more of eye key point coordinates, eyebrow key point coordinates, ear key point coordinates, shoulder key point coordinates, elbow key point coordinates, wrist key point coordinates, hip key point coordinates, knee key point coordinates and ankle key point coordinates;

[0015] Correspondingly, the real-time human body part posture index includes one or more of the eye-eyebrow-ear angle, the arm-body angle and the knee bending angle.

[0016] Optionally, the protective clothing putting on and taking off target information includes one or more of a hand pressing hand sanitizer action, a hat on the head, a mask on the face, an open protective clothing, a gloved hand, a pair of gloves not worn on the table, goggles on the head, no gloves on the table, a hand-crossed action, goggles taken off and placed on the table, a protective clothing put on the table after being taken off, a hand without gloves, a gloves put on the table after being taken off, a mask on the table after being taken off, and a hat on the table after being taken off;

[0017] Correspondingly, based on the preset operation item detection rule, the protective clothing putting on and taking off target information is judged to obtain the protective clothing putting on and taking off process detection result, including:

[0018] In a case where the protective clothing putting on and taking off target information includes a hand pressing hand sanitizer action, determining that the protective clothing putting on and taking off process detection result is completion of the hand hygiene operation;

[0019] When the protective clothing putting on and taking off target information includes a hat on the head, determining that the protective clothing putting on and taking off process detection result is completion of the hat putting on operation;

[0020] In a case where the protective clothing putting on and taking off target information includes a mask on the face, determining that the protective clothing putting on and taking off process detection result is completing the mask wearing operation;

[0021] When the protective clothing putting on and taking off target information includes an open protective clothing, determining that the protective clothing putting on and taking off process detection result is that a protective clothing putting on operation is completed;

[0022] In a case where the protective clothing putting on and taking off target information includes a gloved hand and a pair of gloves not being worn on a table, determining that the protective clothing putting on and taking off process detection result is completion of the inner glove putting on operation;

[0023] When the protective clothing putting on and taking off target information includes wearing goggles, determining that the protective clothing putting on and taking off process detection result is completing the goggles wearing operation;

[0024] When the protective clothing putting on and taking off target information includes the gloved hands and the absence of gloves on the table, determining that the protective clothing putting on and taking off process detection result is the completion of the outer gloves putting on operation;

[0025] In a case where the protective clothing putting on and taking off target information includes a two-hand crossing action and a pair of gloves not being worn on the table, determining that the protective clothing putting on and taking off process detection result is completion of the outer gloves taking off operation;

[0026] When the protective clothing putting on and taking off target information includes putting on goggles and taking off goggles and putting them on the table, determining that the protective clothing putting on and taking off process detection result is completing the goggles taking off operation;

[0027] When the protective clothing putting on and taking off target information includes the state of the protective clothing being opened and the protective clothing being put on the table after being taken off, determining that the protective clothing putting on and taking off process detection result is that the protective clothing taking off operation is completed;

[0028] When the protective clothing putting on and taking off target information includes a two-hand crossing action, a hand not wearing gloves, and a gloves being put on a table after being taken off, determining that the protective clothing putting on and taking off process detection result is completing the inner gloves taking off operation;

[0029] In a case where the protective clothing putting on and taking off target information includes a mask on the face and a mask on the table after taking it off, determining that the protective clothing putting on and taking off process detection result is completing the mask taking off operation;

[0030] In a case where the protective clothing putting on and taking off target information includes the hat on the head and the hat on the table after taking it off, it is determined that the protective clothing putting on and taking off process detection result is that the hat taking off operation is completed.

[0031] Optionally, judging the protective clothing putting on and taking off target information based on preset operation item detection rules to obtain the protective clothing putting on and taking off process detection result also includes:

[0032] When the protective clothing putting on and taking off target information includes the hand pressing hand sanitizer action and the hand separation action, and the time interval between the hand pressing hand sanitizer action and the hand separation action exceeds the preset time, it is determined that the protective clothing putting on and taking off process detection result is that the hand hygiene time is qualified.

[0033] Optionally, judging the protective clothing putting on and taking off target information based on preset operation item detection rules to obtain the protective clothing putting on and taking off process detection result also includes:

[0034] If the protective clothing putting on and taking off target information includes the action of hands appearing in front of the mask in the mask taking off operation link, it is determined that the protective clothing putting on and taking off process detection result is an erroneous behavior of hands appearing in front of the mask during the mask taking off process.

[0035] Optionally, the display device is further used for:

[0036] The video frames of the object to be evaluated putting on and taking off protective clothing are displayed in real time.

[0037] Optionally, the host is further used for:

[0038] Rendering the object key point information and / or the protective clothing putting on and taking off target information onto the protective clothing putting on and taking off video frame to obtain a rendered protective clothing putting on and taking off video frame;

[0039] Accordingly, the display device is also used for:

[0040] The rendered protective clothing putting on and taking off video frames are displayed in real time.

[0041] Optionally, the protective clothing donning and doffing assessment system further comprises:

[0042] The voice device is electrically connected to the host and is used to announce the operating steps of putting on and taking off the protective clothing and / or the precautions of putting on and taking off the protective clothing.

[0043] Optionally, the protective clothing donning and doffing assessment system further comprises:

[0044] The server is connected to the host for receiving and storing one or more of the object key point information, the protective clothing putting on and taking off target information and the protective clothing putting on and taking off detection report sent by the host.

[0045] The protective clothing donning and taking-off evaluation system of the embodiment of the present invention includes: a video acquisition device, a host and a display device; the video acquisition device is used to acquire the protective clothing donning and taking-off video frames of the object to be evaluated; the host is used to input the protective clothing donning and taking-off video frames of the object to be evaluated into a pre-trained object posture detection model to obtain the object key point information; the protective clothing donning and taking-off video frames of the object to be evaluated are input into a pre-trained target detection model of the protective clothing donning and taking-off process to obtain the protective clothing donning and taking-off target information; a protective clothing donning and taking-off detection report is generated based on the object key point information and the protective clothing donning and taking-off target information; the display device is used to display the protective clothing donning and taking-off detection report. The above technical scheme realizes interactive automatic real-time detection and report analysis of protective clothing donning and taking-off through the video acquisition device, the host and the display device, so as to assist the object to be evaluated in practicing putting on and taking off protective clothing, thereby improving the training efficiency of putting on and taking off protective clothing.

[0046] It should be understood that the contents described in this section are not intended to identify the key or important features of the embodiments of the present invention, nor are they intended to limit the scope of the present invention. Other features of the present invention will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0047] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0048] Figure 1 is a structural schematic diagram of a protective clothing donning and doffing assessment system provided according to an embodiment of the present invention;

[0049] Figure 2 is a structural schematic diagram of a protective clothing donning and doffing assessment system provided according to an embodiment of the present invention;

[0050] Figure 3 The figure is a schematic diagram of the structure of a protective clothing donning and doffing evaluation system provided according to an embodiment of the present invention. DETAILED DESCRIPTION

[0051] In order to enable those skilled in the art to better understand the scheme of the present invention, the technical scheme in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work should fall within the scope of protection of the present invention.

[0052] It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchangeable where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any of their variations are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices. The acquisition, storage, use, processing, etc. of data in the technical solution of this application comply with the relevant provisions of national laws and regulations.

[0053] Figure 1The present invention provides a schematic diagram of the structure of a protective clothing donning and doffing evaluation system. This embodiment is applicable to interactively perform protective clothing donning and doffing evaluation on an object to be evaluated. Figure 1 As shown, the system includes:

[0054] A video acquisition device 110, a host 120 and a display device 130, wherein the host 120 is electrically connected to the video acquisition device 110 and the display device 130 respectively; the video acquisition device 110 is used to acquire video frames of putting on and taking off protective clothing of an object to be evaluated; the host 120 is used to input the video frames of putting on and taking off protective clothing of the object to be evaluated into a pre-trained object posture detection model to obtain object key point information; input the video frames of putting on and taking off protective clothing of the object to be evaluated into a pre-trained target detection model of the protective clothing putting on and taking off process to obtain protective clothing putting on and taking off target information; generate a protective clothing putting on and taking off detection report based on the object key point information and the protective clothing putting on and taking off target information; the display device 130 is used to display the protective clothing putting on and taking off detection report.

[0055] In the embodiment of the present invention, the video acquisition device 110 refers to a hardware device for acquiring video frames of putting on and taking off protective clothing, which may be a camera or a camera, etc. The subject to be evaluated may be a medical worker or a nursing student, etc., which is not specifically limited here. The protective clothing putting on and taking off video frames refers to images taken by the subject to be evaluated during the process of putting on and taking off protective clothing, and the number may be one or more.

[0056] For example, one or more video frames of the object to be evaluated putting on and taking off protective clothing can be acquired in real time by a camera.

[0057] In the embodiment of the present invention, the host 120 refers to the main body part of the protective clothing donning and doffing assessment system excluding the input and output devices, and may include but is not limited to a central processing unit, memory, motherboard, hard disk, optical drive, power supply, chassis, cooling system and other input and output controllers and interfaces.

[0058] The host 120 can run an object posture detection model and a target detection model for the process of putting on and taking off protective clothing. Among them, the object posture detection model refers to a pre-trained neural network model, which can be used to detect the posture of the object to be evaluated in real time, so as to obtain the key point information of the object. The key point information of the object refers to the coordinate information of the key parts of the body of the object to be evaluated in the process of putting on and taking off protective clothing, which may include but is not limited to the key point coordinates of the nose, eyes, ears, shoulders, elbows, wrists, hips, knees and ankles of the object to be evaluated. Exemplarily, the object posture detection model can be obtained by training MobilenetV1 or BlazePose, etc., which is not specifically limited here. The target detection model of the process of putting on and taking off protective clothing refers to a pre-trained neural network model, which can be used to detect the target in the video frame of putting on and taking off protective clothing, so as to obtain the target information of putting on and taking off protective clothing. The target information of putting on and taking off protective clothing refers to the target object or target action detected by the object to be evaluated in the process of putting on and taking off protective clothing, etc., which may include but is not limited to the action of pressing hand sanitizer, wearing a hat, wearing a mask, protective clothing, gloves, tables, goggles or wearing goggles. Exemplarily, the target detection model of the protective clothing putting on and taking off process can be trained based on YoloV5 or YoloV8, etc., and is not specifically limited here.

[0059] In some embodiments, the key point information of the object and the target information of putting on and taking off the protective clothing can be directly used to form a protective clothing putting on and taking off detection report. In some embodiments, the key point information of the object can be further processed to obtain the deviation of the posture of the human body parts, and the target information of putting on and taking off the protective clothing can be further processed to obtain the detection result of the protective clothing putting on and taking off process, and then the deviation of the posture of the human body parts and the detection result of the protective clothing putting on and taking off process can be used to form a protective clothing putting on and taking off detection report, which is not specifically limited here.

[0060] The display device 130 is used to display the protective clothing putting on and taking off detection report, which may include object key point information and protective clothing putting on and taking off target information, or the protective clothing putting on and taking off detection report may also include human body part posture deviation generated according to the object key point information and protective clothing putting on and taking off process detection results generated according to the protective clothing putting on and taking off target information, which are not specifically limited here.

[0061] The technical solution of the embodiment of the present invention realizes interactive automatic real-time detection and report analysis of putting on and taking off protective clothing through video acquisition equipment, a host and a display device, so as to assist the subject to be evaluated in practicing putting on and taking off protective clothing, thereby improving the training efficiency of putting on and taking off protective clothing.

[0062] Optionally, a protective clothing putting on and taking off detection report is generated based on the object key point information and the protective clothing putting on and taking off target information, including: generating a real-time human body part posture index based on the object key point information; comparing the real-time human body part posture index with the standard human body part posture index to obtain the human body part posture deviation; judging the protective clothing putting on and taking off target information based on preset operation item detection rules to obtain the protective clothing putting on and taking off process detection result; inputting the human body part posture deviation and the protective clothing putting on and taking off process detection result into a preset detection report template to obtain the protective clothing putting on and taking off detection report.

[0063] Among them, the object key point information includes one or more of the eye key point coordinates, eyebrow key point coordinates, ear key point coordinates, shoulder key point coordinates, elbow key point coordinates, wrist key point coordinates, hip key point coordinates, knee key point coordinates and ankle key point coordinates; correspondingly, the real-time human body part posture indicators include one or more of the eye-eyebrow-ear angle, arm-body angle and knee bending angle.

[0064] In the embodiment of the present invention, the eye-eyebrow-ear angle refers to the angle formed by the eyes, eyebrows and ears of the subject to be evaluated, the arm-body angle refers to the angle between the arm and the body trunk of the subject to be evaluated, and the knee bending angle refers to the angle between the thigh and calf of the subject to be evaluated.

[0065] For example, the real-time eye-eyebrow-ear angle of the object to be evaluated can be calculated according to the eye key point coordinates, the eyebrow key point coordinates and the ear key point coordinates, and then the real-time eye-eyebrow-ear angle of the object to be evaluated is compared with the standard eye-eyebrow-ear angle to obtain the human body part posture deviation corresponding to the eye-eyebrow-ear. The human body part posture deviation calculation principle of other parts of the object to be evaluated is the same as that of the eye-eyebrow-ear, which will not be repeated here.

[0066] In the embodiment of the present invention, the preset operation item detection rule is a preset rule for judging whether the operation of the object to be evaluated complies with the protective clothing putting on and taking off specification.

[0067] Exemplarily, in the hand hygiene operation link, if the protective clothing putting on and taking off target information includes the action of pressing hand sanitizer, the protective clothing putting on and taking off process detection result is determined to be the completion of the hand hygiene operation; if the protective clothing putting on and taking off target information does not include the action of pressing hand sanitizer, the protective clothing putting on and taking off process detection result is determined to be the incomplete hand hygiene operation.

[0068] Optionally, the target information for putting on and taking off protective clothing includes one or more of the following: an action of pressing hand sanitizer with hands, a hat on the head, a mask on the face, an open protective clothing, a gloved hand, a pair of gloves not being worn on the table, goggles on the head, no gloves on the table, an action of crossing both hands, taking off goggles and placing them on the table, a state where the protective clothing is taken off and placed on the table, a state where the hands are not wearing gloves, a state where the gloves are taken off and placed on the table, a mask on the table after taking them off, and a hat on the table after taking them off; accordingly, based on the preset operation item detection rules, the target information for putting on and taking off protective clothing is judged to obtain a detection result of the protective clothing putting on and taking off process, including: when the target information for putting on and taking off protective clothing includes the action of pressing hand sanitizer with hands, determining that the protective clothing The detection result of the putting on and taking off process is that the hand hygiene operation is completed; when the protective clothing putting on and taking off target information includes a hat on the head, it is determined that the hat-wearing operation is completed; when the protective clothing putting on and taking off target information includes a mask on the face, it is determined that the mask-wearing operation is completed; when the protective clothing putting on and taking off target information includes an open protective clothing, it is determined that the protective clothing putting on and taking off process detection result is that the protective clothing putting on operation is completed; when the protective clothing putting on and taking off target information includes a gloved hand and a pair of gloves not being worn on the table, it is determined that the protective clothing putting on and taking off process detection result is that the inner gloves putting on operation is completed; when the protective clothing putting on and taking off target information includes a gloved hand and a pair of gloves not being worn on the table, it is determined that the protective clothing putting on and taking off process detection result is that the inner gloves putting on operation is completed; When the information includes wearing goggles, it is determined that the protective clothing putting on and taking off process detection result is the completion of the goggles putting on operation; when the protective clothing putting on and taking off target information includes gloved hands and no gloves on the table, it is determined that the protective clothing putting on and taking off process detection result is the completion of the outer gloves putting on operation; when the protective clothing putting on and taking off target information includes the crossing of hands and a pair of gloves not being worn on the table, it is determined that the protective clothing putting on and taking off process detection result is the completion of the outer gloves taking off operation; when the protective clothing putting on and taking off target information includes wearing goggles and taking off goggles and putting them on the table, it is determined that the protective clothing taking on and taking off process detection result is the completion of the goggles taking off operation; when the protective clothing putting on and taking off target information includes opening When the protective clothing on and off target information includes the state of the hands crossing, the hands not wearing gloves and the gloves being placed on the table after being taken off, it is determined that the protective clothing putting on and taking off process detection result is the completion of the protective clothing taking off operation; when the protective clothing putting on and taking off target information includes the state of the hands not wearing gloves and the gloves being placed on the table after being taken off, it is determined that the protective clothing putting on and taking off process detection result is the completion of the inner gloves taking off operation; when the protective clothing putting on and taking off target information includes the mask on the face and the mask on the table after being taken off, it is determined that the mask taking off operation is completed; when the protective clothing putting on and taking off target information includes the hat on the head and the hat on the table after being taken off, it is determined that the protective clothing putting on and taking off process detection result is the completion of the hat taking off operation.

[0069] In the embodiment of the present invention, the process detection of wearing protective clothing includes hand hygiene, wearing a hat, wearing a mask, wearing protective clothing, wearing inner gloves, wearing goggles, wearing outer gloves and hand hygiene again. The process detection of taking off protective clothing includes taking off outer gloves, hand hygiene, taking off goggles, taking off protective clothing, taking off inner gloves, taking off masks and taking off hats.

[0070] It should be noted that the protective clothing putting on and taking off evaluation system can determine whether the operation of putting on and taking off protective clothing is completed based on one or more protective clothing putting on and taking off target information. For example, when the protective clothing putting on and taking off target information includes a gloved hand and a pair of gloves that are not worn on a table, it can be determined that the protective clothing putting on and taking off process detection result is that the operation of putting on the inner gloves is completed.

[0071] Optionally, based on preset operation item detection rules, the target information of putting on and taking off protective clothing is judged to obtain the detection result of the protective clothing putting on and taking off process, and also includes: when the target information of putting on and taking off protective clothing includes the action of pressing hand sanitizer with hands and the action of separating both hands, and the time interval between the action of pressing hand sanitizer with hands and the action of separating both hands exceeds the preset time, it is determined that the detection result of the protective clothing putting on and taking off process is that the hand hygiene time is qualified.

[0072] Exemplarily, the timing starts when the action of pressing the hand sanitizer is detected, and ends when the action of separating the hands is detected, so as to obtain the time interval between the hand pressing the hand sanitizer action and the action of separating the hands, that is, the hand hygiene time. If the hand hygiene time exceeds 15 seconds, the result of the protective clothing putting on and taking off process detection is determined to be that the hand hygiene time is qualified; if the hand hygiene time does not exceed 15 seconds, the result of the protective clothing putting on and taking off process detection is determined to be that the hand hygiene time is unqualified.

[0073] Optionally, based on preset operation item detection rules, the target information of putting on and taking off protective clothing is judged to obtain the detection result of the protective clothing putting on and taking off process, and also includes: if the target information of putting on and taking off protective clothing includes the action of hands appearing in front of the mask in the mask taking off operation link, then it is determined that the detection result of the protective clothing putting on and taking off process is an erroneous behavior of hands appearing in front of the mask during the mask taking off process.

[0074] It should be noted that by judging whether the hands appear in front of the mask during the mask removal operation, targeted detection of incorrect behaviors can be achieved, thereby improving the accuracy of the protective clothing wearing and taking off score.

[0075] In an embodiment of the present invention, the deviation of posture of human body parts and the detection results of the protective clothing putting on and taking off process can be input into a preset detection report template to obtain a protective clothing putting on and taking off detection report, so that the object to be evaluated can perform protective clothing putting on and taking off exercises or tests according to the protective clothing putting on and taking off detection report, thereby improving the training efficiency of protective clothing putting on and taking off.

[0076] In some embodiments, the protective clothing putting on and taking off test report may also include but is not limited to the test date, the name of the test subject, the gender of the test subject, and the student number of the test subject, etc., so that users can search and analyze it later.

[0077] Optionally, the display device 130 is further used to: display in real time video frames of the object to be evaluated putting on and taking off protective clothing.

[0078] It should be noted that the display device 130 displays the video frames of the protective clothing putting on and taking off of the subject to be evaluated in real time, so that the subject to be evaluated can adjust the posture and operation movements in real time like looking in a mirror, thereby ensuring the quality of the protective clothing putting on and taking off training.

[0079] Optionally, the host 120 is also used to render the object key point information and / or the protective clothing putting on and taking off target information onto the protective clothing putting on and taking off video frame to obtain the rendered protective clothing putting on and taking off video frame; accordingly, the display device 130 is also used to display the rendered protective clothing putting on and taking off video frame in real time.

[0080] It should be noted that by displaying the protective clothing putting on and taking off video frames containing object key point information and / or protective clothing putting on and taking off target information in real time through the display device 130, the protective clothing putting on and taking off postures and operating actions are highlighted, making it easier for the object to be evaluated to see its own protective clothing putting on and taking off postures and operating actions.

[0081] On the basis of the above embodiment, optionally, the protective clothing putting on and taking off evaluation system further includes: a voice device 140, electrically connected to the host 120, for broadcasting the operating steps of putting on and taking off the protective clothing and / or the precautions of putting on and taking off the protective clothing.

[0082] In an embodiment of the present invention, Figure 2 1 is a schematic diagram of the structure of a protective clothing donning and doffing evaluation system provided according to an embodiment of the present invention. Specifically, when entering a preset operation item, the timer is triggered to work. When the timer reaches the preset time, the voice device 140 plays the operation steps corresponding to the preset operation item and / or the precautions for donning and doffing protective clothing, so as to realize voice guidance training for donning and doffing protective clothing. Among them, the preset operation items can be hand hygiene, wearing a hat, wearing a mask, wearing protective clothing, wearing inner gloves, wearing goggles, wearing outer gloves, taking off outer gloves, taking off goggles, taking off protective clothing, taking off inner gloves, taking off a mask or taking off a hat.

[0083] On the basis of the above embodiment, optionally, the protective clothing putting on and taking off evaluation system also includes: a server 150, which is communicatively connected to the host 120, and is used to receive and store one or more of the object key point information, protective clothing putting on and taking off target information, and protective clothing putting on and taking off detection report sent by the host 120.

[0084] In an embodiment of the present invention, Figure 3It is a structural diagram of a protective clothing donning and taking-off evaluation system provided according to an embodiment of the present invention. Specifically, the server 150 and the host 120 can be connected by wired or wireless communication, which is not specifically limited here. Compared with the traditional offline server-client architecture system, this system adopts a cloud-edge collaborative mode system architecture, which includes an edge computing layer and a cloud service layer, wherein the edge computing layer (video acquisition device, host and display device) is used for protective clothing donning and taking off video frame acquisition and artificial intelligence processing; the cloud service layer (server) is responsible for the persistent storage and display of data, so that the front-end display and back-end data processing of the protective clothing donning and taking off evaluation system are independent of each other, and the object key point information, protective clothing donning and taking off target information and protective clothing donning and taking off detection report are uploaded to the cloud server in real time, without occupying the host memory, so that the calculation and operation of the protective clothing donning and taking off evaluation system are smoother.

[0085] The above specific implementations do not constitute a limitation on the protection scope of the present invention. It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and substitutions can be made according to design requirements and other factors. Any modification, equivalent substitution and improvement made within the spirit and principle of the present invention should be included in the protection scope of the present invention.

Claims

1. A protective clothing donning and doffing assessment system, characterized in that: include: A video acquisition device, a host and a display device, wherein the host is electrically connected to the video acquisition device and the display device respectively; The video acquisition device is used to acquire video frames of putting on and taking off protective clothing of the object to be evaluated; The host is used to input the protective clothing putting on and taking off video frames of the object to be evaluated into a pre-trained object posture detection model to obtain object key point information; Inputting the protective clothing donning and taking-off video frame of the object to be evaluated into the target detection model of the protective clothing donning and taking-off process that has been trained in advance to obtain the protective clothing donning and taking-off target information; Generate a protective clothing donning and taking-off detection report based on the object key point information and the protective clothing donning and taking-off target information; The display device is used to display the protective clothing putting on and taking off detection report.

2. The system according to claim 1, characterized in that The generating of the protective clothing putting on and taking off detection report based on the object key point information and the protective clothing putting on and taking off target information includes: Generating real-time human body part posture indicators based on the object key point information; Comparing the real-time human body part posture index with the standard human body part posture index to obtain the human body part posture deviation; Based on the preset operation item detection rules, the protective clothing putting on and taking off target information is judged to obtain the protective clothing putting on and taking off process detection result; The human body part posture deviation and the protective clothing putting on and taking off process detection results are input into a preset detection report template to obtain a protective clothing putting on and taking off detection report.

3. The system according to claim 2, characterized in that The object key point information includes one or more of eye key point coordinates, eyebrow key point coordinates, ear key point coordinates, shoulder key point coordinates, elbow key point coordinates, wrist key point coordinates, hip key point coordinates, knee key point coordinates and ankle key point coordinates; Correspondingly, the real-time human body part posture index includes one or more of the eye-eyebrow-ear angle, the arm-body angle and the knee bending angle.

4. The system according to claim 2, characterized in that The protective clothing wearing and removing target information includes one or more of the following: hand pressing hand sanitizer action, hat on head, mask on face, open protective clothing, gloved hands, a pair of gloves not worn on the table, goggles on head, no gloves on the table, hands crossed, goggles taken off and placed on the table, protective clothing taken off and placed on the table, hands without gloves, gloves taken off and placed on the table, masks on the table after taking off, and hats on the table after taking off; Correspondingly, based on the preset operation item detection rule, the protective clothing putting on and taking off target information is judged to obtain the protective clothing putting on and taking off process detection result, including: In a case where the protective clothing putting on and taking off target information includes a hand pressing hand sanitizer action, determining that the protective clothing putting on and taking off process detection result is completion of the hand hygiene operation; When the protective clothing putting on and taking off target information includes a hat on the head, determining that the protective clothing putting on and taking off process detection result is completion of the hat putting on operation; In a case where the protective clothing putting on and taking off target information includes a mask on the face, determining that the protective clothing putting on and taking off process detection result is completing the mask wearing operation; When the protective clothing putting on and taking off target information includes an open protective clothing, determining that the protective clothing putting on and taking off process detection result is that a protective clothing putting on operation is completed; In a case where the protective clothing putting on and taking off target information includes a gloved hand and a pair of gloves not being worn on a table, determining that the protective clothing putting on and taking off process detection result is completion of the inner glove putting on operation; When the protective clothing putting on and taking off target information includes wearing goggles, determining that the protective clothing putting on and taking off process detection result is completing the goggles wearing operation; When the protective clothing putting on and taking off target information includes the gloved hands and no gloves on the table, determining that the protective clothing putting on and taking off process detection result is completing the outer gloves putting on operation; In a case where the protective clothing putting on and taking off target information includes a two-hand crossing action and a pair of gloves not being worn on the table, determining that the protective clothing putting on and taking off process detection result is completion of the outer gloves taking off operation; When the protective clothing putting on and taking off target information includes putting on goggles and taking off goggles and putting them on the table, determining that the protective clothing putting on and taking off process detection result is completing the goggles taking off operation; When the protective clothing putting on and taking off target information includes the state of the protective clothing being opened and the protective clothing being put on the table after being taken off, determining that the protective clothing putting on and taking off process detection result is that the protective clothing taking off operation is completed; When the protective clothing putting on and taking off target information includes a two-hand crossing action, a hand not wearing gloves, and a gloves being put on a table after being taken off, determining that the protective clothing putting on and taking off process detection result is completing the inner gloves taking off operation; In a case where the protective clothing putting on and taking off target information includes a mask on the face and a mask on the table after taking it off, determining that the protective clothing putting on and taking off process detection result is completing the mask taking off operation; In a case where the protective clothing putting on and taking off target information includes the hat on the head and the hat on the table after taking it off, it is determined that the protective clothing putting on and taking off process detection result is that the hat taking off operation is completed.

5. The system according to claim 4, characterized in that The step of judging the protective clothing putting on and taking off target information based on the preset operation item detection rule to obtain the protective clothing putting on and taking off process detection result further includes: When the protective clothing putting on and taking off target information includes the hand pressing hand sanitizer action and the hand separation action, and the time interval between the hand pressing hand sanitizer action and the hand separation action exceeds the preset time, it is determined that the protective clothing putting on and taking off process detection result is that the hand hygiene time is qualified.

6. The system according to claim 4, characterized in that The step of judging the protective clothing putting on and taking off target information based on the preset operation item detection rule to obtain the protective clothing putting on and taking off process detection result also includes: If the protective clothing putting on and taking off target information includes the action of hands appearing in front of the mask in the mask taking off operation link, it is determined that the protective clothing putting on and taking off process detection result is an erroneous behavior of hands appearing in front of the mask during the mask taking off process.

7. The system according to claim 1, characterized in that The display device is also used for: The video frames of the object to be evaluated putting on and taking off protective clothing are displayed in real time.

8. The system according to claim 1, characterized in that The host is also used to: Rendering the object key point information and / or the protective clothing putting on and taking off target information onto the protective clothing putting on and taking off video frame to obtain a rendered protective clothing putting on and taking off video frame; Accordingly, the display device is also used for: The rendered protective clothing putting on and taking off video frames are displayed in real time.

9. The system according to claim 1, characterized in that The protective clothing donning and doffing assessment system also includes: The voice device is electrically connected to the host and is used to announce the operating steps of putting on and taking off the protective clothing and / or the precautions for putting on and taking off the protective clothing.

10. The system according to claim 1, characterized in that The protective clothing donning and doffing assessment system also includes: The server is connected to the host for receiving and storing one or more of the object key point information, the protective clothing putting on and taking off target information and the protective clothing putting on and taking off detection report sent by the host.

Images