A method for testing equipment operation compliance and related equipment

Abstract

This application discloses a method and related equipment for detecting equipment operation compliance. By retrieving the equipment reservation work order and corresponding standard operating procedure (SOP) file, a work order operation compliance benchmark is constructed, including standard operating positions, standard operating sequences, and standard operating attributes. By acquiring time-series infrared thermal images of the equipment operating area, transient temperature imprints generated by the operator's contact with the equipment are detected and located, achieving precise determination of the operating position and time. By extracting physical characteristics of the transient temperature imprints over time, such as temperature peak value, heating rate, cooling rate, temperature distribution pattern, and duration, quantitative operating attributes such as operating duration, pressure intensity, type of operating medium, and direction of operating action are derived based on the mapping relationship between these characteristics and operating behavior. By comparing the actual operating information with the work order operation compliance benchmark item by item, the method identifies and alerts operators to violations of equipment operation regulations, achieving accurate, comprehensive, and efficient detection of equipment operation compliance.

Description

Technical Field

[0001] This application relates to the field of intelligent compliance testing technology, and more specifically, to a method and related equipment for testing equipment operation compliance. Background Technology

[0002] In fields such as industrial production, medical diagnosis and treatment, laboratory research, and special equipment operation and maintenance, the standardization of equipment operation is directly related to production safety, product quality, equipment lifespan, and personnel health. For high-risk equipment such as high-voltage electrical equipment, precision medical instruments, and hazardous chemical handling equipment, any deviation from standard operating procedures can lead to safety accidents, causing significant economic losses or even personal injury or death. As equipment operation procedures become increasingly complex and the requirements for operational compliance continue to rise, traditional testing methods are no longer sufficient to meet the needs of modern safety management.

[0003] Currently, compliance inspection of equipment operation mainly employs three technical methods. Manual supervision relies on on-site inspections by safety officers or post-event review of surveillance footage. This method suffers from low efficiency, strong subjectivity, inability to achieve continuous monitoring, and a high risk of missed or false detections. Furthermore, it cannot quantify and evaluate key operational parameters. While computer vision inspection technology based on visible light video achieves a certain degree of automation, it is significantly affected by factors such as lighting conditions, personnel obstruction, and viewing angle limitations, resulting in unstable detection accuracy. It can only identify the general movement trajectory of personnel, failing to acquire crucial physical information reflecting the essence of the operation, making it difficult to accurately determine whether the operation is truly compliant, and also poses a risk of privacy breaches. Contact sensor-based inspection technology requires installing various sensors on the equipment's operating components. This is not only costly to install and difficult to maintain, but also affects the original structure and normal use of the equipment. Moreover, it can only detect specific locations where pre-installed sensors are installed, resulting in extremely poor flexibility.

[0004] Therefore, there is an urgent need for a new method for testing equipment operation compliance in order to overcome the shortcomings of existing technologies and achieve accurate, comprehensive and efficient testing of equipment operation compliance. Summary of the Invention

[0005] This application provides a method and related equipment for testing equipment operation compliance. By detecting the transient temperature imprint generated when an operator touches the equipment, it can achieve comprehensive and accurate compliance testing of multi-dimensional physical attributes without modifying existing equipment.

[0006] A method for testing equipment operation compliance, comprising:

[0007] Retrieve the equipment's reservation work orders and corresponding operation SOP files, and construct work order operation compliance benchmarks. The work order operation compliance benchmarks shall at least include standard operation location, standard operation sequence, and at least one standard operation attribute. The standard operation attribute shall include at least one of the following: standard operation duration, standard pressing force, standard operation medium, and standard operation direction.

[0008] Acquire time-series infrared thermal images containing the operating area of ​​the equipment;

[0009] Detect and locate transient temperature imprints on the surface of the equipment caused by the operator's contact with the equipment components, determine the operator's operation position based on the equipment coordinate area where the temperature imprint is located, and record the moment when the temperature imprint first appears as the operation time;

[0010] Extract at least one physical feature from the transient temperature imprint on the time series, the physical feature being used to characterize the physical behavior information of the operation action;

[0011] Based on the extracted physical features, at least one operational attribute of the operation action is inverted. The operational attribute is a parameter that quantifies the physical behavior of the operation action. The operational attribute includes at least one of operation duration, pressure intensity, operation medium type, and operation direction.

[0012] The operation location, operation time, and operation attributes obtained by inversion are compared with the corresponding standard operation location, standard operation sequence, and standard operation attributes in the work order operation compliance benchmark. If the comparison results are inconsistent, a device operation violation prompt is generated.

[0013] Optionally, the physical characteristics include temperature decay curve characteristics, and the operational attributes include operational duration;

[0014] The process of extracting physical features and inverting operational attributes includes:

[0015] Starting from the frame in which the transient temperature imprint first appears, the temperature characterization values ​​of the pixels in the temperature imprint area are extracted frame by frame to generate a time-temperature decay curve.

[0016] Extract the cooling characteristic parameters of the temperature decay curve, wherein the cooling characteristic parameters include at least one of the following: peak temperature, cooling time required to decay to a preset proportion of peak temperature, and full width at half maximum (FWHM) of the curve.

[0017] The cooling characteristic parameters are matched with a pre-built standard operation duration model library, which stores standard decay curve feature templates corresponding to different operation duration levels established through calibration.

[0018] Based on the matching results, the duration level of this operation is determined and used as one of the operation attributes obtained through inversion.

[0019] Optionally, the physical characteristics include thermal diffusion area variation characteristics, and the operational attributes include pressure intensity;

[0020] The process of extracting physical features and inverting operational attributes includes:

[0021] During the formation stage of the transient temperature imprint, the pixel area increment of the temperature imprint region between each two adjacent frames of infrared thermal images is continuously calculated to obtain the expansion rate of the heat-affected zone area over time.

[0022] Establish a mapping relationship between contact pressure and the rate of thermally affected area expansion;

[0023] The calculated expansion rate is input into the mapping relationship to obtain the pressing force level of this operation, which is used as one of the operational attributes obtained by inversion.

[0024] Optionally, the physical features include the sharpness of the thermal imprint edge, and the operational attributes include the type of operational medium;

[0025] The process of extracting physical features and inverting operational attributes includes:

[0026] In the frame where the transient temperature imprint reaches its peak area, the boundary of the temperature imprint region is extracted, the gradient magnitude of each pixel on the boundary is calculated, and the edge sharpness index is statistically obtained.

[0027] Extract the pixel temperature distribution uniformity index within the temperature imprint region, wherein the uniformity index includes the pixel temperature standard deviation or texture entropy value.

[0028] The edge sharpness index and the heat distribution uniformity index are input into a pre-trained medium classifier, which is constructed by learning the different imprint morphology features produced by the differences in thermal conductivity of metal tools, bare skin, and insulating gloves.

[0029] The media classifier is used to identify the type of operation medium for this operation. The type of operation medium includes at least manual operation and tool operation, which is one of the operation attributes obtained by inversion.

[0030] Optionally, the physical features include the imprinted centroid movement trajectory features, and the operational attributes include the direction of the operational action;

[0031] The process of extracting physical features and inverting operational attributes includes:

[0032] For transient temperature imprints corresponding to dynamically operating components, the centroid coordinates of the high-temperature region of the temperature imprint in the time-series infrared thermal image are marked and tracked to generate a centroid movement trajectory.

[0033] Calculate the cumulative curvature or tangential change of the centroid's trajectory;

[0034] When the cumulative curvature or tangent direction change exceeds the preset curvature threshold, the direction of the operation is determined to be clockwise or counterclockwise rotation based on the curvature direction.

[0035] When the cumulative curvature or tangent direction change does not exceed the preset curvature threshold, and the overall direction of the frame-by-frame displacement vector sequence of the centroid movement trajectory is unidirectional, the operation action direction is determined to be a straight-line flick.

[0036] The direction of the determined operation action is used as one of the operation attributes obtained through inversion.

[0037] Optionally, before detecting and locating the transient temperature imprint, the method further includes:

[0038] In the preparatory stage of determining that the operator has entered the equipment operation area but has not made contact with the equipment, the operator's hand area is identified by infrared thermal imaging, and the real-time body surface temperature of the operator's hands is collected.

[0039] Based on the real-time surface temperature of the hand, the threshold parameter used to segment transient temperature imprints from the infrared thermal image is adjusted and compensated.

[0040] Optional, also includes:

[0041] Acquire thermal image information of personnel within the equipment area and personnel tag information within the equipment's designated area;

[0042] The equipment operator is determined based on the personnel thermal image information and personnel tag information;

[0043] If the equipment operator's information does not match the personnel information corresponding to the appointment work order, a violation operation prompt will be generated.

[0044] Optionally, the work order operation compliance benchmark also includes the operation interval duration, and the method further includes:

[0045] If the actual operation interval between any two adjacent operation steps exceeds the operation interval duration set in the operation SOP file, an operation timeout violation prompt will be generated.

[0046] A device for testing equipment operation compliance, comprising:

[0047] The standard construction module is used to retrieve the equipment's reservation work order and the corresponding operation SOP file, and construct the work order operation compliance benchmark. The work order operation compliance benchmark includes at least the standard operation location, standard operation sequence, and at least one standard operation attribute. The standard operation attribute includes at least one of the following: standard operation duration, standard pressing force, standard operation medium, and standard operation direction.

[0048] The image acquisition module is used to acquire time-series infrared thermal images containing the operating area of ​​the device;

[0049] The imprint detection module is used to detect and locate transient temperature imprints generated on the surface of the equipment by the operator's contact with the equipment components, determine the operator's operation position based on the equipment coordinate area where the temperature imprint is located, and record the moment when the temperature imprint first appears as the operation time.

[0050] The feature extraction module is used to extract at least one physical feature of the transient temperature imprint on the time series, and the physical feature is used to characterize the physical behavior information of the operation action;

[0051] The attribute inversion module is used to invert at least one operational attribute of the operation action based on the extracted physical features. The operational attribute is a parameter that quantifies the physical behavior of the operation action. The operational attribute includes at least one of operation duration, pressure intensity, operation medium type, and operation direction.

[0052] The compliance comparison module is used to compare the operation location, operation time, and the operation attributes obtained by inversion with the corresponding standard operation location, standard operation sequence, and standard operation attributes in the work order operation compliance benchmark. If the comparison results are inconsistent, a device operation violation prompt will be generated.

[0053] A device operation compliance testing device, comprising a memory and a processor;

[0054] The memory is used to store programs;

[0055] The processor is configured to execute the program to implement the various steps of the device operation compliance detection method as described in any of the preceding claims.

[0056] A readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the steps of the device operation compliance detection method as described in any of the preceding claims.

[0057] A computer program product includes a computer program that, when executed by a processor, performs the steps of the device operation compliance detection method as described in any of the preceding claims.

[0058] As can be seen from the above technical solutions, the equipment operation compliance detection method and related equipment provided in this application first retrieve the equipment's reservation work order and corresponding operation SOP file to construct a work order operation compliance benchmark that includes standard operation position, standard operation sequence, and at least one standard operation attribute; then, it acquires a time-series infrared thermal image containing the equipment operation area, detects and locates transient temperature imprints generated on the equipment surface by the operator's contact with equipment components, determines the operation position based on the equipment coordinate area where the temperature imprint is located, and records the operation time; next, it extracts the physical features of the transient temperature imprint in the time series to invert at least one operation attribute of the operation action; finally, it compares the actual operation information with the work order operation compliance benchmark, and generates a violation prompt if they are inconsistent.

[0059] This application identifies operational behavior by detecting transient temperature imprints generated when an operator touches equipment. These temperature imprints are objective physical traces left on the equipment surface by the operational actions, possessing the characteristics of being tamper-proof and traceable, and accurately reflecting the actual situation of the operation. By locating the position of the temperature imprint and recording the moment of its first appearance, the operation position and time can be accurately determined, achieving accurate judgment of the operation position and timing. The detection can be completed automatically without manual intervention, effectively improving detection efficiency and objectivity, and avoiding the problems of missed detections and false detections in manual detection. Simultaneously, this application extracts the physical characteristics of the transient temperature imprint over time, including temperature peak, heating rate, cooling rate, temperature distribution pattern, and duration. These characteristics have a clear mapping relationship with the physical behavior of the operational actions. Based on these characteristics, multiple quantitative operational attributes such as operation duration, pressure intensity, type of operating medium, and direction of operation can be derived, achieving a multi-dimensional and refined characterization of operational behavior, solving the problem that traditional detection methods cannot quantify the physical attributes of operations. Furthermore, this application adopts a non-contact detection method, which does not require the installation of any sensors on the equipment, will not affect the original structure and normal use of the equipment, and can cover the entire operating area of ​​the equipment, offering high flexibility. At the same time, this detection method is not affected by environmental factors such as lighting conditions and personnel obstruction, has stable detection accuracy, and only collects temperature information on the surface of the equipment, without involving the operator's personal privacy, effectively solving the problems of poor environmental adaptability and privacy leakage in existing technologies. Attached Figure Description

[0060] To more clearly illustrate the technical solutions in the embodiments of this application or the prior art, the drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, the drawings described below are only embodiments of this application. For those skilled in the art, other drawings can be obtained based on the provided drawings without creative effort.

[0061] Figure 1 This is a flowchart of a device operation compliance testing method disclosed in an embodiment of this application;

[0062] Figure 2 This is a schematic diagram of a device for detecting equipment operation compliance disclosed in an embodiment of this application;

[0063] Figure 3 This is a hardware structure block diagram of a device operation compliance testing device disclosed in an embodiment of this application. Detailed Implementation

[0064] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. Based on the embodiments of this application, all other embodiments obtained by those skilled in the art without creative effort are within the scope of protection of this application.

[0065] This application can be used in a wide variety of general-purpose or special-purpose computing device environments or configurations. For example: personal computers, server computers, handheld or portable devices, tablet devices, multiprocessor devices, distributed computing environments including any of the above devices, etc.

[0066] The following section introduces the solution proposed in this application. The technical solution is as follows, please refer to the text below for details.

[0067] Figure 1 This is a flowchart of a device operation compliance testing method disclosed in an embodiment of this application.

[0068] like Figure 1 As shown, the method may include:

[0069] Step S1: Retrieve the equipment's reservation work order and corresponding operation SOP file, and construct the work order operation compliance benchmark. The work order operation compliance benchmark shall include at least the standard operation position, standard operation sequence, and at least one standard operation attribute. The standard operation attribute includes at least one of the following: standard operation duration, standard pressing pressure, standard operation medium, and standard operation direction.

[0070] Specifically, the system retrieves the equipment reservation work order and corresponding standard operating procedure (SOP) file to establish a compliance benchmark for work order operations. This step first involves data integration with the company's existing equipment management system, work order scheduling system, or production execution system. Through standardized interface protocols, it automatically retrieves the equipment reservation work order to be executed. The work order contains complete task metadata, including the unique identification code of the equipment to be operated, the equipment location, the operation task number, the operation task name, the planned start and end times, authorized operator information, and the operation task priority. Based on the operation task type and equipment model specified in the work order, the system accurately matches and retrieves the corresponding standardized SOP file from a pre-established standard operating procedure database. This SOP file is an authoritative operating specification jointly reviewed and confirmed by the company's safety management and technical departments. It details all operational steps required to complete the specific operation task, the content of each step, key points, safety precautions, and acceptance criteria. The system intelligently and structurally parses the retrieved SOP file, using natural language processing technology to transform the unstructured natural language descriptions into a standardized parameter set that is computer-recognizable and comparable, thereby constructing a specific operational compliance benchmark for this particular work order. This benchmark includes at least standard operation location information, i.e., the specific equipment component corresponding to each operation step and its spatial range in the equipment coordinate system; operation timing information, i.e., the execution order of each operation step, the minimum and maximum allowable time interval between adjacent steps; and at least one standard operation attribute used to quantify and standardize the physical behavior of the operation, including but not limited to standard operation duration, standard pressure range, permitted standard operation media type, and standard operation direction. The completed work order operation compliance benchmark will be stored in the system's compliance benchmark library, serving as the basis for determining whether the operation behavior is compliant throughout the subsequent inspection process.

[0071] Step S2: Acquire time-series infrared thermal images containing the operating area of ​​the device.

[0072] Specifically, this involves acquiring time-series infrared thermal images covering the equipment's operating area. This step utilizes at least one infrared thermal imaging acquisition device deployed around the equipment under inspection. During system deployment, technicians precisely calibrate and fix the installation position, height, pitch angle, and horizontal rotation angle of the infrared thermal imaging device based on the equipment's dimensions, structural characteristics, and all possible operating areas. This ensures the infrared thermal imaging device's field of view completely and without blind spots, eliminating any detection blind zones. Simultaneously, the system establishes a mapping between the infrared thermal imaging device's image coordinate system and the equipment's physical coordinate system, providing a foundation for subsequent operation location positioning. Within a preset time period before the scheduled operation time, the system automatically sends a start command to the infrared thermal imaging device. The device then continuously acquires infrared thermal images covering the equipment's operating area at a pre-set acquisition frequency, forming a time-series infrared thermal image data arranged chronologically. Each acquired infrared thermal image frame is automatically marked with a precise timestamp, the corresponding infrared thermal imaging device number, and the mapping parameters between the image coordinate system and the equipment's physical coordinate system. The image acquisition process will continue for a preset time period after the planned operation time of the work order ends, ensuring complete recording of all temperature changes on the equipment surface throughout the entire operation. The acquired time-series infrared thermal image data will be transmitted in real time to the backend data processing server via wired or wireless communication networks for subsequent analysis and processing.

[0073] Step S3: Detect and locate the transient temperature imprint generated on the surface of the equipment by the operator's contact with the equipment components, determine the operator's operation position based on the equipment coordinate area where the temperature imprint is located, and record the moment when the temperature imprint first appears as the operation time.

[0074] Specifically, the system detects and locates transient temperature imprints on the equipment surface caused by an operator's contact with equipment components. The operator's position is determined based on the equipment coordinates where the temperature imprint is located, and the moment the temperature imprint first appears is recorded as the operation time. When an operator's hand, arm, or handheld tool comes into contact with the equipment surface, heat conduction occurs due to the inherent temperature difference between the human body / tool ​​and the equipment surface. This causes a localized, instantaneous change in the surface temperature of the contact area, forming a transient temperature imprint with distinct temperature characteristics on the equipment surface. This transient temperature imprint has a significant characteristic that distinguishes it from the equipment's background temperature and gradually dissipates as heat diffuses, eventually returning to the equipment's background temperature level. The system first preprocesses continuously acquired time-series infrared thermal images to remove noise and interference. Then, it uses a background subtraction method combined with an adaptive background update algorithm to establish and update the background temperature model of the equipment surface in real time. By comparing the current frame of the infrared thermal image with the background temperature model pixel by pixel, abnormal temperature regions that differ significantly from the background temperature are identified as candidate transient temperature imprint regions. The system further performs morphological processing and feature analysis on the candidate regions to eliminate false temperature anomalies caused by factors such as changes in ambient temperature, equipment heating, and sunlight exposure, accurately detecting genuine transient temperature imprints. The system converts the detected transient temperature imprint region into a coordinate region within the equipment's physical coordinate system using a pre-established mapping relationship between the image coordinate system and the equipment's physical coordinate system. This region is then matched with the equipment's 3D digital model to determine the specific equipment component corresponding to the temperature imprint, thus identifying the operator's actual location. Simultaneously, the system retrieves the frame in the time-series infrared thermal image where the transient temperature imprint first appears, extracts the timestamp information corresponding to that frame, and uses it as the time of the operation.

[0075] Step S4: Extract at least one physical feature of the transient temperature imprint on the time series, wherein the physical feature is used to characterize the physical behavior information of the operation.

[0076] Specifically, at least one physical feature of the transient temperature imprint is extracted over time, and this physical feature characterizes the physical properties of the operation. For each successfully detected and located transient temperature imprint, the system continuously tracks the entire lifecycle of the temperature imprint from its first appearance to its complete dissipation in the time-series infrared thermal image, extracting multiple physical features in both the temporal and spatial dimensions. These physical features specifically include: based on the temperature decay curve feature of the pixel temperature value within the temperature imprint area changing over time, the system calculates the average temperature value of all pixels within the temperature imprint area in each frame, plotting a complete temperature decay curve over time, which accurately reflects the heat dissipation process on the device surface; based on the heat diffusion area change feature of the area growth rate of the temperature imprint area between different frames, the system calculates the area size of the temperature imprint area frame by frame, obtains the area change curve over time, and calculates the area growth rate within different time periods, which reflects the heat diffusion area change rate on the device surface. The system calculates the temperature gradient magnitude at the boundary of the temperature imprint region and analyzes the temperature texture distribution within the region, based on the gradient magnitude and edge sharpness characteristics of the temperature imprint edge. This feature reflects the clarity and boundary transition characteristics of the temperature imprint. Furthermore, based on the centroid movement trajectory features of the temperature imprint region's centroid displacement vector across multiple frames, the system calculates the centroid coordinates for each frame and then obtains the centroid displacement vector and movement trajectory through these coordinates. This feature reflects the movement path and direction of the operational action. All extracted physical features are standardized and used as the basic input data for subsequent inversion of operational attributes.

[0077] Step S5: Based on the extracted physical features, invert at least one operational attribute of the operation action. The operational attribute is a parameter that quantifies the physical behavior of the operation action. The operational attribute includes at least one of operation duration, pressure intensity, operation medium type, and operation direction.

[0078] Specifically, based on the extracted physical features, at least one operational attribute of the operation is retrieved, whereby the operational attribute is a parameter that quantifies the physical behavior of the operation. This step utilizes a pre-established correspondence between physical features and operational attributes to analyze and calculate the transient temperature imprint physical features extracted in step S4, obtaining the corresponding quantified operational attributes. This correspondence is established based on the fundamental principles of heat conduction and extensive experimental verification, clarifying the unique physical characteristics of transient temperature imprints generated by different operational actions. Specifically, the operation duration is determined by the temperature decay curve feature. The starting point of the temperature decay curve corresponds to the start of the operation, and the ending point corresponds to the end of the operation. The time interval between the two is the duration of the operation. The pressure intensity is evaluated by the heat diffusion area change feature. The greater the pressure intensity during operation, the more sufficient the contact area between the operator and the equipment surface, the higher the heat conduction efficiency, the faster the lateral diffusion of heat on the equipment surface, and the higher the corresponding heat diffusion area growth rate. The operation medium type is identified by the thermal imprint edge sharpness feature. Different materials of the operation medium have different thermal conductivity and contact characteristics, which will result in different edge sharpness of the temperature imprint. For example, metal tools have high thermal conductivity and tight contact, resulting in sharp and clear edges of the temperature imprint, while rubber gloves have low thermal conductivity and relatively loose contact, resulting in blurred and smooth transitions of the edges of the temperature imprint. The operation direction is analyzed by the imprint centroid movement trajectory feature. The displacement vector of the temperature imprint centroid directly reflects the movement direction and path of the operation. By analyzing the displacement change of the centroid in multiple consecutive frames of images, the specific direction of the operation can be accurately determined. Through the above inversion process, the system can obtain a multi-dimensional and refined quantitative description of the physical behavior of the operation.

[0079] Step S6: Compare the operation location, operation time, and inverted operation attributes with the corresponding standard operation location, standard operation sequence, and standard operation attributes in the work order operation compliance benchmark. If the comparison results are inconsistent, generate a device operation violation prompt.

[0080] Specifically, the operation location, operation time, and the inverted operation attributes are compared with the corresponding standard operation location, standard operation sequence, and standard operation attributes in the work order operation compliance benchmark. If the comparison results are inconsistent, a device operation violation warning is generated. The system compares the actual operation location and operation time of each operation obtained in step S3, and the corresponding operation attributes obtained in step S5, with the standard parameters in the work order operation compliance benchmark constructed in step S1, item by item and step by step, according to the chronological order of the operations. During the comparison process, the system sets a reasonable allowable error range for each parameter based on its characteristics and actual production needs. When the actual parameter value exceeds this allowable error range, the comparison result for that parameter is determined to be inconsistent. The system integrates the comparison results of all parameters to determine whether the operation meets the standard requirements. Once any inconsistency in the comparison results is detected, the system will immediately generate a device operation violation warning. The violation notification includes detailed information such as the work order number of the violation, the specific time of the violation, the specific location of the violation, the corresponding SOP steps, the specific parameters involved in the violation, the actual measured parameter values, and the corresponding standard requirements. The system supports multiple violation notification methods, including on-site audible and visual alarms, system pop-up notifications at the monitoring center, and SMS or application message pushes to relevant management personnel's mobile devices. Simultaneously, the system permanently stores all violation records, establishing a violation operation archive.

[0081] As can be seen from the above technical solutions, the equipment operation compliance detection method and related equipment provided in this application first retrieve the equipment's reservation work order and corresponding operation SOP file to construct a work order operation compliance benchmark that includes standard operation position, standard operation sequence, and at least one standard operation attribute; then, it acquires a time-series infrared thermal image containing the equipment operation area, detects and locates transient temperature imprints generated on the equipment surface by the operator's contact with equipment components, determines the operation position based on the equipment coordinate area where the temperature imprint is located, and records the operation time; next, it extracts the physical features of the transient temperature imprint in the time series to invert at least one operation attribute of the operation action; finally, it compares the actual operation information with the work order operation compliance benchmark, and generates a violation prompt if they are inconsistent.

[0082] This application identifies operational behavior by detecting transient temperature imprints generated when an operator touches equipment. These temperature imprints are objective physical traces left on the equipment surface by the operational actions, possessing the characteristics of being tamper-proof and traceable, and accurately reflecting the actual situation of the operation. By locating the position of the temperature imprint and recording the moment of its first appearance, the operation position and time can be accurately determined, achieving accurate judgment of the operation position and timing. The detection can be completed automatically without manual intervention, effectively improving detection efficiency and objectivity, and avoiding the problems of missed detections and false detections in manual detection. Simultaneously, this application extracts the physical characteristics of the transient temperature imprint over time, including temperature peak, heating rate, cooling rate, temperature distribution pattern, and duration. These characteristics have a clear mapping relationship with the physical behavior of the operational actions. Based on these characteristics, multiple quantitative operational attributes such as operation duration, pressure intensity, type of operating medium, and direction of operation can be derived, achieving a multi-dimensional and refined characterization of operational behavior, solving the problem that traditional detection methods cannot quantify the physical attributes of operations. Furthermore, this application adopts a non-contact detection method, which does not require the installation of any sensors on the equipment, will not affect the original structure and normal use of the equipment, and can cover the entire operating area of ​​the equipment, offering high flexibility. At the same time, this detection method is not affected by environmental factors such as lighting conditions and personnel obstruction, has stable detection accuracy, and only collects temperature information on the surface of the equipment, without involving the operator's personal privacy, effectively solving the problems of poor environmental adaptability and privacy leakage in existing technologies.

[0083] In some embodiments of this application, the extraction and inversion processes of several physical features and their corresponding operational attributes are described in detail. These four physical features correspond to the four core dimensions of operational behavior, enabling a comprehensive and accurate quantification of the physical characteristics of operational actions, providing a reliable data foundation for subsequent compliance comparisons.

[0084] First embodiment: Inversion operation time based on temperature decay curve characteristics:

[0085] The physical features include temperature decay curve features, and the operational attributes include operational duration. The process of extracting physical features and inverting operational attributes includes: starting from the frame where the transient temperature imprint first appears, extracting the temperature characterization values ​​of pixels within the temperature imprint region frame by frame to generate a time-based temperature decay curve. Extracting cooling feature parameters from the temperature decay curve, the cooling feature parameters include at least one of the following: peak temperature, cooling duration required to decay to a preset percentage of the peak temperature, and full width at half maximum (FWHM) of the curve. Matching the cooling feature parameters with a pre-built standard operational duration model library, which stores standard decay curve feature templates corresponding to different operational duration levels established through calibration. Based on the matching results, determining the operational duration level of this operation as one of the operational attributes obtained through inversion.

[0086] Specifically, when extracting temperature characterization values, the system can use the average temperature value of all pixels within the temperature imprint area as the temperature characterization value of that frame, or it can use the highest temperature value or weighted average temperature value within the area to improve the stability and representativeness of the temperature data. The generated time-temperature decay curve fully records the entire thermal evolution process of the transient temperature imprint from its generation, development to dissipation. Among them, the peak temperature corresponds to the moment when heat conduction is most sufficient during the operation; the cooling time required to decay to a preset proportion of the peak temperature reflects the rate of heat dissipation on the equipment surface; and the full width at half maximum (FWHM) of the curve comprehensively reflects the duration of the operation and the intensity of heat conduction. The construction process of the standard operation duration model library is as follows: Under the same equipment model, ambient temperature, and initial equipment temperature conditions as the actual detection, professional operators perform standard operations of different durations, collect corresponding transient temperature imprint data, extract the characteristic parameters of their temperature decay curves, establish a one-to-one correspondence between operation duration and cooling characteristic parameters, and form a standard template library containing multiple operation duration levels. In actual testing, the system calculates the similarity between the real-time extracted cooling feature parameters and each template in the standard template library, selecting the operation time level corresponding to the standard template with the highest similarity as the inversion result. This method utilizes the inherent laws of heat conduction to invert operation time, and is unaffected by the speed of the operator's movements or changes in perspective, exhibiting high accuracy and reliability.

[0087] Second embodiment: Inverting pressure intensity based on thermal diffusion area change characteristics:

[0088] The physical features include thermal diffusion area change characteristics, and the operational attributes include pressure intensity. The process of extracting physical features and inverting operational attributes includes: during the formation stage of the transient temperature imprint, continuously calculating the pixel area increment of the temperature imprint region between every two adjacent frames of infrared thermal images to obtain the expansion rate of the heat-affected zone area over time. Establishing a mapping relationship between contact pressure and the expansion rate of the heat-affected zone. Inputting the calculated expansion rate into the mapping relationship to obtain the pressure intensity level of this operation, which is used as one of the inverted operational attributes.

[0089] Specifically, the formation stage of transient temperature imprints refers to the time period from the first appearance of the temperature imprint to the point where its area reaches its maximum value. This stage mainly reflects the process of heat diffusion laterally to the equipment surface during operation. When calculating the area of ​​the temperature imprint region, the system uses a preset temperature threshold to determine the boundary of the temperature imprint; that is, pixel areas with temperatures higher than this threshold are identified as temperature imprint regions. The expansion rate of the heat-affected zone (HAZ) refers to the number of pixels added to the temperature imprint region per unit time. This rate is directly positively correlated with the pressure applied during operation. The mapping relationship between contact pressure and the expansion rate of the HAZ is established based on the fundamental principles of heat conduction and numerous calibration experiments: when the pressure increases, the actual contact area between the operator and the equipment surface increases, the contact thermal resistance decreases, the heat transferred per unit time increases, and the lateral diffusion rate of heat on the equipment surface accelerates, thus increasing the expansion rate of the HAZ. During the calibration stage, the system applies different levels of standard pressure, collects corresponding data on the change in heat diffusion area, plots the relationship curve between pressure and expansion rate, and establishes a mapping table. In actual testing, the system compares the calculated expansion rate with a mapping table to determine the corresponding pressure level. This method can effectively distinguish between different pressure levels and is of great significance for detecting violations caused by excessive or insufficient pressure.

[0090] Third embodiment: Inversion operation medium type based on thermal imprint edge sharpness characteristics:

[0091] The physical features include the edge sharpness feature of the thermal imprint, and the operational attributes include the type of operational medium. The process of extracting physical features and inverting operational attributes includes: in the frame where the transient temperature imprint reaches its peak area, extracting the boundary of the temperature imprint region, calculating the gradient magnitude of each pixel on the boundary, and statistically obtaining an edge sharpness index. Extracting a pixel temperature distribution uniformity index within the temperature imprint region, the uniformity index including pixel temperature standard deviation or texture entropy value. Inputting the edge sharpness index and the thermal distribution uniformity index into a pre-trained medium classifier, which is constructed by learning the different imprint morphology features produced by the differences in thermal conductivity of metal tools, bare skin, and insulating gloves. Using the medium classifier to identify the operational medium type of this operation, the operational medium type includes at least bare-hand operation and tool operation, as one of the operational attributes obtained through inversion.

[0092] Specifically, when extracting the boundaries of the temperature imprint region, the system can employ the Canny edge detection algorithm or the Sobel edge detection algorithm to accurately identify the edge contours of the temperature imprint. The gradient magnitude of each pixel on the boundary reflects the drastic temperature change at that point; the larger the gradient magnitude, the more drastic the temperature change and the sharper the edge. The edge sharpness index can be obtained by calculating the average or median of the gradient magnitudes of all boundary pixels. The pixel temperature standard deviation in the temperature distribution uniformity index reflects the degree of temperature dispersion within the temperature imprint region; the smaller the standard deviation, the more uniform the temperature distribution. The texture entropy value reflects the complexity of the temperature distribution; the smaller the entropy value, the more regular the temperature distribution. Different materials used as operating media, due to differences in thermal conductivity and contact characteristics, will form transient temperature imprints with distinctly different morphological characteristics on the equipment surface: metal tools, with their high thermal conductivity and tight, uniform contact with the equipment surface, produce temperature imprints with sharp, clear edges and uniform internal temperature distribution; bare skin, with its moderate thermal conductivity and relatively uniform contact area and pressure distribution, produces temperature imprints with relatively clear edges and relatively uniform internal temperature distribution; and insulating gloves, with their low thermal conductivity and relatively loose, uneven contact with the equipment surface, produce temperature imprints with blurred, smoothly transitioning edges and uneven internal temperature distribution. A media classifier, through feature extraction and training on a large number of temperature imprint samples from these three media, can accurately distinguish between different types of operating media. This method can effectively detect violations involving the use of incorrect operating media, which is crucial for ensuring safe equipment operation.

[0093] Fourth embodiment: Inverting the direction of the operation action based on the characteristics of the imprint centroid's movement trajectory:

[0094] The physical features include the centroid movement trajectory features, and the operational attributes include the direction of the operational action. The process of extracting physical features and inverting operational attributes includes: for transient temperature imprints corresponding to dynamic operating components, marking and tracking the centroid coordinates of the high-temperature region of the temperature imprint in the time-series infrared thermal image to generate a centroid movement trajectory. Calculating the cumulative curvature or tangent direction change of the centroid movement trajectory. When the cumulative curvature or tangent direction change exceeds a preset curvature threshold, the operational action direction is determined to be clockwise or counterclockwise rotation based on the curvature direction. When the cumulative curvature or tangent direction change does not exceed the preset curvature threshold, and the overall direction of the frame-by-frame displacement vector sequence of the centroid movement trajectory is unidirectional, the operational action direction is determined to be a straight-line movement. The determined operational action direction is used as one of the inverted operational attributes.

[0095] Specifically, the centroid coordinates of the high-temperature region of the temperature imprint are calculated using a weighted average method. This involves using the temperature value of each pixel as a weight to calculate the weighted average of the coordinates of all pixels within the temperature imprint region, thus obtaining the centroid coordinates of that frame's temperature imprint. By continuously tracking the centroid coordinates across multiple frames, the movement trajectory of the centroid over time can be generated. Cumulative curvature refers to the sum of the absolute values ​​of the curvature at each point on the centroid's movement trajectory, reflecting the overall degree of curvature of the trajectory. Tangential direction change refers to the sum of the angles between the centroid displacement vectors of two adjacent frames, also reflecting the degree of curvature of the trajectory. Preset curvature thresholds are set based on the operational characteristics of different types of dynamic operating components. For example, rotary operating components such as knobs and valves have a larger curvature in their centroid movement trajectory, while linear operating components such as switches and levers have a smaller curvature. When the cumulative curvature or tangential direction change exceeds the preset curvature threshold, the operation is determined to be a rotational action. The direction of rotation is then determined by calculating the sign of the trajectory's curvature: a positive curvature indicates clockwise rotation, and a negative curvature indicates counterclockwise rotation. When the cumulative curvature or tangent direction change does not exceed a preset curvature threshold, the frame-by-frame displacement vector sequence of the centroid movement trajectory is further analyzed. If the directions of all displacement vectors are basically consistent and the overall displacement direction is unidirectional, the operation is determined to be a linear flick, and the specific flicking direction, such as up / down flicking or left / right flicking, is determined based on the overall direction of the displacement vectors. This method can accurately identify the direction of the operation and plays an important role in detecting violations caused by incorrect operation direction.

[0096] In some embodiments of this application, considering that in practical applications, environmental temperature fluctuations, individual differences among operators, and temperature changes in different seasons can lead to significant differences in the operator's hand temperature, and that a fixed temperature segmentation threshold would seriously affect the accuracy and stability of transient temperature imprint detection, this application may also include a process of dynamically adjusting the temperature imprint segmentation threshold based on the operator's hand temperature.

[0097] Before detecting and locating the transient temperature imprint, the system further includes a preparatory stage where, in determining if an operator has entered the equipment operating area but has not made contact with the equipment, the system identifies the operator's hand area using infrared thermal imaging and collects the real-time surface temperature of the operator's hands. The system first identifies personnel entering the equipment operating area using a personnel detection algorithm, and then locates the operator's hand area using human posture estimation and contour analysis. During the time period when the operator's hands are not in contact with the equipment, multiple frames of infrared thermal images are continuously acquired, and the average surface temperature of the hand area is calculated as a real-time temperature reference for the operator's hands. Based on the real-time surface temperature of the hands, the threshold parameters used to segment the transient temperature imprint from the infrared thermal images are compensated and adjusted. The system dynamically calculates the optimal segmentation threshold under the current conditions based on a pre-established correspondence between hand temperature and temperature segmentation threshold. When the hand temperature is high, the segmentation threshold is appropriately increased to avoid misjudging the hand's own thermal radiation as a temperature imprint; when the hand temperature is low, the segmentation threshold is appropriately decreased to ensure accurate detection of weak temperature imprints. This dynamic threshold adjustment mechanism effectively eliminates the influence of ambient temperature and individual differences among operators on temperature imprint detection, significantly improving the robustness and accuracy of the detection.

[0098] In some embodiments of this application, considering the security risk of unauthorized personnel operating the equipment in practical applications, and the fact that traditional access control systems can only control personnel access permissions and cannot effectively prevent authorized personnel from being operated by other personnel after entering, this application may also include an operator authentication process based on infrared thermal images.

[0099] The system acquires thermal image information of personnel within the equipment area and personnel tag information within the designated area of ​​the equipment. Infrared thermal imaging devices deployed around the equipment collect thermal image information of personnel within the equipment area. Simultaneously, by interfacing with the enterprise's access control system, personnel positioning system, or facial recognition system, it obtains tag information for all personnel entering the designated area of ​​the equipment, including personnel name, employee ID, and job permissions. Based on the personnel thermal image information and personnel tag information, the system determines the equipment operator. By analyzing the human posture and movement trajectory in the personnel thermal images, the system identifies the personnel operating the equipment and then correlates and matches the personnel's thermal image features with the personnel tag information to determine the identity of the actual operator. If the equipment operator does not match the personnel information corresponding to the work order, a violation notification is generated. The system compares the identity information of the actual operator with the pre-specified authorized operator information in the work order. If the actual operator is not on the authorized personnel list or does not match the authorized personnel information, a violation notification is immediately generated, and the identity information and operation time of the violating personnel are recorded. This method enables real-time verification of operator identity, effectively preventing unauthorized personnel from operating the equipment and ensuring equipment operation safety.

[0100] In some embodiments of this application, considering that many equipment operation processes in practical applications have strict requirements on the time interval between adjacent operation steps, and that operation intervals that are too long or too short may affect the operation quality or even cause safety accidents, and that traditional detection methods can only detect the compliance of a single operation step and cannot effectively monitor the time interval between operation steps, this application may also include a compliance detection process for the duration of operation intervals.

[0101] The work order operation compliance benchmark also includes operation interval duration. The method further includes: if the actual operation interval between any two adjacent operation steps exceeds the operation interval duration set in the operation SOP file, an operation timeout violation prompt is generated. Specifically, when constructing the work order operation compliance benchmark, the system parses the standard operation interval duration between each adjacent operation step from the SOP file, including the minimum allowed interval duration and the maximum allowed interval duration. During actual operation, the system records the actual occurrence time of each operation step and then calculates the actual operation interval duration between two adjacent operation steps. The system compares the actual operation interval duration with the standard operation interval duration. If the actual interval duration is less than the minimum allowed interval duration, it indicates that the operation step is executed too quickly, possibly indicating non-standard operation; if the actual interval duration is greater than the maximum allowed interval duration, it indicates that the operation step is executed too slowly, possibly indicating operation interruption or delay. Once an actual operation interval duration exceeding the specified range is detected, the system will immediately generate an operation timeout violation prompt, which includes the adjacent operation step number that violated the rule, the actual interval duration, and the standard interval duration requirement. This method enables comprehensive monitoring of the entire operation process sequence, ensuring that the operation steps are executed in an orderly manner according to the prescribed rhythm, thereby improving the standardization and safety of the operation.

[0102] The following describes a device for testing equipment operation compliance provided in an embodiment of this application. The device for testing equipment operation compliance described below can be referred to in correspondence with the device operation compliance testing method described above.

[0103] See Figure 2 , Figure 2 This is a schematic diagram of a device for testing equipment operation compliance disclosed in an embodiment of this application.

[0104] like Figure 2 As shown, the equipment operation compliance testing device may include:

[0105] The standard construction module 110 is used to retrieve the equipment's reservation work order and the corresponding operation SOP file, and construct the work order operation compliance benchmark. The work order operation compliance benchmark includes at least the standard operation location, the standard operation sequence, and at least one standard operation attribute. The standard operation attribute includes at least one of the following: standard operation duration, standard pressing pressure, standard operation medium, and standard operation direction.

[0106] Image acquisition module 120 is used to acquire time-series infrared thermal images containing the operating area of ​​the device;

[0107] The imprint detection module 130 is used to detect and locate transient temperature imprints generated on the surface of the equipment by the operator's contact with the equipment components, determine the operator's operation position based on the equipment coordinate area where the temperature imprint is located, and record the moment when the temperature imprint first appears as the operation time.

[0108] The feature extraction module 140 is used to extract at least one physical feature of the transient temperature imprint on the time series, the physical feature being used to characterize the physical behavior information of the operation action;

[0109] The attribute inversion module 150 is used to invert at least one operation attribute of the operation action based on the extracted physical features. The operation attribute is a parameter that quantifies the physical behavior of the operation action. The operation attribute includes at least one of operation duration, pressure intensity, operation medium type and operation direction.

[0110] The compliance comparison module 160 is used to compare the operation location, operation time, and operation attributes obtained by inversion with the corresponding standard operation location, standard operation sequence, and standard operation attributes in the work order operation compliance benchmark. If the comparison results are inconsistent, a device operation violation prompt is generated.

[0111] As can be seen from the above technical solutions, the equipment operation compliance detection method and related equipment provided in this application first retrieve the equipment's reservation work order and corresponding operation SOP file to construct a work order operation compliance benchmark that includes standard operation position, standard operation sequence, and at least one standard operation attribute; then, it acquires a time-series infrared thermal image containing the equipment operation area, detects and locates transient temperature imprints generated on the equipment surface by the operator's contact with equipment components, determines the operation position based on the equipment coordinate area where the temperature imprint is located, and records the operation time; next, it extracts the physical features of the transient temperature imprint in the time series to invert at least one operation attribute of the operation action; finally, it compares the actual operation information with the work order operation compliance benchmark, and generates a violation prompt if they are inconsistent.

[0112] This application identifies operational behavior by detecting transient temperature imprints generated when an operator touches equipment. These temperature imprints are objective physical traces left on the equipment surface by the operational actions, possessing the characteristics of being tamper-proof and traceable, and accurately reflecting the actual situation of the operation. By locating the position of the temperature imprint and recording the moment of its first appearance, the operation position and time can be accurately determined, achieving accurate judgment of the operation position and timing. The detection can be completed automatically without manual intervention, effectively improving detection efficiency and objectivity, and avoiding the problems of missed detections and false detections in manual detection. Simultaneously, this application extracts the physical characteristics of the transient temperature imprint over time, including temperature peak, heating rate, cooling rate, temperature distribution pattern, and duration. These characteristics have a clear mapping relationship with the physical behavior of the operational actions. Based on these characteristics, multiple quantitative operational attributes such as operation duration, pressure intensity, type of operating medium, and direction of operation can be derived, achieving a multi-dimensional and refined characterization of operational behavior, solving the problem that traditional detection methods cannot quantify the physical attributes of operations. Furthermore, this application adopts a non-contact detection method, which does not require the installation of any sensors on the equipment, will not affect the original structure and normal use of the equipment, and can cover the entire operating area of ​​the equipment, offering high flexibility. At the same time, this detection method is not affected by environmental factors such as lighting conditions and personnel obstruction, has stable detection accuracy, and only collects temperature information on the surface of the equipment, without involving the operator's personal privacy, effectively solving the problems of poor environmental adaptability and privacy leakage in existing technologies.

[0113] The equipment operation compliance testing device provided in this application embodiment can be applied to equipment operation compliance testing equipment. Figure 3 The hardware structure block diagram of the equipment operation compliance testing equipment is shown. Figure 3 The hardware structure of the equipment operation compliance testing equipment may include: at least one processor 1, at least one communication interface 2, at least one memory 3, and at least one communication bus 4;

[0114] In this embodiment of the application, the number of processor 1, communication interface 2, memory 3, and communication bus 4 is at least one, and processor 1, communication interface 2, and memory 3 communicate with each other through communication bus 4;

[0115] Processor 1 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement embodiments of the present invention.

[0116] Memory 3 may include high-speed RAM, and may also include non-volatile memory, such as at least one disk storage device;

[0117] The memory stores a program, which the processor can call. The program is used for:

[0118] Retrieve the equipment's reservation work orders and corresponding operation SOP files, and construct work order operation compliance benchmarks. The work order operation compliance benchmarks shall at least include standard operation location, standard operation sequence, and at least one standard operation attribute. The standard operation attribute shall include at least one of the following: standard operation duration, standard pressing force, standard operation medium, and standard operation direction.

[0119] Acquire time-series infrared thermal images containing the operating area of ​​the equipment;

[0120] Detect and locate transient temperature imprints on the surface of the equipment caused by the operator's contact with the equipment components, determine the operator's operation position based on the equipment coordinate area where the temperature imprint is located, and record the moment when the temperature imprint first appears as the operation time;

[0121] Extract at least one physical feature from the transient temperature imprint on the time series, the physical feature being used to characterize the physical behavior information of the operation action;

[0122] Based on the extracted physical features, at least one operational attribute of the operation action is inverted. The operational attribute is a parameter that quantifies the physical behavior of the operation action. The operational attribute includes at least one of operation duration, pressure intensity, operation medium type, and operation direction.

[0123] The operation location, operation time, and operation attributes obtained by inversion are compared with the corresponding standard operation location, standard operation sequence, and standard operation attributes in the work order operation compliance benchmark. If the comparison results are inconsistent, a device operation violation prompt is generated.

[0124] Optionally, the refined and extended functions of the program can be referred to the above description.

[0125] This application embodiment also provides a readable storage medium that can store a program suitable for execution by a processor, the program being used for:

[0126] Retrieve the equipment's reservation work orders and corresponding operation SOP files, and construct work order operation compliance benchmarks. The work order operation compliance benchmarks shall at least include standard operation location, standard operation sequence, and at least one standard operation attribute. The standard operation attribute shall include at least one of the following: standard operation duration, standard pressing force, standard operation medium, and standard operation direction.

[0127] Acquire time-series infrared thermal images containing the operating area of ​​the equipment;

[0128] Detect and locate transient temperature imprints on the surface of the equipment caused by the operator's contact with the equipment components, determine the operator's operation position based on the equipment coordinate area where the temperature imprint is located, and record the moment when the temperature imprint first appears as the operation time;

[0129] Extract at least one physical feature from the transient temperature imprint on the time series, the physical feature being used to characterize the physical behavior information of the operation action;

[0130] Based on the extracted physical features, at least one operational attribute of the operation action is inverted. The operational attribute is a parameter that quantifies the physical behavior of the operation action. The operational attribute includes at least one of operation duration, pressure intensity, operation medium type, and operation direction.

[0131] The operation location, operation time, and operation attributes obtained by inversion are compared with the corresponding standard operation location, standard operation sequence, and standard operation attributes in the work order operation compliance benchmark. If the comparison results are inconsistent, a device operation violation prompt is generated.

[0132] Optionally, the refined and extended functions of the program can be referred to the above description.

[0133] This application also provides a computer program product, including a computer program, wherein the computer program is executed by a processor using the following method:

[0134] Retrieve the equipment's reservation work orders and corresponding operation SOP files, and construct work order operation compliance benchmarks. The work order operation compliance benchmarks shall at least include standard operation location, standard operation sequence, and at least one standard operation attribute. The standard operation attribute shall include at least one of the following: standard operation duration, standard pressing force, standard operation medium, and standard operation direction.

[0135] Acquire time-series infrared thermal images containing the operating area of ​​the equipment;

[0136] Detect and locate transient temperature imprints on the surface of the equipment caused by the operator's contact with the equipment components, determine the operator's operation position based on the equipment coordinate area where the temperature imprint is located, and record the moment when the temperature imprint first appears as the operation time;

[0137] Extract at least one physical feature from the transient temperature imprint on the time series, the physical feature being used to characterize the physical behavior information of the operation action;

[0138] Based on the extracted physical features, at least one operational attribute of the operation action is inverted. The operational attribute is a parameter that quantifies the physical behavior of the operation action. The operational attribute includes at least one of operation duration, pressure intensity, operation medium type, and operation direction.

[0139] The operation location, operation time, and operation attributes obtained by inversion are compared with the corresponding standard operation location, standard operation sequence, and standard operation attributes in the work order operation compliance benchmark. If the comparison results are inconsistent, a device operation violation prompt is generated.

[0140] Optionally, the refined and extended functions of the program can be referred to the above description.

[0141] Finally, it should be noted that in this document, relational terms such as "first" and "second" are used only to distinguish one entity or operation from another, and do not necessarily require or imply any such actual relationship or order between these entities or operations. Furthermore, the terms "comprising," "including," or any other variations thereof are intended to cover non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements includes not only those elements but also other elements not expressly listed, or elements inherent to such a process, method, article, or apparatus. Without further limitations, an element defined by the phrase "comprising one..." does not exclude the presence of other identical elements in the process, method, article, or apparatus that includes said element.

[0142] The various embodiments in this specification are described in a progressive manner, with each embodiment focusing on the differences from other embodiments. The same or similar parts between the various embodiments can be referred to each other.

[0143] The above description of the disclosed embodiments enables those skilled in the art to make or use this application. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of this application. Therefore, this application is not to be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims

1. A method for testing equipment operation compliance, characterized in that, include: Retrieve the equipment's reservation work orders and corresponding operation SOP files, and construct work order operation compliance benchmarks. The work order operation compliance benchmarks shall at least include standard operation location, standard operation sequence, and at least one standard operation attribute. The standard operation attribute shall include at least one of the following: standard operation duration, standard pressing force, standard operation medium, and standard operation direction. Acquire time-series infrared thermal images containing the operating area of ​​the equipment; Detect and locate transient temperature imprints on the surface of the equipment caused by the operator's contact with the equipment components, determine the operator's operation position based on the equipment coordinate area where the temperature imprint is located, and record the moment when the temperature imprint first appears as the operation time; Extract at least one physical feature from the transient temperature imprint on the time series, the physical feature being used to characterize the physical behavior information of the operation action; Based on the extracted physical features, at least one operational attribute of the operation action is inverted. The operational attribute is a parameter that quantifies the physical behavior of the operation action. The operational attribute includes at least one of operation duration, pressure intensity, operation medium type, and operation direction. The operation location, operation time, and operation attributes obtained by inversion are compared with the corresponding standard operation location, standard operation sequence, and standard operation attributes in the work order operation compliance benchmark. If the comparison results are inconsistent, a device operation violation prompt is generated. The physical features include thermal diffusion area variation characteristics, and the operational attributes include pressure intensity. The process of extracting physical features and inverting operational attributes includes: During the formation stage of the transient temperature imprint, the pixel area increment of the temperature imprint region between each two adjacent frames of infrared thermal images is continuously calculated to obtain the expansion rate of the heat-affected zone area over time. Establish a mapping relationship between contact pressure and the rate of thermally affected area expansion; The calculated expansion rate is input into the mapping relationship to obtain the pressing force level of this operation, which is used as one of the operational attributes obtained by inversion; The physical features include the imprinted centroid movement trajectory features, and the operational attributes include the direction of the operational action. The process of extracting physical features and inverting operational attributes includes: For transient temperature imprints corresponding to dynamically operating components, the centroid coordinates of the high-temperature region of the temperature imprint in the time-series infrared thermal image are marked and tracked to generate a centroid movement trajectory. Calculate the cumulative curvature or tangential change of the centroid's trajectory; When the cumulative curvature or tangent direction change exceeds the preset curvature threshold, the direction of the operation is determined to be clockwise or counterclockwise rotation based on the curvature direction. When the cumulative curvature or tangent direction change does not exceed the preset curvature threshold, and the overall direction of the frame-by-frame displacement vector sequence of the centroid movement trajectory is unidirectional, the operation action direction is determined to be a straight-line flick. The direction of the determined operation action is used as one of the operation attributes obtained through inversion.

2. The method according to claim 1, characterized in that, The physical characteristics include temperature decay curve characteristics, and the operational attributes include operation duration; The process of extracting physical features and inverting operational attributes includes: Starting from the frame in which the transient temperature imprint first appears, the temperature characterization values ​​of the pixels in the temperature imprint area are extracted frame by frame to generate a time-temperature decay curve. Extract the cooling characteristic parameters of the temperature decay curve, wherein the cooling characteristic parameters include at least one of the following: peak temperature, cooling time required to decay to a preset proportion of peak temperature, and full width at half maximum (FWHM) of the curve. The cooling characteristic parameters are matched with a pre-built standard operation duration model library, which stores standard decay curve feature templates corresponding to different operation duration levels established through calibration. Based on the matching results, the duration level of this operation is determined and used as one of the operation attributes obtained through inversion.

3. The method according to claim 1, characterized in that, The physical features include the edge sharpness of the thermal imprint, and the operational attributes include the type of operational medium. The process of extracting physical features and inverting operational attributes includes: In the frame where the transient temperature imprint reaches its peak area, the boundary of the temperature imprint region is extracted, the gradient magnitude of each pixel on the boundary is calculated, and the edge sharpness index is statistically obtained. Extract the heat distribution uniformity index within the temperature imprint region, wherein the heat distribution uniformity index includes the pixel temperature standard deviation or texture entropy value; The edge sharpness index and the heat distribution uniformity index are input into a pre-trained medium classifier, which is constructed by learning the different imprint morphology features produced by the differences in thermal conductivity of metal tools, bare skin, and insulating gloves. The media classifier is used to identify the type of operation medium for this operation. The type of operation medium includes at least manual operation and tool operation, which is one of the operation attributes obtained by inversion.

4. The method according to claim 1, characterized in that, Before detecting and locating the transient temperature imprint, the method further includes: In the preparatory stage of determining that the operator has entered the equipment operation area but has not made contact with the equipment, the operator's hand area is identified by infrared thermal imaging, and the real-time body surface temperature of the operator's hands is collected. The threshold parameters used to segment transient temperature imprints from infrared thermal images are adjusted based on the real-time surface temperature of the hand.

5. The method according to claim 1, characterized in that, Also includes: Acquire thermal image information of personnel within the equipment area and personnel tag information within the equipment's designated area; The equipment operator is determined based on the personnel thermal image information and personnel tag information; If the equipment operator's information does not match the personnel information corresponding to the appointment work order, a violation operation prompt will be generated.

6. The method according to claim 1, characterized in that, The compliance criteria for work order operations also include the operation interval duration, and the method further includes: If the actual operation interval between any two adjacent operation steps exceeds the operation interval duration set in the operation SOP file, an operation timeout violation prompt will be generated.

7. A device for detecting compliance in equipment operation, characterized in that, include: The standard construction module is used to retrieve the equipment's reservation work order and the corresponding operation SOP file, and construct the work order operation compliance benchmark. The work order operation compliance benchmark includes at least the standard operation location, standard operation sequence, and at least one standard operation attribute. The standard operation attribute includes at least one of the following: standard operation duration, standard pressing force, standard operation medium, and standard operation direction. The image acquisition module is used to acquire time-series infrared thermal images containing the operating area of ​​the device; The imprint detection module is used to detect and locate transient temperature imprints generated on the surface of the equipment by the operator's contact with the equipment components, determine the operator's operation position based on the equipment coordinate area where the temperature imprint is located, and record the moment when the temperature imprint first appears as the operation time. The feature extraction module is used to extract at least one physical feature of the transient temperature imprint on the time series, and the physical feature is used to characterize the physical behavior information of the operation action; The attribute inversion module is used to invert at least one operational attribute of the operation action based on the extracted physical features. The operational attribute is a parameter that quantifies the physical behavior of the operation action. The operational attribute includes at least one of operation duration, pressure intensity, operation medium type, and operation direction. The compliance comparison module is used to compare the operation location, operation time, and the operation attributes obtained by inversion with the standard operation location, standard operation sequence, and standard operation attributes corresponding to the work order operation compliance benchmark. If the comparison results are inconsistent, a device operation violation prompt will be generated. The physical features include thermal diffusion area variation characteristics, and the operational attributes include pressure intensity. The process of extracting physical features and inverting operational attributes includes: During the formation stage of the transient temperature imprint, the pixel area increment of the temperature imprint region between each two adjacent frames of infrared thermal images is continuously calculated to obtain the expansion rate of the heat-affected zone area over time. Establish a mapping relationship between contact pressure and the rate of thermally affected area expansion; The calculated expansion rate is input into the mapping relationship to obtain the pressing force level of this operation, which is used as one of the operational attributes obtained by inversion; The physical features include the imprinted centroid movement trajectory features, and the operational attributes include the direction of the operational action. The process of extracting physical features and inverting operational attributes includes: For transient temperature imprints corresponding to dynamically operating components, the centroid coordinates of the high-temperature region of the temperature imprint in the time-series infrared thermal image are marked and tracked to generate a centroid movement trajectory. Calculate the cumulative curvature or tangential change of the centroid's trajectory; When the cumulative curvature or tangent direction change exceeds the preset curvature threshold, the direction of the operation is determined to be clockwise or counterclockwise rotation based on the curvature direction. When the cumulative curvature or tangent direction change does not exceed the preset curvature threshold, and the overall direction of the frame-by-frame displacement vector sequence of the centroid movement trajectory is unidirectional, the operation action direction is determined to be a straight-line flick. The direction of the determined operation action is used as one of the operation attributes obtained through inversion.

8. A device for testing compliance in equipment operation, characterized in that, Including memory and processor; The memory is used to store programs; The processor is used to execute the program to implement each step of the device operation compliance detection method as described in any one of claims 1-6.

9. A readable storage medium having a computer program stored thereon, characterized in that, When the computer program is executed by the processor, it implements each step of the device operation compliance detection method as described in any one of claims 1-6.

10. A computer program product, comprising a computer program, characterized in that, The computer program is executed by the processor to perform each step of the device operation compliance detection method as described in any one of claims 1-6.

Images