Equipment standardization verification method and system based on visual analysis

Abstract

The present invention is applicable to the technical field of equipment standardization verification, and provides an equipment standardization verification method and system based on visual analysis. The present invention receives an equipment verification request, determines the equipment to be verified, and obtains production process information; performs activity intrusion analysis, determines the viewing angle verification structure and multiple passive verification structures; performs real-time binocular verification monitoring and shooting of manual operation; spatial coordinate recognition, records activity coordinate data; calculates the frequency of abnormal intrusions between the viewing angle verification structure and multiple passive verification structures and manual operation, and determines whether the standardized verification has passed. In the product trial production stage, it is possible to perform activity intrusion analysis and real-time binocular verification monitoring and shooting on the equipment to be verified participating in the trial production, record activity coordinate data, calculate the frequency of abnormal intrusions, and determine whether the standardized verification has passed, thereby performing comprehensive operational safety standardized verification on the equipment participating in the trial production, and effectively avoiding the safety risks that exist when the equipment is manually operated.

Description

Technical Field

[0001] The present invention belongs to the technical field of equipment standardization verification, and in particular relates to an equipment standardization verification method and system based on visual analysis. Background Art

[0002] Equipment standardization verification is a standardized inspection and verification of all aspects of equipment design, manufacturing, use and maintenance to ensure that the equipment complies with relevant technical standards, quality standards, usage requirements and safety standards. It improves the reliability, interoperability, compatibility and maintainability of equipment through standardized means, thereby improving the overall performance of the equipment and ensuring combat effectiveness.

[0003] In the prior art, standardized verification of equipment focuses on performance evaluation of the equipment to ensure that the equipment can quickly and accurately complete preset functions. However, for equipment that requires manual operation, only some basic safety settings are performed, and no comprehensive operational safety standardization verification is performed on the equipment involved in the trial production during the product trial production phase. Therefore, although the performance of the equipment has been verified, there are still certain safety risks when manually operating the equipment during the actual production process. Summary of the invention

[0004] The purpose of the embodiments of the present invention is to provide a method and system for equipment standardization verification based on visual analysis, aiming to solve the technical problems existing in the prior art mentioned in the background technology.

[0005] The embodiment of the present invention is implemented as follows:

[0006] The equipment standardization verification method based on visual analysis specifically comprises the following steps:

[0007] Receive an equipment verification request, determine the equipment to be verified, and obtain production process information, and extract relevant process information from the production process information according to the equipment to be verified;

[0008] Acquire a three-dimensional model of the equipment, perform active intrusion analysis based on the relevant process information, and determine a perspective verification structure and multiple passive verification structures;

[0009] During process verification production, the visual angle verification structure is verified, and real-time binocular verification monitoring and shooting of manual operation is performed to obtain binocular shooting data;

[0010] Constructing a fixed coordinate system and a movable coordinate system, performing spatial coordinate recognition on the binocular shooting data, and recording movable coordinate data;

[0011] According to the activity coordinate data, the frequency of abnormal intrusion between the viewing angle verification structure and multiple passive verification structures and manual operation is calculated to determine whether the standardized verification is passed.

[0012] As a further limitation of the technical solution of the embodiment of the present invention, the receiving of the equipment verification request, determining the equipment to be verified, and obtaining the production process information, and extracting the relevant process information from the production process information according to the equipment to be verified specifically comprises the following steps:

[0013] receiving a device verification request;

[0014] Identify the equipment verification request and determine the equipment to be verified and the trial-produced verification product;

[0015] Matching production process information based on the trial production verification product;

[0016] According to the equipment to be verified, relevant process information is extracted from the production process information.

[0017] As a further limitation of the technical solution of the embodiment of the present invention, the obtaining of the equipment three-dimensional model, performing active intrusion analysis based on the relevant process information, and determining the perspective verification structure and the plurality of passive verification structures specifically include the following steps:

[0018] Obtaining the internal equipment number of the equipment to be verified;

[0019] According to the internal equipment number, matching the equipment 3D model of the equipment to be verified from a preset 3D model database;

[0020] Determine the processing station area of ​​the equipment to be verified;

[0021] Based on the relevant process information, an activity structure analysis is performed on the three-dimensional model of the equipment to determine an activity verification structure in which multiple activities invade the processing station area;

[0022] A perspective verification structure and a plurality of passive verification structures are selected from the plurality of active verification structures.

[0023] As a further limitation of the technical solution of the embodiment of the present invention, during the process verification production, in the viewing angle verification structure, the manual operation is followed by real-time binocular verification monitoring shooting, and obtaining binocular shooting data specifically includes the following steps:

[0024] During process validation production, determine the follow-up monitoring period;

[0025] Generating a follow-up monitoring signal according to the follow-up monitoring period;

[0026] According to the follow-up monitoring signal, in the viewing angle verification structure, the manual operation is followed by real-time binocular verification monitoring shooting to obtain binocular shooting data.

[0027] As a further limitation of the technical solution of the embodiment of the present invention, the construction of the fixed coordinate system and the movable coordinate system, the spatial coordinate recognition of the binocular shooting data, and the recording of the movable coordinate data specifically include the following steps:

[0028] Based on the three-dimensional model of the equipment, a fixed coordinate origin is selected;

[0029] Constructing a fixed coordinate system according to the fixed coordinate origin;

[0030] In the perspective verification structure, select the active coordinate origin;

[0031] Constructing an active coordinate system according to the active coordinate origin;

[0032] Perform spatial coordinate recognition on the binocular shooting data and record activity coordinate data.

[0033] As a further limitation of the technical solution of the embodiment of the present invention, the performing of spatial coordinate recognition on the binocular shooting data and recording of activity coordinate data specifically comprises the following steps:

[0034] Based on the active coordinate system, the spatial coordinate recognition is performed on the binocular shooting data, and the basic coordinate data of the manual operation is recorded;

[0035] According to the fixed coordinate system, the operation basic coordinate data is transformed to obtain operation transformation coordinate data;

[0036] Based on the fixed coordinate system, acquiring structural coordinate data of the viewing angle verification structure and the plurality of passive verification structures;

[0037] The operation conversion coordinate data and the structure coordinate data are integrated to record the activity coordinate data.

[0038] As a further limitation of the technical solution of the embodiment of the present invention, the calculation of the abnormal intrusion frequency between the view verification structure and the multiple passive verification structures and the manual operation according to the active coordinate data, and the determination of whether the standardized verification is passed specifically include the following steps:

[0039] Calculating multiple real-time relative distances between the viewpoint verification structure and multiple passive verification structures and the manual operation according to the active coordinate data;

[0040] Plan standardized validation cycles based on the relevant process information;

[0041] Compare the multiple real-time relative distances with the preset safety relative distances, and record the frequency of abnormal intrusions in the standardized verification cycle;

[0042] Comparing the abnormal intrusion frequency with a preset standard intrusion frequency;

[0043] If the abnormal intrusion frequency is less than the standard intrusion frequency, the standardized verification is passed;

[0044] If the abnormal intrusion frequency is not less than the standard intrusion frequency, the standardized verification fails.

[0045] The equipment standardization verification system based on visual analysis includes a verification request processing module, an activity intrusion analysis module, a follow-up monitoring and shooting module, a spatial coordinate recognition module and a standard verification judgment module, wherein:

[0046] A verification request processing module, used to receive equipment verification requests, determine the equipment to be verified, and obtain production process information, and extract relevant process information from the production process information according to the equipment to be verified;

[0047] An active intrusion analysis module, used to obtain a three-dimensional model of the equipment, perform active intrusion analysis based on the relevant process information, and determine a viewpoint verification structure and a plurality of passive verification structures;

[0048] A follow-up monitoring and shooting module is used to perform follow-up real-time binocular verification monitoring and shooting of manual operation in the visual angle verification structure during process verification production to obtain binocular shooting data;

[0049] A spatial coordinate recognition module is used to construct a fixed coordinate system and a movable coordinate system, perform spatial coordinate recognition on the binocular shooting data, and record movable coordinate data;

[0050] The standard verification judgment module is used to calculate the abnormal intrusion frequency between the viewing angle verification structure and multiple passive verification structures and manual operation according to the active coordinate data, and judge whether the standardized verification is passed.

[0051] As a further limitation of the technical solution of the embodiment of the present invention, the activity intrusion analysis module specifically includes:

[0052] A number obtaining unit, used to obtain the internal equipment number of the equipment to be verified;

[0053] A model matching unit, used to match the equipment three-dimensional model of the equipment to be verified from a preset three-dimensional model database according to the internal equipment number;

[0054] An area determination unit, used to determine a processing station area of ​​the equipment to be verified;

[0055] A structural analysis unit, configured to perform an activity structural analysis on the three-dimensional model of the equipment based on the relevant process information, and determine an activity verification structure in which multiple activities invade the processing station area;

[0056] The structure selection unit is used to select a perspective verification structure and a plurality of passive verification structures from the plurality of active verification structures.

[0057] As a further limitation of the technical solution of the embodiment of the present invention, the spatial coordinate recognition module specifically includes:

[0058] A fixed origin selection unit, used for selecting a fixed coordinate origin based on the equipment three-dimensional model;

[0059] A fixed coordinate system construction unit, used to construct a fixed coordinate system according to the fixed coordinate origin;

[0060] An active origin selection unit, used for selecting an active coordinate origin in the viewing angle verification structure;

[0061] An active coordinate system construction unit, used to construct an active coordinate system according to the active coordinate origin;

[0062] The spatial coordinate recognition unit is used to perform spatial coordinate recognition on the binocular shooting data and record activity coordinate data.

[0063] Compared with the prior art, the present invention has the following beneficial effects:

[0064] The embodiment of the present invention receives an equipment verification request, determines the equipment to be verified, obtains production process information; performs activity intrusion analysis, determines the viewing angle verification structure and multiple passive verification structures; performs real-time binocular verification monitoring and shooting of manual operation; spatial coordinate recognition, records activity coordinate data; calculates the frequency of abnormal intrusions between the viewing angle verification structure and multiple passive verification structures and manual operation, and determines whether the standardized verification has passed. During the product trial production stage, it is possible to perform activity intrusion analysis and real-time binocular verification monitoring and shooting on the equipment to be verified participating in the trial production, record activity coordinate data, calculate the frequency of abnormal intrusions, and determine whether the standardized verification has passed, thereby performing comprehensive operational safety standardized verification on the equipment participating in the trial production, effectively avoiding the safety risks that exist when manually operating the equipment. BRIEF DESCRIPTION OF THE DRAWINGS

[0065] Figure 1 A flowchart of an equipment standardization verification method based on visual analysis provided by an embodiment of the present invention is shown;

[0066] Figure 2 A flowchart of receiving and processing an equipment verification request in a method provided by an embodiment of the present invention is shown;

[0067] Figure 3 A flowchart of performing activity intrusion analysis in a method provided by an embodiment of the present invention is shown;

[0068] Figure 4A flowchart of binocular verification monitoring shooting in the method provided by an embodiment of the present invention is shown;

[0069] Figure 5 A flowchart of spatial coordinate recognition in a method provided by an embodiment of the present invention is shown;

[0070] Figure 6 A flow chart of recording activity coordinate data in a method provided by an embodiment of the present invention is shown;

[0071] Figure 7 A flowchart of determining whether verification is passed in the method provided by an embodiment of the present invention is shown;

[0072] Figure 8 An application architecture diagram of an equipment standardization verification system based on visual analysis provided by an embodiment of the present invention is shown;

[0073] Fig. 9 A structural block diagram of an active intrusion analysis module in a system provided by an embodiment of the present invention is shown;

[0074] Fig.10 The structure block diagram of the space coordinate recognition module in the system provided by the embodiment of the present invention is shown. DETAILED DESCRIPTION

[0075] In order to make the purpose, technical solution and advantages of the present invention more clearly understood, the present invention is further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are only used to explain the present invention and are not intended to limit the present invention.

[0076] It is understandable that in the prior art, standardized verification of equipment focuses on performance evaluation of equipment to ensure that the equipment can quickly and accurately complete preset functions. However, for equipment that requires manual operation, only some basic safety settings are performed, and no comprehensive operational safety standardization verification is performed on the equipment involved in the trial production during the product trial production phase. Therefore, although the performance of the equipment has been verified, there are still certain safety risks when manually operating the equipment during the actual production process.

[0077] To solve the above problems, the equipment standardization verification method and system based on visualization analysis disclosed in the embodiment of the present invention, by receiving the equipment verification request, determine the equipment to be verified, and obtain the production process information, extract the relevant process information from the production process information according to the equipment to be verified; obtain the equipment three-dimensional model, perform activity intrusion analysis based on the relevant process information, determine the view verification structure and multiple passive verification structures; during the process verification production, in the view verification structure, perform real-time binocular verification monitoring shooting of the manual operation, and obtain binocular shooting data; construct a fixed coordinate system and an active coordinate system, perform spatial coordinate recognition on the binocular shooting data, and record the active coordinate data; according to the active coordinate data, calculate the abnormal intrusion frequency between the view verification structure and multiple passive verification structures and the manual operation, and judge whether the standardized verification is passed. In the product trial production stage, it is possible to perform activity intrusion analysis and real-time binocular verification monitoring shooting on the equipment to be verified participating in the trial production, record the active coordinate data, calculate the abnormal intrusion frequency, and judge whether the standardized verification is passed, so as to conduct comprehensive operation safety standardized verification on the equipment participating in the trial production, and effectively avoid the safety risks existing when the equipment is operated manually.

[0078] Specifically, Figure 1 A flow chart of an equipment standardization verification method based on visual analysis provided by an embodiment of the present invention is shown.

[0079] In a preferred embodiment of the present invention, a method for verifying equipment standardization based on visual analysis specifically comprises the following steps:

[0080] Step S101: receiving an equipment verification request, determining the equipment to be verified, and obtaining production process information, and extracting relevant process information from the production process information according to the equipment to be verified.

[0081] In an embodiment of the present invention, during the product trial production process, if there is a requirement for standardized verification of equipment, the trial production management personnel can upload an equipment verification request, receive the uploaded equipment verification request, identify the equipment verification request, determine the trial production verification product and the equipment to be verified, match the production process information corresponding to the trial production verification product, and then match and extract relevant process information from the production process information based on the corresponding process of the equipment to be verified during trial production of the trial production verification product.

[0082] It can be understood that the production process information is the process information related to all processes during the trial production and processing of the trial production and verification product; the relevant process information is the part of the production process information that is only related to the equipment to be verified.

[0083] Specifically, Figure 2 A flowchart of receiving and processing an equipment verification request in the method provided by an embodiment of the present invention is shown.

[0084] Among them, in another preferred embodiment provided by the present invention, the receiving equipment verification request, determining the equipment to be verified, and obtaining production process information, and extracting relevant process information from the production process information according to the equipment to be verified specifically include the following steps:

[0085] Step S1011: receiving a device verification request.

[0086] Step S1012: Identify the equipment verification request and determine the equipment to be verified and the trial-produced verification product.

[0087] Step S1013: Match the production process information according to the trial production and verification product.

[0088] Step S1014: extract relevant process information from the production process information according to the equipment to be verified.

[0089] Furthermore, the equipment standardization verification method based on visual analysis also includes the following steps:

[0090] Step S102: Acquire a three-dimensional model of the equipment, perform active intrusion analysis based on the relevant process information, and determine a perspective verification structure and multiple passive verification structures.

[0091] In an embodiment of the present invention, by obtaining the internal equipment number of the equipment to be verified, and then matching the equipment three-dimensional model of the equipment to be verified from a preset three-dimensional model database according to the internal equipment number, and downloading the equipment three-dimensional model of the equipment to be verified, the processing station area in the equipment to be verified is determined by analyzing the equipment three-dimensional model, and then based on relevant process information, the equipment three-dimensional model is analyzed for activity structure, and it is determined that when the equipment to be verified performs production activities according to the relevant process information, multiple activity verification structures will invade the processing station area, and from the multiple activity verification structures, one is selected as a perspective verification structure, and the others are passive verification structures, thereby obtaining a perspective verification structure and multiple passive verification structures.

[0092] It can be understood that the active verification structure is a structure that will invade the processing station area when the equipment to be verified is in accordance with relevant process information during the trial production of the trial-verified product. For example, when the equipment to be verified is "screw locking equipment", the processing station area is the "product picking and placing workbench", and multiple active verification structures are "screw suction and placement end" and "screw driving end".

[0093] Specifically, Figure 3 A flow chart of performing activity intrusion analysis in the method provided by an embodiment of the present invention is shown.

[0094] Among them, in another preferred embodiment provided by the present invention, the obtaining of the equipment three-dimensional model, performing active intrusion analysis based on the relevant process information, and determining the viewing angle verification structure and the plurality of passive verification structures specifically include the following steps:

[0095] Step S1021: Obtain the internal equipment number of the equipment to be verified.

[0096] Step S1022: Match the equipment 3D model of the equipment to be verified from a preset 3D model database according to the internal equipment number.

[0097] Step S1023: determine the processing station area of ​​the equipment to be verified.

[0098] Step S1024: Based on the relevant process information, an activity structure analysis is performed on the three-dimensional model of the equipment to determine an activity verification structure in which multiple activities invade the processing station area.

[0099] Step S1025: Select a perspective verification structure and multiple passive verification structures from the multiple active verification structures.

[0100] Furthermore, the equipment standardization verification method based on visual analysis also includes the following steps:

[0101] Step S103: During process verification production, at the viewing angle verification structure, a real-time binocular verification monitoring shooting is performed to follow the manual operation to obtain binocular shooting data.

[0102] In an embodiment of the present invention, a binocular camera is installed on a viewing angle verification structure to determine a follow-up monitoring period during process verification production, and a follow-up monitoring signal is generated according to the follow-up monitoring period. Then, based on the follow-up monitoring signal, a real-time binocular verification monitoring and shooting of manual operation is performed on the viewing angle verification structure to obtain binocular shooting data.

[0103] It can be understood that the follow-up monitoring period is the working period of the equipment to be verified.

[0104] Specifically, Figure 4 A flow chart of binocular verification monitoring shooting in the method provided by an embodiment of the present invention is shown.

[0105] Among them, in another preferred embodiment provided by the present invention, during the process verification production, in the viewing angle verification structure, the manual operation is followed by real-time binocular verification monitoring shooting, and obtaining binocular shooting data specifically includes the following steps:

[0106] Step S1031: during process verification production, determine the follow-up monitoring period.

[0107] Step S1032: Generate a follow-up monitoring signal according to the follow-up monitoring period.

[0108] Step S1033: According to the follow-up monitoring signal, in the viewing angle verification structure, a follow-up real-time binocular verification monitoring shooting is performed on the manual operation to obtain binocular shooting data.

[0109] Furthermore, the equipment standardization verification method based on visual analysis also includes the following steps:

[0110] Step S104: construct a fixed coordinate system and a movable coordinate system, perform spatial coordinate recognition on the binocular shooting data, and record the movable coordinate data.

[0111] In an embodiment of the present invention, on the three-dimensional model of the equipment, a fixed coordinate origin is selected, and the x-axis, y-axis and z-axis are determined to construct a fixed coordinate system, and on the perspective verification structure, an active coordinate origin is selected, and the x-axis, y-axis and z-axis are determined to construct an active coordinate system, and then based on the active coordinate system, spatial coordinate recognition is performed on the binocular shooting data, and the basic operation coordinate data of the manual operation is recorded, and the real-time coordinate position of the perspective verification structure in the fixed coordinate system during the follow-up monitoring period is recorded, and then in the fixed coordinate system, according to the real-time coordinate position of the perspective verification structure, the basic operation coordinate data is coordinate transformed to obtain the operation transformation coordinate data in the fixed coordinate system, and the structural coordinate data of the perspective verification structure and multiple passive verification structures in the fixed coordinate system during the follow-up monitoring period are obtained, and the active coordinate data is obtained by comprehensively arranging the operation transformation coordinate data and the structural coordinate data.

[0112] It can be understood that the basic operation coordinate data records the spatial coordinate data of the operator's hands and head in the active coordinate system when the operation is performed manually.

[0113] It can be understood that the real-time coordinate position is part of the coordinate data in the structural coordinate data.

[0114] Specifically, Figure 5 A flow chart of spatial coordinate recognition in the method provided by an embodiment of the present invention is shown.

[0115] Among them, in another preferred embodiment provided by the present invention, the construction of a fixed coordinate system and a movable coordinate system, the spatial coordinate recognition of the binocular shooting data, and the recording of the movable coordinate data specifically include the following steps:

[0116] Step S1041: Select a fixed coordinate origin based on the equipment three-dimensional model.

[0117] Step S1042: construct a fixed coordinate system according to the fixed coordinate origin.

[0118] Step S1043: In the viewing angle verification structure, select an active coordinate origin.

[0119] Step S1044: construct an active coordinate system according to the active coordinate origin.

[0120] Step S1045: perform spatial coordinate recognition on the binocular shooting data and record activity coordinate data.

[0121] Specifically, Figure 6 A flow chart of recording activity coordinate data in the method provided by an embodiment of the present invention is shown.

[0122] In another preferred embodiment of the present invention, the performing of spatial coordinate recognition on the binocular shooting data and recording of activity coordinate data specifically comprises the following steps:

[0123] Step S10451: Based on the active coordinate system, perform spatial coordinate recognition on the binocular shooting data, and record basic coordinate data of manual operation.

[0124] Step S10452: transform the operation basic coordinate data according to the fixed coordinate system to obtain operation transformation coordinate data.

[0125] Step S10453: Based on the fixed coordinate system, obtain the structural coordinate data of the viewing angle verification structure and the plurality of passive verification structures.

[0126] Step S10454: Integrate the operation conversion coordinate data and the structure coordinate data to record the activity coordinate data.

[0127] Furthermore, the equipment standardization verification method based on visual analysis also includes the following steps:

[0128] Step S105: Calculate the abnormal intrusion frequency between the viewing angle verification structure and multiple passive verification structures and the manual operation according to the activity coordinate data, and determine whether the standardized verification is passed.

[0129] In an embodiment of the present invention, by analyzing the active coordinate data, multiple real-time relative distances between the viewing angle verification structure and multiple passive verification structures and manual operations are recorded, and according to relevant process information, a standardized verification cycle is planned, and according to the time corresponding to the multiple real-time relative distances, multiple verification relative distances within the standardized verification cycle are screened from the multiple real-time relative distances, and then the multiple verification relative distances are compared with the preset safety relative distances, and the abnormal intrusion frequency in the standardized verification cycle is recorded, and then the abnormal intrusion frequency is compared with the preset standard intrusion frequency to determine whether the standardized verification is passed. Specifically, when the abnormal intrusion frequency is less than the standard intrusion frequency, the standardized verification is determined to be passed; when the abnormal intrusion frequency is not less than the standard intrusion frequency, the standardized verification is determined to be failed.

[0130] It is understandable that the standardized verification cycle consists of 1-5 process cycles corresponding to relevant process information, ensuring that the monitoring time is reasonable, which can not only achieve effective monitoring and verification, but also avoid long-term monitoring to generate a large amount of data, which will lead to cumbersome and complicated verification.

[0131] It can be understood that the multiple real-time relative distances are the shortest distances between the perspective verification structure and the multiple passive verification structures and the manual operation at different times.

[0132] It can be understood that, among multiple verification relative distances, the number of verification relative distances that are smaller than the safety relative distance is the value of the abnormal intrusion frequency.

[0133] Specifically, Figure 7 A flow chart for determining whether verification is passed in the method provided by an embodiment of the present invention is shown.

[0134] Among them, in another preferred embodiment provided by the present invention, the calculation of the abnormal intrusion frequency between the viewing angle verification structure and the plurality of passive verification structures and the manual operation according to the active coordinate data, and the determination of whether the standardized verification is passed specifically include the following steps:

[0135] Step S1051: Calculate multiple real-time relative distances between the viewing angle verification structure and multiple passive verification structures and the manual operation according to the active coordinate data.

[0136] Step S1052: plan a standardized verification cycle according to the relevant process information.

[0137] Step S1053: compare the multiple real-time relative distances with the preset safe relative distances, and record the frequency of abnormal intrusions in the standardized verification cycle.

[0138] Step S1054: compare the abnormal intrusion frequency with a preset standard intrusion frequency.

[0139] Step S1055: If the abnormal intrusion frequency is less than the standard intrusion frequency, the standardized verification is passed.

[0140] Step S1056: If the abnormal intrusion frequency is not less than the standard intrusion frequency, the standardized verification fails.

[0141] Furthermore, Figure 8 An application architecture diagram of an equipment standardization verification system based on visual analysis provided by an embodiment of the present invention is shown.

[0142] Specifically, in another preferred embodiment provided by the present invention, the equipment standardization verification system based on visual analysis includes:

[0143] The verification request processing module 101 is used to receive an equipment verification request, determine the equipment to be verified, and obtain production process information, and extract relevant process information from the production process information according to the equipment to be verified.

[0144] In an embodiment of the present invention, during the product trial production process, if there is a requirement for standardized verification of equipment, the trial production management personnel can upload an equipment verification request. The verification request processing module 101 receives the uploaded equipment verification request, identifies the equipment verification request, determines the trial production verification product and the equipment to be verified, matches the production process information corresponding to the trial production verification product, and then matches and extracts relevant process information from the production process information based on the corresponding process of the equipment to be verified during trial production of the trial production verification product.

[0145] The active intrusion analysis module 102 is used to obtain a three-dimensional model of the equipment, perform active intrusion analysis based on the relevant process information, and determine a viewpoint verification structure and multiple passive verification structures.

[0146] In an embodiment of the present invention, the activity intrusion analysis module 102 obtains the internal equipment number of the equipment to be verified, and then matches the equipment three-dimensional model of the equipment to be verified from a preset three-dimensional model database according to the internal equipment number, and downloads the equipment three-dimensional model of the equipment to be verified, and determines the processing station area in the equipment to be verified by analyzing the equipment three-dimensional model, and then performs activity structure analysis on the equipment three-dimensional model based on relevant process information to determine that when the equipment to be verified performs production activities according to the relevant process information, multiple activity verification structures will invade the processing station area, and from the multiple activity verification structures, one is selected as a perspective verification structure, and the others are passive verification structures, thereby obtaining a perspective verification structure and multiple passive verification structures.

[0147] Specifically, Fig. 9 It shows a structural block diagram of the activity intrusion analysis module 102 in the system provided by an embodiment of the present invention.

[0148] In another preferred embodiment of the present invention, the activity intrusion analysis module 102 specifically includes:

[0149] The number obtaining unit 1021 is used to obtain the internal equipment number of the equipment to be verified.

[0150] The model matching unit 1022 is used to match the equipment 3D model of the equipment to be verified from a preset 3D model database according to the internal equipment number.

[0151] The area determination unit 1023 is used to determine the processing station area of ​​the equipment to be verified.

[0152] The structure analysis unit 1024 is used to perform activity structure analysis on the equipment three-dimensional model based on the relevant process information, and determine activity verification structures of multiple activities invading the processing station area.

[0153] The structure selection unit 1025 is used to select a perspective verification structure and a plurality of passive verification structures from the plurality of active verification structures.

[0154] Furthermore, the equipment standardization verification system based on visual analysis also includes:

[0155] The follow-up monitoring and shooting module 103 is used to perform follow-up real-time binocular verification monitoring and shooting of manual operation in the visual angle verification structure during process verification production to obtain binocular shooting data.

[0156] In an embodiment of the present invention, the follow-up monitoring shooting module 103 installs a binocular camera on the viewing angle verification structure, determines the follow-up monitoring period during process verification production, generates a follow-up monitoring signal according to the follow-up monitoring period, and then performs follow-up real-time binocular verification monitoring shooting of manual operation in the viewing angle verification structure based on the follow-up monitoring signal to obtain binocular shooting data.

[0157] The spatial coordinate recognition module 104 is used to construct a fixed coordinate system and a movable coordinate system, perform spatial coordinate recognition on the binocular shooting data, and record movable coordinate data.

[0158] In an embodiment of the present invention, the spatial coordinate recognition module 104 selects a fixed coordinate origin on the three-dimensional model of the equipment, and determines the x-axis, y-axis and z-axis to construct a fixed coordinate system, and selects an active coordinate origin on the perspective verification structure, and determines the x-axis, y-axis and z-axis to construct an active coordinate system, and then based on the active coordinate system, performs spatial coordinate recognition on the binocular shooting data, records the basic operation coordinate data of the manual operation, and records the real-time coordinate position of the perspective verification structure in the fixed coordinate system during the follow-up monitoring period, and then in the fixed coordinate system, according to the real-time coordinate position of the perspective verification structure, coordinates are transformed on the basic operation coordinate data to obtain the operation transformation coordinate data in the fixed coordinate system, and obtains the structural coordinate data of the perspective verification structure and multiple passive verification structures in the fixed coordinate system during the follow-up monitoring period, and obtains the active coordinate data by comprehensively arranging the operation transformation coordinate data and the structural coordinate data.

[0159] Specifically, Fig.10 It shows a structural block diagram of the space coordinate identification module 104 in the system provided by the embodiment of the present invention.

[0160] In another preferred embodiment of the present invention, the spatial coordinate recognition module 104 specifically includes:

[0161] The fixed origin selection unit 1041 is used to select a fixed coordinate origin based on the equipment three-dimensional model.

[0162] The fixed coordinate system construction unit 1042 is used to construct a fixed coordinate system according to the fixed coordinate origin.

[0163] The active origin selection unit 1043 is used to select an active coordinate origin in the viewing angle verification structure.

[0164] The active coordinate system constructing unit 1044 is used to construct an active coordinate system according to the active coordinate origin.

[0165] The spatial coordinate recognition unit 1045 is used to perform spatial coordinate recognition on the binocular shooting data and record activity coordinate data.

[0166] Furthermore, the equipment standardization verification system based on visual analysis also includes:

[0167] The standard verification judgment module 105 is used to calculate the abnormal intrusion frequency between the viewing angle verification structure and multiple passive verification structures and the manual operation according to the activity coordinate data, and judge whether the standardized verification is passed.

[0168] In an embodiment of the present invention, the standard verification judgment module 105 analyzes the active coordinate data, records multiple real-time relative distances between the viewing angle verification structure and multiple passive verification structures and manual operations, and plans a standardized verification cycle according to relevant process information, and screens multiple verification relative distances within the standardized verification cycle from the multiple real-time relative distances according to the time corresponding to the multiple real-time relative distances, and then compares the multiple verification relative distances with the preset safety relative distances, records the abnormal intrusion frequency in the standardized verification cycle, and then compares the abnormal intrusion frequency with the preset standard intrusion frequency to determine whether the standardized verification is passed. Specifically, when the abnormal intrusion frequency is less than the standard intrusion frequency, the standardized verification is determined to be passed; when the abnormal intrusion frequency is not less than the standard intrusion frequency, the standardized verification is determined to be failed.

[0169] It should be understood that, although each step in the flow chart of each embodiment of the present invention is shown in sequence according to the indication of the arrow, these steps are not necessarily performed in sequence according to the order indicated by the arrow. Unless there is a clear explanation in this article, the execution of these steps does not have a strict order restriction, and these steps can be performed in other orders. Moreover, at least a portion of the steps in each embodiment may include a plurality of sub-steps or a plurality of stages, and these sub-steps or stages are not necessarily performed at the same time, but can be performed at different times, and the execution order of these sub-steps or stages is not necessarily performed in sequence, but can be performed in turn or alternately with at least a portion of other steps or sub-steps or stages of other steps.

[0170] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the program can be stored in a non-volatile computer-readable storage medium. When the program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to memory, storage, database or other media used in the embodiments provided in this application may include non-volatile and / or volatile memory. Non-volatile memory may include read-only memory (ROM), programmable ROM (PROM), electrically programmable ROM (EPROM), electrically erasable programmable ROM (EEPROM) or flash memory. Volatile memory may include random access memory (RAM) or external cache memory. As an illustration and not limitation, RAM is available in many forms, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (DDRSDRAM), enhanced SDRAM (ESDRAM), synchronous link (Synchlink) DRAM (SLDRAM), memory bus (Rambus) direct RAM (RDRAM), direct memory bus dynamic RAM (DRDRAM), and memory bus dynamic RAM (RDRAM).

[0171] The above-mentioned embodiments only express several implementation methods of the present invention, and the description thereof is relatively specific and detailed, but it cannot be understood as limiting the scope of the patent of the present invention. It should be pointed out that, for ordinary technicians in this field, several variations and improvements can be made without departing from the concept of the present invention, which all belong to the protection scope of the present invention. Therefore, the protection scope of the patent of the present invention shall be subject to the attached claims.

Claims

1. The equipment standardization verification method based on visual analysis is characterized by: The method specifically comprises the following steps: Receive an equipment verification request, determine the equipment to be verified, and obtain production process information, and extract relevant process information from the production process information according to the equipment to be verified; Acquire a three-dimensional model of the equipment, perform active intrusion analysis based on the relevant process information, and determine a perspective verification structure and multiple passive verification structures; During process verification production, the visual angle verification structure is verified, and real-time binocular verification monitoring and shooting of manual operation is performed to obtain binocular shooting data; Constructing a fixed coordinate system and a movable coordinate system, performing spatial coordinate recognition on the binocular shooting data, and recording movable coordinate data; On the three-dimensional model of the equipment, a fixed coordinate origin is selected, and the x-axis, y-axis and z-axis are determined to construct a fixed coordinate system. On the perspective verification structure, an active coordinate origin is selected, and the x-axis, y-axis and z-axis are determined to construct an active coordinate system. Then, based on the active coordinate system, spatial coordinate recognition is performed on the binocular shooting data, and the basic operation coordinate data of manual operation is recorded. The real-time coordinate position of the perspective verification structure in the fixed coordinate system during the follow-up monitoring period is recorded. Then, in the fixed coordinate system, the basic operation coordinate data is transformed according to the real-time coordinate position of the perspective verification structure to obtain the operation transformation coordinate data in the fixed coordinate system. The structural coordinate data of the perspective verification structure and multiple passive verification structures in the fixed coordinate system during the follow-up monitoring period are obtained. The active coordinate data is obtained by comprehensively sorting the operation transformation coordinate data and the structural coordinate data. In the basic operation coordinate data, the spatial coordinate data of the operator's hands and head in the active coordinate system when manually operated are recorded. According to the activity coordinate data, the abnormal intrusion frequency between the viewing angle verification structure and the plurality of passive verification structures and the manual operation is calculated to determine whether the standardized verification is passed; By analyzing the active coordinate data, multiple real-time relative distances between the perspective verification structure and multiple passive verification structures and manual operations are recorded, and a standardized verification cycle is planned according to relevant process information. According to the time corresponding to the multiple real-time relative distances, multiple verification relative distances within the standardized verification cycle are screened from the multiple real-time relative distances, and then the multiple verification relative distances are compared with the preset safety relative distances, and the abnormal intrusion frequency in the standardized verification cycle is recorded. Then, the abnormal intrusion frequency is compared with the preset standard intrusion frequency to determine whether the standardized verification has passed. Specifically, when the abnormal intrusion frequency is less than the standard intrusion frequency, the standardized verification is determined to have passed; when the abnormal intrusion frequency is not less than the standard intrusion frequency, the standardized verification is determined to have failed; the multiple real-time relative distances are the shortest distances between the perspective verification structure and multiple passive verification structures and manual operations at different times; among the multiple verification relative distances, the number of verification relative distances that are less than the safety relative distance is the value of the abnormal intrusion frequency.

2. The equipment standardization verification method based on visual analysis according to claim 1 is characterized in that: The receiving of the equipment verification request, determining the equipment to be verified, and obtaining the production process information, and extracting the relevant process information from the production process information according to the equipment to be verified specifically comprises the following steps: receiving a device verification request; Identify the equipment verification request and determine the equipment to be verified and the trial-produced verification product; Matching production process information according to the trial production verification product; According to the equipment to be verified, relevant process information is extracted from the production process information.

3. The equipment standardization verification method based on visual analysis according to claim 1 is characterized in that: The obtaining of the equipment three-dimensional model, performing active intrusion analysis based on the relevant process information, and determining the viewing angle verification structure and multiple passive verification structures specifically include the following steps: Obtaining the internal equipment number of the equipment to be verified; According to the internal equipment number, matching the equipment 3D model of the equipment to be verified from a preset 3D model database; Determine the processing station area of ​​the equipment to be verified; Based on the relevant process information, an activity structure analysis is performed on the three-dimensional model of the equipment to determine an activity verification structure in which multiple activities invade the processing station area; A perspective verification structure and a plurality of passive verification structures are selected from the plurality of active verification structures.

4. The equipment standardization verification method based on visual analysis according to claim 1 is characterized in that: During the process verification production, in the visual angle verification structure, the manual operation is followed by real-time binocular verification monitoring shooting, and obtaining binocular shooting data specifically includes the following steps: During process validation production, determine the follow-up monitoring period; Generating a follow-up monitoring signal according to the follow-up monitoring period; According to the follow-up monitoring signal, in the viewing angle verification structure, the manual operation is followed by real-time binocular verification monitoring shooting to obtain binocular shooting data.

5. Equipment standardization verification system based on visual analysis, characterized in that: The system includes a verification request processing module, an activity intrusion analysis module, a follow-up monitoring and shooting module, a spatial coordinate recognition module and a standard verification judgment module, wherein: A verification request processing module, used to receive equipment verification requests, determine the equipment to be verified, and obtain production process information, and extract relevant process information from the production process information according to the equipment to be verified; An active intrusion analysis module, used to obtain a three-dimensional model of the equipment, perform active intrusion analysis based on the relevant process information, and determine a viewpoint verification structure and a plurality of passive verification structures; A follow-up monitoring and shooting module is used to perform follow-up real-time binocular verification monitoring and shooting of manual operation in the visual angle verification structure during process verification production to obtain binocular shooting data; A spatial coordinate recognition module is used to construct a fixed coordinate system and a movable coordinate system, perform spatial coordinate recognition on the binocular shooting data, and record movable coordinate data; The spatial coordinate recognition module selects a fixed coordinate origin on the equipment three-dimensional model, and determines the x-axis, y-axis and z-axis to construct a fixed coordinate system. The spatial coordinate recognition module selects an active coordinate origin on the view verification structure, and determines the x-axis, y-axis and z-axis to construct an active coordinate system. Based on the active coordinate system, the module performs spatial coordinate recognition on the binocular shooting data, records the basic operation coordinate data of manual operation, and records the real-time coordinate position of the view verification structure in the fixed coordinate system during the follow-up monitoring period. The module then performs coordinate transformation on the basic operation coordinate data in the fixed coordinate system according to the real-time coordinate position of the view verification structure to obtain the operation transformation coordinate data in the fixed coordinate system, and obtains the structural coordinate data of the view verification structure and multiple passive verification structures in the fixed coordinate system during the follow-up monitoring period. The module obtains the activity coordinate data by comprehensively sorting the operation transformation coordinate data and the structural coordinate data. In the basic operation coordinate data, the spatial coordinate data of the operator's hands and head in the active coordinate system when the operation is performed manually are recorded. A standard verification judgment module, used to calculate the abnormal intrusion frequency between the view verification structure and multiple passive verification structures and manual operation according to the activity coordinate data, and judge whether the standardized verification is passed; The standard verification judgment module analyzes the active coordinate data, records multiple real-time relative distances between the perspective verification structure and multiple passive verification structures and manual operations, and plans a standardized verification cycle according to relevant process information. According to the time corresponding to the multiple real-time relative distances, multiple verification relative distances within the standardized verification cycle are screened from the multiple real-time relative distances, and then the multiple verification relative distances are compared with the preset safety relative distances, and the abnormal intrusion frequency in the standardized verification cycle is recorded. Then, the abnormal intrusion frequency is compared with the preset standard intrusion frequency to determine whether the standardized verification is passed. Specifically, when the abnormal intrusion frequency is less than the standard intrusion frequency, the standardized verification is determined to be passed; when the abnormal intrusion frequency is not less than the standard intrusion frequency, the standardized verification is determined to be failed; the multiple real-time relative distances are the shortest distances between the perspective verification structure and multiple passive verification structures and manual operations at different times; among the multiple verification relative distances, the number of verification relative distances that are less than the safety relative distance is the value of the abnormal intrusion frequency.

6. The equipment standardization verification system based on visual analysis according to claim 5 is characterized in that: The activity intrusion analysis module specifically includes: A number obtaining unit, used to obtain the internal equipment number of the equipment to be verified; A model matching unit, used to match the equipment three-dimensional model of the equipment to be verified from a preset three-dimensional model database according to the internal equipment number; An area determination unit, used to determine a processing station area of ​​the equipment to be verified; A structural analysis unit, configured to perform an activity structural analysis on the three-dimensional model of the equipment based on the relevant process information, and determine an activity verification structure in which multiple activities invade the processing station area; The structure selection unit is used to select a perspective verification structure and a plurality of passive verification structures from the plurality of active verification structures.

7. The equipment standardization verification system based on visual analysis according to claim 5 is characterized in that: The spatial coordinate recognition module specifically includes: A fixed origin selection unit, used for selecting a fixed coordinate origin based on the equipment three-dimensional model; A fixed coordinate system construction unit, used to construct a fixed coordinate system according to the fixed coordinate origin; An active origin selection unit, used for selecting an active coordinate origin in the viewing angle verification structure; An active coordinate system construction unit, used to construct an active coordinate system according to the active coordinate origin; The spatial coordinate recognition unit is used to perform spatial coordinate recognition on the binocular shooting data and record activity coordinate data.

Images