Optical measuring machine vision system based on multi-focal length phase coherent imaging
Through the multi-focal length phase coherent imaging optical measuring machine vision system, the problem of insufficient measurement speed and accuracy in the prior art is solved, high-precision and rapid measurement are achieved, and the operation is safe and stable through full-process monitoring and risk assessment.
Patent Information
- Application Number
- CN202311601995.2
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2023-11-28
- Publication Date
- 2025-03-25
- Estimated Expiration
- 2043-11-28
AI Technical Summary
Existing optical measurement methods are difficult to achieve fast and high-precision non-contact measurements, and cannot detect operational risks in real time, affecting measurement accuracy and equipment safety.
The optical measuring machine vision system adopts multi-focal length phase coherent imaging, and light beams are emitted through the light source module. The multi-focal length phase coherent imaging module divides and recombines the beams to form phase coherent imaging. The vision processing module extracts three-dimensional morphological data of the object surface, and conducts full-process monitoring and risk assessment through operation process monitoring and personnel arrangement early warning modules.
It realizes rapid measurement with high accuracy and high resolution, ensures safety and stability of the operation process, and promptly detects safety hazards in system operation, and prevents damage to equipment and components.
Smart Images

Figure CN117647195B_ABST
Abstract
Description
Technical Field
[0001] The invention relates to the technical field of optical measuring machines, in particular to a multi-focal length phase coherent imaging optical measuring machine vision system. Background Art
[0002] In the fields of manufacturing, scientific research, biomedicine, etc., high-precision, high-resolution non-contact measurement of the surface morphology of objects is of great significance. Most existing optical measurement methods are based on the principle of interference, and the morphological information of the surface of objects is obtained by measuring the phase change of the interference pattern. However, this method usually requires complex interference devices and cumbersome data processing, which makes it difficult to achieve fast and high-precision measurement.
[0003] In addition, it is difficult to determine the matching degree of operators before the measurement operation and to realize the full process monitoring and early warning of the operation behavior during the operation. It is also impossible to detect and accurately evaluate the risk level during the operation in real time, which is not conducive to ensuring the stability of the operation process and the safety of each component. It is also impossible to comprehensively test the performance of the corresponding components and provide feedback and early warning. It is difficult for management personnel to conduct timely and targeted inspection and maintenance of components, and the accuracy and stability of subsequent measurements cannot be effectively guaranteed.
[0004] In view of the above technical defects, a solution is now proposed. Summary of the invention
[0005] The purpose of the present invention is to provide an optical measuring machine vision system with multi-focal length phase coherent imaging, which solves the problems that the prior art cannot achieve fast and high-precision non-contact measurement, it is difficult to judge the matching degree of the operator before the measurement operation and to achieve full-process monitoring and early warning of the operation behavior during the operation, it is difficult to detect and accurately evaluate the risk level during the operation in real time, and it is impossible to guarantee the accuracy and stability of subsequent measurements.
[0006] To achieve the above object, the present invention provides the following technical solutions:
[0007] An optical measuring machine vision system for multi-focal length phase coherent imaging includes a control platform, a light source module, a multi-focal length phase coherent imaging module, an image acquisition module, and a visual processing module; the light source module is used to emit a light beam, and the multi-focal length phase coherent imaging module divides the light beam into a reference beam and a measuring beam, and recombine the reference beam and the measuring beam to form phase coherent imaging;
[0008] The image acquisition module acquires phase coherent imaging images and transmits the images to the visual processing module, which processes and analyzes the images, extracts the morphological information of the object surface, and obtains high-precision, high-resolution three-dimensional morphological data of the object surface; the control platform is used to control the light source module, the multi-focal length phase coherent imaging module, the image acquisition module and the visual processing module, and the control platform displays the relevant data information;
[0009] The control platform is communicated with the operation process monitoring module and the personnel arrangement warning module. The operation process monitoring module is used to monitor the entire operation process of the operator, collect the operation monitoring images and analyze them frame by frame to identify the erroneous operation behavior of the corresponding operator, and enable the control platform to issue a corresponding warning when the erroneous operation behavior is identified; the personnel arrangement warning module is used to evaluate and analyze the arranged operators before the operation, and generate a personnel arrangement qualified signal or a personnel arrangement unqualified signal based on this, and enable the control platform to issue a corresponding warning when the personnel arrangement unqualified signal is generated.
[0010] Furthermore, the multi-focal length phase coherent imaging module includes a beam splitter, a reflector and a lens group, wherein the beam splitter splits the light beam emitted by the light source module into a reference beam and a measurement beam, the reflector reflects the reference beam to the lens group, the lens group focuses the reference beam onto the surface of the object, and the measurement beam is adjusted by the reflector and the lens group, focused onto the surface of the object and reflected back, and the beam splitter recombines the reference beam and the measurement beam to form phase coherent imaging.
[0011] Furthermore, the visual processing module includes an image processing unit, a feature extraction unit and a three-dimensional reconstruction unit, wherein the image processing unit processes the acquired phase coherent imaging image to eliminate noise and improve image quality, the feature extraction unit extracts feature information of the object surface from the processed image, and the three-dimensional reconstruction unit performs three-dimensional reconstruction using the feature information to obtain high-precision, high-resolution three-dimensional morphological data of the object surface.
[0012] Furthermore, the specific operation process of the personnel arrangement warning module includes:
[0013] The age of the corresponding operator is collected, and the difference between the age and the value of 26 is calculated and the absolute value is taken to obtain the age deviation value; the total operation time of the corresponding operator on the optical measuring machine vision system is collected, and all the wrong operation behaviors of the corresponding operator in the historical operation process are collected, and the wrong operation detection value of the corresponding operator is obtained based on the wrong operation behavior analysis;
[0014] And collect the loss performance data of the optical measuring machine vision system caused by the corresponding operator's wrong operation behavior during the historical operation process, and sum up all the loss performance data to obtain the loss table evaluation value; compare the loss performance data with the preset loss performance data threshold, if the loss performance data exceeds the preset loss performance data threshold, mark the corresponding loss performance data as abnormal loss table data, and mark the number of abnormal loss table data as a high loss table value;
[0015] The age deviation value, total operation time, wrong operation detection value, damage table assessment value and high-damage operation table value of the corresponding operator are normalized and calculated to obtain the operation arrangement warning value, and the operation arrangement warning value is numerically compared with the preset operation arrangement warning threshold. If the operation arrangement warning value exceeds the preset operation arrangement warning threshold, an unqualified personnel arrangement signal is generated; if the operation arrangement warning value does not exceed the preset operation arrangement warning threshold, a qualified personnel arrangement signal is generated.
[0016] Furthermore, the specific analysis process of wrong operation behavior analysis is as follows:
[0017] All types of erroneous operation behaviors that need to be monitored are obtained, and all erroneous operation behaviors that have existed in the historical operation process of the corresponding operator are classified, and the number of occurrences of each type of erroneous operation behavior of the corresponding operator is obtained accordingly, and it is marked as the erroneous operation behavior frequency of the corresponding type of erroneous operation behavior; each type of erroneous operation behavior is set in advance to correspond to a set of erroneous operation weight values, and the erroneous operation behavior frequency of the corresponding type of erroneous operation behavior is multiplied by the corresponding erroneous operation weight value, and the product value is marked as the erroneous operation tracing value; the erroneous operation tracing values of all types of erroneous operation behaviors that occurred in the historical operation process of the corresponding operator are summed up, and the sum value is marked as the erroneous operation detection value.
[0018] Furthermore, the control platform is connected in communication with the operation comprehensive test module, which is used to conduct a comprehensive test on the entire system operation process, and to generate a normal operation test signal or an abnormal operation test signal through analysis, and to send the abnormal operation test signal to the control platform, which displays the abnormal operation test signal and issues a corresponding warning; the specific operation process of the operation comprehensive test module is as follows:
[0019] Collect the luminous brightness deviation value and luminous color deviation value of the light source module, compare the luminous brightness deviation value and luminous color deviation value with the preset luminous brightness deviation threshold value and the preset luminous color deviation threshold value respectively, and generate an abnormal operation signal if the luminous brightness deviation value or the luminous color deviation value exceeds the corresponding preset threshold value;
[0020] If the luminous brightness deviation value and the luminous color deviation value do not exceed the corresponding preset threshold value, the imaging information of the multi-focal length phase coherent imaging module is collected, and the imaging information includes resolution data, contrast data, distortion data, signal-to-noise ratio data and dynamic range data. The resolution data, contrast data, distortion data, signal-to-noise ratio data and dynamic range data are numerically calculated to obtain an imaging evaluation value, and the imaging evaluation value is numerically compared with the preset imaging evaluation threshold value. If the imaging evaluation value exceeds the preset imaging evaluation threshold value, a measurement abnormality signal is generated;
[0021] If the imaging evaluation value does not exceed the preset imaging evaluation threshold, the processing information of the visual processing module is collected, and the processing information includes processing efficiency data, processing delay data and processing jamming data. The processing efficiency data, processing delay data and processing jamming data are numerically calculated to obtain a processing evaluation value; the processing evaluation value is numerically compared with the preset processing evaluation threshold. If the processing evaluation value exceeds the preset processing evaluation threshold, an operation and measurement abnormality signal is generated. If the processing evaluation value does not exceed the preset processing evaluation threshold, a normal operation and measurement signal is generated.
[0022] Furthermore, the control platform is communicatively connected with the fortune risk decision module, which is used to perform fortune risk decision analysis on the system during operation, generate a high-risk fortune signal or a low-risk fortune signal through analysis, and send the high-risk fortune signal to the control platform. When the control platform receives the high-risk fortune signal, it will display it and issue a corresponding warning.
[0023] Furthermore, the specific analysis process of the risk decision analysis is as follows:
[0024] The components that need to be supervised during the system operation are collected in real time, and the corresponding components are marked as monitoring target i, where i is a natural number greater than 1; the operating parameters required for real-time detection of monitoring target i are obtained, and it is determined whether the corresponding operating parameters meet the corresponding parameter requirements. If all operating parameters of monitoring target i meet the corresponding parameter requirements, it is determined that there is no operating risk for monitoring target i; if there is no operating risk for all monitoring targets i, environmental hazard monitoring and analysis are performed, otherwise a high-risk operation signal is generated.
[0025] Furthermore, the specific analysis process of environmental hazard monitoring and analysis is as follows:
[0026] Environmental information of the environment in which the system is operating is collected, including ambient temperature deviation value, ambient humidity deviation value and ambient dust concentration data. The ambient temperature deviation value, ambient humidity deviation value and ambient dust concentration data are numerically calculated to obtain an environmental detection value; the environmental detection value is numerically compared with a preset environmental detection threshold value. If the environmental detection value exceeds the preset environmental detection threshold value, a high-risk signal is generated; if the environmental detection value does not exceed the preset environmental detection threshold value, a low-risk signal is generated.
[0027] Compared with the prior art, the present invention has the following beneficial effects:
[0028] 1. In the present invention, a light beam is emitted by a light source module, a multi-focal phase coherent imaging module divides the light beam into a reference beam and a measurement beam, and the reference beam and the measurement beam are recombined to form a phase coherent imaging, and a visual processing module processes and analyzes the image to obtain three-dimensional morphological data of the object surface, and high-precision, high-resolution measurement and rapid measurement are achieved by adopting non-contact measurement; and an operation process monitoring module is used to monitor the entire operation process of the operator, accurately identify the erroneous operation behavior of the corresponding operator and provide early warning feedback to ensure the safety and stability of the operation process; and before the operation is performed, the operator is evaluated and analyzed by the personnel arrangement early warning module to effectively reduce the subsequent operation risks, which promotes the accuracy of the operation results and the safety of the equipment;
[0029] 2. In the present invention, a transportation risk decision module is used to analyze the transportation risk decision of the system during the operation process, and a high-risk transportation signal or a low-risk transportation signal is generated through analysis, so as to timely discover the safety hazards existing in the system operation and make targeted improvements, thereby ensuring safe and stable operation and effectively preventing damage to corresponding equipment components; and a comprehensive test module is used to conduct a comprehensive test on the entire system operation process, and a normal operation signal or an abnormal operation signal is generated through analysis, so as to achieve a comprehensive evaluation of the system operation performance and accurately feedback early warning, so that management personnel can timely inspect and repair the corresponding components, thereby improving the service life of each component and ensuring the subsequent use effect. BRIEF DESCRIPTION OF THE DRAWINGS
[0030] In order to facilitate understanding by those skilled in the art, the present invention is further described below in conjunction with the accompanying drawings;
[0031] Figure 1 This is a first system block diagram of Embodiment 1 of the present invention;
[0032] Figure 2 is a second system block diagram of Embodiment 1 of the present invention;
[0033] Figure 3This is a system block diagram of Embodiment 2 and Embodiment 3 of the present invention. DETAILED DESCRIPTION
[0034] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.
[0035] Embodiment 1: Figure 1-2 As shown, the optical measuring machine vision system of multi-focal length phase coherent imaging proposed in the present invention comprises a control platform, a light source module, a multi-focal length phase coherent imaging module, an image acquisition module and a visual processing module; and the control platform is used to control the light source module, the multi-focal length phase coherent imaging module, the image acquisition module and the visual processing module, and the control platform displays relevant data information; the present invention adopts non-contact measurement, does not damage the surface of the object, and can achieve high-precision and high-resolution measurement, and realizes rapid measurement based on a simple interference structure and data processing process;
[0036] In a specific operation process, the light source module is used to emit a light beam, and the multi-focal length phase coherent imaging module divides the light beam into a reference beam and a measurement beam, and recombine the reference beam and the measurement beam to form phase coherent imaging; specifically, the multi-focal length phase coherent imaging module includes a beam splitter, a reflector, and a lens group, wherein the beam splitter divides the light beam emitted by the light source module into a reference beam and a measurement beam, the reflector reflects the reference beam to the lens group, the lens group focuses the reference beam onto the surface of the object, and the measurement beam is adjusted by the reflector and the lens group, focused onto the surface of the object and reflected back, and the beam splitter recombine the reference beam and the measurement beam to form phase coherent imaging;
[0037] The image acquisition module acquires phase coherent imaging images and transmits the images to the visual processing module, which processes and analyzes the images, extracts the morphological information of the object surface, and obtains high-precision, high-resolution three-dimensional morphological data of the object surface; specifically, the visual processing module includes an image processing unit, a feature extraction unit and a three-dimensional reconstruction unit, wherein the image processing unit processes the acquired phase coherent imaging images, eliminates noise and improves image quality, the feature extraction unit extracts feature information of the object surface from the processed image, and the three-dimensional reconstruction unit performs three-dimensional reconstruction using the feature information to obtain high-precision, high-resolution three-dimensional morphological data of the object surface, mainly by utilizing the extracted feature information and adopting three-dimensional reconstruction algorithms, such as stereo vision, structured light, time of flight, etc., to calculate the three-dimensional coordinates of the object surface, etc.
[0038] Furthermore, the processing process of the image processing unit mainly includes image preprocessing, preliminary feature extraction and image segmentation, among which image preprocessing is used to preprocess the collected image to remove noise and improve image quality. The preprocessing operations include filtering, denoising, enhancement and other operations; feature extraction is mainly used to extract representative features such as edges, corners, textures, etc. based on the preprocessed image. These features will be used for subsequent target detection and classification tasks; image segmentation is used to divide the image into different regions to facilitate subsequent feature extraction and target detection. Image segmentation can adopt a variety of methods, such as threshold segmentation, region growing, etc.; through the above processing process, the image processing unit can provide high-quality image data and provide reliable input for subsequent feature extraction and three-dimensional reconstruction.
[0039] The task of the feature extraction unit is to extract the feature information of the object surface from the processed image. These features will be used for tasks such as target recognition, classification and tracking. The specific feature extraction process includes local feature descriptors, target detection and feature matching. Among them, local feature descriptors refer to the use of local invariant feature descriptors (such as SIFT, SURF, ORB and other algorithms) to describe the local features in the image. These descriptors have stability against transformations such as rotation, scaling, and brightness changes, and can effectively describe the features of the object surface. Among them, SIFT, SURF, and ORB refer to Scale-Invariant Feature Transform, Speeded Up Robust Features, and Oriented FAST and Rotated BRIEF, respectively.
[0040] Target detection: refers to the use of region extraction-based target detection methods (such as R-CNN, Fast R-CNN, FasterR-CNN, etc.) or deep learning-based target detection methods (such as YOLO, SSD, etc.) to automatically identify targets or objects of interest in an image; Feature matching: refers to the use of feature matching algorithms to match the extracted features with known templates or features in a database to achieve target recognition and classification; Through the above feature extraction process, the feature extraction unit can provide feature information on the surface of the object to provide support for subsequent 3D reconstruction and target tracking;
[0041] Among them, R-CNN (Region-based Convolutional Networks) refers to target detection technology based on algorithms such as convolutional neural network (CNN), linear regression and support vector machine (SVM); Fast R-CNN (Region-based Convolutional Networks for Fast Feature Extraction) is an improved version of R-CNN, which improves the detection speed by improving the region extraction and feature extraction process; Faster R-CNN (Region-based Convolutional Networks with Deeply Learned Deformable Kernels) is an improved version of Fast R-CNN, which achieves more accurate target detection by introducing a learnable deformable kernel (a deformable convolution kernel); YOLO (You Only Look Once) is a real-time target detection algorithm; SSD (Single Shot MultiBox Detector) is a single-shot multi-box detector, also a target detection algorithm.
[0042] In addition, the control platform is connected to the operation process monitoring module and the personnel arrangement warning module. The operation process monitoring module is used to monitor the entire operation process of the operator, collect the operation monitoring images and analyze them frame by frame to identify the wrong operation behavior of the corresponding operator. When the wrong operation behavior is identified, the control platform will issue a corresponding warning to remind the operator to correct it in time and remind the management personnel to strengthen the operation supervision, so as to ensure the safety and stability of the operation process;
[0043] Before the operation, the personnel arrangement warning module evaluates and analyzes the arranged operators, and generates a qualified personnel arrangement signal or a failed personnel arrangement signal based on this. When a failed personnel arrangement signal is generated, the control platform issues a corresponding warning. When the corresponding management personnel receive the warning, they should replace the operator in time and replace him with a matching operator, or strengthen the operation supervision during the operation to effectively reduce the operation risk, which will promote the accuracy of the operation results and the safety of the equipment. The specific operation process of the personnel arrangement warning module is as follows:
[0044] The age of the corresponding operator is collected, and the difference between the age and the value of 26 is calculated and the absolute value is taken to obtain the age deviation value; wherein, the larger the value of the age deviation value is, the worse the operation safety and reliability of the corresponding operator are in general; and the total operation time of the corresponding operator on the optical measuring machine vision system is collected, and all the erroneous operation behaviors of the corresponding operator in the historical operation process are collected (the operation process monitoring module captures and identifies the erroneous operation behaviors through the whole process monitoring, and the control platform stores all the erroneous operation behaviors of the corresponding operator), and the wrong operation detection value of the corresponding operator is obtained based on the wrong operation behavior analysis; and the larger the value of the wrong operation detection value is, the worse the historical operation performance of the corresponding operator is;
[0045] The specific analysis of wrong operation behavior is as follows: obtain all types of wrong operation behaviors that need to be monitored, classify all wrong operation behaviors that exist in the historical operation process of the corresponding operator, and obtain the number of occurrences of each type of wrong operation behavior of the corresponding operator, and mark it as the wrong operation behavior frequency of the corresponding type of wrong operation behavior; set each type of wrong operation behavior in advance to correspond to a set of wrong operation weight values, the values of the wrong operation weight values are all greater than zero, and the wrong operation weight values are stored in the control platform; it should be noted that the larger the value of the wrong operation weight value, the greater the safety risk brought by the corresponding type of wrong operation behavior; multiply the wrong operation behavior frequency of the corresponding type of wrong operation behavior by the corresponding wrong operation weight value, and mark the product value as the wrong operation tracing value; sum up the wrong operation tracing values of all types of wrong operation behaviors that occurred in the historical operation process of the corresponding operator, and mark the sum value as the wrong operation detection value;
[0046] And collect the loss performance data of the corresponding operator caused to the optical measuring machine vision system due to the wrong operation behavior in the historical operation process. The loss performance data is the data value indicating the amount of loss caused by the damage to the corresponding parts due to the operation problem. The larger the value of the loss performance data, the greater the damage impact. All the loss performance data are summed up to obtain the loss table evaluation value; the loss performance data is numerically compared with the preset loss performance data threshold. If the loss performance data exceeds the preset loss performance data threshold, the corresponding loss performance data is marked as abnormal loss table data, and the number of abnormal loss table data is marked as a high loss table value.
[0047] The age deviation value CF, the total operation time CY, the wrong operation detection value CK, the damage table evaluation value CP and the high damage operation table value CW of the corresponding operator are normalized and calculated by the formula CR=(a1*CF+a3*CK+a4*CP+a5*CW) / (a2*CY+3.627) to obtain the operation arrangement warning value CR, wherein a1, a2, a3, a4 and a5 are preset proportional coefficients, and a5>a3>a2>a4>a1>0; and the larger the value of the operation arrangement warning value CR is, the less suitable the corresponding operator is for operating the optical measuring machine vision system, and the greater the operation safety risk is, and the operator should be replaced or strengthened in the operation process. Operation supervision;
[0048] The operation arrangement warning value is numerically compared with the preset operation arrangement warning threshold. If the operation arrangement warning value exceeds the preset operation arrangement warning threshold, it indicates that the corresponding operator is not suitable for the current operation and the operation risk is relatively high, then a personnel arrangement unqualified signal is generated; if the operation arrangement warning value does not exceed the preset operation arrangement warning threshold, it indicates that the corresponding operator is suitable for the current operation and the operation risk is relatively low, then a personnel arrangement qualified signal is generated.
[0049] Embodiment 2: Figure 3 As shown, the difference between this embodiment and embodiment 1 is that the control platform is connected to the transportation risk decision module in communication. The transportation risk decision module performs transportation risk decision analysis on the system during operation, generates a high-risk transportation signal or a low-risk transportation signal through analysis, and sends the high-risk transportation signal to the control platform. When the control platform receives the high-risk transportation signal, it displays it and issues a corresponding warning, so as to timely discover the safety hazards existing in the system operation, and the corresponding operators can take targeted improvement measures in time, so as to ensure the safe and stable operation and effectively prevent the corresponding equipment components from being damaged; the specific analysis process of the transportation risk decision analysis is as follows:
[0050] The components that need to be supervised during the system operation (including the light source module, the components in the multi-focal phase coherent imaging module, etc.) are collected in real time, and the corresponding components are marked as monitoring targets i, where i is a natural number greater than 1; the operating parameters required for real-time detection of monitoring target i (including the surface temperature of the components, the operating current, etc.) are obtained, and it is judged whether the corresponding operating parameters meet the corresponding parameter requirements. If all the operating parameters of the monitoring target i meet the corresponding parameter requirements, it is judged that the monitoring target i does not have an operating risk; if all the monitoring targets i do not have an operating risk, an environmental hazard monitoring analysis is performed, otherwise a high-risk signal for operation is generated;
[0051] Furthermore, the environmental hazard monitoring and analysis is specifically as follows: collecting environmental information of the environment in which the system is operated, including the environmental temperature deviation value, the environmental humidity deviation value and the environmental dust concentration data. The environmental temperature deviation value is a data value indicating the degree of deviation of the actual temperature of the environment from the preset suitable temperature standard value; similarly, the environmental humidity deviation value can be obtained;
[0052] By formula The environmental temperature deviation value QR, the environmental humidity deviation value QS and the environmental dust concentration data QD are numerically calculated to obtain the environmental detection value QW; wherein ku1, ku2, and ku3 are preset proportional coefficients with values greater than zero, and α is a preset correction factor with a value greater than 1; and the numerical value of the environmental detection value QW is directly proportional to the environmental temperature deviation value QR, the environmental humidity deviation value QS and the environmental dust concentration data QD;
[0053] Specifically, the larger the value of the environmental detection value QW, the worse the system operating environment is, and the greater the damage to the various components of the system; the environmental detection value QW is numerically compared with the preset environmental detection threshold. If the environmental detection value QW exceeds the preset environmental detection threshold, it indicates that the system operating environment is poor, and a high-risk signal is generated; if the environmental detection value QW does not exceed the preset environmental detection threshold, it indicates that the system operating environment is good, and a low-risk signal is generated.
[0054] Embodiment 3: Figure 3 As shown, the difference between this embodiment and embodiment 1 and embodiment 2 is that the control platform is connected to the comprehensive test module for communication, the comprehensive test module performs a comprehensive test on the entire system operation process, and generates a normal test signal or an abnormal test signal through analysis, and sends the abnormal test signal to the control platform. The control platform displays the abnormal test signal and issues a corresponding warning, which can perform a comprehensive test on the system operation, realize a comprehensive evaluation of the system operation performance and accurately feedback the warning, so that the management personnel can timely inspect and repair the corresponding components, improve the service life of each component and ensure the subsequent use effect; the specific operation process of the comprehensive test module is as follows:
[0055] The luminous brightness deviation value and luminous color deviation value of the light source module are collected, wherein the luminous brightness deviation value is a data quantity value indicating the degree of deviation of the luminous brightness of the light source module compared to the set brightness, and the luminous color deviation value is a data quantity value indicating the degree of deviation of the luminous color of the light source module compared to the set color; and the larger the values of the luminous brightness deviation value and the luminous color deviation value, the worse the test condition of the light source module is; the luminous brightness deviation value and the luminous color deviation value are numerically compared with the preset luminous brightness deviation threshold value and the preset luminous color deviation threshold value respectively, and if the luminous brightness deviation value or the luminous color deviation value exceeds the corresponding preset threshold value, a test abnormality signal is generated;
[0056] If the luminous brightness deviation value and the luminous color deviation value do not exceed the corresponding preset threshold value, the imaging information of the multi-focal length phase coherent imaging module is collected, and the imaging information includes resolution data, contrast data, distortion data, signal-to-noise ratio data and dynamic range data, wherein the distortion data refers to the data value of the deviation size from its actual shape in the measured image; the larger the values of the resolution data and the contrast data, the better the clarity and recognizability of the image; the larger the dynamic range data, the wider the brightness range that can be captured, and the better the real details of the image can be restored; the signal-to-noise ratio data refers to the ratio of signal to noise, which is used to measure the signal quality. The larger the signal-to-noise ratio data, the higher the clarity and accuracy of the image;
[0057] By formula The resolution data XR, the contrast data XT, the distortion data XW, the signal-to-noise ratio data XK and the dynamic range data XF are numerically calculated to obtain an imaging evaluation value XP, wherein sg1, sg2, sg3, sg4 and sg5 are preset proportional coefficients, and the values of sg1, sg2, sg3, sg4 and sg5 are all greater than zero; and the larger the value of the imaging evaluation value XP is, the worse the performance test condition of the multi-focal length phase coherent imaging module is; the imaging evaluation value XP is numerically compared with a preset imaging evaluation threshold value, and if the imaging evaluation value XP exceeds the preset imaging evaluation threshold value, a measurement abnormality signal is generated;
[0058] If the imaging evaluation value XP does not exceed the preset imaging evaluation threshold, the processing information of the visual processing module is collected, and the processing information includes processing efficiency data, processing delay data and processing jamming data, wherein the processing efficiency data is a data value indicating the interval between the start and end time of the visual processing module, the processing delay data is a data value indicating the interval between the time when the visual processing module receives the processing task and the time when the processing starts, and the processing jamming data is a data value indicating the frequency of jamming during the processing process;
[0059] The processing efficiency data GT, the processing delay data GY and the processing jamming data GP are numerically calculated using the formula GR=fq1*GT+fq2*GY+fq3*GP to obtain the processing evaluation value GR; wherein, fq1, fq2, and fq3 are preset weight coefficients, and fq3>fq2>fq1>0; and, the larger the numerical value of the processing evaluation value GR, the worse the performance test condition of the visual processing module; the processing evaluation value GR is numerically compared with the preset processing evaluation threshold value, and if the processing evaluation value GR exceeds the preset processing evaluation threshold value, an operation and test abnormality signal is generated, and if the processing evaluation value GR does not exceed the preset processing evaluation threshold value, a normal operation and test signal is generated.
[0060] The working principle of the present invention is as follows: when in use, a light beam is emitted through a light source module, a multi-focal length phase coherent imaging module divides the light beam into a reference beam and a measurement beam, and recombines the reference beam and the measurement beam to form a phase coherent imaging, an image acquisition module transmits the image to a visual processing module, and the visual processing module processes and analyzes the image to obtain high-precision, high-resolution three-dimensional morphological data of the object surface, and non-contact measurement is adopted, so that the surface of the object is not damaged, and high-precision, high-resolution measurement can be achieved, and rapid measurement can be achieved based on a simple interference structure and data processing process; and an operation process monitoring module is used to monitor the entire operation process of the operator, accurately identify the erroneous operation behavior of the corresponding operator and provide early warning feedback to ensure the safety and stability of the operation process; and before the operation is performed, the arranged operator is evaluated and analyzed through a personnel arrangement early warning module, and a qualified personnel arrangement signal or an unqualified personnel arrangement signal is generated accordingly, so as to effectively reduce the operation risk, promote the accuracy of the operation result and the safety of the equipment, and have a high degree of intelligence.
[0061] The above formulas are all dimensionless and numerical calculations. The formula is a formula obtained by collecting a large amount of data and performing software simulation to obtain the most recent real situation. The preset parameters in the formula are set by technicians in this field according to actual conditions. The preferred embodiments of the present invention disclosed above are only used to help explain the present invention. The preferred embodiments do not describe all the details in detail, nor do they limit the invention to only specific implementation methods. Obviously, many modifications and changes can be made according to the contents of this specification. This specification selects and specifically describes these embodiments in order to better explain the principles and practical applications of the present invention, so that technicians in the relevant technical field can understand and use the present invention well. The present invention is only limited by the claims and their full scope and equivalents.
Claims
1. An optical measuring machine vision system with multi-focal length phase coherent imaging, characterized in that: It includes a control platform, a light source module, a multi-focal phase coherent imaging module, an image acquisition module and a visual processing module; the light source module is used to emit a light beam, the multi-focal phase coherent imaging module divides the light beam into a reference beam and a measurement beam, and recombine the reference beam and the measurement beam to form phase coherent imaging; The image acquisition module acquires phase coherent imaging images and transmits the images to the visual processing module, which processes and analyzes the images, extracts the morphological information of the object surface, and obtains high-precision, high-resolution three-dimensional morphological data of the object surface; the control platform is used to control the light source module, the multi-focal length phase coherent imaging module, the image acquisition module and the visual processing module, and the control platform displays the relevant data information; The control platform is connected to the operation process monitoring module and the personnel arrangement warning module in communication. The operation process monitoring module is used to monitor the operation process of the operator in the whole process, collect the operation monitoring images and analyze them frame by frame to identify the wrong operation behavior of the corresponding operator, and make the control platform issue a corresponding warning when the wrong operation behavior is identified; the personnel arrangement warning module is used to evaluate and analyze the arranged operators before the operation, and generate a qualified personnel arrangement signal or a unqualified personnel arrangement signal accordingly, and make the control platform issue a corresponding warning when the unqualified personnel arrangement signal is generated; The specific operation process of the personnel arrangement early warning module includes: The age of the corresponding operator is collected, and the difference between the age and the value of 26 is calculated and the absolute value is taken to obtain the age deviation value; the total operation time of the corresponding operator on the optical measuring machine vision system is collected, and all the wrong operation behaviors of the corresponding operator in the historical operation process are collected, and the wrong operation detection value of the corresponding operator is obtained based on the wrong operation behavior analysis; And collect the loss performance data of the optical measuring machine vision system caused by the corresponding operator's wrong operation behavior during the historical operation process, and sum up all the loss performance data to obtain the loss table evaluation value; compare the loss performance data with the preset loss performance data threshold, if the loss performance data exceeds the preset loss performance data threshold, mark the corresponding loss performance data as abnormal loss table data, and mark the number of abnormal loss table data as a high loss table value; The age deviation value, total operation time, wrong operation detection value, damage table evaluation value and high damage operation table value of the corresponding operator are normalized and calculated to obtain the operation arrangement warning value. If the operation arrangement warning value exceeds the preset operation arrangement warning threshold, a personnel arrangement unqualified signal is generated; if the operation arrangement warning value does not exceed the preset operation arrangement warning threshold, a personnel arrangement qualified signal is generated; The specific analysis process of wrong operation behavior analysis is as follows: All types of erroneous operation behaviors that need to be monitored are obtained, and all erroneous operation behaviors that have existed in the historical operation process of the corresponding operator are classified, and the number of occurrences of each type of erroneous operation behavior of the corresponding operator is obtained accordingly, and it is marked as the erroneous operation behavior frequency of the corresponding type of erroneous operation behavior; each type of erroneous operation behavior is set in advance to correspond to a set of erroneous operation weight values, and the erroneous operation behavior frequency of the corresponding type of erroneous operation behavior is multiplied by the corresponding erroneous operation weight value, and the product value is marked as the erroneous operation tracing value; the erroneous operation tracing values of all types of erroneous operation behaviors that occurred in the historical operation process of the corresponding operator are summed up, and the sum value is marked as the erroneous operation detection value.
2. The optical measuring machine vision system of multi-focal length phase coherent imaging according to claim 1, characterized in that: The multi-focal length phase coherent imaging module includes a beam splitter, a reflector and a lens group, wherein the beam splitter splits the light beam emitted by the light source module into a reference beam and a measurement beam, the reflector reflects the reference beam to the lens group, the lens group focuses the reference beam onto the surface of the object, and the measurement beam is adjusted by the reflector and the lens group, focused onto the surface of the object and reflected back, and the beam splitter recombines the reference beam and the measurement beam to form phase coherent imaging.
3. The optical measuring machine vision system of multi-focal phase coherent imaging according to claim 1, characterized in that: The visual processing module includes an image processing unit, a feature extraction unit and a three-dimensional reconstruction unit. The image processing unit processes the acquired phase coherent imaging image to eliminate noise and improve image quality. The feature extraction unit extracts feature information of the object surface from the processed image. The three-dimensional reconstruction unit uses the feature information to perform three-dimensional reconstruction to obtain high-precision and high-resolution three-dimensional morphological data of the object surface.
4. The optical measuring machine vision system of multi-focal length phase coherent imaging according to claim 1, characterized in that: The control platform is connected to the comprehensive test module for comprehensive testing of the entire system operation process, and generates normal operation and test signals or abnormal operation and test signals through analysis, and sends the abnormal operation and test signals to the control platform. The control platform displays the abnormal operation and test signals and issues corresponding warnings. The specific operation process of the comprehensive test module is as follows: Collect the luminous brightness deviation value and luminous color deviation value of the light source module, compare the luminous brightness deviation value and luminous color deviation value with the preset luminous brightness deviation threshold value and the preset luminous color deviation threshold value respectively, and generate an abnormal operation signal if the luminous brightness deviation value or the luminous color deviation value exceeds the corresponding preset threshold value; If the luminous brightness deviation value and the luminous color deviation value do not exceed the corresponding preset threshold value, the imaging information of the multi-focal length phase coherent imaging module is collected, and the imaging information includes resolution data, contrast data, distortion data, signal-to-noise ratio data and dynamic range data. The resolution data, contrast data, distortion data, signal-to-noise ratio data and dynamic range data are numerically calculated to obtain an imaging evaluation value. If the imaging evaluation value exceeds the preset imaging evaluation threshold value, a measurement abnormality signal is generated; If the imaging evaluation value does not exceed the preset imaging evaluation threshold, the processing information of the visual processing module is collected, and the processing information includes processing efficiency data, processing delay data and processing jamming data. The processing efficiency data, processing delay data and processing jamming data are numerically calculated to obtain a processing evaluation value; if the processing evaluation value exceeds the preset processing evaluation threshold, an operation and measurement abnormality signal is generated; if the processing evaluation value does not exceed the preset processing evaluation threshold, a normal operation and measurement signal is generated.
5. The optical measuring machine vision system of multi-focal phase coherent imaging according to claim 4, characterized in that: The control platform is communicatively connected with the fortune risk decision module, which is used to perform fortune risk decision analysis on the system during operation, generate a high-risk fortune signal or a low-risk fortune signal through analysis, and send the high-risk fortune signal to the control platform. When the control platform receives the high-risk fortune signal, it will display it and issue a corresponding warning.
6. The optical measuring machine vision system of multi-focal phase coherent imaging according to claim 5, characterized in that: The specific analysis process of the risk decision analysis is as follows: The components that need to be supervised during the system operation are collected in real time, and the corresponding components are marked as monitoring target i, where i is a natural number greater than 1; the operating parameters required for real-time detection of monitoring target i are obtained, and it is determined whether the corresponding operating parameters meet the corresponding parameter requirements. If all operating parameters of monitoring target i meet the corresponding parameter requirements, it is determined that there is no operating risk for monitoring target i; if there is no operating risk for all monitoring targets i, environmental hazard monitoring and analysis are performed, otherwise a high-risk operation signal is generated.
7. The optical measuring machine vision system of multi-focal phase coherent imaging according to claim 6, characterized in that: The specific analysis process of environmental hazard monitoring and analysis is as follows: Collect environmental information of the environment in which the system is operating, including environmental temperature deviation value, environmental humidity deviation value and environmental dust concentration data, and perform numerical calculations on the environmental temperature deviation value, environmental humidity deviation value and environmental dust concentration data to obtain an environmental detection value; if the environmental detection value exceeds a preset environmental detection threshold, a high-risk signal is generated; If the environmental detection value does not exceed the preset environmental detection threshold, a low risk signal is generated.
Citation Information
Patent Citations
Material fracture surface microscopic three-dimensional topography interference detection device and detection and data processing method thereof
CN104390604A