Fastener status detection method, system and readable storage medium

By generating three-dimensional images to determine the fastener status, the problems of low efficiency and high cost of bolt status detection in the prior art are solved, and high accuracy and low cost of fastener status detection are achieved, which extends the service life.

CN112819752BActive Publication Date: 2024-11-01CHINA RAILWAY CONSTR HEAVY IND
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202110007450.3
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2021-01-05
Publication Date
2024-11-01
Estimated Expiration
2041-01-05

AI Technical Summary

Technical Problem

In the prior art, the bolt status detection efficiency is low and the cost is high, and environmental changes and rust stains affect the detection accuracy, making it difficult to achieve intelligent inspection.

Method used

By acquiring the position data of the fastener, generating point cloud data and establishing a three-dimensional image, determining the status of the fastener, avoiding contact detection and background distinction, and improving detection accuracy and efficiency.

Benefits of technology

The status detection of non-contact fasteners is realized, which reduces costs, improves detection accuracy and scope of application, reduces the frequency of fastening operations, and extends service life.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112819752B_ABST
    Figure CN112819752B_ABST
Patent Text Reader

Abstract

According to an embodiment of the present invention, a fastener status detection method, system and readable storage medium are proposed. Among them, the fastener status detection method includes: obtaining point cloud data of a preset area where the fastener is set according to the position data of the fastener; establishing a three-dimensional image of the preset area according to the point cloud data; and determining the status of the fastener based on the three-dimensional image. The fastener status detection method provided by the embodiment of the present invention realizes non-contact acquisition of the three-dimensional image of the fastener, avoids the problem of damaging the shape of the fastener caused by contact detection of the fastener status, and reduces the detection cost. In addition, by using the three-dimensional image established by the point cloud data to determine the status of the fastener, it is not necessary to distinguish between the fastener and the background of the fastener, which improves the accuracy and efficiency of determining the status of the fastener and avoids the influence of the fastener installation environment, fastener corrosion and fastener staining on the three-dimensional image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of fastener state detection, and in particular to a fastener state detection method, a fastener state detection system and a readable storage medium. Background Art

[0002] At present, the detection of bolt status is mostly in the stage of manual inspection, and there is still a blank period for intelligent inspection methods with practical engineering application value.

[0003] In the related art, there are two methods for detecting the status of bolts: one is to install sensors or other positioning marks on the bolts. When this detection method is used to detect the status of bolts on the track, due to the large number of bolts on the track, the investment cost of sensors or other positioning marks is high, and the operation is complicated and inefficient. The other method is to apply image processing technology to apply color marks on the bolts and identify them through grayscale and binarization. However, when this detection method is used to detect the status of bolts on the track, due to the large changes in the environment near the track, the detected bolts are difficult to distinguish from their background. In addition, the track environment, bolt rust and bolt stains all have a serious impact on the detection accuracy of image processing technology. Summary of the invention

[0004] The present invention aims to solve at least one of the technical problems existing in the prior art or related art.

[0005] To this end, a first aspect of an embodiment of the present invention is to provide a fastener status detection method.

[0006] A second aspect of an embodiment of the present invention provides a fastener status detection system.

[0007] A third aspect of an embodiment of the present invention provides a readable storage medium.

[0008] In view of this, according to a first aspect of an embodiment of the present invention, a fastener status detection method is proposed, comprising: acquiring point cloud data of a preset area where the fastener is set based on position data of the fastener; establishing a three-dimensional image of the preset area based on the point cloud data; and determining the status of the fastener based on the three-dimensional image.

[0009] The fastener status detection method provided by the embodiment of the present invention obtains point cloud data of the area where the fastener is located based on the position data of the fastener, and then establishes a three-dimensional image of the area where the fastener is located based on the point cloud data, so as to determine the state of the fastener based on the three-dimensional image, that is, determine whether the fastener is loose. Further, by obtaining point cloud data to establish a three-dimensional image containing the fastener for determining the state of the fastener, non-contact acquisition of the three-dimensional image of the fastener is achieved, avoiding the problem of damaging the shape of the fastener caused by contact detection of the fastener state, and reducing the detection cost. In addition, by using the three-dimensional image established by the point cloud data to determine the state of the fastener, it is not necessary to distinguish between the fastener and the background of the fastener, thereby improving the accuracy and efficiency of determining the state of the fastener, avoiding the influence of the fastener installation environment, fastener corrosion and fastener staining on the three-dimensional image, and improving the scope of application of the fastener status detection method.

[0010] It should be noted that in this technical solution, the state of the fastener includes a tightened state and a loose state. The tightened state means that the fastener can still achieve a tightening effect that meets the preset standards. The loose state means that the fastener cannot achieve a tightening effect.

[0011] In addition, the fastener status detection method in the above technical solution provided by the present invention may also have the following additional technical features:

[0012] In the above technical solution, before executing the step of determining the state of the fastener according to the three-dimensional image, the fastener state detection method also includes: determining the structural state of the fastener based on the three-dimensional image and the template image of the fastener; confirming that the structural state of the fastener is a complete state, and obtaining the initial parameter value of the fixing part of the fastener relative to the preset area, wherein the initial parameter value includes an initial angle value and / or an initial height value.

[0013] In this technical solution, before detecting the current state of the fastener, the initial parameter value of the fastener relative to the fixing part in the preset area is first obtained, so that when the state of the fastener is subsequently detected, the initial parameter value is used as a reference value to determine the state of the fastener. By setting the initial parameter value, the judgment reference for the current parameter value of the fastener is improved, and the accuracy of the fastener state detection is improved.

[0014] Furthermore, in this technical solution, when obtaining the initial parameter value of the fastener, the structural state of the fastener is first determined to achieve the determination of the initial parameter value when the fastener is in a complete state, thereby ensuring the accuracy of the initial parameter value and thereby improving the accuracy of fastener state detection.

[0015] Furthermore, in the technical solution, the template image of the fastener refers to the template image of the fastener in a complete state. Specifically, the three-dimensional image containing the fastener is compared with the template image of the fastener, and through the template matching method, it is pre-determined whether the fastener is missing or broken, and then the structural state of the fastener is determined.

[0016] Furthermore, in this technical solution, the structural state includes a complete state and an incomplete state, wherein the complete state refers to a state when the fastener is not missing and not broken.

[0017] In any of the above technical solutions, the step of determining the state of the fastener based on the three-dimensional image specifically includes: based on the situation where the initial parameter value includes an initial angle value, obtaining a first current angle value of the fastener relative to the fixing component according to the three-dimensional image; and determining the state of the fastener based on the relationship between the first current angle value and the initial angle value.

[0018] In this technical solution, when the initial parameter value includes an initial angle value, a first current angle value of the fastener relative to the fixing component is obtained, and then the state of the fastener is determined by the relationship between the first current angle value and the initial angle value. By determining the state of the fastener by the relationship between the first current angle value and the initial angle value, the loose state of the fastener caused by tilting can be accurately determined, thereby improving the accuracy of fastener state detection.

[0019] In any of the above technical solutions, the step of determining the state of the fastener based on the relationship between the first current angle value and the initial angle value specifically includes: determining that the fastener is in a loose state when the difference between the first current angle value and the initial angle value is greater than a preset angle threshold.

[0020] In this technical solution, when the difference between the first current angle value and the initial angle value is greater than a preset angle threshold, the fastener is determined to be in a loose state. When the difference between the first current angle value and the initial angle value is not greater than the preset angle threshold, the fastener is determined to be in a tightened state. Specifically, the difference between the first current angle value and the initial angle value reflects the angle at which the fastener deviates from the reference position. By setting the difference to be greater than the preset angle threshold, the fastener is determined to be in a loose state, thereby reserving a certain range of tilting space for the fastener, avoiding determining the fastener as a loose state when the fastener deviates less from the reference position, resulting in frequent tightening operations on the fastener. Furthermore, by reducing the tightening operations on the fastener, it is achieved to reduce maintenance costs and increase the service life of the fastener.

[0021] Furthermore, in this technical solution, the preset angle threshold is 3 degrees. By setting the preset angle threshold to 3 degrees, on the one hand, it can be ensured that the current state of the fastener will not affect its fastening effect on the fastened component, and on the other hand, it is avoided that the fastener is fastened too frequently, which affects the service life of the fastener.

[0022] In any of the above technical solutions, the step of determining the state of the fastener based on the three-dimensional image specifically includes: based on the situation where the initial parameter value includes an initial height value, obtaining a first current height value of the fastener relative to the fixing component according to the three-dimensional image; and determining the state of the fastener based on the relationship between the first current height value and the initial height value.

[0023] In this technical solution, when the initial parameter value includes an initial height value, a first current height value of the fastener relative to the fixing component is obtained, and then the state of the fastener is determined by the relationship between the first current height value and the initial height value. The state of the fastener is determined by the relationship between the first current height value and the initial height value, and the loose state caused by the fastener being separated from the fixed component can be accurately determined, thereby improving the accuracy of fastener state detection.

[0024] In any of the above technical solutions, the step of determining the state of the fastener based on the relationship between the first current height value and the initial height value specifically includes: when the difference between the first current height value and the initial height value is greater than the first preset height threshold, determining that the fastener is in a loose state.

[0025] In this technical solution, when the difference between the first current height value and the initial height value is greater than the first preset height threshold, the fastener is determined to be in a loose state. When the difference between the first current height value and the initial height value is not greater than the first preset height threshold, the fastener is determined to be in a tightened state. Specifically, the difference between the first current height value and the initial height value reflects the height of the component to which the fastener is fixed. By setting the difference to be greater than the first preset height threshold, the fastener is determined to be in a loose state, thereby reserving a certain range of change space between the fastener and the fixed component, thereby avoiding determining the fastener as a loose state when the distance between the fastener and the fixed component changes less, resulting in frequent tightening operations on the fastener. Furthermore, by reducing the tightening operations on the fastener, it is achieved to reduce maintenance costs and increase the service life of the fastener.

[0026] Furthermore, in the technical solution, when a threaded structure is provided on the fastener, the first preset height threshold is 1 / 2 of a thread pitch of the fastener. By associating the second preset height threshold with the structure of the fastener itself, the application scope of the fastener status detection method is improved, making the application scope of the detection method wider, and when the model and size of the fastener change, the accuracy and precision of the status detection will not be affected.

[0027] In any of the above technical solutions, the step of determining the state of the fastener based on the three-dimensional image specifically includes: based on the situation where the initial parameter value includes an initial angle value and an initial height value, based on the three-dimensional image, obtaining a second current angle value of the fastener relative to the fixing component, and a second current height value of the fastener relative to the fixing component; and determining the state of the fastener based on the relationship between the second current angle value and the initial angle value, and the relationship between the second current height value and the initial height value.

[0028] In this technical solution, by judging the state of the fastener from two aspects, namely, angle change and height change, on the one hand, the loose state of the fastener caused by tilting can be accurately judged; on the other hand, the loose state caused by the fastener detaching from the fixed component can be accurately judged, thereby realizing multi-dimensional judgment of the state of the fastener and improving the accuracy and precision of fastener state detection.

[0029] In any of the above technical solutions, based on the relationship between the second current angle value and the initial angle value of the fastener, and the relationship between the second current height value and the initial height value of the fastener, the step of determining the state of the fastener specifically includes: when the difference between the second current angle value and the initial angle value meets the preset conditions, and the difference between the second current height value and the initial height value is greater than the second preset height threshold, determining that the fastener is in a loose state.

[0030] In this technical solution, when the difference between the second current angle value and the initial angle value meets the preset conditions, and the difference between the second current height value and the initial height value is greater than the second preset height threshold, the fastener is determined to be in a loose state. When the difference between the second current angle value and the initial angle value does not meet the preset conditions, or the difference between the second current height value and the initial height value is not greater than the second preset height threshold, the fastener is determined to be in a fastened state. By judging the state of the fastener from two aspects, namely, the loose state of the fastener caused by tilting can be accurately judged on the one hand, and the loose state caused by the fastener being separated from the fixed component can be accurately judged on the other hand, thereby realizing multi-dimensional judgment of the state of the fastener, improving the accuracy and precision of the fastener state detection, and making the detection result of the fastener state more accurate.

[0031] Furthermore, in this technical solution, the preset condition is that the difference between the angle value and the initial angle value is a positive integer multiple of any angle between 50° and 60°.

[0032] Furthermore, in the technical solution, the preset condition is that the difference between the angle value and the initial angle value is a positive integer multiple of 60°, that is, the difference is 60°, 120°, 180°, etc. By setting the preset condition that the difference between the angle value and the initial angle value is a positive integer multiple of 60°, it is avoided that when the fastener is a hexagonal bolt, when the hexagonal bolt rotates a positive integer multiple of 60°, the change in angle cannot be recognized, resulting in the problem that the fastener state cannot be determined by the angle.

[0033] Furthermore, in the technical solution, when a thread structure is provided on the fastener, the second preset height threshold is 1 / 6 of a thread pitch of the fastener. By associating the second preset height threshold with the structure of the fastener itself, the application scope of the fastener status detection method is improved, making the application scope of the detection method wider, and when the model and size of the fastener change, the accuracy and precision of the status detection will not be affected.

[0034] In any of the above technical solutions, the fastener status detection method also includes: determining the number of point clouds of the fastener along the height direction according to the point cloud data; and performing a tightening operation on the fastener based on the relationship between the number of point clouds and a preset value.

[0035] In this technical solution, the number of point clouds in the area of ​​the fastener along the high zone direction is determined according to the point cloud data, and then according to the relationship between the number of point clouds and the preset value, it is possible to determine whether there are no obstacles within the preset range of the fastener. When the judgment result is yes, that is, there are no obstacles within the preset range of the fastener, at this time, the fastening operation can be performed on the fastener. When the judgment result is no, it means that there are obstacles within the preset range of the fastener. If the fastening operation is continued to be performed on the fastener at this time, on the one hand, the obstacles will hinder the fastening effect of the fastener, and on the other hand, the fastener will also damage the obstacles. By first determining whether there are foreign objects invading the surroundings of the fastener, and then performing the fastening operation on the fastener, it is possible to avoid the foreign objects around the fastener affecting the fastening operation. In addition, by determining whether there are no obstacles within the preset range of the fastener, it is also possible to avoid the surrounding parts of the fastener being damaged when the fastening device performs the fastening operation on the fastener, thereby improving the safety of the maintenance operation. Specifically, when the number of point clouds is greater than the preset value, it is determined that there are obstacles within the preset range of the fastener. At this time, it is necessary to deal with the obstacles first to avoid the obstacles affecting the fastening operation. When the number of point clouds is less than a preset value, it is determined that there are no obstacles within the preset range of the fastener. At this time, the fastening operation can be directly performed on the fastener.

[0036] According to a second aspect of an embodiment of the present invention, a fastener status detection system is proposed, comprising: a line structured light sensor for acquiring point cloud data; a memory for storing a computer program; and a processor for executing the computer program to: implement the steps of the fastener status detection method in any of the above technical solutions.

[0037] The fastener status detection system provided by the embodiment of the present invention can implement the steps of the fastener status detection method in any of the above technical solutions. Therefore, it has all the technical effects of the fastener status detection method in any of the above technical solutions, which will not be repeated here.

[0038] According to a third aspect of an embodiment of the present invention, the present invention provides a readable storage medium having a computer program stored thereon, and when the computer program is executed by a processor, the steps of the fastener status detection method in any of the above technical solutions are implemented.

[0039] The readable storage medium provided by the embodiment of the present invention stores a computer program thereon. When the computer program is executed by a processor, the steps of the fastener status detection method in any of the above-mentioned technical solutions are implemented. Therefore, it has all the technical effects of the fastener status detection method in any of the above-mentioned technical solutions, which will not be repeated here.

[0040] Additional aspects and advantages of the present invention will become apparent from the following description or may be learned by practice of the present invention. BRIEF DESCRIPTION OF THE DRAWINGS

[0041] The above and / or additional aspects and advantages of the present invention will become apparent and easily understood from the description of the embodiments in conjunction with the following drawings, in which:

[0042] Figure 1 A flow chart showing a fastener status detection method according to an embodiment of the present invention;

[0043] Figure 2 A flowchart showing a fastener status detection method according to another embodiment of the present invention is shown;

[0044] Figure 3 A flowchart showing a fastener status detection method according to another embodiment of the present invention is shown;

[0045] Figure 4 A flowchart showing a fastener status detection method according to another embodiment of the present invention is shown;

[0046] Figure 5 A flowchart showing a fastener status detection method according to another embodiment of the present invention is shown;

[0047] Figure 6 A flowchart showing a fastener status detection method according to another embodiment of the present invention is shown;

[0048] Figure 7 A schematic structural diagram of a fastener status detection system according to an embodiment of the present invention is shown;

[0049] Figure 8 A schematic structural diagram of a fastener according to an embodiment of the present invention is shown;

[0050] Fig. 9 A schematic structural diagram of a fastener according to another embodiment of the present invention is shown;

[0051] Fig.10 A schematic structural diagram of a fastener according to another embodiment of the present invention is shown;

[0052] Fig.11 A schematic structural diagram of a fastener according to another embodiment of the present invention is shown.

[0053] The corresponding relationship between the reference numerals and the component names is as follows:

[0054] 700 fastener status detection system, 702 line structured light sensor, 704 memory, 706 processor, 800 fastener, 802 upper surface of the nut of the fastener, 804 upper surface of the screw of the fastener, 900 upper surface of the embedded iron seat of the rail. DETAILED DESCRIPTION

[0055] In order to more clearly understand the above-mentioned purpose, features and advantages of the present invention, the present invention is further described in detail below in conjunction with the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features in the embodiments can be combined with each other without conflict.

[0056] In the following description, many specific details are set forth to facilitate a full understanding of the present invention. However, the present invention may also be implemented in other ways different from those described herein. Therefore, the protection scope of the present invention is not limited to the specific embodiments disclosed below.

[0057] Refer to the following Figures 1 to 11 A fastener status detection method, a fastener status detection system, and a readable storage medium are described according to some embodiments of the present invention.

[0058] Embodiment 1

[0059] like Figure 1 As shown, embodiment 1 proposes a fastener status detection method, including:

[0060] Step 102, acquiring point cloud data of a preset area where the fastener is disposed according to the position data of the fastener;

[0061] Step 104, creating a three-dimensional image of a preset area based on the point cloud data;

[0062] Step 106 , determining the state of the fastener based on the three-dimensional image.

[0063] The fastener status detection method provided by the embodiment of the present invention obtains point cloud data of the area where the fastener is located based on the position data of the fastener, and then establishes a three-dimensional image of the area where the fastener is located based on the point cloud data, so as to determine the state of the fastener based on the three-dimensional image, that is, determine whether the fastener is loose. Further, by obtaining point cloud data to establish a three-dimensional image containing the fastener for determining the state of the fastener, non-contact acquisition of the three-dimensional image of the fastener is achieved, avoiding the problem of damaging the shape of the fastener caused by contact detection of the fastener state, and reducing the detection cost. In addition, by using the three-dimensional image established by the point cloud data to determine the state of the fastener, it is not necessary to distinguish between the fastener and the background of the fastener, thereby improving the accuracy and efficiency of determining the state of the fastener, avoiding the influence of the fastener installation environment, fastener corrosion and fastener staining on the three-dimensional image, and improving the scope of application of the fastener status detection method.

[0064] It should be noted that, in this embodiment, the state of the fastener includes a tightened state and a loose state. The tightened state means that the fastener can still achieve a tightening effect that meets the preset standard. The loose state means that the fastener cannot achieve a tightening effect.

[0065] Further, based on the above embodiment, before executing the step of determining the state of the fastener according to the three-dimensional image, the fastener state detection method also includes: determining the structural state of the fastener based on the three-dimensional image and the template image of the fastener; confirming that the structural state of the fastener is a complete state, and obtaining the initial parameter value of the fixing part of the fastener relative to the preset area, wherein the initial parameter value includes an initial angle value and / or an initial height value.

[0066] In a specific embodiment, Figure 2 As shown, the fastener status detection method includes:

[0067] Step 202, acquiring point cloud data of a preset area where the fastener is disposed according to the position data of the fastener;

[0068] Step 204, creating a three-dimensional image of a preset area based on the point cloud data;

[0069] Step 206, judging whether the structural state of the fastener is a complete state based on the three-dimensional image and the template image of the fastener, and if the judgment result is yes, executing step 208, and if the judgment result is no, executing ends;

[0070] Step 208, obtaining initial parameter values ​​of the fixing component of the fastener relative to the preset area, wherein the initial parameter values ​​include initial angle values ​​and / or initial height values;

[0071] Step 210 , determining the state of the fastener based on the three-dimensional image.

[0072] In this embodiment, before detecting the current state of the fastener, the initial parameter value of the fastener relative to the fixing component in the preset area is first obtained, so that when the state of the fastener is subsequently detected, the initial parameter value is used as a reference value to determine the state of the fastener. By setting the initial parameter value, the judgment reference for the current parameter value of the fastener is improved, and the accuracy of the fastener state detection is improved.

[0073] It should be noted that the preset area has at least two fixed components. When obtaining the initial angle value and the initial height value, the same fixed component and / or different fixed components in the preset area can be selected as a reference benchmark.

[0074] like Figure 8 and Fig. 9 As shown, in a specific embodiment, the fastener 800 is a single-toe spring fastener, and the fixed component in the preset area is a rail. The initial height H is the vertical distance between the upper surface 802 of the nut of the fastener and the upper surface 900 of the embedded iron seat of the rail. The initial angle β is the angle between the extension line of the nut side straight line L1 of the fastener and the straight line L2 along the rail. In this embodiment, when obtaining the initial angle value and the initial height value, the same fixed component in the preset area is used as a reference benchmark.

[0075] It should be noted that in this embodiment, the ground can also be used as the reference line, the height of the upper surface 802 of the nut of the fastener relative to the ground is H1, and the height of the upper surface 900 of the embedded iron seat of the rail relative to the ground is H2. At this time, the initial height is the difference between H1 and H2. Among them, L2 and H2 are the fixed references of the single-toe spring fastener, and will not change significantly due to the loosening of the single-toe spring fastener.

[0076] Furthermore, if Fig.10 and Fig.11 As shown, in another specific embodiment, the fastener 800 is a spring bar I type fastener. When obtaining the initial angle value, the fixed component in the preset area is a rail, and the initial angle γ is the angle between the extension line of the nut side straight line L3 of the fastener and the straight line L4 along the rail. When obtaining the initial height value, the fixed component in the preset area is the screw of the fastener, wherein the initial height H is the vertical distance between the upper surface 802 of the nut of the fastener and the upper surface 804 of the screw of the fastener. In this embodiment, when obtaining the initial angle value and the initial height value, different fixed components in the preset area are used as reference datums.

[0077] It should be noted that in this embodiment, the ground can also be used as the reference line, the height of the upper surface 802 of the nut of the fastener relative to the ground is H3, and the height of the upper surface 804 of the screw of the fastener relative to the ground is H4. In this case, the initial height is the difference between H3 and H4. Among them, L4 and H4 are the fixed references of the spring clip type I fastener, and will not change significantly due to the loosening of the spring clip type I fastener.

[0078] Furthermore, in this embodiment, when obtaining the initial parameter value of the fastener, the structural state of the fastener is first determined, so that the initial parameter value is determined when the fastener is in a complete state, the accuracy of the initial parameter value is ensured, and the accuracy of the fastener state detection is improved.

[0079] Furthermore, in this embodiment, the template image of the fastener refers to the template image when the fastener is in a complete state. Specifically, the three-dimensional image containing the fastener is compared with the template image of the fastener, and through the template matching method, it is pre-determined whether the fastener is missing or broken, and then the structural state of the fastener is determined.

[0080] Further, in this embodiment, the structural state includes a complete state and an incomplete state, wherein the complete state refers to a state when the fastener is not missing and not broken.

[0081] Embodiment 2

[0082] Based on any of the above embodiments, the step of determining the state of the fastener based on the three-dimensional image specifically includes: based on the situation where the initial parameter value includes an initial angle value, obtaining a first current angle value of the fastener relative to the fixing component according to the three-dimensional image; and determining the state of the fastener based on the relationship between the first current angle value and the initial angle value.

[0083] In a specific embodiment, Figure 3 As shown, the fastener status detection method includes:

[0084] Step 302, acquiring point cloud data of a preset area where the fastener is disposed according to the position data of the fastener;

[0085] Step 304, creating a three-dimensional image of a preset area based on the point cloud data;

[0086] Step 306, based on the three-dimensional image and the template image of the fastener, determine whether the structural state of the fastener is a complete state, if the determination result is yes, execute step 308, if the determination result is no, execute the end;

[0087] Step 308, obtaining initial parameter values ​​of the fixing component of the fastener relative to the preset area, wherein the initial parameter values ​​include initial angle values;

[0088] Step 310, obtaining a first current angle value of the fastener relative to the fixing component according to the three-dimensional image;

[0089] Step 312, determining the state of the fastener based on the relationship between the first current angle value and the initial angle value.

[0090] In this embodiment, when the initial parameter value includes an initial angle value, a first current angle value of the fastener relative to the fixing component is obtained, and then the state of the fastener is determined by the relationship between the first current angle value and the initial angle value. By determining the state of the fastener by the relationship between the first current angle value and the initial angle value, the loose state of the fastener caused by tilting can be accurately determined, thereby improving the accuracy of fastener state detection.

[0091] Further, based on the above embodiment, the step of determining the state of the fastener according to the relationship between the first current angle value and the initial angle value specifically includes: when the difference between the first current angle value and the initial angle value is greater than a preset angle threshold, determining that the fastener is in a loose state.

[0092] In this embodiment, when the difference between the first current angle value and the initial angle value is greater than the preset angle threshold, the fastener is determined to be in a loose state. When the difference between the first current angle value and the initial angle value is not greater than the preset angle threshold, the fastener is determined to be in a tightened state. Specifically, the difference between the first current angle value and the initial angle value reflects the angle at which the fastener deviates from the reference position. By setting the difference to be greater than the preset angle threshold, the fastener is determined to be in a loose state, thereby reserving a certain range of tilting space for the fastener, avoiding determining the fastener as a loose state when the fastener deviates less from the reference position, resulting in frequent tightening operations on the fastener. Furthermore, by reducing the tightening operations on the fastener, it is achieved to reduce maintenance costs and increase the service life of the fastener.

[0093] Furthermore, in this embodiment, the preset angle threshold is 3 degrees. By setting the preset angle threshold to 3 degrees, on the one hand, it can be ensured that the current state of the fastener will not affect its fastening effect on the fastened component, and on the other hand, it is avoided that the fastening operation of the fastener is performed too frequently, which affects the service life of the fastener.

[0094] Embodiment 3

[0095] Based on any of the above embodiments, the step of determining the state of the fastener based on the three-dimensional image specifically includes: based on the situation where the initial parameter value includes an initial height value, obtaining a first current height value of the fastener relative to the fixing component according to the three-dimensional image; and determining the state of the fastener based on the relationship between the first current height value and the initial height value.

[0096] In a specific embodiment, Figure 4 As shown, the fastener status detection method includes:

[0097] Step 402, acquiring point cloud data of a preset area where the fastener is disposed according to the position data of the fastener;

[0098] Step 404, creating a three-dimensional image of a preset area based on the point cloud data;

[0099] Step 406, based on the three-dimensional image and the template image of the fastener, determine whether the structural state of the fastener is a complete state, if the determination result is yes, execute step 408, if the determination result is no, the execution ends;

[0100] Step 408, obtaining initial parameter values ​​of the fixing component of the fastener relative to the preset area, wherein the initial parameter values ​​include an initial height value;

[0101] Step 410, obtaining a first current height value of the fastener relative to the fixing component according to the three-dimensional image;

[0102] Step 412, determining a state of the fastener based on a relationship between the first current height value and the initial height value.

[0103] In this embodiment, when the initial parameter value includes an initial height value, a first current height value of the fastener relative to the fixing component is obtained, and then the state of the fastener is determined by the relationship between the first current height value and the initial height value. By determining the state of the fastener by the relationship between the first current height value and the initial height value, the loose state caused by the fastener being separated from the fixed component can be accurately determined, thereby improving the accuracy of fastener state detection.

[0104] Further, based on the above embodiment, the step of determining the state of the fastener based on the relationship between the first current height value and the initial height value specifically includes: when the difference between the first current height value and the initial height value is greater than a first preset height threshold, determining that the fastener is in a loose state.

[0105] In this embodiment, when the difference between the first current height value and the initial height value is greater than the first preset height threshold, the fastener is determined to be in a loose state. When the difference between the first current height value and the initial height value is not greater than the first preset height threshold, the fastener is determined to be in a tightened state. Specifically, the difference between the first current height value and the initial height value reflects the height of the fastener fixed component. By setting the difference to be greater than the first preset height threshold, the fastener is determined to be in a loose state, which is achieved by reserving a certain range of change space between the fastener and the fixed component, avoiding determining the fastener as a loose state when the distance between the fastener and the fixed component changes less, resulting in frequent tightening operations on the fastener. Furthermore, by reducing the tightening operations on the fastener, it is achieved to reduce maintenance costs and increase the service life of the fastener.

[0106] Furthermore, in this embodiment, when a thread structure is provided on the fastener, the first preset height threshold is 1 / 2 of a thread pitch of the fastener. By associating the second preset height threshold with the structure of the fastener itself, the application scope of the fastener status detection method is improved, making the application scope of the detection method wider, and when the model and size of the fastener change, the accuracy and precision of the status detection will not be affected.

[0107] Embodiment 4

[0108] On the basis of the first embodiment, the step of determining the state of the fastener based on the three-dimensional image specifically includes: based on the situation that the initial parameter value includes an initial angle value and an initial height value, based on the three-dimensional image, obtaining a second current angle value of the fastener relative to the fixing component, and a second current height value of the fastener relative to the fixing component; based on the relationship between the second current angle value and the initial angle value, and the relationship between the second current height value and the initial height value, determining the state of the fastener.

[0109] In a specific embodiment, Figure 5 As shown, the fastener status detection method includes:

[0110] Step 502, acquiring point cloud data of a preset area where the fastener is disposed according to the position data of the fastener;

[0111] Step 504, creating a three-dimensional image of a preset area based on the point cloud data;

[0112] Step 506, based on the three-dimensional image and the template image of the fastener, determine whether the structural state of the fastener is a complete state, if the determination result is yes, execute step 508, if the determination result is no, the execution ends;

[0113] Step 508, obtaining initial parameter values ​​of the fixing component of the fastener relative to the preset area, wherein the initial parameter values ​​include an initial angle value and an initial height value;

[0114] Step 510, obtaining a second current angle value of the fastener relative to the fixing component and a second current height value of the fastener relative to the fixing component according to the three-dimensional image;

[0115] Step 512, determining the state of the fastener based on the relationship between the second current angle value and the initial angle value, and the relationship between the second current height value and the initial height value.

[0116] In this embodiment, by judging the state of the fastener from two aspects, namely, angle change and height change, on the one hand, the loose state of the fastener caused by tilting can be accurately judged; on the other hand, the loose state caused by the fastener detaching from the fixed component can be accurately judged, thereby realizing multi-dimensional judgment of the state of the fastener and improving the accuracy and precision of fastener state detection.

[0117] Further, on the basis of the above embodiments, based on the relationship between the second current angle value and the initial angle value of the fastener, and the relationship between the second current height value and the initial height value of the fastener, the step of determining the state of the fastener specifically includes: when the difference between the second current angle value and the initial angle value meets the preset conditions, and the difference between the second current height value and the initial height value is greater than the second preset height threshold, determining that the fastener is in a loose state.

[0118] In this embodiment, when the difference between the second current angle value and the initial angle value meets the preset condition, and the difference between the second current height value and the initial height value is greater than the second preset height threshold, the fastener is determined to be in a loose state. When the difference between the second current angle value and the initial angle value does not meet the preset condition, or the difference between the second current height value and the initial height value is not greater than the second preset height threshold, the fastener is determined to be in a fastened state. By judging the state of the fastener from two aspects, namely, the loose state of the fastener caused by tilting can be accurately judged on the one hand, and the loose state caused by the fastener being separated from the fixed component can be accurately judged on the other hand, thereby realizing multi-dimensional judgment of the state of the fastener, improving the accuracy and precision of the fastener state detection, and making the detection result of the fastener state more accurate.

[0119] Further, in this embodiment, the preset condition is that the difference between the angle value and the initial angle value is a positive integer multiple of any angle between 50° and 60°.

[0120] Further, in this embodiment, the preset condition is that the difference between the angle value and the initial angle value is a positive integer multiple of 60°, that is, the difference is 60°, 120°, 180°, etc. By setting the preset condition that the difference between the angle value and the initial angle value is a positive integer multiple of 60°, it is avoided that when the fastener is a hexagonal bolt, when the hexagonal bolt rotates a positive integer multiple of 60°, the change in angle cannot be recognized, resulting in the problem that the state of the fastener cannot be determined by the angle.

[0121] Furthermore, in this embodiment, when a thread structure is provided on the fastener, the second preset height threshold is 1 / 6 of a thread pitch of the fastener. By associating the second preset height threshold with the structure of the fastener itself, the application scope of the fastener status detection method is improved, making the application scope of the detection method wider, and when the model and size of the fastener change, the accuracy and precision of the status detection will not be affected.

[0122] Embodiment 5

[0123] Based on any of the above embodiments, the fastener status detection method further includes: determining the number of point clouds of the fastener along the height direction according to the point cloud data; and performing a tightening operation on the fastener based on a relationship between the number of point clouds and a preset value.

[0124] In a specific embodiment, Figure 6 As shown, the fastener status detection method includes:

[0125] Step 602, acquiring point cloud data of a preset area where the fastener is disposed according to the position data of the fastener;

[0126] Step 604, creating a three-dimensional image of a preset area based on the point cloud data;

[0127] Step 606, judging whether the fastener is in a loose state based on the three-dimensional image, if the judgment result is yes, executing step 608, if the judgment result is no, the execution ends;

[0128] Step 608, determining the number of point clouds of the fastener along the height direction according to the point cloud data;

[0129] Step 610, based on the relationship between the number of point clouds and the preset value, determine whether there is no obstacle within the preset range of the fastener. If the judgment result is yes, execute step 612, and if the judgment result is no, the execution ends;

[0130] Step 612, performing a tightening operation on the fastener.

[0131] In this embodiment, the number of point clouds in the area of ​​the fastener along the high zone direction is determined according to the point cloud data, and then according to the relationship between the number of point clouds and the preset value, it is realized to judge whether there is no obstacle in the preset range of the fastener. When the judgment result is yes, that is, there is no obstacle in the preset range of the fastener, at this time, the fastening operation can be performed on the fastener. When the judgment result is no, it means that there is an obstacle in the preset range of the fastener. If the fastening operation is continued to be performed on the fastener at this time, on the one hand, the obstacle will hinder the fastening effect of the fastener, and on the other hand, the fastener will also damage the obstacle. By first judging whether there is foreign matter invading the surroundings of the fastener, and then performing the fastening operation on the fastener, it is possible to avoid the foreign matter around the fastener affecting the fastening operation. In addition, by judging whether there is no obstacle in the preset range of the fastener, it is also possible to avoid the surrounding parts of the fastener being damaged when the fastening device performs the fastening operation on the fastener, thereby improving the safety of the maintenance operation. Specifically, when the number of point clouds is greater than the preset value, it is judged that there is an obstacle in the preset range of the fastener. At this time, it is necessary to deal with the obstacle first to avoid the obstacle affecting the fastening operation. When the number of point clouds is less than a preset value, it is determined that there are no obstacles within the preset range of the fastener. At this time, the fastening operation can be directly performed on the fastener.

[0132] Embodiment 6

[0133] like Figure 7 As shown, embodiment six proposes a fastener state detection system 700, including: a line structured light sensor 702, used to obtain point cloud data; a memory 704, used to store computer programs; a processor 706, used to execute the computer program to: implement the steps of the fastener state detection method in any of the above technical solutions.

[0134] The fastener status detection system 700 provided in the embodiment of the present invention can implement the steps of the fastener status detection method in any of the above technical solutions. Therefore, it has all the technical effects of the fastener status detection method in any of the above technical solutions, which will not be repeated here.

[0135] Embodiment 7

[0136] Embodiment 7 proposes a readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the fastener status detection method in any of the above technical solutions are implemented.

[0137] The readable storage medium provided by the embodiment of the present invention stores a computer program thereon. When the computer program is executed by a processor, the steps of the fastener status detection method in any of the above-mentioned technical solutions are implemented. Therefore, it has all the technical effects of the fastener status detection method in any of the above-mentioned technical solutions, which will not be repeated here.

[0138] It should be noted that in the claims, any reference signs placed between brackets shall not be construed as limiting the claims. The word "comprising" does not exclude the presence of components or steps not listed in the claim. The word "a" or "an" preceding a component does not exclude the presence of a plurality of such components. The invention may be implemented by means of hardware comprising several different components and by means of a suitably programmed computer. In a unit claim enumerating several means, several of these means may be embodied by the same item of hardware. The use of the words first, second, and third etc. does not indicate any order. These words may be interpreted as names.

[0139] Although the preferred embodiments of the present invention have been described, those skilled in the art may make other changes and modifications to these embodiments once they have learned the basic creative concept. Therefore, the appended claims are intended to be interpreted as including the preferred embodiments and all changes and modifications that fall within the scope of the present invention.

[0140] The above are only preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. A fastener status detection method, characterized in that: The fastener status detection method comprises: Acquiring point cloud data of a preset area where the fastener is disposed according to the position data of the fastener; Creating a three-dimensional image of the preset area based on the point cloud data; determining a status of the fastener based on the three-dimensional image; Before performing the step of determining the state of the fastener according to the three-dimensional image, the fastener state detection method further includes: determining a structural state of the fastener based on the three-dimensional image and the template image of the fastener; confirming that the structural state of the fastener is a complete state, obtaining an initial parameter value of a fixing component of the fastener relative to the preset area, Wherein, the initial parameter value includes an initial angle value and / or an initial height value; The step of determining the structural state of the fastener based on the three-dimensional image and the template image of the fastener specifically includes: Comparing the three-dimensional image containing the fastener with the template image of the fastener, and determining in advance whether the fastener is missing or broken by template matching; Wherein, the fastener comprises a single-toe spring fastener and / or a spring bar I-type fastener, the fixing component comprises a rail, and the preset area has at least two of the fixing components; The step of determining the state of the fastener based on the three-dimensional image specifically includes: Based on the fact that the initial parameter value includes an initial angle value and an initial height value, based on the three-dimensional image, acquiring a second current angle value of the fastener relative to the fixing component and a second current height value of the fastener relative to the fixing component; Determining a state of the fastener based on a relationship between the second current angle value and the initial angle value, and a relationship between the second current height value and the initial height value; The step of determining the state of the fastener based on the relationship between the second current angle value and the initial angle value of the fastener, and the relationship between the second current height value and the initial height value of the fastener, specifically includes: When the difference between the second current angle value and the initial angle value meets a preset condition, and the difference between the second current height value and the initial height value is greater than a second preset height threshold, it is determined that the fastener is in a loose state; The preset condition is that the difference between the second current angle value and the initial angle value is a positive integer multiple of 60°.

2. The fastener status detection method according to claim 1, characterized in that: The step of determining the state of the fastener based on the three-dimensional image specifically comprises: Based on the fact that the initial parameter value includes the initial angle value, obtaining a first current angle value of the fastener relative to the fixing component according to the three-dimensional image; Based on a relationship between the first current angle value and the initial angle value, a state of the fastener is determined.

3. The fastener status detection method according to claim 2, characterized in that: The step of determining the state of the fastener according to the relationship between the first current angle value and the initial angle value specifically includes: When the difference between the first current angle value and the initial angle value is greater than a preset angle threshold, it is determined that the fastener is in a loose state.

4. The fastener status detection method according to claim 1, characterized in that: The step of determining the state of the fastener based on the three-dimensional image specifically comprises: Based on the fact that the initial parameter value includes the initial height value, obtaining a first current height value of the fastener relative to the fixing component according to the three-dimensional image; Based on a relationship between the first current height value and the initial height value, a state of the fastener is determined.

5. The fastener status detection method according to claim 4, characterized in that: The step of determining the state of the fastener based on the relationship between the first current height value and the initial height value specifically includes: When the difference between the first current height value and the initial height value is greater than a first preset height threshold, it is determined that the fastener is in a loose state.

6. The fastener status detection method according to any one of claims 1 to 5, characterized in that: The fastener status detection method further comprises: Determining the number of point clouds of the fastener along a height direction according to the point cloud data; Based on the relationship between the number of point clouds and a preset value, a fastening operation is performed on the fastener.

7. A fastener status detection system, characterized in that: include: Line structured light sensor, used to obtain point cloud data; Memory for storing computer programs; A processor is used to execute the computer program to implement the steps of the fastener status detection method according to any one of claims 1 to 6.

8. A readable storage medium, characterized in that: include: A memory, a processor, and a computer program stored in the memory and executable on the processor; When the computer program is executed by a processor, the steps of the fastener status detection method according to any one of claims 1 to 6 are implemented.