A five-axis gimbal linkage control method and device
By conducting dynamic characteristics testing and multi-modal positioning on the five-axis gimbal, combined with real-time motion control, the coordination and accuracy problems of the multi-axis system in complex shape detection are solved, and efficient and accurate detection effects are achieved.
Patent Information
- Application Number
- CN202411170026.0
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-08-26
- Publication Date
- 2024-11-26
- Estimated Expiration
- 2044-08-26
AI Technical Summary
The existing multi-axis system has insufficient coordination, low accuracy, poor adaptability when dealing with complex shapes or multi-angle detection products, making it difficult to take into account efficiency and accuracy, and the differences in different products affect the universality and flexibility of the detection system.
By conducting dynamic characteristics testing of the five-axis gimbal, a dynamic model is constructed, multi-modal positioning is combined with pressure sensors and structured light scanning technology, a coordinated detection path is generated, and real-time coordinated motion control is carried out to realize multi-angle view of sample surface feature data. , high-quality collection and detection and analysis.
It improves the accuracy and efficiency of sample detection, enhances the optimization and coverage of detection paths, realizes the accuracy and stability of system motion, dynamically optimizes the detection strategy, and improves the flexibility and accuracy of detection.
Smart Images

Figure CN118689167B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to the technical field of pan-tilt linkage control, and in particular to a five-axis pan-tilt linkage control method and device. Background Art
[0002] High-precision and high-efficiency product appearance inspection technology is becoming increasingly important. Traditional manual inspection methods are not only time-consuming and labor-intensive, but also easily affected by subjective factors, and it is difficult to meet the current industrial production requirements for accuracy and consistency. With the development of automation technology, machine vision inspection systems have gradually become mainstream, but ordinary fixed camera systems still have limitations when dealing with products with complex shapes or that require multi-angle inspection.
[0003] In order to solve these problems, multi-axis motion platforms were introduced into visual inspection systems. However, existing multi-axis systems often have problems such as insufficient coordination, low precision, and poor adaptability. Especially when dealing with products with complex shapes and diverse surface features, conventional inspection methods are difficult to balance efficiency and accuracy. In addition, the differences between different products also pose challenges to the versatility and flexibility of the inspection system. Summary of the invention
[0004] The present application provides a five-axis pan-tilt linkage control method and device for improving the accuracy of the five-axis pan-tilt linkage control, thereby improving the accuracy of sample detection.
[0005] In a first aspect, the present application provides a five-axis gimbal linkage control method, the five-axis gimbal linkage control method comprising:
[0006] Conduct dynamic characteristic tests on the five-axis gimbal and build a dynamic model of the five-axis gimbal;
[0007] Based on the five-axis gimbal dynamic model, multi-modal positioning is performed on the sample to be tested to obtain the initial posture data of the sample;
[0008] Generate a five-axis collaborative initial detection path according to the sample initial posture data;
[0009] Based on the five-axis collaborative initial detection path, the five-axis gimbal is subjected to collaborative motion control to obtain real-time five-axis state data;
[0010] Based on the real-time five-axis state data, control the image acquisition device to acquire multi-angle images to obtain sample surface feature data;
[0011] The sample surface feature data is detected, analyzed and optimized to obtain sample detection results and target five-axis collaborative detection strategies.
[0012] In a second aspect, the present application provides a five-axis gimbal linkage control device, the five-axis gimbal linkage control device comprising:
[0013] A construction module is used to test the dynamic characteristics of the five-axis gimbal and build a dynamic model of the five-axis gimbal;
[0014] A positioning module, used to perform multi-modal positioning on the sample to be tested based on the five-axis gimbal dynamic model to obtain initial position data of the sample;
[0015] A generation module, used for generating a five-axis collaborative initial detection path according to the sample initial posture data;
[0016] A control module, used for performing coordinated motion control on the five-axis gimbal based on the five-axis coordinated initial detection path to obtain real-time five-axis state data;
[0017] An acquisition module, used to control an image acquisition device to acquire multi-angle images based on the real-time five-axis state data to obtain sample surface feature data;
[0018] The analysis module is used to detect, analyze and optimize the sample surface feature data to obtain the sample detection results and the target five-axis collaborative detection strategy.
[0019] The third aspect of the present application provides a five-axis gimbal linkage control device, comprising: a memory and at least one processor, wherein the memory stores instructions; the at least one processor calls the instructions in the memory so that the five-axis gimbal linkage control device executes the above-mentioned five-axis gimbal linkage control method.
[0020] A fourth aspect of the present application provides a computer-readable storage medium, in which instructions are stored. When the computer-readable storage medium is run on a computer, the computer executes the above-mentioned five-axis gimbal linkage control method.
[0021] In the technical solution provided by the present application, by testing the dynamic characteristics of the five-axis gimbal and building a dynamic model, the motion characteristics of each axis and the coupling effect between axes can be accurately captured. By combining pressure sensors and structured light scanning technology for multi-modal positioning, the position, posture and morphological information of the sample can be obtained more comprehensively, and the measurement accuracy of the initial posture of the sample is improved. The five-axis collaborative initial detection path is generated based on the initial posture data of the sample, and the working space limitation and kinematic characteristics of the five-axis gimbal are considered, so that the detection path is more optimized, and the detection efficiency and coverage are improved. By performing real-time collaborative motion control on the five-axis gimbal and continuously updating the dynamic model, real-time compensation of motion errors is achieved, and the motion accuracy and stability of the system are improved. Based on the real-time five-axis state data, the image acquisition device is controlled to achieve multi-angle and high-quality image acquisition of the sample, and the integrity and accuracy of the surface feature data are improved. By analyzing the surface feature data of the sample and evaluating the detection effect, the motion parameters and detection path of the five-axis gimbal are dynamically optimized, and the adaptive adjustment of the detection strategy is achieved, which improves the flexibility and efficiency of the detection. The motion control of the five-axis gimbal is closely integrated with sample detection to achieve full process optimization from sample positioning, path planning to detection execution, significantly improving the accuracy of the five-axis gimbal linkage control, thereby improving the accuracy of sample detection. BRIEF DESCRIPTION OF THE DRAWINGS
[0022] In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the accompanying drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are some embodiments of the present invention. For ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without paying creative work.
[0023] Figure 1 This is a schematic diagram of an embodiment of a five-axis gimbal linkage control method in an embodiment of the present application;
[0024] Figure 2 This is a schematic diagram of an embodiment of a five-axis gimbal linkage control device in an embodiment of the present application. DETAILED DESCRIPTION
[0025] The embodiments of the present application provide a five-axis gimbal linkage control method and device. The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present application and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments described herein can be implemented in an order other than that illustrated or described herein. In addition, the terms "including" or "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.
[0026] For ease of understanding, the specific process of the embodiment of the present application is described below. Figure 1 , an embodiment of the five-axis gimbal linkage control method in the embodiment of the present application includes:
[0027] Step S101, performing a dynamic characteristic test on the five-axis gimbal and constructing a dynamic model of the five-axis gimbal;
[0028] It is understandable that the execution subject of the present application can be a five-axis pan-tilt linkage control device, or a terminal or a server, which is not limited here. The present application embodiment is described by taking a server as the execution subject as an example.
[0029] Specifically, a preset motion sequence is executed on each axis of the five-axis gimbal, and the motion data of each axis is collected to obtain the original dynamic response data. The preset motion sequence includes all possible motion states of the five-axis gimbal to ensure that the collected data is comprehensive and representative. The original dynamic response data is preprocessed, and the preprocessing steps include denoising, normalization and filtering to eliminate noise and outliers in the data to obtain the cleaned dynamic response data. According to the cleaned dynamic response data, the single-axis dynamic characteristics of each axis are calculated to obtain the single-axis dynamic parameters of each axis, which include inertia, damping and stiffness. The five-axis gimbal is tested for linkage, and the mutual influence data between the axes are collected to obtain the inter-axis coupling characteristic data. During the linkage test, by applying different composite motion sequences, the interaction effects between the axes are observed to ensure that the obtained inter-axis coupling characteristic data can truly reflect the linkage behavior of the five-axis gimbal. Based on the single-axis dynamic parameters and inter-axis coupling characteristic data, an initial dynamic model of the five-axis gimbal is established. The initial model can preliminarily reflect the dynamic characteristics of the five-axis gimbal in various motion states. Perform parameter analysis on the initial dynamic model to identify potential deficiencies and improvement points in the model, further adjust and optimize the initial model to obtain an adaptive dynamic model. Test and optimize the adaptive dynamic model. The test process includes applying the adaptive dynamic model to the actual five-axis gimbal motion, observing the deviation between the model prediction results and the actual motion data, and continuously adjusting the model parameters to make the model's prediction results more in line with the actual situation. The means of optimization and adjustment include applying optimization algorithms, adding new test data, and improving the model structure, etc., to obtain an accurate and reliable five-axis gimbal dynamic model.
[0030] Step S102: Based on the dynamic model of the five-axis gimbal, multi-modal positioning is performed on the sample to be tested to obtain initial pose data of the sample;
[0031] Specifically, according to the dynamic model of the five-axis gimbal, the five-axis gimbal is initialized and adjusted to ensure that each axis is in a preset reference state, and the initial state data of the gimbal is obtained to ensure that the five-axis gimbal is in a stable and controllable starting state. The weight distribution of the sample to be detected is scanned based on the pressure sensor array, and the weight data of the sample at different positions is measured by a multi-point pressure sensor to obtain the weight distribution data of the sample. The sample to be detected is scanned in three dimensions using a structured light scanner, and high-precision point cloud data of the sample surface is generated by projecting structured light and capturing reflected light. The point cloud data records the geometric shape and detailed features of the sample surface. The sample surface point cloud data is combined with the sample weight distribution data to construct the sample space representation data of the sample to be detected. This space representation data includes not only the external shape of the sample, but also its internal weight distribution characteristics, forming a comprehensive sample model. The sample space representation data is compared and analyzed with the pre-stored standard model. Through comparison and analysis, the deviation between the specific position and shape of the sample and the standard model is calculated to obtain the sample position deviation data. Based on the sample position deviation data, the specific position and direction of the sample to be detected in the five-axis gimbal coordinate system are calculated to obtain the sample pose estimation data. According to the sample pose estimation data, the five-axis gimbal is controlled to adjust the position. By precisely controlling the movement of each axis, the sample is adjusted to the optimal detection position to obtain the adjusted gimbal state data. Through the adjusted gimbal state data, multi-angle image acquisition is performed on the sample to obtain the multi-view image data of the sample. Using these multi-view image data, the surface features and details of the sample are comprehensively observed and recorded from different angles. The multi-view image data of the sample is processed, and the image processing algorithm is used to extract the key feature point data of the sample. These feature point data include edge, corner and texture features. Combined with the sample feature point data, the sample weight distribution data and the dynamic model of the five-axis gimbal, comprehensive analysis and calibration are performed to finally obtain the initial pose data of the sample.
[0032] Step S103, generating a five-axis collaborative initial detection path according to the sample initial posture data;
[0033] Specifically, a three-dimensional detection area model of the sample to be detected is established according to the initial pose data of the sample. By combining the initial pose data with the geometric characteristics of the sample, a complete three-dimensional detection area model is generated to obtain the detection area data, and the detection area data is partitioned to divide the detection area into several detection sub-area sets. These detection sub-area sets help to carry out subsequent detection work more efficiently. For each detection sub-area, its key detection points are determined to obtain a detection point data set. The detection point data set is prioritized, and the priority of the detection points is arranged according to the detection requirements and the important characteristics of the sample to obtain a detection point sequence. The priority evaluation process comprehensively considers the importance, location and relationship of each detection point to ensure that the detection can be carried out in the optimal order during the detection process. Based on the detection point sequence, the preliminary motion path data of the five-axis gimbal is planned. The motion path of the five-axis gimbal is mainly planned based on the shortest path and the least number of movements, so as to minimize unnecessary movement and time consumption. Combined with the workspace restrictions of the five-axis gimbal, the feasibility analysis of the preliminary motion path data is carried out. By analyzing the actual motion range and spatial constraints of the five-axis gimbal, infeasible paths are eliminated and the motion plan is adjusted. Kinematic optimization is performed through the dynamic model of the five-axis gimbal, and the motion path is adjusted and optimized step by step to ensure the smoothness and efficiency of the motion. The five-axis collaborative initial detection path is obtained.
[0034] Step S104, based on the five-axis collaborative initial detection path, the five-axis gimbal is subjected to collaborative motion control to obtain real-time five-axis state data;
[0035] Specifically, the five-axis collaborative initial detection path is segmented, and the path segmentation data is obtained by dividing the initial path into several smaller path segments. Five-axis motion instructions are generated according to the path segmentation data, and specific motion control instructions are generated for each path data segment. These instructions specify the motion state and requirements of the five-axis gimbal in each path segment. The five-axis motion instructions are time-synchronized, and the five-axis collaborative motion timing is obtained by coordinating the motion timing of each axis to ensure that the motion of the five axes in each path segment can be accurately synchronized. According to the five-axis collaborative motion timing, a control signal is sent to the five-axis gimbal to command each axis to move according to the predetermined time and sequence. In this process, the specific position and speed information of the five-axis gimbal is collected in real time through the sensors on each axis to obtain the five-axis real-time motion data. The real-time motion data reflects the state of each axis of the five-axis gimbal during the actual motion process. The five-axis real-time motion data is compared with the five-axis collaborative initial detection path, and the motion error is calculated to obtain the error data. The error data is used to evaluate the deviation between the actual motion and the expected path. By analyzing these errors, problems and deficiencies in the motion process are found. Based on the error data, compensation instructions are generated to adjust the five-axis gimbal in real time to ensure that it can accurately move according to the predetermined path and timing. Through the five-axis motion characteristic data, the dynamic characteristics and motion laws of the five-axis gimbal in different motion states are understood. These motion characteristic data are used to update the dynamic model of the five-axis gimbal and obtain the updated dynamic model parameters. Based on the updated dynamic model parameters, the overall motion state of the five-axis gimbal is comprehensively evaluated to obtain real-time five-axis state data.
[0036] Step S105, based on the real-time five-axis state data, controlling the image acquisition device to acquire multi-angle images to obtain sample surface feature data;
[0037] Specifically, according to the real-time five-axis state data, the position of the camera detection module relative to the sample to be detected is determined to obtain the camera position data. By analyzing these data, the initial camera parameters of the camera detection module are adjusted to ensure that the camera is in the best position for image acquisition. According to the initial camera parameters, the brightness of the coaxial light source is adjusted to achieve the best lighting effect, and the light source setting data is obtained. Based on the light source setting data, the sample to be detected is illuminated and multi-angle original images are taken. These multi-angle original images cover all angles and details of the sample to ensure that no key features are missed. The multi-angle original images are processed, and the image clarity and contrast are improved by enhancement technology to obtain enhanced image data. Based on the enhanced image data, the sample surface features are extracted to obtain two-dimensional feature data. These two-dimensional feature data include the texture, shape and other significant features of the sample surface, which can fully reflect the surface condition of the sample. The two-dimensional feature data are synthesized from multiple angles, and a three-dimensional feature model of the sample surface is constructed by integrating the two-dimensional feature data of different angles. According to the three-dimensional feature model of the sample surface, the data of the area to be inspected is identified. The area to be inspected is the part of the sample surface that needs to be focused on detection and analysis. For the data of the area to be inspected, the five-axis gimbal is controlled to scan to ensure that each area to be inspected can be detected with high precision. During the scanning process, the corresponding high-definition local images are collected. The high-definition local images are combined with the three-dimensional feature model of the sample surface for analysis, and the sample surface feature data is obtained through comparison and comprehensive analysis.
[0038] Step S106: Detect, analyze and optimize the sample surface feature data to obtain the sample detection results and the target five-axis collaborative detection strategy.
[0039] Specifically, the sample surface feature data is feature classified, and the sample surface feature data is subdivided into different types through a classification algorithm to obtain feature type distribution data. According to the feature type distribution data, the sample surface features are analyzed, the possible preliminary defect information is identified, and various feature types and potential problems existing on the sample surface are preliminarily screened and identified. The preliminary defect information is analyzed in multiple dimensions, and the size, location, quantity and distribution of the defects are comprehensively considered to generate a defect distribution map. The defect distribution map can intuitively display the spatial distribution of defects on the sample surface. According to the defect distribution map and the preset quality standards, the overall quality of the sample is evaluated to obtain the sample test results. These results include whether the sample meets the quality standards, what specific defects exist, and the degree of influence of these defects on the sample performance. Based on the sample test results, the effect of the current five-axis gimbal detection strategy is evaluated, the efficiency, accuracy and stability in the detection process are analyzed, and the detection effect evaluation data is obtained. The evaluation data reflects the advantages and disadvantages of the existing detection strategy. According to the detection effect evaluation data, the motion parameters and detection path of the five-axis gimbal are optimized. By adjusting the motion speed, acceleration and path planning of the five-axis gimbal, an optimized motion plan is generated. The optimization measures are designed to improve detection efficiency and accuracy while reducing errors and unnecessary movements during the detection process. Based on the optimized motion scheme, a new five-axis collaborative motion instruction sequence is generated to obtain an updated detection path. Based on the updated detection path and the five-axis gimbal dynamic model, a target five-axis collaborative detection strategy is created. This strategy combines the optimized motion scheme and real-time dynamic model parameters to ensure efficient and accurate detection in practical applications.
[0040] In the embodiment of the present application, by testing the dynamic characteristics of the five-axis gimbal and building a dynamic model, the motion characteristics of each axis and the coupling effect between axes can be accurately captured. By combining pressure sensors and structured light scanning technology for multi-modal positioning, the position, posture and morphological information of the sample can be more comprehensively obtained, and the measurement accuracy of the initial posture of the sample is improved. The five-axis collaborative initial detection path is generated based on the initial posture data of the sample, and the working space limitation and kinematic characteristics of the five-axis gimbal are considered, so that the detection path is more optimized, and the detection efficiency and coverage are improved. By performing real-time collaborative motion control on the five-axis gimbal and continuously updating the dynamic model, real-time compensation of motion errors is achieved, and the motion accuracy and stability of the system are improved. Based on the real-time five-axis state data, the image acquisition device is controlled to achieve multi-angle and high-quality image acquisition of the sample, and the integrity and accuracy of the surface feature data are improved. By analyzing the surface feature data of the sample and evaluating the detection effect, the motion parameters and detection path of the five-axis gimbal are dynamically optimized, and the adaptive adjustment of the detection strategy is achieved, which improves the flexibility and efficiency of the detection. The motion control of the five-axis gimbal is closely integrated with sample detection to achieve full process optimization from sample positioning, path planning to detection execution, significantly improving the accuracy of the five-axis gimbal linkage control, thereby improving the accuracy of sample detection.
[0041] In a specific embodiment, the process of executing step S101 may specifically include the following steps:
[0042] (1) Execute the preset motion sequence for each axis of the five-axis gimbal and collect the motion data of each axis to obtain the original dynamic response data;
[0043] (2) Preprocessing the original dynamic response data to obtain the cleaned dynamic response data, and calculating the uniaxial dynamic characteristics of each axis based on the cleaned dynamic response data to obtain the uniaxial dynamic parameters;
[0044] (3) Conduct linkage test on the five-axis gimbal, collect data on the mutual influence between axes, and obtain data on the coupling characteristics between axes;
[0045] (4) Based on the single-axis dynamic parameters and inter-axis coupling characteristic data, the initial dynamic model of the five-axis gimbal is established, and the parameters of the initial dynamic model are analyzed to obtain an adaptive dynamic model;
[0046] (5) The adaptive dynamic model is tested and optimized to obtain the dynamic model of the five-axis gimbal.
[0047] Specific and reasonably designed motion sequences. These sequences should cover all motion states that the five-axis gimbal may experience to ensure the comprehensiveness and representativeness of the data. After setting the motion sequence, these sequences are executed one by one through the control system, and high-precision sensors are used to collect the motion data of each axis to obtain the original dynamic response data, which contains the displacement, velocity and acceleration information of each axis under different motion states. The original dynamic response data often contains noise and outliers, and needs to be preprocessed to obtain the cleaned dynamic response data. The preprocessing steps include operations such as denoising, normalization and filtering. Denoising can use algorithms such as wavelet denoising, filtering can use methods such as Kalman filters, and normalization is to convert the data to a uniform scale for comparison and analysis. Based on the cleaned dynamic response data, the single-axis dynamic characteristics of each axis are calculated. The single-axis dynamic characteristics include inertia ( )、Damping( ) and stiffness These parameters can be obtained through system identification methods, such as using the least squares method to estimate parameters. The dynamic equation of the system can be expressed as:
[0048] ;
[0049] in, represents the mass matrix, represents the damping matrix, represents the stiffness matrix, represents the displacement vector, Represents the external force vector. By fitting these parameters, the single-axis dynamic parameters of each axis are obtained. The five-axis gimbal is tested in linkage to collect the mutual influence data between the axes. By applying a composite motion sequence and recording the responses of each axis under these motion states, the inter-axis coupling characteristic data are obtained. These data reflect the dynamic coupling relationship between the axes. Based on the single-axis dynamic parameters and the inter-axis coupling characteristic data, the initial dynamic model of the five-axis gimbal is established. The initial dynamic model can be modeled using the multi-body dynamics method, and an overall dynamic model is formed by establishing the connection relationship and torque between the axes. The initial dynamic model is analyzed by parameters, and the deficiencies in the model are identified and adjusted by comparing the model prediction value with the actual measurement value. Using optimization algorithms such as genetic algorithms, the parameters are adjusted through multiple iterations to minimize the error between the model prediction value and the actual measurement value, and an adaptive dynamic model is obtained. The adaptive dynamic model is tested and optimized. By applying the adaptive dynamic model to the actual five-axis gimbal movement, the deviation between the model prediction result and the actual motion data is observed, and the model parameters are continuously adjusted to make the model prediction result more in line with the actual situation. The means of optimization and adjustment include applying optimization algorithms, adding new test data and improving the model structure to obtain an accurate and reliable five-axis gimbal dynamic model.
[0050] In a specific embodiment, the process of executing step S102 may specifically include the following steps:
[0051] (1) According to the dynamic model of the five-axis gimbal, the five-axis gimbal is initialized and adjusted to obtain the initial state data of the gimbal, and the weight distribution of the sample to be tested is scanned based on the pressure sensor array to obtain the sample weight distribution data;
[0052] (2) Use a structured light scanner to perform a three-dimensional scan on the sample to be tested to obtain point cloud data of the sample surface, and construct sample space representation data of the sample to be tested based on the sample weight distribution data and the sample surface point cloud data;
[0053] (3) Compare and analyze the sample space representation data with the pre-stored standard model to obtain the sample position deviation data, and based on the sample position deviation data, calculate the position and direction of the sample to be tested in the five-axis gimbal coordinate system to obtain the sample pose estimation data;
[0054] (4) According to the sample pose estimation data, the five-axis gimbal is controlled to adjust its position to obtain the adjusted gimbal status data, and multi-angle image acquisition of the sample is performed through the adjusted gimbal status data to obtain the multi-view image data of the sample;
[0055] (5) Process the multi-view image data of the sample to obtain the sample feature point data, and then perform comprehensive analysis and calibration based on the sample feature point data, sample weight distribution data, and the five-axis gimbal dynamic model to obtain the sample initial posture data.
[0056] Specifically, the five-axis gimbal is preliminarily set and calibrated for its dynamic parameters. By analyzing and modeling the dynamic characteristics of each axis, the inertia, damping, and stiffness parameters of each axis are determined. During the initialization process, each axis of the five-axis gimbal will be adjusted to a preset reference position to ensure that all axes start working in a balanced state and obtain the initial state data of the gimbal. A weight distribution scan of the sample to be tested is performed based on the pressure sensor array. The pressure sensor array is distributed on a plane. When the sample is placed on the sensor array, each sensor records the pressure it is subjected to. Through these pressure data, the weight distribution of the sample at different positions is calculated to obtain the weight distribution data of the sample. Assume that the total weight of the sample is , the pressure recorded by the pressure sensor at a certain position is , then the weight contribution of this position can be expressed as:
[0057] ;
[0058] in is the total pressure recorded by all sensors. In this way, the detailed weight distribution of the sample is obtained. A structured light scanner is used to perform a three-dimensional scan of the sample to be tested to obtain the point cloud data of the sample surface. The structured light scanner calculates the three-dimensional coordinate points of the sample surface by projecting a grating pattern onto the sample surface and capturing the deformed grating pattern through a camera. The point cloud data is recorded to obtain the detailed three-dimensional shape of the sample surface. Combined with the sample weight distribution data, the sample space representation data of the sample to be tested is constructed. These data include the external shape of the sample and also reflect the mass distribution inside the sample. The sample space representation data is compared and analyzed with the pre-stored standard model to obtain the sample position deviation data. The standard model is an ideal model pre-established according to the sample design or historical data. Through comparative analysis, the difference between the sample and the standard model is identified. The position and direction of the sample in the five-axis gimbal coordinate system are calculated to obtain the sample pose estimation data. The pose estimation uses the least squares method to align the sample space representation data with the standard model to solve the displacement and rotation parameters of the sample. The pose estimation formula can be expressed as:
[0059] ;
[0060] in, is a point in the sample space representing the data, is the corresponding point in the Standard Model, is the rotation matrix, is the translation vector. By optimizing and t, and obtain the pose estimation data of the sample. According to the pose estimation data of the sample, the five-axis gimbal is controlled to adjust the position. The motion control system of the gimbal receives the pose estimation data, adjusts the position and angle of each axis, makes the sample reach the predetermined detection position and posture, and obtains the adjusted gimbal state data. In this process, the high-precision motion control system of the five-axis gimbal ensures the smooth and accurate movement of each axis, and avoids the detection deviation caused by motion error. Through the adjusted gimbal state data, multi-angle image acquisition is performed on the sample. The camera detection module takes images of the sample at different angles to obtain multi-view image data of the sample. The multi-view image data provides the appearance information of the sample from different perspectives. The multi-view image data is processed, and the feature point data of the sample is extracted by image processing technology. These feature point data include the edge, corner point and texture information of the sample surface, which can fully reflect the appearance characteristics of the sample. Combined with the sample feature point data, the sample weight distribution data and the dynamic model of the five-axis gimbal, comprehensive analysis and calibration are performed to obtain the initial pose data of the sample. Through comprehensive analysis, the spatial position and posture of the sample are calibrated to ensure that all feature points and mass distribution are consistent with expectations.
[0061] In a specific embodiment, the process of executing step S103 may specifically include the following steps:
[0062] (1) Based on the initial pose data of the sample, a three-dimensional detection area model of the sample to be detected is established, and the detection area data is generated based on the three-dimensional detection area model;
[0063] (2) Partitioning the detection area data to obtain a detection sub-area set, and determining the detection key points of each detection sub-area set to obtain a detection key point data set;
[0064] (3) Prioritize the detection point data set to obtain the detection point sequence, and plan the preliminary motion path data of the five-axis gimbal based on the detection point sequence;
[0065] (4) Considering the working space limitation of the five-axis gimbal, a feasibility analysis is conducted on the preliminary motion path data, and kinematic optimization is performed through the dynamic model of the five-axis gimbal to obtain the five-axis collaborative initial detection path.
[0066] Specifically, according to the initial posture data of the sample, the three-dimensional detection area of the sample is modeled using computer-aided design (CAD) software or three-dimensional modeling software. Based on the geometric shape and posture data of the sample, a three-dimensional model is established to ensure that all areas to be detected can be accurately described and identified. The detection area data is generated according to the three-dimensional detection area model. These data include the coordinates, size and other relevant characteristics of each detection area to ensure that each area can be accurately located in the subsequent detection process. The detection area data is partitioned and the detection area is divided into several detection sub-area sets by a partitioning algorithm. These detection sub-area sets allow each area to be processed separately, thereby improving the efficiency and accuracy of the detection. For example, a spatial segmentation algorithm such as an octree or a KD tree is used to divide a complex three-dimensional space into smaller, easier-to-manage sub-areas. The result of the partitioning process is a detection sub-area set, each of which contains its specific location information and size data. For the detection sub-area set, the detection points of each detection sub-area are determined. Detection points refer to specific locations in each sub-area that need to be inspected. These detection points are determined by analyzing the geometric characteristics and importance of each sub-area to form a detection point data set, including the specific coordinates and priority information of each point. Priority evaluation is performed on the detection point data set. Each detection point is prioritized according to the importance of the sample, detection difficulty, and other relevant factors to obtain a detection point sequence to ensure that important detection points can be inspected first during the detection process, thereby improving the efficiency and accuracy of the detection. For example, priority evaluation can be performed by weighted scoring, and the scoring formula is:
[0067] ;
[0068] in, Indicates the key points of detection The priority score of Indicates the importance of the point. Indicates the difficulty of detection. Indicates the utilization of detection resources. is the corresponding weight coefficient. Based on the sequence of key detection points, the preliminary motion path data of the five-axis gimbal is planned. The preliminary motion path data plans the motion path that the five-axis gimbal should execute during the detection process by considering the spatial position and priority of the detection points. The goal of preliminary path planning is to enable the gimbal to efficiently cover all detection points while minimizing the motion distance and time. For example, the traveling salesman problem (TSP) optimization algorithm is used to plan the shortest path to ensure the optimization of the detection path. Combined with the workspace restrictions of the five-axis gimbal, the feasibility analysis of the preliminary motion path data is carried out. The workspace restrictions include the motion range, motion speed and load capacity of the gimbal. By analyzing these restrictions, it is ensured that the preliminary motion path is feasible in actual operation. If the preliminary path does not meet the workspace restrictions, the path needs to be adjusted and optimized. Kinematic optimization is performed through the dynamic model of the five-axis gimbal to obtain the five-axis collaborative initial detection path. The motion of the gimbal is finely adjusted through the dynamic model to ensure that the gimbal can perform the detection task in the optimal state during the actual detection process. Kinematic optimization can improve the smoothness and efficiency of motion by minimizing motion errors and energy consumption. The optimized detection path not only meets the motion capabilities and workspace limitations of the gimbal, but also maximizes the accuracy and efficiency of detection.
[0069] In a specific embodiment, the process of executing step S104 may specifically include the following steps:
[0070] (1) Segment the five-axis collaborative initial detection path to obtain path segmentation data, and generate five-axis motion instructions based on the path segmentation data;
[0071] (2) Perform time synchronization processing on the five-axis motion instructions to obtain the five-axis coordinated motion timing, and send control signals to the five-axis gimbal according to the five-axis coordinated motion timing;
[0072] (3) The real-time position and speed information of the five-axis gimbal is collected through sensors on each axis to obtain the five-axis real-time motion data, and the motion error is calculated by combining the five-axis real-time motion data with the five-axis collaborative initial detection path to obtain error data;
[0073] (4) Generate compensation instructions based on the error data, and adjust the five-axis gimbal in real time to obtain adjusted five-axis motion data, and perform feature extraction on the adjusted five-axis motion data to obtain five-axis motion feature data;
[0074] (5) The dynamic model of the five-axis gimbal is updated through the five-axis motion feature data to obtain updated dynamic model parameters. The overall motion state of the five-axis gimbal is evaluated based on the updated dynamic model parameters to obtain real-time five-axis state data.
[0075] Specifically, the five-axis collaborative initial detection path is segmented to obtain path segmentation data. Assume that the initial detection path is , segment it into multiple small segments, each path can be expressed as ,in is the path segment number. Through segment processing, the movement of the five-axis gimbal can be controlled more accurately. The data of each path segment includes parameters such as the starting point, end point, speed and acceleration. The five-axis motion command is generated according to the path segment data. The five-axis motion command includes the motion parameters of each axis, such as position, speed and acceleration. Assume that the five-axis motion command is ,in Indicates Segment path at time In order to ensure the coordinated movement of the five axes, the motion instructions are synchronized. By synchronizing the motion instructions of each axis, the five-axis coordinated motion timing is obtained. , ensuring that each axis moves as planned at the same time point. , sending control signals to the five-axis gimbal. These control signals contain the motion instructions of each axis at each time point, which are transmitted to the controller of the five-axis gimbal through the real-time control system. The controller drives the motor of each axis to perform corresponding movements according to the received signals. During the movement of the five-axis gimbal, the real-time position and speed information is collected through the sensors on each axis to obtain the real-time motion data of the five axes. Assume that the real-time motion data of the five axes is ,in Includes each axis in time The actual position and speed at that time. These real-time data are combined with the five-axis collaborative initial detection path Compare and calculate the motion error. The error calculation formula is:
[0076] ;
[0077] in, Indicates time The motion error when represents the expected path, Indicates actual motion data. According to error data , generate compensation instructions The compensation command is used to correct the motion deviation of the five-axis gimbal to make it as close to the expected path as possible. The generation of the compensation command can be based on the PID control algorithm, and the formula is:
[0078] ;
[0079] in, , and They are proportional, integral and differential coefficients respectively. The five-axis motion data is sent to the controller of the five-axis gimbal to adjust the five-axis gimbal in real time. It can be collected again by the sensor. The adjusted five-axis motion data is subjected to feature extraction to obtain the five-axis motion feature data. These characteristic data include the speed change, acceleration and position error of each axis. , update the dynamic model of the five-axis gimbal. Assume that the dynamic model parameters are , through the analysis of characteristic data, the model parameters are adjusted to more accurately reflect the actual movement of the five-axis gimbal. The updated dynamic model parameters can be expressed as:
[0080] ;
[0081] in, are the initial model parameters, It is the parameter adjustment amount obtained through feature data analysis. According to the updated dynamic model parameters, the overall motion state of the five-axis gimbal is evaluated to obtain real-time five-axis state data. The evaluation process can determine whether the operation state of the five-axis gimbal is normal by comparing the difference between the current model parameters and the expected parameters, and analyzing the stability and accuracy of the real-time motion data.
[0082] In a specific embodiment, the process of executing step S105 may specifically include the following steps:
[0083] (1) Determine the position of the camera detection module relative to the sample to be detected according to the real-time five-axis state data, obtain the camera position data, and adjust the camera initial parameters of the camera detection module based on the camera position data;
[0084] (2) According to the initial parameters of the camera, the brightness of the coaxial light source is adjusted to obtain the light source setting data, and based on the light source setting data, the sample to be inspected is illuminated and photographed to obtain multi-angle original images;
[0085] (3) Performing image processing on the original images from multiple angles to obtain enhanced image data, and extracting the surface features of the sample based on the enhanced image data to obtain two-dimensional feature data;
[0086] (4) Perform multi-angle synthesis on the two-dimensional feature data to obtain a three-dimensional feature model of the sample surface, and identify the data of the area to be inspected based on the three-dimensional feature model of the sample surface;
[0087] (5) Control the five-axis gimbal to scan the data of the area to be inspected to obtain the corresponding high-definition local image, and then combine the high-definition local image with the three-dimensional feature model of the sample surface for analysis to obtain the sample surface feature data.
[0088] Specifically, the position of the camera detection module relative to the sample to be detected is determined based on the real-time five-axis state data. Assume that the five-axis state data is , including position and direction information. The position of the camera relative to the sample can be calculated through geometric transformation to obtain the camera position data The geometric transformation formula is:
[0089] ;
[0090] in, is the rotation matrix, is the translation vector, is the coordinate of the camera at the initial position. According to the camera position data , adjust the initial camera parameters of the camera detection module. The initial camera parameters include focal length, exposure time and white balance, etc. Adjustment function It can be expressed as:
[0091] ;
[0092] in, is the adjustment factor, is the offset, is the initial position. According to the adjusted initial parameters of the camera , adjust the brightness of the coaxial light source and obtain the light source setting data . Light source setting function It can be expressed as:
[0093] ;
[0094] in, is the light source setting coefficient, is the offset. After adjusting the light source settings, the camera and light source are used to illuminate and shoot the sample to be tested to obtain multi-angle original images. Assume that the original image is ,in Indicates the shooting angle. By shooting at multiple angles, image data of the sample at different angles is obtained. Perform image processing to obtain enhanced image data Image processing functions Including steps such as noise removal, contrast enhancement and edge detection, the formula is as follows:
[0095] ;
[0096] in, is the Gaussian filter function used for noise removal, is the contrast enhancement function, is the edge detection function. Based on the enhanced image data , extract the sample surface features and obtain two-dimensional feature data Feature extraction includes steps such as edge detection, texture analysis and shape recognition. The formula is as follows:
[0097] ;
[0098] in, is the edge detection function, is the texture analysis function, is the shape recognition function. For two-dimensional feature data Perform multi-angle synthesis to obtain a three-dimensional feature model of the sample surface By registering and synthesizing the feature data at different angles, a three-dimensional representation of the sample surface is generated, and the formula is as follows:
[0099] ;
[0100] in, Is used for angle The rotation matrix of the sample surface is , identify the data of the area to be inspected By analyzing the 3D model, we can determine the areas that need further inspection. The identification function can be expressed as:
[0101] ;
[0102] in, It is a function used to identify the area to be inspected. , control the five-axis gimbal to scan and obtain the corresponding high-definition local image. By controlling the position and angle of the five-axis gimbal, a high-definition image of the area to be inspected can be captured. The high-definition local image is combined with the three-dimensional feature model of the sample surface to obtain the sample surface feature data. . The combined analysis function can be expressed as:
[0103] ;
[0104] in, It is the surface feature data of the sample, including comprehensive information of high-definition local images and three-dimensional feature models.
[0105] In a specific embodiment, the process of executing step S106 may specifically include the following steps:
[0106] (1) Classify the sample surface feature data to obtain feature type distribution data, and analyze the sample surface features based on the feature type distribution data to obtain preliminary defect information;
[0107] (2) Perform multi-dimensional analysis on the preliminary defect information to obtain a defect distribution map, and evaluate the overall quality of the sample based on the defect distribution map and preset quality standards to obtain the sample test results;
[0108] (3) Based on the sample test results, the effectiveness of the current five-axis gimbal detection strategy is evaluated to obtain the detection effect evaluation data;
[0109] (4) Based on the detection effect evaluation data, the motion parameters and detection path of the five-axis gimbal are optimized to obtain the optimized motion plan;
[0110] (5) Based on the optimized motion plan, a new five-axis collaborative motion instruction sequence is generated to obtain an updated detection path;
[0111] (6) Create a target five-axis collaborative detection strategy based on the updated detection path and the five-axis gimbal dynamic model.
[0112] Specifically, the sample surface feature data is classified. Assume that the sample surface feature data is , the K-means clustering algorithm can be used to classify the feature data. The classification result is the feature type distribution data , represents the distribution of each feature on the sample surface. The clustering algorithm formula is as follows:
[0113] ;
[0114] in, is the number of clusters, It is clusters, It is The center of the cluster, Representation sample With cluster center Euclidean distance between them. Data distribution based on feature type , analyze the surface features of the sample and identify preliminary defect information. By comparing normal features and abnormal features, possible defects are identified. Assume that the preliminary defect information is , calculated by the feature analysis function DefectAnalysis:
[0115] ;
[0116] Among them, isDefect Is a judgment function used to identify features Is it a defect? Preliminary defect information Perform multi-dimensional analysis to generate defect distribution maps The multi-dimensional analysis includes defect location, type, and severity, which are calculated by the statistical analysis function DefectDistribution:
[0117] ;
[0118] in, Indicates The number of defects, Indicates The severity of each defect. According to the defect distribution diagram and preset quality standards , evaluate the overall quality of the sample and obtain the sample test results. The evaluation function can be expressed as:
[0119] ;
[0120] Among them, Pass means the sample is qualified, and Fail means the sample is unqualified. Based on the sample test results , evaluate the effect of the current five-axis gimbal detection strategy and obtain the detection effect evaluation data. The evaluation function can be expressed as:
[0121] ;
[0122] in, Indicates The accuracy of the test. Evaluate the data based on the test results , optimize the motion parameters and detection path of the five-axis gimbal, and obtain the optimized motion plan. The optimization function can be expressed as:
[0123] ;
[0124] in, is the optimized motion parameter, is the optimized detection path. Based on the optimized motion scheme , generate a new five-axis coordinated motion instruction sequence and obtain the updated detection path. The generation function can be expressed as:
[0125] ;
[0126] According to the updated detection path And the five-axis gimbal dynamic model, create the target five-axis collaborative detection strategy. The creation function can be expressed as:
[0127] ;
[0128] in, Indicates the detection path after executing the update. Indicates updating the dynamic model of the five-axis gimbal .
[0129] The above describes the five-axis pan-tilt linkage control method in the embodiment of the present application. The following describes the five-axis pan-tilt linkage control device in the embodiment of the present application. Figure 2 In the embodiment of the present application, an embodiment of the five-axis gimbal linkage control device includes:
[0130] A construction module 201 is used to test the dynamic characteristics of the five-axis gimbal and construct a dynamic model of the five-axis gimbal;
[0131] The positioning module 202 is used to perform multi-modal positioning on the sample to be tested based on the dynamic model of the five-axis gimbal to obtain the initial position and posture data of the sample;
[0132] A generation module 203 is used to generate a five-axis collaborative initial detection path according to the sample initial posture data;
[0133] The control module 204 is used to perform coordinated motion control on the five-axis gimbal based on the five-axis coordinated initial detection path to obtain real-time five-axis state data;
[0134] The acquisition module 205 is used to control the image acquisition device to acquire multi-angle images based on the real-time five-axis state data to obtain sample surface feature data;
[0135] The analysis module 206 is used to perform detection, analysis and optimization on the sample surface feature data to obtain the sample detection results and the target five-axis collaborative detection strategy.
[0136] Through the cooperation of the above components, the dynamic characteristics of the five-axis gimbal are tested and the dynamic model is constructed, which can accurately capture the motion characteristics of each axis and the coupling effect between axes. The multi-modal positioning combined with pressure sensors and structured light scanning technology can obtain the position, posture and morphology information of the sample more comprehensively, improve the measurement accuracy of the initial posture of the sample, generate the five-axis collaborative initial detection path based on the initial posture data of the sample, consider the workspace limitation and kinematic characteristics of the five-axis gimbal, make the detection path more optimized, and improve the detection efficiency and coverage. By performing real-time collaborative motion control on the five-axis gimbal and continuously updating the dynamic model, real-time compensation of motion errors is achieved, and the motion accuracy and stability of the system are improved. Based on the real-time five-axis state data, the image acquisition device is controlled to achieve multi-angle and high-quality image acquisition of the sample, and the integrity and accuracy of the surface feature data are improved. Through the analysis of the sample surface feature data and the evaluation of the detection effect, the motion parameters and detection path of the five-axis gimbal are dynamically optimized, and the adaptive adjustment of the detection strategy is achieved, which improves the flexibility and efficiency of the detection. The motion control of the five-axis gimbal is closely integrated with sample detection to achieve full process optimization from sample positioning, path planning to detection execution, significantly improving the accuracy of the five-axis gimbal linkage control, thereby improving the accuracy of sample detection.
[0137] The present application also provides a five-axis gimbal linkage control device, which includes a memory and a processor. The memory stores computer-readable instructions. When the computer-readable instructions are executed by the processor, the processor executes the steps of the five-axis gimbal linkage control method in the above-mentioned embodiments.
[0138] The present application also provides a computer-readable storage medium, which may be a non-volatile computer-readable storage medium or a volatile computer-readable storage medium. Instructions are stored in the computer-readable storage medium. When the instructions are executed on a computer, the computer executes the steps of the five-axis gimbal linkage control method.
[0139] Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working processes of the above-described systems, systems and units can refer to the corresponding processes in the aforementioned method embodiments and will not be repeated here.
[0140] If the integrated unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application is essentially or the part that contributes to the prior art or all or part of the technical solution can be embodied in the form of a software product. The computer software product is stored in a storage medium, including several instructions to enable a computer device (which can be a personal computer, server, or network device, etc.) to execute all or part of the steps of the method described in each embodiment of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (ROM), random access memory (RAM), disk or optical disk and other media that can store program codes.
[0141] As described above, the above embodiments are only used to illustrate the technical solutions of the present application, rather than to limit them. Although the present application has been described in detail with reference to the aforementioned embodiments, those skilled in the art should understand that they can still modify the technical solutions described in the aforementioned embodiments, or make equivalent replacements for some of the technical features therein. However, these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present application.
Claims
1. A five-axis gimbal linkage control method, characterized in that: The method comprises: A dynamic characteristic test is performed on the five-axis gimbal to construct a dynamic model of the five-axis gimbal; specifically, the test includes: executing a preset motion sequence on each axis of the five-axis gimbal and collecting motion data of each axis to obtain original dynamic response data; preprocessing the original dynamic response data to obtain cleaned dynamic response data, and calculating the single-axis dynamic characteristics of each axis based on the cleaned dynamic response data to obtain single-axis dynamic parameters; performing a linkage test on the five-axis gimbal, collecting data on mutual influence between axes, and obtaining coupling characteristic data between axes; establishing an initial dynamic model of the five-axis gimbal based on the single-axis dynamic parameters and the coupling characteristic data between axes, and performing parameter analysis on the initial dynamic model to obtain an adaptive dynamic model; testing and optimizing the adaptive dynamic model to obtain a dynamic model of the five-axis gimbal; Based on the dynamic model of the five-axis gimbal, multi-modal positioning is performed on the sample to be detected to obtain the initial posture data of the sample; specifically, the five-axis gimbal is initialized and adjusted according to the dynamic model of the five-axis gimbal to obtain the initial state data of the gimbal, and the weight distribution of the sample to be detected is scanned based on the pressure sensor array to obtain the weight distribution data of the sample; a structured light scanner is used to perform a three-dimensional scan on the sample to be detected to obtain the sample surface point cloud data, and the sample space representation data of the sample to be detected is constructed according to the sample weight distribution data and the sample surface point cloud data; the sample space representation data is compared and analyzed with the pre-stored standard model to obtain to the sample position deviation data, and based on the sample position deviation data, calculate the position and direction of the sample to be detected in the five-axis gimbal coordinate system to obtain the sample pose estimation data; according to the sample pose estimation data, control the five-axis gimbal to adjust the position to obtain the adjusted gimbal state data, and perform multi-angle image acquisition on the sample through the adjusted gimbal state data to obtain the sample multi-viewing angle image data; process the sample multi-viewing angle image data to obtain the sample feature point data, and perform comprehensive analysis and calibration in combination with the sample feature point data, the sample weight distribution data and the five-axis gimbal dynamic model to obtain the sample initial pose data; Generate a five-axis collaborative initial detection path according to the sample initial posture data; specifically include: establishing a three-dimensional detection area model of the sample to be detected according to the sample initial posture data, and generating detection area data according to the three-dimensional detection area model; partitioning the detection area data to obtain a detection sub-area set, and determining the detection points of each detection sub-area for the detection sub-area set to obtain a detection point data set; performing priority evaluation on the detection point data set to obtain a detection point sequence, and planning the preliminary motion path data of the five-axis gimbal based on the detection point sequence; performing a feasibility analysis on the preliminary motion path data in combination with the workspace limitation of the five-axis gimbal, and performing kinematic optimization through the dynamic model of the five-axis gimbal to obtain a five-axis collaborative initial detection path; Based on the five-axis collaborative initial detection path, the five-axis gimbal is subjected to collaborative motion control to obtain real-time five-axis state data; Based on the real-time five-axis state data, control the image acquisition device to acquire multi-angle images to obtain sample surface feature data; The sample surface feature data is detected, analyzed and optimized to obtain sample detection results and target five-axis collaborative detection strategies.
2. The five-axis gimbal linkage control method according to claim 1, characterized in that: The step of performing coordinated motion control on the five-axis gimbal based on the five-axis coordinated initial detection path to obtain real-time five-axis state data includes: Segmenting the five-axis collaborative initial detection path to obtain path segmentation data, and generating five-axis motion instructions according to the path segmentation data; Performing time synchronization processing on the five-axis motion command to obtain a five-axis coordinated motion timing sequence, and sending a control signal to the five-axis gimbal according to the five-axis coordinated motion timing sequence; The real-time position and speed information of the five-axis gimbal is collected through sensors on each axis to obtain five-axis real-time motion data, and the motion error is calculated between the five-axis real-time motion data and the five-axis collaborative initial detection path to obtain error data; Generate compensation instructions according to the error data, and adjust the five-axis gimbal in real time to obtain adjusted five-axis motion data, and extract features from the adjusted five-axis motion data to obtain five-axis motion feature data; The five-axis motion characteristic data is used to update the dynamic model of the five-axis gimbal to obtain updated dynamic model parameters, and the overall motion state of the five-axis gimbal is evaluated based on the updated dynamic model parameters to obtain real-time five-axis state data.
3. The five-axis gimbal linkage control method according to claim 2, characterized in that: Based on the real-time five-axis state data, controlling the image acquisition device to acquire multi-angle images to obtain sample surface feature data includes: Determine the position of the camera detection module relative to the sample to be detected according to the real-time five-axis state data, obtain camera position data, and adjust the camera initial parameters of the camera detection module based on the camera position data; According to the initial parameters of the camera, the brightness of the coaxial light source is adjusted to obtain light source setting data, and based on the light source setting data, the sample to be detected is illuminated and photographed to obtain a multi-angle original image; Performing image processing on the multi-angle original image to obtain enhanced image data, and extracting sample surface features based on the enhanced image data to obtain two-dimensional feature data; Performing multi-angle synthesis on the two-dimensional feature data to obtain a three-dimensional feature model of the sample surface, and identifying the data of the area to be inspected based on the three-dimensional feature model of the sample surface; The five-axis gimbal is controlled to scan the data of the area to be inspected to obtain a corresponding high-definition local image, and the high-definition local image is combined with the three-dimensional feature model of the sample surface for analysis to obtain the sample surface feature data.
4. The five-axis gimbal linkage control method according to claim 3, characterized in that: The detecting, analyzing and optimizing the sample surface feature data to obtain the sample detection results and the target five-axis collaborative detection strategy includes: Performing feature classification on the sample surface feature data to obtain feature type distribution data, and analyzing the sample surface features according to the feature type distribution data to obtain preliminary defect information; Performing a multi-dimensional analysis on the preliminary defect information to obtain a defect distribution map, and evaluating the overall quality of the sample based on the defect distribution map and preset quality standards to obtain a sample test result; Based on the sample detection results, the effect of the current five-axis gimbal detection strategy is evaluated to obtain detection effect evaluation data; According to the detection effect evaluation data, the motion parameters and detection path of the five-axis gimbal are optimized to obtain an optimized motion plan; Based on the optimized motion scheme, a new five-axis coordinated motion instruction sequence is generated to obtain an updated detection path; A target five-axis collaborative detection strategy is created based on the updated detection path and the five-axis gimbal dynamic model.
5. A five-axis pan-tilt linkage control device, characterized in that: The device is used to execute the five-axis gimbal linkage control method according to any one of claims 1 to 4, comprising: A construction module is used to perform a dynamic characteristic test on a five-axis gimbal and construct a dynamic model of the five-axis gimbal; specifically comprising: executing a preset motion sequence on each axis of the five-axis gimbal and collecting motion data of each axis to obtain original dynamic response data; preprocessing the original dynamic response data to obtain cleaned dynamic response data, and calculating the single-axis dynamic characteristics of each axis based on the cleaned dynamic response data to obtain single-axis dynamic parameters; performing a linkage test on the five-axis gimbal, collecting data on mutual influence between axes, and obtaining coupling characteristic data between axes; establishing an initial dynamic model of the five-axis gimbal based on the single-axis dynamic parameters and the coupling characteristic data between axes, and performing parameter analysis on the initial dynamic model to obtain an adaptive dynamic model; testing and optimizing the adaptive dynamic model to obtain a dynamic model of the five-axis gimbal; A positioning module is used to perform multimodal positioning of the sample to be detected based on the dynamic model of the five-axis gimbal to obtain the initial posture data of the sample; specifically comprising: initializing and adjusting the five-axis gimbal according to the dynamic model of the five-axis gimbal to obtain the initial state data of the gimbal, and performing a weight distribution scan on the sample to be detected based on the pressure sensor array to obtain the sample weight distribution data; using a structured light scanner to perform a three-dimensional scan on the sample to be detected to obtain the sample surface point cloud data, and constructing the sample space representation data of the sample to be detected based on the sample weight distribution data and the sample surface point cloud data; comparing the sample space representation data with the pre-stored standard model Analyze to obtain sample position deviation data, and based on the sample position deviation data, calculate the position and direction of the sample to be detected in the five-axis gimbal coordinate system to obtain sample pose estimation data; according to the sample pose estimation data, control the five-axis gimbal to adjust the position to obtain the adjusted gimbal state data, and perform multi-angle image acquisition on the sample through the adjusted gimbal state data to obtain sample multi-viewing angle image data; process the sample multi-viewing angle image data to obtain sample feature point data, and perform comprehensive analysis and calibration in combination with the sample feature point data, the sample weight distribution data and the five-axis gimbal dynamic model to obtain sample initial pose data; A generation module is used to generate a five-axis collaborative initial detection path according to the sample initial posture data; specifically comprising: establishing a three-dimensional detection area model of the sample to be detected according to the sample initial posture data, and generating detection area data according to the three-dimensional detection area model; partitioning the detection area data to obtain a detection sub-area set, and determining the detection points of each detection sub-area for the detection sub-area set to obtain a detection point data set; performing priority evaluation on the detection point data set to obtain a detection point sequence, and planning the preliminary motion path data of the five-axis gimbal based on the detection point sequence; performing a feasibility analysis on the preliminary motion path data in combination with the workspace limitation of the five-axis gimbal, and performing kinematic optimization through the dynamic model of the five-axis gimbal to obtain a five-axis collaborative initial detection path; A control module, used for performing coordinated motion control on the five-axis gimbal based on the five-axis coordinated initial detection path to obtain real-time five-axis state data; An acquisition module, used to control an image acquisition device to acquire multi-angle images based on the real-time five-axis state data to obtain sample surface feature data; The analysis module is used to detect, analyze and optimize the sample surface feature data to obtain the sample detection results and the target five-axis collaborative detection strategy.
6. A five-axis pan-tilt linkage control device, characterized in that: The five-axis gimbal linkage control device comprises: a memory and at least one processor, wherein instructions are stored in the memory; The at least one processor calls the instruction in the memory so that the five-axis gimbal linkage control device executes the five-axis gimbal linkage control method as described in any one of claims 1-4.
7. A computer-readable storage medium having instructions stored thereon, characterized in that: When the instruction is executed by the processor, the five-axis gimbal linkage control method as described in any one of claims 1 to 4 is implemented.
