Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

581 results about "Point cloud processing" patented technology

Point Clouds are data sets containing a large number of three-dimensional points. These points are captured by [UAS Lidar Systems] or created by overlapping images using [Photogrammetric Imagery Processing Software]. With Point Cloud Processing Software the Point Clouds can be stored, processed, analyzed and visualized.

Non-standard intelligent customized welding system based on vision and surface gradient

The invention relates to the field of welding, and discloses a non-standard intelligent customized welding system based on vision and surface gradient, which comprises a visual perception module used for iteratively approaching a workpiece from a preset initial height through a self-adaptive high angle shooting exploration mechanism, and combining layered grid division based on a camera view and a progressive multi-angle expansion scanning mode, collecting multi-view three-dimensional point cloud data of the workpiece; and the point cloud processing module is used for performing regional progressive registration on the multi-view three-dimensional point cloud data, implementing threshold constraint based on point cloud curvature characteristics by dynamically adjusting registration step length, and eliminating accumulative errors in combination with pose map optimization. Through self-adaptive high-angle shooting and layered grid scanning, multi-view point cloud can be automatically collected without manually presetting a workpiece model, regional registration and curvature constraint are combined, the workpiece model is constructed, a weld joint structure is automatically extracted based on surface gradient features, traditional manual labeling is replaced, a welding track is generated according to weld joint topology, and the precision is dynamically corrected.
Owner:SHANGHAI SHENGSHI WEISHENG TECH CO LTD

High-precision intelligent welding system adapting to complex working conditions

The invention provides a high-precision intelligent welding system adapting to complex working conditions, and relates to the technical field of laser welding. The high-precision intelligent welding system adapting to the complex working conditions comprises the steps of S1, based on a high-resolution visual sensor and a laser scanner, S2, based on preprocessed point cloud data, S3, based on a workpiece three-dimensional model, S4, based on an optimized welding path and a material attribute database, S5, based on a dynamic welding parameter set, S6, based on a real-time welding track, and S7, based on multi-sensor monitoring data. S8, based on a defect detection report; and S9, based on a repaired welding result and historical welding data. According to the invention, the geometric data of the workpiece are collected through the high-resolution visual sensor and the laser scanner, the filtering algorithm is applied to remove noise to generate high-quality point cloud data, and a subsequent processing foundation is laid; workpiece features are identified by using a point cloud processing algorithm and a machine learning method based on the point cloud data, and an accurate digital model is generated through a three-dimensional reconstruction algorithm.
Owner:NANTONG SHANGSHAN MOLDING TECH CO LTD

Shield muck volume estimation method and system based on image processing

The invention discloses a shield muck volume estimation method and system based on image processing, and particularly relates to the technical field of tunnel engineering monitoring, and the method comprises the steps: obtaining muck RGB and depth images through an image collection device, generating high-precision three-dimensional point cloud data through the combination of laser scanning and a multispectral technology, and calculating the muck volume through a slicing method. And fusing the mass flow and water content data of the belt weigher, dynamically generating a calibration factor, and correcting a volume estimation result in real time. The system comprises an image acquisition module, a point cloud processing module, a volume calculation module and a dynamic calibration module, has the characteristics of automation, high precision, real-time feedback and the like, effectively solves the problems of large error and slow response of a traditional manual metering and single weighing mode, and is suitable for continuous and accurate monitoring of the volume of muck in the shield construction process.
Owner:CHINA POWER CONSTR CHENGDU CONSTR INVESTMENT CO LTD +4

Point cloud static denoising method based on geometric constraint and deep learning

The invention relates to a point cloud static denoising method based on geometric constraint and deep learning, belongs to the technical field of point cloud processing, and solves the problem of poor point cloud denoising effect caused by poor geometric fidelity and weak generalization ability for complex noise in the prior art. Comprising the following steps: after preprocessing a to-be-denoised point cloud, dividing the to-be-denoised point cloud into a plurality of point cloud blocks with overlapping regions; for each point cloud block, performing multi-round iterative optimization on the coordinates of each point cloud by using the trained denoising network, and optimizing the predicted coordinates of each point cloud output by the denoising network in each round of iteration by using normal guided filtering and incremental updating to obtain the coordinates of each point cloud for the next round of iteration; the denoising network sequentially comprises a dynamic graph convolutional network, a first multi-layer perceptron and a second multi-layer perceptron; and after the optimization results of the point cloud blocks are fused, carrying out post-processing filtering to obtain a denoised point cloud. The point cloud denoising precision and the detail retention capability are improved.
Owner:CE CENT FOR ENG RES TEST & APPRAISAL +1

Laser welding line on-line quality detection system and method based on multi-mode visual fusion

The invention discloses a laser welding seam online quality detection system and method based on multi-mode visual fusion, and particularly relates to the technical field of laser welding seam quality detection. Comprising a data acquisition and synchronous control unit, a 2D image processing and defect detection unit, a 3D point cloud processing and size measurement unit, a multi-modal information fusion and collaborative analysis unit and a comprehensive quality judgment and output unit. According to the laser welding seam online quality detection system and method based on multi-modal visual fusion, the 2D and 3D multi-modal visual fusion technology is adopted, an improved defect detection algorithm and an accurate size measurement method are combined, welding seam surface defects are accurately recognized through 2D images, key size data are obtained by means of 3D point cloud, and the detection accuracy is improved. And the limitation of'heavy defects and light sizes' or'heavy sizes and light defects' in single-modal detection is avoided, and comprehensive and accurate evaluation of the welding seam quality is realized.
Owner:SUZHOU UNIV OF SCI & TECH

Laser scanning optimization system for high-precision ellipticity and diameter measurement

The invention discloses a laser scanning optimization system for high-precision ellipticity and diameter measurement, and relates to the technical field of cylindrical workpiece geometric dimension measurement. Comprising a laser contourgraph assembly, the laser contourgraph assembly comprises four laser contourgraphs, the four laser contourgraphs are arranged in the circumferential direction of the cross section of a to-be-measured workpiece at equal intervals, the included angle between every two adjacent laser contourgraphs is 90 degrees, and the laser contourgraphs are used for synchronously collecting contour point cloud data of the surface of the to-be-measured workpiece; and the data acquisition module is used for receiving and summarizing the contour point cloud data. The four laser contourgraphs are arranged at equal intervals in the circumferential direction of the cross section of the workpiece and collect synchronously, so that the problems that a traditional single laser module is incomplete in rotary scanning coverage and has timeliness deviation are solved; and the point cloud processing module improves the condition of insufficient point cloud processing refinement through splicing, direction correction, section extraction, adaptive region division and arc length interception processing.
Owner:TIANJIN BROTHERS INTELLIGENT TECHNOLOGY CO LTD

Slope radar point cloud data slice abnormal value complementation method based on space-time fusion

The invention provides a side slope radar point cloud data slice abnormal value complementing method based on space-time fusion, which comprises the following steps: acquiring point cloud data of a plurality of time slices obtained by scanning of a side slope radar, and mapping the point cloud data into a three-dimensional point cloud; identifying a piece of abnormal regions of the three-dimensional point cloud through statistical filtering and a density-based clustering method; constructing a point cloud processing model based on PointNet + +, generating masked data and a mask index by adopting a mask strategy, and masking off pieces of point clouds; spatial features are extracted in different regions, static space weight matrixes generated by longitude and latitude and time difference global features are fused, deformation values of mask regions are predicted through a full-connection network, and model parameters are optimized; and inputting the trained model into latitude and longitude coordinates of an abnormal region of actual missing point cloud data, performing abnormal value completion, outputting a completed deformation value, and calculating a completion precision index. According to the method, the completion effect is good, all abnormal values of multiple time slices can be completed at a time, and the calculation efficiency is improved.
Owner:BEIJING JIAOTONG UNIV

Robot laser vision three-dimensional scanning measurement system for large-scale structural member

The invention relates to the technical field of large-scale structure measurement, and discloses a robot laser vision three-dimensional scanning measurement system for a large-scale structural member. The system comprises a robot motion platform, a laser vision sensing module, an ambient light sensing module, a point cloud processing module and a motion control module, wherein the laser vision sensing module is arranged at the tail end of the robot motion platform. The ambient light sensing module collects ambient light intensity distribution data in real time, and the motion control module combines the data with three-dimensional model data of the large-scale structural member to be measured to generate a multi-view dynamic scanning path instruction. The robot motion platform executes an instruction to drive the laser vision sensing module to move, the module projects laser stripes to the surface of a to-be-measured structural member and synchronously collects an image, the point cloud processing module performs adaptive filtering processing on the image and then generates three-dimensional point cloud data, and the requirement for efficient and accurate measurement of a large structural member in a complex industrial environment can be met.
Owner:NINGDE SKEQI INTELLIGENT EQUIP CO LTD

Autonomous planning algorithm for automobile gluing path

The invention discloses an autonomous planning algorithm for an automobile gluing path, and relates to the technical field of automobile manufacturing, and the algorithm comprises the specific steps: collecting multi-source data through a line laser radar and an industrial camera, carrying out the preprocessing and synchronous fusion, carrying out the point cloud processing and curved surface modeling, generating and optimizing a gluing path, and adjusting the deviation in real time. And finally, converting into a mechanical arm instruction, controlling an executing mechanism to move, and synchronously adjusting gluing parameters and the posture of a gun head to finish high-precision gluing operation. Through dynamic formula linkage design, full-process self-adaption of track planning and execution control is achieved, manual intervention is reduced, and the gluing quality and the production efficiency are guaranteed; meanwhile, a high-precision positioning and complex curved surface modeling system is constructed by adopting a multi-sensor fusion and curvature self-adaptive NURBS weight factor formula, so that the positioning reliability and the curved surface model precision are ensured, and the adaptation requirement of a complex gluing scene of an automobile body is met.
Owner:NAT INSTR SMART EYES (CHONGQING) TECH CO LTD

Three-dimensional point cloud processing method and system for anti-wrinkle interference clothes for massage robot, terminal and medium

The invention discloses a three-dimensional point cloud processing method, system, terminal and medium for anti-wrinkle interference clothes for a massage robot, and relates to the technical field of robot perception and point cloud processing, and the method comprises the steps: obtaining the three-dimensional point cloud data of the surface of the clothes based on a depth camera, and carrying out the cutting processing, and obtaining the point cloud data after cutting; preprocessing the cut point cloud data to obtain target point cloud data, and performing cascade filtering processing to obtain optimized point cloud data; and based on the optimized point cloud data, calculating a normal vector of each point, and determining to carry out massage path planning so as to control the massage robot to execute a massage action based on the planned massage path. The method can remarkably reduce the influence of clothes wrinkles on massage direction recognition of the massage robot, and can adapt to interference of clothes made of different materials. In addition, according to the cascade filtering processing method, the calculation burden is greatly reduced while the effectiveness of normal vector estimation is ensured.
Owner:GUANGDONG EMBOSSED STORM ROBOT CO LTD

Automatic tooth segmentation method and system for oral cavity scanning point cloud

The invention belongs to the technical field of three-dimensional point cloud processing, and particularly discloses an automatic tooth segmentation method and system for oral cavity scanning point clouds, and the method comprises the following steps: collecting and preprocessing dentition three-dimensional point clouds, extracting point cloud features containing coordinates and normal directions, and constructing a neighborhood structure; setting a first-stage multi-branch network, and performing tooth and gingiva coarse segmentation and instance initial clustering on the point cloud; setting a second-stage semantic refinement network, and carrying out local cutting on the original point cloud; setting a boundary detection and boundary offset network to enhance a tooth contact area, and refining a boundary instance by clustering to obtain a boundary enhanced instance tag; and performing label fusion, and propagating the fused label to the original high-resolution point cloud through a nearest neighbor algorithm to obtain a final semantic label and a final instance label. By adopting the technical scheme, high-precision instance-level segmentation of the complete dentition point cloud is realized through semantic segmentation, boundary detection and clustering cooperative work based on a biased field.
Owner:CHONGQING UNIV

A battery pack blue film defect detection method, device and electronic equipment

The application provides a battery pack blue film defect detection method and device and electronic equipment, including: for each blue film surface of the battery pack, the following processing is performed: extracting a corresponding to-be-detected region image on the depth image of the blue film surface; performing point cloud conversion on the to-be-detected region image to obtain a to-be-processed point cloud image; using a point cloud gradient filtering algorithm to calculate a defect region of the to-be-processed point cloud image to obtain at least one defect region corresponding to the blue film surface and size information corresponding to each defect region; respectively performing defect analysis on the at least one defect region based on a defect detection standard and the size information corresponding to each defect region to determine a defect detection result corresponding to the blue film surface. The application detects defects of the battery pack blue film through a 3D point cloud processing technology, improves detection accuracy, and ensures detection stability.
Owner:DR OCTOPUS INTELLIGENT TECH (SHANGHAI) CO LTD

Laser radar individual tree segmentation method based on point cloud dimensionality reduction and individual tree network reforming

The invention relates to the technical field of forest resource investigation and point cloud processing, and discloses a laser radar individual tree segmentation method based on point cloud dimensionality reduction and individual tree network reforming, and the method comprises the steps: taking airborne LiDAR point cloud as a special network structure, replacing a single point with a point cloud cluster, and taking a fitting cluster circle as a hub. Dimensionality reduction processing from the three-dimensional point cloud to the two-dimensional hub is carried out, and redundant information is reduced. Three hub clustering methods (Euclidean distance, four-dimensional similarity and cosine similarity) are provided to construct individual tree hub clusters, and clustering results are mapped back to the three-dimensional point cloud to realize individual tree segmentation. The calculation pressure caused by huge point clouds is effectively relieved, and meanwhile, the segmentation precision and universality are improved; through a multi-strategy hub clustering method, the adaptability and robustness in a complex forest environment are improved; by introducing automatic precision evaluation based on convex hulls, low efficiency and subjectivity of traditional manual discrimination are avoided, objectification and automation of segmentation precision are realized, and the method has high theoretical value and application prospect.
Owner:SOUTHWEST FORESTRY UNIVERSITY

Anisotropic point cloud convolution method based on local geometric self-adaption

The invention belongs to the technical field of computer vision and three-dimensional point cloud processing. The invention provides an anisotropic point cloud convolution method based on local geometric self-adaption. According to the embodiment of the invention, the principal component analysis is carried out on the neighborhood point cloud to estimate the principal direction of the local geometric structure, and the affine transformation matrix is constructed; and performing dynamic deformation on the basic kernel point of the convolution operator by using the matrix, so that the shape and the direction of the convolution kernel are dynamically aligned with the local structure of the point cloud. The convolution operator is integrated into a point cloud registration network, and can be used for feature extraction of three-dimensional point clouds, especially underwater multi-beam depth finder point clouds. The convolution operator constructed by the method can effectively capture the structure priori of the strong anisotropic point cloud, and solves the problems of structure information loss and limited feature extraction capability caused by the isotropic kernel processing the data.
Owner:NINGBO INST OF NORTHWESTERN POLYTECHNICAL UNIV

Curved surface workpiece machining three-dimensional reconstruction method and system based on point cloud data

The invention discloses a curved surface workpiece processing three-dimensional reconstruction method and system based on point cloud data, and relates to the field of data processing, and the system comprises an acquisition module which is used for adaptively adjusting the scanning path, sampling density and scanning distance parameters of an acquisition device, and driving the acquisition device to obtain workpiece surface point cloud data; the preprocessing module is used for hierarchically dividing the acquired point cloud data according to the curvature change of the curved surface of the workpiece, removing abnormal points in each hierarchy and complementing missing point clouds; according to the method, scanning parameters are flexibly adjusted in combination with workpiece machining area parameters, comprehensive and accurate point cloud data collection is ensured, point cloud processing can be optimized according to curvature, features are accurately extracted, a model is constructed in a layered mode, the integrity of the model is guaranteed through splicing constraint, and it is ensured that the model meets machining requirements through precision verification and correction.
Owner:DALIAN YUYANG IND INTELLIGENT

Intelligent modeling method based on point cloud data

The invention relates to the technical field of point cloud processing, in particular to an intelligent modeling method based on point cloud data. The method comprises the following steps: scanning the interior of the transformer substation to obtain vision field overlapping graph data; performing point cloud density distribution field construction on the view field overlapping graph data to obtain point cloud density distribution field data; performing occlusion region extraction on the point cloud density distribution field data to obtain occlusion region data; performing structure connectivity calculation on the point cloud density distribution field data according to the occlusion region data to obtain occlusion region connectivity data; performing hole residual mapping on the occlusion area communication data to obtain hole residual data; performing graph neural network reasoning on the hole residual data to obtain category reasoning data; and performing physical rule fusion according to the category reasoning data to obtain point cloud complementation data, and performing point cloud model construction to obtain a point cloud model. According to the invention, the spatial coverage integrity of the point cloud data and the recognition precision of the occlusion area in the occlusion environment are improved, so that the accuracy of point cloud modeling is improved.
Owner:HUBEI CENT CHINA TECH DEV OF ELECTRIC POWER +1

Robot grabbing pose generation method and device

The invention discloses a robot grabbing pose generation method and device, and the method comprises the steps: obtaining a natural language grabbing task instruction, and carrying out the analysis based on a large language model, and generating a structured task parameter containing target object identification information and grabbing constraint information; performing open vocabulary target detection on the image based on the identification information, and obtaining a target area mask in combination with pixel-level segmentation; generating a target point cloud based on the mask, the depth map and the camera internal reference, carrying out depth completion or denoising, outlier elimination and threshold confirmation filtering, inputting the processed target point cloud into a grabbing pose prediction network, outputting a plurality of candidate six-degree-of-freedom grabbing poses, carrying out constraint screening according to grabbing constraints, and carrying out collision detection; and selecting the candidate with the optimal confidence coefficient from the collision-free candidates as the optimal grabbing pose to be output. Task constraints penetrate through a target extraction process, a point cloud construction process and a pose screening process, and point cloud processing and collision verification are combined, so that an executable six-degree-of-freedom grabbing pose which meets the constraints is output.
Owner:BEIJING SCI & TECH PATENT OFFICE

Superficial ultrasonic scanning path planning method and device based on SVD-improved RRT algorithm

The invention relates to the technical field of ultrasonic medical robots, and discloses a superficial ultrasonic scanning path planning method and device based on an SVD-improved RRT algorithm. The superficial ultrasonic scanning path planning method is applied to ultrasonic medical robot equipment, and specifically comprises the following steps: S101, receiving a data acquisition request sent by a main control end, controlling a Kinect camera to acquire a superficial depth image, processing 20 groups of calibration board images through a Matlab calibration tool box, and executing a corner detection algorithm to identify checkerboard corners, and optimizing and solving the internal reference matrix of the infrared camera. According to the method, SVD plane fitting and an improved RRT algorithm are fused, the precision and efficiency of an ultrasonic scanning path are remarkably improved, in the point cloud processing stage, statistical filtering and voxel gravity center down-sampling synergistically act, point cloud noise is reduced by 90%, meanwhile, more than 95% of three-dimensional features are reserved, a high-fidelity data basis is provided for path planning, and the method has good application prospects. SVD plane fitting forcibly passes through the center of mass, and the error is smaller than or equal to 0.5 mm
Owner:UESTC (SHENZHEN) ADVANCED RES INST

Calibration method of binocular camera and laser radar based on hollow ellipse calibrator

The invention relates to a calibration method of a binocular camera and a laser radar based on a hollow ellipse calibrator, and belongs to the field of robot vision. Hamming code graticule marks are respectively arranged at four corners of one side face of a square aluminum plate of the hollow elliptical calibrator in the clockwise direction, an elliptical through hole is formed in the middle of the hollow elliptical calibrator, and the center of the elliptical through hole coincides with the center of the square aluminum plate; and the long axis of the elliptical through hole is positioned in the vertical direction. A hardware system of the calibration method comprises a binocular camera, an upper computer, a 16-line laser radar and a hollow ellipse calibrator. An image processing program, a three-dimensional point cloud processing program and a mathematical calculation program are arranged in the upper computer; the calibration method comprises the following operation steps: (1) carrying out image feature recognition on the hollow ellipse calibrator; (2) carrying out point cloud feature recognition on the hollow ellipse calibrator; (3) calculating external parameters of the camera and the 16-line laser radar; and (4) determining a calibration result. According to the calibration method, the calibration accuracy and robustness are improved, and the calibration method is suitable for practical application.
Owner:UNIV OF SCI & TECH OF CHINA

Reverse BIM modeling method, system and equipment for existing building space rod system composite structure

The invention discloses a reverse BIM modeling method, system and equipment for an existing building space rod system composite structure, and belongs to the technical field of BIM modeling. In order to solve the problem that in the prior art, point cloud processing software lacks a special recognition and reconstruction tool for a'ball node-rod piece 'class space rod system combined structure, and efficient and accurate reverse generation of a rod piece axis is difficult to achieve, through curvature analysis, DBSCAN clustering, RANSAC spherical surface fitting and other technologies, the position of a ball node is accurately recognized from actually measured point cloud data; and finally generating a high-precision BIM model of a space rod system combined structure according with engineering practice by combining a two-stage geometric filtering strategy according to a sphere center connecting line of sphere nodes and the space constraint of the rod piece point cloud data. According to the method, the problem that actually measured point cloud data is discrete and difficult to process is effectively solved, and reliable technical support is provided for health monitoring, digital filing and accurate modeling of the existing building space rod system composite structure.
Owner:XIAN CONSTR SCI & TECH UNIV ENG TECH CO LTD

Weld joint ROI segmentation method based on active and passive vision fusion

The invention discloses a weld ROI segmentation method based on active and passive vision fusion. The method comprises the following steps: synchronously acquiring a two-dimensional image and a three-dimensional point cloud of the surface of a welded workpiece; inputting the trained deep learning network, and outputting a weld joint candidate region and a pixel-level mask graph thereof; establishing a cross-modal mapping relation through geometric calibration, and projecting the three-dimensional point cloud to a two-dimensional image to complete registration and fusion; cutting from the three-dimensional point cloud by using a cross-modal mapping relation to obtain a candidate point cloud region; generating a gray matrix for ray odd-even discrimination according to the pixel-level mask pattern; and each point of the candidate point cloud is projected to a pixel coordinate point by point, ray odd-even discrimination is carried out on the projection points according to the gray matrix, the points conforming to an odd-even rule are determined as welding line points and are aggregated into a welding line ROI point cloud, and the welding line ROI point cloud is output as a segmentation result. According to the method, the adaptive capacity to the unstructured welding seam is effectively improved, the point cloud processing complexity is reduced, and good real-time performance and robustness are achieved.
Owner:ANHUI UNIV +1

Overhead transmission line point cloud classification method and system based on rule improved RandLA-Net, and storage medium

The invention discloses an overhead transmission line point cloud classification method and system based on rule improved RandLA-Net, and a storage medium, and belongs to the field of three-dimensional laser point cloud processing and power system automation. The classification method comprises the following steps: collecting original point cloud data of the overhead transmission line, and performing preprocessing after data conversion and data classification to obtain a standardized point cloud data set; constructing and training an improved RandLA-Net point cloud classification model, performing feature enhancement through a channel attention mechanism, and outputting a preliminary classification result; performing optimization processing on the preliminary classification result based on a prior rule to obtain a final classification result; and outputting the final classification result and displaying the final classification result through a visual tool for supporting power transmission line inspection. Through improvement of a channel attention mechanism, data preprocessing optimization, combination of four types of prior rules and the like, high-precision classification of power transmission equipment is realized, and reliable data support is provided for power inspection.
Owner:UNIV OF SCI & TECH BEIJING +1

Concrete member steel bar identification and dislocation connection collaborative design method and system

The invention discloses a concrete member reinforcing steel bar identification and dislocation connection collaborative design method and system. According to the method, point cloud data of an exposed reinforcement area are collected through high-precision three-dimensional laser scanning, and precise three-dimensional geometric parameters of existing reinforcements are obtained through registration, denoising and geometric reconstruction; on the basis, a multi-target optimization model which takes bearing capacity maximization as a core target and takes distribution uniformity and symmetry into consideration is constructed, a two-stage optimization strategy is adopted to automatically solve an optimal arrangement scheme of newly-added reinforcing steel bars, and a digital result capable of being directly constructed is output after performance checking. The system comprises a data acquisition module, a point cloud processing and reconstruction module, a collaborative optimization design module and a scheme output and check module. According to the method, full-process automation from reinforcing steel bar recognition to optimization design is achieved, and the design quality and efficiency of reinforcement engineering are remarkably improved.
Owner:CHINA CONSTR FIFTH ENG DIV CORP LTD

Dispensing machine height measurement method, warping correction method, dispensing machine and storage medium

The invention discloses a dispenser height measurement method, a warping correction method, a dispenser and a storage medium, and relates to the field of dispensers. Controlling the carrying platform to drive the substrate to move, starting the laser transmitter to roughly measure the substrate, and obtaining initial point cloud data of the surface of the substrate; performing accuracy judgment on the initial point cloud data, determining material characteristics of the substrate according to a judgment result, and selecting a target height measurement mode; when a mixed height measurement mode is selected, identifying an abnormal key point and a target area of the initial point cloud data, and switching to a probe height measurement mode to perform fine measurement on the target area to obtain secondary point cloud data; the abnormal key points comprise intensity abrupt change points and boundary positions of the substrate; and carrying out point cloud processing fusion based on the initial point cloud data and the secondary point cloud data to generate a high-precision 3D morphology graph. According to the scheme, high-precision height measurement of substrates made of different materials is realized. The mixed height measurement mode overcomes the limitation of a single measurement mode, and improves the adaptability of the dispenser to various substrates.
Owner:长三角集成电路工业应用技术创新中心 +2

Weld joint extraction method based on multi-dimensional information fusion

The invention provides a weld joint extraction method based on multi-dimensional information fusion. The method comprises the following steps: S1, collecting a Texture image and depth data of a weld joint; s2, inputting the Texture image into an image recognition model to obtain a mask image of the welding seam; s3, binarization processing is carried out on the mask image, and pixel coordinates of the welding seam are extracted; s4, aligning the pixel coordinates with the depth data to generate an initial welding seam point cloud; s5, the initial welding seam point cloud is processed through plane segmentation and a fitting algorithm, and welding seam feature points are extracted; and S6, obtaining an accurate welding seam point cloud by using a straight line fitting algorithm or a plane intersection fitting algorithm. By combining the two-dimensional image segmentation and the three-dimensional point cloud processing technology, the problem that accurate three-dimensional information extraction and background noise interference resistance of the weld joint are difficult to consider simultaneously in a complex industrial scene by a traditional method is solved, the precision and robustness of weld joint extraction are improved, the processing efficiency is ensured, and the method is suitable for popularization and application. And a high-reliability three-dimensional path planning basis is provided for an automatic welding system.
Owner:WUHAN UNIV OF SCI & TECH

Mechanical arm intelligent grabbing system and method based on three-dimensional vision

The invention discloses a mechanical arm intelligent grabbing system and method based on three-dimensional vision. The system comprises a three-dimensional vision system, an image preprocessing module, a model matching module, a grabbing point generation module, a grabbing control module and a dynamic environment self-adaption module. The method comprises the steps of multi-modal reference model collection and feature library establishment, precise hand-eye calibration and grabbing strategy self-learning and multi-modal fusion recognition, and dynamic prediction and self-adaptive grabbing. By adopting the three-dimensional visual recognition system and combining algorithms such as point cloud processing, point cloud method phase generation, point cloud downsampling, rough model matching and fine model matching, the limitation that a traditional mechanical arm system depends on two-dimensional image training and position coordinate point matching is overcome; by generating the grabbing points and calculating the pose coordinates of the grabbing points according to the hand-eye calibration matrix, the problem that the estimated pose of the grabbed object under the camera coordinate system is inaccurate in the prior art is solved. The system is easy to implement and has high practicability and popularization value.
Owner:NINGBO XINGBOYUAN INTELLIGENT TECHNOLOGY CO LTD

Noise reduction and thinning method, system and equipment for cloud data of power distribution network, and medium

The invention discloses a power distribution network point cloud data noise reduction and thinning method, system and device and a medium, and belongs to the technical field of power system point cloud data processing, and the method comprises the steps: constructing a tower structure model and a lead structure model containing structural feature parameters, extracting the geometric features of each point, calculating the similarity score, and achieving the point cloud classification; based on a normal vector, neighborhood geometry and a scoring result, structure confidence scoring is executed, and low confidence points and background points are removed; adopting a voxel division strategy driven by a structure trend to carry out self-adaptive thinning on the residual point clouds; and constructing a structural consistency loss function including main axis offset, curvature residual error and feature point space error, and executing fusion registration processing. According to the method, point cloud classification is guided through structure modeling, and the structure recognition precision is improved; the noise elimination accuracy is improved by combining confidence score; adopting structure self-adaptive thinning to retain key geometric features; structural consistency constraint optimization fusion registration is introduced, and the cloud processing effect and modeling quality of the power distribution network point are enhanced.
Owner:GUIZHOU POWER GRID CO LTD

Steel truss extraction method based on point cloud segmentation and feature analysis

The invention discloses a steel truss extraction method based on point cloud segmentation and feature analysis, and belongs to the technical field of three-dimensional point cloud processing. The method mainly comprises the following steps: firstly, carrying out multi-scale filtering denoising on an original point cloud and constructing an octree index; local geometric features such as normal vectors, curvatures and first-order plane fitting errors of all the points are calculated; based on the adaptively selected seed points, carrying out region growth by combining a normal vector included angle, a curvature difference and an adaptive edge criterion to realize preliminary segmentation; and finally, a coarse-to-fine multi-layer cascade classifier is adopted to screen the segmented areas, and the steel truss point cloud is accurately extracted through geometric dimension filtering, shape feature screening and multi-dimensional feature matching in sequence. The method does not need pre-training, has the advantages of strong anti-interference capability, high extraction precision and high calculation efficiency, and is suitable for engineering scenes of bridge detection, building surveying and mapping and the like.
Owner:四川高速公路建设开发集团有限公司 +4

Hybrid filtering denoising method and device based on adaptive parameters

The invention provides a hybrid filtering denoising method and device based on adaptive parameters, and relates to the technical field of three-dimensional point cloud processing. The method comprises the following steps: acquiring three-dimensional point cloud data of a target object; performing voxel segmentation processing on the three-dimensional point cloud data to obtain a plurality of voxels; according to the segmented three-dimensional point cloud data, combining a plurality of voxels by using a density similarity model to obtain a voxel set with different density distributions; based on the merged voxels, a radius filtering parameter and a statistical filtering parameter of each voxel set are adaptively determined, the radius filtering parameter is used for filtering isolated noise in the three-dimensional point cloud data, and the statistical filtering parameter is used for filtering random noise in the three-dimensional point cloud data; performing random noise removal processing on the three-dimensional point cloud data according to the statistical filtering parameters; and performing isolated noise removal processing on the three-dimensional point cloud data after random noise removal according to the radius filtering parameter.
Owner:INST OF MICROELECTRONICS CHINESE ACAD OF SCI LTD

A mine rock mass structure surface discontinuity intelligent identification method and device

This invention provides an intelligent method and apparatus for identifying discontinuities in mine rock mass structural surfaces, relating to the field of rock mass structural surface recognition technology. The method includes: acquiring original 3D point cloud data of mine rock mass structural surfaces; performing point cloud processing on the original 3D point cloud data to obtain a training set; constructing an initial SoftGroup model; training the initial SoftGroup model based on the training set to obtain a trained SoftGroup model; acquiring actual 3D point cloud data of mine rock mass structural surfaces; inputting the actual 3D point cloud data of mine rock mass structural surfaces into the trained SoftGroup model; and obtaining the identification result of the mine rock mass structural surfaces by classifying discontinuities in the mine rock mass structural surfaces. This invention can improve the accuracy of identifying discontinuities in mine rock mass structural surfaces by employing an end-to-end processing approach, allowing model training to maximize the use of inter-task relationships.
Owner:UNIV OF SCI & TECH BEIJING +1