Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

9652results about "Three-dimensional object recognition" patented technology

High-performance loosely-coupled multi-modal data fusion system for smart driving environmental perception system and vehicle-mounted device

Disclosed are a high-performance loosely-coupled multi-modal data fusion system for a smart driving environmental perception system and a vehicle-mounted device, comprising: a fusion detection model based on a modality-independent feature interaction strategy, which is configured for converting a LiDAR point cloud, a camera image, and a millimeter-wave radar point cloud into a unified bird's-eye view representation, and performing multi-modal fusion; and a fusion tracking model based on a motion-appearance feature cascaded coupling data association strategy, which is configured for performing subsequent trajectory tracking and matching according to multi-modal fusion feature information. A VoD data set and a K-Radar data set are selected for training, verifying, and testing the comprehensive performance of the models, and a TensorRT accelerated inference model is applied, then quantized, and deployed to a vehicle-mounted computational testing platform. The present invention is compatible with mainstream sensor deployment solutions, and achieves the efficient complementary fusion of multi-source heterogeneous sensor information, significantly improving the reliability, accuracy, and adaptability of vehicle-mounted perception systems, thereby effectively responding to extreme operating conditions such as complex traffic scenarios and inclement weather.
Owner:JIANGSU UNIV

Pollutant identification and early warning method and system for river patrol pollution source

The invention relates to the technical field of river pollution identification, in particular to a pollutant identification and early warning method and system for a river patrol pollution source, and the method comprises the steps: constructing a three-dimensional monitoring network system, so as to build a three-dimensional data collection architecture; establishing a space-time reference unified framework to realize synchronous time service of different monitoring nodes; deploying an edge computing node, and implementing data preprocessing at an equipment end of the monitoring node; constructing a pollutant feature library which comprises spectral features, water quality parameter correlation features and visual morphological features of river pollutants, and establishing a water quality parameter correlation model of organic pollutants and inorganic pollutants, which comprises a plurality of feature dimensions; and a self-adaptive threshold early warning mechanism is established, a space-time composite early warning model is constructed, and accurate positioning and hazard degree grading early warning of pollution events are realized. According to the invention, through the hierarchical fusion model of technology fusion, the precision and speed of identifying the river pollutants are improved.
Owner:浙江菲达环保科技股份有限公司

Rapid point cloud data processing system based on 3D vision

The invention discloses a point cloud data rapid processing system based on 3D vision, and relates to the technical field of point cloud data processing. The binocular acquisition module generates an anti-interference high-precision point cloud; the preprocessing module is used for reducing noise and dimensionality and retaining key geometric features; the hierarchical feature extraction module fuses curvature weight and a non-maximum suppression strategy, and improves the robustness of an ORB algorithm in rotation, scale and noise scenes; the industrial scene segmentation module accurately separates stacked objects through normal vector clustering and a dynamic region growing algorithm, and secondarily verifies boundaries in combination with a lightweight semantic model; the two-stage registration module dynamically adjusts a threshold value based on error feedback to realize pose optimization from coarse registration to fine registration; the coordinate mapping module establishes a space mapping model through multi-attitude calibration and robot multi-axis linkage trajectory optimization. The problem that in the prior art, a 3D machine vision algorithm is high in time delay is solved, the real-time performance and rapidity of 3D model recognition and feature extraction are improved, and the efficiency requirement of industrial production is met.
Owner:GUANGXI TECHCAL COLLEGE OF MACHINERY & ELECTRICITY

Intelligent supervision management and control method and system

The invention discloses an intelligent supervision management and control method and system, and the method comprises the steps: generating a violation operation recognition result and an equipment abnormality early warning signal according to construction scene multi-mode data collected by an intelligent camera and real-time monitoring information of an Internet of Things sensor; generating a non-tampering block chain evidence storage data chain based on the violation operation identification result and the equipment abnormity early warning signal; according to the engineering change information in the block chain evidence storage data chain, updating a BIM collaboration platform through an incremental three-dimensional model synchronization technology, and generating a multi-party real-time interaction enhanced three-dimensional model; based on an enhanced three-dimensional model and Internet of Things environment monitoring data, a digital twin mirror image space is constructed, a construction process is simulated through a multi-source data fusion deduction engine, and a risk pre-judgment map and a resource configuration optimization strategy are generated. According to the embodiment of the invention, visual supervision, credible tracing and prospective decision making of the construction process can be realized.
Owner:ZHEJIANG HIGHWAY WATERWAY ENG SUPERVISION CO LTD

Indoor real scene three-dimensional reconstruction method based on improved 3D Gaussian sputtering

The invention discloses an indoor real scene three-dimensional reconstruction method based on improved 3D Gaussian sputtering, belongs to the technical field of three-dimensional reconstruction, and aims to complement initial point clouds in a self-adaptive manner through a designed feed-forward point cloud densification network, generate a high-density 3D Gaussian radiation field, fill scene missing details and avoid the problem of precision attenuation caused by lack of point cloud constraints. In the cost body optimization stage, a depth regularization loss module is designed by integrating global structure features, depth information is integrated into the optimization process, algorithm reasoning is accelerated, and object structure fuzziness is relieved; and finally, in combination with adaptive density control and Gaussian pruning, radiation field parameters and density distribution are finely adjusted, indoor scene reconstruction with double improvement of visual fidelity and structural integrity is realized, interactive application becomes possible, a real-time solution is provided for indoor scene reconstruction, and application of a three-dimensional reconstruction technology is widened.
Owner:DALIAN UNIV

Loess tunnel surrounding rock deformation monitoring method

The invention discloses a loess tunnel surrounding rock deformation monitoring method, and relates to the technical field of civil engineering and geological engineering, and the method comprises the steps: integrating a spiral winding type optical fiber sensor, a double-cavity humidity compensation vibrating wire sensor and a microseismic array, and capturing surrounding rock strain, vibration and geological activities; the vibrating wire sensor suppresses humidity interference through a silicone oil damping medium and self-adaptive excitation frequency, and the optical fiber sensor is fixed through a pre-embedded silica gel sleeve to adapt to surrounding rock deformation; edge computing nodes are deployed on the inner wall of the tunnel, an FPGA chip and a lightweight GRU model are integrated, optical fiber strain, a micro-seismic energy spectrum and laser point cloud displacement field data are fused in real time, the strain gradient is analyzed, and a crack propagation probability cloud picture is generated; redundant optical fiber link switching is combined with a six-degree-of-freedom mechanical arm to realize breakpoint self-repairing, and a self-cleaning air curtain is integrated to inhibit dust adhesion; and constructing a geological parameter library based on a BIM-GIS fusion platform, driving a finite element-discrete element coupling model to dynamically update boundary conditions, and predicting surrounding rock deformation and collapse risks.
Owner:XIAN UNIV OF TECH

Monorail crane inspection robot intelligent test method based on data analysis

The invention discloses a monorail crane inspection robot intelligent test method based on data analysis, and relates to the technical field of intelligent detection, and the method comprises the following steps: synchronously collecting track images, point cloud and attitude data, carrying out time alignment and preprocessing, and outputting a standardized data packet; detecting an inspection target by using a YOLO detection network, and outputting a multi-scale feature vector in combination with a point cloud feature hierarchy extraction network and a time sequence convolutional network; predicting a fault development trend in combination with an improved A-star algorithm and a long short-term memory network, optimizing an inspection path through reinforcement learning, and outputting a maintenance decision scheme; the maintenance decision scheme is converted into a control instruction, the robot is driven to execute an inspection task and feed back the operation state in real time, incremental learning and point cloud reconstruction are combined, and a visual diagnosis report is output. According to the method, the dynamic threshold algorithm is adopted for self-adaptive analysis, and the key geometric indexes are calculated in combination with the cross-modal attention mechanism, so that the recognition capability of structural anomalies is improved.
Owner:CHANGZHOU CHART INFORMATION TECH CO LTD

Human shape posture recognition method and system based on image analysis

The invention relates to a human shape posture recognition method and system based on image analysis, and the method comprises the steps: inputting the reference human shape data of a monitored object, and collecting the multi-modal data of an RGB image, an infrared image and inertial measurement data in a target scene in real time; space-time alignment processing is carried out, and corresponding features are fused; image space features are extracted, time sequence modeling is carried out on inertial data, and dynamic weighted fusion of two paths of network outputs is realized through a gating mechanism; human body basic joint points are positioned, and refined posture vectors including joint angles and limb relative positions are generated; according to attitude data and environment information collected in real time, adaptively adjusting an attitude classification threshold value and a similarity measurement standard, and predicting abnormal behaviors in a future time period; and when the abnormal behavior is predicted, triggering to execute a preset safety measure. Multi-modal data can be efficiently fused, attitude features can be accurately extracted, an identification strategy can be adaptively adjusted, and human shape attitude identification with behavior trend prediction capability can be realized.
Owner:CHINA WEST NORMAL UNIVERSITY

Mechanical arm dynamic deviation correction method and system based on visual driving and medium

The invention discloses a mechanical arm dynamic deviation correction method and system based on visual driving and a medium, and relates to the technical field of mechanical arm control. The method comprises the steps that when the tail end of a mechanical arm enters a preset machining space, an integrated 3D visual sensor is triggered to collect 3D point cloud of a workpiece to be machined; after pose recognition is carried out on the point cloud, the offset is recognized according to the teaching pose and the actual pose, and the initial offset is output; calling the multi-dimensional perception data, performing fusion correction, and outputting a correction offset; performing interference correction through an offset compensation model, and outputting a target offset; parameter adjustment and optimization are carried out according to the target offset, and a joint angle adjustment instruction is output; and performing correction closed-loop feedback according to the updated pose data. The technical problems of precision errors and low efficiency caused by deviation in the operation process of the mechanical arm are solved, and the technical effects that through dynamic deviation correction and multi-sensor data fusion, the operation precision and efficiency of the mechanical arm are improved, and stable operation in a complex environment is ensured are achieved.
Owner:ZHUHAI DEXIN ZHONGCHUANG INTELLIGENT TECHNOLOGY CO LTD

Edge perception multi-prototype learning-based few-sample medical image segmentation method

The invention relates to the technical field of medical image segmentation, in particular to a few-sample medical image segmentation method based on edge perception multi-prototype learning, and the method comprises the steps: inputting support and query images into a feature encoder, and extracting support and query feature maps of different sizes; inputting into a local attention fusion prototype generator to generate a support foreground prototype; processing the support mask through dynamic corrosion operation to generate an inner boundary prototype; generating a multi-foreground local prototype through a multi-layer perceptron; local and global information is optimized through multi-scale feature extraction, and a multi-scale prototype is obtained; fusing to obtain a multi-prototype foreground prototype; dynamic calculation weighting is carried out on the multi-prototype foreground prototype by using a double-stage prototype optimization network, and automatic calibration is carried out; then prediction is carried out through a prototype prediction module, and finally collaborative optimization is carried out through a loss calculation module; the method can effectively solve the problem of edge detail loss involved in the background technology.
Owner:CHANGSHU FIRST PEOPLES HOSPITAL (CHANGSHU OCCUPATIONAL DISEASE HOSPITAL) +1

Unmanned aerial vehicle three-dimensional point cloud-based lightweight semantic segmentation roadside signboard identification method

The invention relates to a roadside signboard identification method based on unmanned aerial vehicle three-dimensional point cloud lightweight semantic segmentation, and belongs to the technical field of intelligent traffic. The method comprises the following steps: optimizing a point cloud acquisition path through adaptive flight control; adopting an RSPAE algorithm to enhance local geometric features of the point cloud; converting the point cloud into a three-channel fusion image (a depth image, an intensity image and a local depth variance image); extracting multi-scale features by using a double-branch neural network, and fusing the aligned features through a GFM module and a CFM module; the lightweight decoder recovers a high-precision semantic segmentation map; and generating a final identification result by combining geographical registration and multi-frame redundancy suppression. And state evaluation and anomaly detection are realized based on an MLP scoring device and a mahalanobis distance. According to the method, the segmentation precision, the reasoning speed and the positioning precision are remarkably improved in a complex scene, the method is suitable for deployment of embedded equipment, and the problems of low efficiency and high omission ratio in the prior art are solved.
Owner:SHANDONG HI SPEED GRP CO LTD +1

Robot sensing and decision-making method based on lightweight multi-modal large model

The invention relates to a robot sensing and decision-making method based on a lightweight multi-modal large model. The method comprises the following steps: constructing a semantic voxel map; collecting multi-modal data based on the semantic voxel map and preprocessing the multi-modal data, wherein the multi-modal data comprises visual data, point cloud data and a target semantic tag; performing feature extraction on the preprocessed multi-modal data, and performing dynamic cross-modal attention fusion to obtain multi-modal fusion features; inputting the multi-modal data into a lightweight multi-modal large model at the same time, and performing semantic analysis to obtain global space object semantic description; and based on the global space object semantic description, the target and direction embedding vector and the multi-modal fusion feature, a reinforcement learning algorithm is adopted to carry out hierarchical navigation decision making to obtain a target decision, and the target and direction embedding vector is a preprocessed target semantic tag. And the accuracy, timeliness and adaptability of robot perception and navigation decision making in a complex scene are improved.
Owner:SOUTHWEST JIAOTONG UNIV

Three-dimensional point cloud segmentation method and apparatus based on locally weighted curvature and two-point method

A three-dimensional point cloud segmentation method and apparatus based on a locally weighted curvature and a two-point method, which method and apparatus relate to the field of point cloud processing. The segmentation method comprises: calculating a normal vector of each sample point in a three-dimensional point cloud image (S101); calculating a locally weighted curvature of each sample point on the basis of the normal vector, and comparing the locally weighted curvature with a preset curvature threshold value, so as to obtain a comparison result (S102); when the comparison result indicates that the locally weighted curvature of the sample point is greater than or equal to the preset curvature threshold value, marking the sample point as a boundary feature point, so as to obtain a boundary feature point set (S103); fitting a point cloud planar model on the basis of the boundary feature point set, and performing iterative calculation on the point cloud planar model, so as to obtain a target inner point set (S104); and segmenting the three-dimensional point cloud image on the basis of the boundary feature point set and the target inner point set (S105).
Owner:CHINA TELECOM BESTPAY CO LTD

Image-based three-dimensional point cloud traffic marker classification method and system

The invention provides an image-based three-dimensional point cloud traffic marker classification method and system, and relates to the technical field of computer vision, and the method comprises the steps: collecting a multi-frame multi-angle image of a traffic marker, converting the multi-frame multi-angle image into point cloud data, constructing a histogram based on reflection intensity and geometric features, determining an optimal segmentation threshold value, and carrying out the segmentation of the point cloud data; the method comprises the following steps: carrying out region merging by combining spatial distribution characteristics of scattering coefficients and absorption coefficients to obtain point cloud sub-regions with uniform materials, determining a core region by utilizing a curvature entropy value and a normal vector entropy value, establishing a local coordinate system, carrying out region growth and dynamic merging through spatial position and geometric structure constraints to obtain candidate point cloud sub-regions, and carrying out point cloud distribution on the candidate point cloud sub-regions. And extracting the position offset and the attitude variation to construct a time sequence motion feature, thereby realizing accurate classification of the traffic markers.
Owner:BEIJING NANDE SPACE INFORMATION TECH CO LTD

Agricultural ecological environment monitoring method and system based on digital twinborn

The invention relates to the technical field of ecological monitoring, in particular to an agricultural ecological environment monitoring method and system based on digital twinning, and the method comprises the following steps: obtaining monitoring data in a farmland, constructing a mapping relation, carrying out time sequence arrangement, merging multi-source data, calling a virtual grid to update a three-dimensional model, generating a mapping result, and analyzing a crop growth image. And tracking environmental changes, comparing ecological stability intervals, extracting risk trends, calling the three-dimensional model, and generating a risk early warning interface layer. According to the method, the continuous data of the agricultural ecological environment is acquired, and the mapping relation is constructed to perform time sequence arrangement on the information, so that the response speed and the processing precision of the change of the agricultural ecological environment are improved, the monitoring and management of the crop growth environment are optimized, and the environment change can be visually displayed through the expression of the real-time updated three-dimensional environment model; by comparing humidity and temperature changes and screening space segments, careful monitoring and accurate early warning of environmental changes are enhanced.
Owner:SHANDONG BUSINESS INST +1

Special-shaped curved glass laser cutting track planning method

The invention belongs to the technical field of laser processing, and particularly relates to a special-shaped curved glass laser cutting track planning method. According to the method, the instantaneous thermal effect and the historical thermal accumulation effect are subjected to coupling calculation, high-precision prediction and compensation of thermal deformation in the laser cutting process are achieved, the accuracy of the cutting track is improved, contour deviation caused by thermal deformation is avoided, and the geometric precision is improved; according to the local geometric complexity of the special-shaped curved glass, regions are divided, and differential virtual scanning layers and scanning modes are matched, so that the dynamic balance of efficiency and precision is guaranteed, the processing quality of regions with high curvature, thin walls and the like is guaranteed, the cutting speed of flat regions is increased, and the processing period is shortened; by monitoring the temperature and feeding back actual thermal historical parameters during cutting, model parameters are reversely optimized by using contour precision data after cutting is completed, so that robustness and stability are enhanced, and the yield and process reliability of laser cutting of the special-shaped curved glass are improved.
Owner:ZHONGSHAN GUANGDA OPTICAL INSTR CO LTD

Three-dimensional modeling processing method based on unmanned aerial vehicle oblique photography

PendingCN120672994AImage enhancementImage analysisPhotographic cameraPoint cloud
The invention provides a three-dimensional modeling processing method based on unmanned aerial vehicle oblique photography. The method is applied to the technical field of three-dimensional modeling, and comprises the following steps: obtaining a serialized image set containing geographical coordinate information according to original image data collected by an oblique photography camera carried by a multi-rotor unmanned aerial vehicle; according to time-space synchronization parameters of the serialized image set, determining a multi-view image matching relation matrix with an overlapping degree quantitative index; determining mixed three-dimensional point cloud data fusing sparse point cloud and dense point cloud according to geometric constraint conditions of the multi-view image matching relation matrix; determining an initial three-dimensional grid model with multi-level details according to the topological connection relationship of the mixed three-dimensional point cloud data; and determining an optimized three-dimensional model based on adaptive texture mapping according to the surface curvature distribution characteristics of the initial three-dimensional mesh model. In this way, the efficiency of three-dimensional modeling can be improved.
Owner:HENAN WEITU INFORMATION TECH CO LTD

Power equipment defect detection system and method based on deep learning

The invention relates to the technical field of electrical equipment defect detection, in particular to an electrical equipment defect detection system and method based on deep learning, which are characterized in that a three-dimensional model of a power grid region is constructed, and based on historical defect data, a neural network model is adopted to mark an importance score of an inspection object in the three-dimensional model; quantitative evaluation of the equipment fault risk level is completed, and the matching degree of inspection resources and defect risk distribution is improved. A power grid three-dimensional model and importance scores are combined, a reinforcement learning model is utilized to construct an unmanned aerial vehicle inspection route planning strategy, the inspection route comprehensively considers power equipment defect risks and space factors in the planning stage, task allocation is optimized, and the problem that a static route cannot adapt to equipment changes is solved. In the inspection execution process, the unmanned aerial vehicle is dispatched according to the planning strategy, and the image flow is synchronously acquired for defect detection, so that the linkage of the inspection action and the detection process is realized, and the response efficiency and the detection quality of potential defects are improved.
Owner:GUANGZHOU JINYUAN TECH DEV CO LTD

Method for establishing 3D medical image segmentation model based on masked modeling and application thereof

Disclosed is a method for establishing a 3D medical image segmentation model based on masked modeling and application thereof includes: establishing a semi-supervised learning network, wherein a student network includes an encoding module for extracting latent features and a segmentation decoder that predicts segmentation results, a teacher network includes an encoding module and a segmentation decoder that are structurally consistent with the student network; training the semi-supervised learning network, wherein during training, two random masking operations are performed on each image, and the image is input to the two networks respectively; optimizing and updating the weight of the student network, and transferring the updated weight to the teacher network, wherein the training loss function includes prototype representation loss, which is used to characterize the difference between the prototypes extracted and generated by the two networks; the student network may further include a reconstruction decoder and an auxiliary segmentation decoder.
Owner:HUAZHONG UNIV OF SCI & TECH

Building facade defect detection system based on unmanned aerial vehicle exogenous thermal excitation compensation

The invention belongs to the field of data analysis and processing, and discloses a building facade defect detection system based on unmanned aerial vehicle exogenous thermal excitation compensation. Comprising the steps of generating a building facade three-dimensional model, predefining a heterogeneous modal joint optimization framework, selecting an automatic connection port according to a mode, and operating an intelligent control center; unmanned aerial vehicle formations are deployed based on a master-slave mode, and the formations share detection data through federal learning; the intelligent control center comprises the steps of deploying an airborne lightweight model, processing thermal imaging data and RGB images in real time at an unmanned aerial vehicle end, identifying a suspected defect area, generating a light spot distribution thermodynamic diagram through a pre-detection model deployed by the intelligent control center, and performing a heating task in a dynamic light-heat cooperative and integrated manner; the intelligent control center further comprises ground analysis centralized control, a cloud actuarial model is used for constructing a thermal diffusion space-time map and hollowing expansion trend prediction, a three-dimensional defect distribution map is finally generated and displayed through an interactive interface, and defect detection of the unmanned aerial vehicle on the building facade under exogenous thermal excitation compensation is achieved.
Owner:HUNAN TIANFANG TECHNOLOGY DEVELOPMENT CO LTD

Belt tearing detection method, device and equipment based on visual identification

The invention relates to the technical field of visual identification, and discloses a belt tearing detection method, device and equipment based on visual identification, and the method comprises the steps: carrying out the dual-channel image collection and preprocessing of the surface of a conveying belt, and obtaining a multi-channel preprocessing image; extracting a thermal difference feature and a texture structure feature of the multi-channel preprocessed image through a double-flow feature network, and inputting the thermal difference feature and the texture structure feature into a quaternion material deformation analysis model for deformation gradient tensor and invariant parameter calculation to obtain a tear feature description vector; performing hierarchical progressive identification and three-dimensional reconstruction analysis to obtain target tearing feature data; and risk assessment is carried out based on the target tear feature data to obtain a tear grade classification result, the interference of ambient temperature drift and non-uniform illumination is effectively eliminated, the calculation efficiency and accuracy of tear detection are improved, and false alarms and missing alarms are reduced.
Owner:宁夏京能宁东发电有限责任公司

Urban building three-dimensional automatic modeling and visualization method

The invention discloses an urban building three-dimensional automatic modeling and visualization method, and belongs to the technical field of building three-dimensional modeling. The method comprises the steps that point cloud data, high-resolution images and geographic information system data of urban buildings are acquired, data cleaning, registration and alignment are carried out, and preliminary building digital representation is formed; accurately segmenting each building, and identifying the contour and main structural features of the building; based on the data integrity and the building complexity, adaptively selecting a proper reconstruction strategy to carry out three-dimensional reconstruction; in the reconstruction process, the geometric structure is analyzed and optimized in real time, and potential topological problems are repaired; automatically generating missing details based on a predefined architectural style library and a component library, and performing material inference and texture mapping; a graph structure is used for representing the relation between the buildings, and the positions and orientations of the buildings are adjusted through a global optimization algorithm; a rendering engine supporting multi-level detail switching is developed, and smooth visualization and interaction of a large-scale city scene are achieved.
Owner:CHANGZHOU JINTAN DISTRICT LUOSUI TECHNOLOGY CO LTD

Waste metal classification and identification method and system based on image identification

The invention relates to the technical field of industrial visual inspection, and particularly discloses a waste metal classification and recognition method and system based on image recognition, and the method comprises the steps: obtaining metal surface visual information through an image collection system, extracting multi-level depth features after preprocessing, and generating a preliminary classification result and confidence evaluation; when the confidence coefficient is insufficient, starting a multi-mode verification mechanism, acquiring element composition data by adopting a laser-induced breakdown spectroscopy technology, and acquiring surface topological characteristics by adopting a structured light three-dimensional scanning technology; matching the element data with a component database to generate a component verification result, and comparing the morphology features with a morphology database to generate a morphology verification result; and finally, three types of results are integrated based on a weighted fusion algorithm to generate a final classification decision, and a sorting mechanism is controlled to complete accurate sorting.
Owner:JIANGXI JIANGLING NON-FERROUS METAL DIE-CASTING CO LTD

Welding seam track extraction method and system based on RANSAC parameter fitting

The invention discloses a welding seam track extraction method and system based on RANSAC parameter fitting, and the method comprises the steps: S1, obtaining three-dimensional point cloud data, and obtaining the normal vector and local curvature of each point cloud data point; selecting an initial seed point from the three-dimensional point cloud data according to the local curvature of each point cloud data point; s2, establishing a feature similarity evaluation system, and adding the initial seed points and the corresponding similar adjacent points into the same plane; according to different planes where the point cloud data points are located, plane area coarse segmentation is carried out; and S3, a plurality of geometric fitting models are constructed for the welding track based on the RANSAC algorithm, the geometric fitting model with the highest matching degree is selected from the geometric fitting models, and the welding track in the welding area is extracted. According to the technical scheme, the welding seam track can be rapidly and effectively extracted, the universality of welding seam track recognition is improved, and the extraction error of the welding seam track is remarkably reduced.
Owner:WUHAN UNIV OF SCI & TECH

Part defect automatic detection method based on machine vision

The invention relates to the technical field of part detection, and discloses a part defect automatic detection method based on machine vision. The method comprises the following steps: firstly, acquiring three-dimensional geometric parameters of a target part, and matching a historical defect sample set in a visual sample library according to the three-dimensional geometric parameters; performing defect type clustering division on the set to obtain a plurality of defect type subsets; processing the subsets one by one to execute multispectral feature extraction, and obtaining a reference detection area and a defect diffusion range parameter corresponding to each defect category; utilizing defect diffusion range parameters to configure the scanning step length of the multi-stage detection network layer, and generating a plurality of scale defect feature maps; and finally, performing cross-level association fusion on the feature maps to generate a fusion defect feature map, and outputting the fusion defect feature map as a final detection result. According to the method, three-dimensional geometric features and historical data are combined, and the comprehensiveness and accuracy of part defect detection are improved through multispectral extraction, adaptive scanning and feature fusion.
Owner:XIAN AERONAUTICAL UNIV

End-to-end automatic driving method based on dynamic multi-modal fusion in complex scene

The invention discloses an end-to-end automatic driving method based on dynamic multi-modal fusion in a complex scene, and belongs to the technical field of automatic driving. In order to solve the problems of sensor perception deficiency, cross-modal feature mismatching, unstable trajectory planning and the like easily occurring in night, low-illumination and complex dynamic environments in the existing end-to-end automatic driving method, texture details of a camera mode and geometric structure features of a laser radar mode are respectively enhanced through a double-flow feature refining mechanism; the characteristic difference between different modes is relieved; an information-driven dynamic fusion strategy is designed, the fusion weight is adaptively adjusted according to scene factors such as environment illumination and obstacle density, and the scene sensitivity and discrimination ability of the model are improved; asymmetric convolution and a low-rank-sparse decoupling technology are introduced, multi-order reconstruction of key channels is carried out on the multi-modal features, and the path change modeling capability is enhanced; and in combination with time sequence dependence of waypoints, outputting a future trajectory through an autoregression decoder to realize high-precision trajectory prediction and stable decision control.
Owner:ZHONGBEI UNIV

Bridge scour curved surface morphological feature reconstruction method based on three-dimensional sonar point clouds

Disclosed in the present invention is a bridge scour curved surface morphological feature reconstruction method based on three-dimensional sonar point clouds, comprising the following steps: collecting point cloud data of a three-dimensional morphology of an underwater riverbed terrain near a bridge foundation, and acquiring original point cloud data of a complete morphology of an underwater riverbed; performing denoising and ball pivoting reconstruction preprocessing on the collected original point cloud data to complete preliminary reconstruction of point clouds; on the basis of the point cloud data having undergone preliminary reconstruction, performing point cloud binarization-based scour morphology recognition on the basis of a computer vision principle, calculating scour pit element classification values of all the point clouds, and recognizing scour pit point clouds; on the basis of the recognized scour pit point clouds, using a K-means clustering algorithm for clustering, and calculating the maximum depth of each pier scour pit; and on the basis of the obtained scour pit element classification values of all the point clouds, providing a curved surface reconstruction method based on scour recognition to perform high-precision curved surface reconstruction on the scour pits. The present invention can achieve high-precision scour pit morphology reconstruction.
Owner:SOUTHEAST UNIV

Virtual reality scene three-dimensional reconstruction method and system based on multi-source data fusion

The invention discloses a virtual reality scene three-dimensional reconstruction method and system based on multi-source data fusion, and relates to the technical field of underground commercial and traffic integrated space scene three-dimensional reconstruction. The system constructs a multi-dimensional data set through synchronous acquisition of point cloud, images, poses, positioning and semantic text information; a three-dimensional convolutional neural network is adopted to establish an AI reconstruction fusion model, and a three-dimensional model is generated; the system calculates a structural integrity evaluation coefficient JGPG, a fusion consistency evaluation coefficient RHPG and a VR interaction adaptability evaluation coefficient VRJH, compares the coefficients with corresponding thresholds, triggers an optimization strategy, and finally completes model adaptability optimization and packaging output, thereby improving the reduction degree and interaction performance of a virtual reality scene.
Owner:GUANGDONG ZHONGKE KAIZER INFORMATION TECH CO LTD

Wind power construction intelligent safety management method and system based on intelligent AI monitoring

The invention relates to the field of image recognition, in particular to a wind power construction intelligent safety management method and system based on intelligent AI monitoring. The method comprises the following steps: obtaining an omnibearing real-time image flow of a wind power construction area, carrying out super-resolution deep convolution optimization and operator three-dimensional image segmentation, and extracting an operator three-dimensional image frame; three-dimensional point cloud modeling of the construction area is carried out based on the image flow, real-time image frame position positioning rendering is carried out according to a three-dimensional image frame, and a real-time twinborn model of the construction area is constructed; performing operation dynamic behavior analysis and behavior deviation degree quantitative analysis based on a twin model to obtain the behavior deviation degree of the operator; and according to the behavior deviation degree, carrying out early prediction analysis on illegal behaviors, making an adaptive risk early warning decision, and constructing an operation behavior risk early warning strategy. According to the invention, through real-time operation behavior identification and environmental risk analysis, the intelligence and safety level of wind power construction are improved.
Owner:JIANGXI QIANPING MASCH CO LTD