Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

9321 results about "Lidar" patented technology

Lidar (/ˈlaɪdɑːr/, called LIDAR, LiDAR, and LADAR) is a surveying method that measures distance to a target by illuminating the target with laser light and measuring the reflected light with a sensor. Differences in laser return times and wavelengths can then be used to make digital 3-D representations of the target. The name lidar, now used as an acronym of light detection and ranging (sometimes, light imaging, detection, and ranging), was originally a portmanteau of light and radar. Lidar sometimes is called 3D laser scanning, a special combination of a 3D scanning and laser scanning. It has terrestrial, airborne, and mobile applications.

High-performance loosely-coupled multi-modal data fusion system for smart driving environmental perception system and vehicle-mounted device

Disclosed are a high-performance loosely-coupled multi-modal data fusion system for a smart driving environmental perception system and a vehicle-mounted device, comprising: a fusion detection model based on a modality-independent feature interaction strategy, which is configured for converting a LiDAR point cloud, a camera image, and a millimeter-wave radar point cloud into a unified bird's-eye view representation, and performing multi-modal fusion; and a fusion tracking model based on a motion-appearance feature cascaded coupling data association strategy, which is configured for performing subsequent trajectory tracking and matching according to multi-modal fusion feature information. A VoD data set and a K-Radar data set are selected for training, verifying, and testing the comprehensive performance of the models, and a TensorRT accelerated inference model is applied, then quantized, and deployed to a vehicle-mounted computational testing platform. The present invention is compatible with mainstream sensor deployment solutions, and achieves the efficient complementary fusion of multi-source heterogeneous sensor information, significantly improving the reliability, accuracy, and adaptability of vehicle-mounted perception systems, thereby effectively responding to extreme operating conditions such as complex traffic scenarios and inclement weather.
Owner:JIANGSU UNIV

Three-dimensional environment reconstruction optimization method based on multi-sensor fusion data

The invention discloses a three-dimensional environment reconstruction optimization method based on multi-sensor fusion data, and relates to the field of three-dimensional environment reconstruction optimization, and the three-dimensional environment reconstruction optimization method based on the multi-sensor fusion data comprises the following steps: S1, collecting multi-source sensor data, and constructing a data set under a unified coordinate system; s2, generating dense visual point cloud, and extracting laser point cloud features to construct a model; s3, establishing a local three-dimensional model, and generating a local environment image; s4, shadow parameters are extracted through shadow geometric analysis, and time sequence optimization is carried out; s5, consistency verification and correction are carried out, and three-dimensional reconstruction data are output; and S6, comparing the reconstruction data with the navigation map database, and carrying out map optimization updating. According to the method, time synchronization and space calibration are carried out on data acquired by the depth camera and the laser radar, complete and accurate three-dimensional information modeling of the target environment is realized, and the geometric precision of environment reconstruction and the image detail reduction capability are improved.
Owner:NORTH CHINA UNIV OF WATER RESOURCES & ELECTRIC POWER

Multi-modal visual fusion complex scene small target detection tracking method and system

The invention discloses a multi-modal visual fusion complex scene small target detection tracking method and system, and relates to the technical field of unmanned aerial vehicle target tracking, and the method comprises the steps: employing a visible light camera, an infrared thermal imager and a laser radar sensor which are carried on an unmanned aerial vehicle platform, and synchronously collecting RGB images, thermal infrared images and point cloud data; the consistency of the multi-modal data is ensured through data preprocessing and space-time alignment; constructing a lightweight double-branch network to extract multi-scale features, generating a fusion feature map by adopting adaptive weighted fusion, and generating depth information by utilizing point cloud to assist in scale estimation; a small target detection head is designed based on the fusion feature map, and precise detection is realized in combination with a feature pyramid network, adaptive scale prediction and a context awareness suppression mechanism; furthermore, through multi-mode cooperative tracking, including target association, spatio-temporal context modeling, trajectory prediction and a re-detection mechanism, tracking continuity is ensured.
Owner:BEIJING INSTITUTE OF GRAPHIC COMMUNICATION

Data center machine room AI energy-saving control method and system

The invention discloses a data center machine room AI energy-saving control method and system, a digital twin model of a machine room operation state is constructed through a holographic perception and heterogeneous data fusion technology, centimeter-level monitoring of an equipment state and environmental parameters is realized, and the system integrates a laser radar array, an acoustic sensor and a gas sensor network. The time-space alignment of multi-modal data is completed by combining edge computing nodes, holographic mapping including thermodynamic characteristics, vibration characteristics and gas leakage risks is formed, historical temperature control strategy characteristics are extracted by adopting a variational auto-encoder based on a dynamic strategy generation mechanism of generative artificial intelligence, and a load trend is predicted by combining a long-short-term memory network. Constructing a self-adaptive strategy pool; the multi-agent reinforcement learning framework enables temperature control, equipment scheduling and power grid response to form game optimization, the strategy robustness in a complex scene is improved, and the system innovatively fuses power grid real-time electricity price and carbon transaction data so as to establish a multi-target decision system.
Owner:SHENZHEN JITON INTELLIGENT TECH CO LTD

Unmanned aerial vehicle laser and vision fusion inspection method and system for bridge bottom disease detection

The invention discloses an unmanned aerial vehicle laser and vision fusion inspection method and system for bridge bottom disease detection, and the method comprises the steps: carrying out the synchronous data collection through employing a calibrated laser radar, a camera and an IMU, and obtaining a three-dimensional laser point cloud and a two-dimensional visual image of the appearance of a bridge; sharpening the image containing the motion blur and completing brightness self-adaption of the image; stable feature points are extracted, multi-frame matching is carried out, the corresponding poses of the images are estimated, and bridge dense point cloud reconstruction is completed; performing geometric component segmentation on the point cloud to generate a geometric prior region; component segmentation is carried out on a support area in the image, and a continuous and accurate component segmentation result is obtained in combination with a geometric prior area; screening the image, calling a targeted disease detection model in a corresponding component area, and generating a segmentation mask for the disease; obtaining a real disease three-dimensional point cloud, and carrying out quantitative calculation on the physical size of the disease; and displaying the real disease three-dimensional point cloud data and the physical size of the disease. The method is high in efficiency and precision.
Owner:SOUTHEAST UNIV

Robot multi-modal fusion autonomous decision-making method and system based on large language model

The invention relates to the technical field of robot decision making, and provides a robot multi-modal fusion autonomous decision making method and system based on a large language model.The method comprises the steps that a robot obtains multi-modal environment information through a visual sensor, a touch sensor, an auditory sensor and a laser radar which are carried by the robot; performing preliminary filtering and noise reduction processing on the original sensor data, and synchronously recording all the sensor data by timestamps; performing space-time semantic alignment on the preprocessed multi-modal data, mapping pixel coordinates of a target in a visual target coordinate quantization original image to a robot coordinate system, performing uncertainty evaluation on a multi-modal signal through a dynamic Bayesian network, and taking entropy or variance as an uncertainty quantitative evaluation index. According to the method, the information quality is improved from a data fusion source, accurate and reliable basic support is provided for subsequent decision making, and decision making errors caused by data deviation are greatly reduced.
Owner:ANHUI UNIV +1

Intelligent surveying and mapping method and system based on AI and BIM fusion

The embodiment of the invention discloses an intelligent surveying and mapping method and system based on AI and BIM fusion. The method comprises the steps that an unmanned aerial vehicle platform carrying a laser radar, an RGB camera and a positioning system is used for scanning ancient building cultural relics and surroundings in a multi-angle flight mode, point cloud data, multi-view image data and position and attitude data are synchronously collected, and the three are associated through timestamps; after the point cloud data and the multi-view image data are preprocessed, cross-modal registration is completed through feature matching and pose estimation in combination with the position and pose data, and a registration data set is obtained; semantic segmentation is carried out on the point cloud data and the image data in the registration data set, and semantic segmentation results are fused based on the incidence relation; classifying and aggregating the original point cloud components according to category labels, constructing a topological relation reasoning assembly relation, calling corresponding BIM template instantiation model components based on the assembly relation, and hooking a segmentation result to generate a semantic enhanced BIM model; and integrating the BIM model and the GIS base map to form a fusion model so as to plot the historic building cultural relics.
Owner:XIAN UNVERSITY OF ARTS & SCI

Visual language navigation method for cross-modal alignment in dynamic shielding environment

The invention discloses a visual language navigation method for cross-modal alignment in a dynamic shielding environment, and the method comprises the steps: collecting multi-modal data through a visual sensor, an inertial measurement unit, a laser radar and the like, and carrying out the preprocessing and time synchronization; sensing the dynamic shielding object through a model composed of a convolutional neural network and a long-short-term memory network, and estimating the future change of the dynamic shielding object in combination with a space-time sequence prediction algorithm; a double-branch convolutional neural network and a Transform based on a dynamic attention mechanism are adopted to respectively extract visual and semantic features and fuse the visual and semantic features; on the basis of occlusion prediction, potential occlusion region features are extracted in advance from a time dimension, an occluded image is repaired by using a generative adversarial network and geometric constraints in a space dimension, and cross-modal feature alignment is optimized through an attention mechanism; planning a path by using a hybrid reinforcement learning algorithm based on a deep Q network-space and a fast exploration random tree, and dynamically adjusting according to real-time shielding; according to the method, the accuracy, adaptability and reliability of visual language navigation in a dynamic shielding environment are improved.
Owner:SHANGHAI JIAOTONG UNIV

Tower crane operation control system based on complex scene three-dimensional real-time modeling

The invention relates to a tower crane operation control system based on complex scene three-dimensional real-time modeling. According to the system, a lifting hook is coarsely positioned through a lifting hook positioning and state sensing unit, a real-time position is positioned by combining a laser radar point cloud clustering algorithm with historical pose data, and visual tracking is synchronously performed by means of a tower top camera AI; converting the real-time point cloud data into a 3D voxel grid map, generating a global path by using a 3DA algorithm, and outputting a hoisting track after smooth processing and track optimization; establishing a sling-lifting hook double-pendulum dynamic model, predicting a state sequence based on a model prediction control algorithm, and adjusting a control signal through a feedforward compensation item and a feedback correction item; and the man-machine interaction and monitoring unit is used for displaying the cantilever angle, the lifting hook height and the three-dimensional map of the tower crane in real time and remotely intervening the operation state of the tower crane. According to the system, multi-source data are fused to construct a high-precision three-dimensional map, lifting hook positioning and full-view tracking are achieved, and lifting safety and trajectory tracking precision are improved through path planning and dynamics control.
Owner:UNIVERSAL UBIQUITOUS TECH CO LTD

End-to-end automatic driving method based on dynamic multi-modal fusion in complex scene

The invention discloses an end-to-end automatic driving method based on dynamic multi-modal fusion in a complex scene, and belongs to the technical field of automatic driving. In order to solve the problems of sensor perception deficiency, cross-modal feature mismatching, unstable trajectory planning and the like easily occurring in night, low-illumination and complex dynamic environments in the existing end-to-end automatic driving method, texture details of a camera mode and geometric structure features of a laser radar mode are respectively enhanced through a double-flow feature refining mechanism; the characteristic difference between different modes is relieved; an information-driven dynamic fusion strategy is designed, the fusion weight is adaptively adjusted according to scene factors such as environment illumination and obstacle density, and the scene sensitivity and discrimination ability of the model are improved; asymmetric convolution and a low-rank-sparse decoupling technology are introduced, multi-order reconstruction of key channels is carried out on the multi-modal features, and the path change modeling capability is enhanced; and in combination with time sequence dependence of waypoints, outputting a future trajectory through an autoregression decoder to realize high-precision trajectory prediction and stable decision control.
Owner:ZHONGBEI UNIV

Ground mobile unmanned equipment autonomous obstacle avoidance control system optimized by artificial intelligence

The invention relates to the technical field of ground mobile unmanned equipment control, and discloses a ground mobile unmanned equipment autonomous obstacle avoidance control system optimized by artificial intelligence. The system comprises an environment perception layer, a bimodal risk assessment layer, a dynamic decision-making layer, a trajectory optimization layer and a feedback optimization layer. The environment sensing layer adopts a retina fovea centralis imitating mechanism to perform non-uniform sampling on laser radar point cloud data to generate dynamic point cloud partitions; the bimodal risk assessment layer fuses two types of radar data to generate static and dynamic obstacle risk assessment diagrams; the dynamic decision-making layer establishes space-time mapping and generates an obstacle confidence coefficient matrix through a graph neural network; the trajectory optimization layer converts the matrix into a control parameter based on a multi-objective evolutionary algorithm, and issues the control parameter through a time-sensitive network protocol; and the feedback optimization layer monitors environment change, calculates deviation, generates an effectiveness index, and dynamically adjusts a point cloud acquisition strategy until the index is optimal. According to the system, the autonomous obstacle avoidance capability and adaptability of the ground mobile unmanned equipment in a complex environment are enhanced.
Owner:SHANXI ZHENGHETIAN TECH CO LTD

Double-station robot sorting optimization method, system and terminal based on digital twinning

The invention discloses a double-station robot sorting optimization method and system based on digital twinning and a terminal, double improvement of sorting efficiency and safety is achieved by constructing a digital twinning driven collaborative operation system, and the method comprises the steps that firstly, a laser radar and a polarization camera are used for forming a composite sensing unit; geometric morphology, material reflection characteristics and spatial pose data of a target object are synchronously obtained, and are input into a digital twin engine after time synchronization processing; an engine constructs a virtual sorting scene containing a material attribute database based on a physical rendering technology, sub-millimeter-level space registration is achieved through feature fusion of a binocular stereoscopic vision depth map and geometric parameters, high-precision digital twin stations are generated, a system plans a space-time constraint trajectory of a double-station robot in a virtual environment, and a target object is obtained. And an integrated discrete event simulation engine performs operation time sequence conflict prediction, and when a space overlapping risk is detected, an alternative path containing a dynamic obstacle avoidance strategy is generated through a trajectory re-planning algorithm.
Owner:SUZHOU YONGSHUO INTELLIGENT TECH CO LTD

Multi-modal fusion real-time environment monitoring visual robot system

The invention discloses a multi-modal fusion real-time environment monitoring visual robot system, and relates to the technical field of real-time vision. The system comprises a multi-mode sensing module, and is equipped with various sensors such as a binocular stereo camera and a laser radar to collect environment data. The heterogeneous data preprocessing unit cleans and downsamples data such as images and point clouds; the space-time alignment fusion module realizes multi-source data space-time registration and synchronization; the environment semantic understanding engine constructs an environment semantic graph through a multi-branch network in combination with an attention mechanism; the abnormal event detection unit identifies abnormity based on a historical data model; the path planning and decision-making module integrates multiple targets to generate an optimal path; the autonomous movement execution module controls the robot to move and operate; and the cloud cooperative control center supports model updating and remote intervention. According to the invention, through cooperative work of all the modules, full-process intelligentization of environment monitoring data acquisition, processing, analysis and decision making is realized.
Owner:JIANGSU SHIWEI TECHNOLOGY CO LTD

Building robot multi-machine collaborative operation optimizing and monitoring method and system based on digital twinning

The invention discloses a building robot multi-machine collaborative operation optimizing and monitoring method and system based on digital twinning, and belongs to the technical field of building construction intellectualization. The method comprises the following steps: constructing a digital twinborn body comprising an environment perception model and a kinematics / dynamics model based on a building information model and robot physical parameters; performing multi-machine task allocation and path planning containing static / dynamic obstacle avoidance in the virtual environment; synchronizing physical environment data in real time through a multi-mode sensor; dynamically optimizing operation parameters by adopting a genetic algorithm or a particle swarm algorithm and realizing closed-loop control; and generating a safety early warning and emergency scheme based on machine learning. According to the method, Markov decision path planning of reinforcement learning and multi-agent game task allocation are creatively fused, laser radar-vision-inertial navigation multi-source data fusion is adopted, the technical problems that in a traditional method, digital twinning precision is insufficient, and dynamic cooperation efficiency is low are solved, and the method is suitable for large-scale popularization and application. And the construction efficiency, the safety and the man-machine interaction experience are remarkably improved.
Owner:CHINA MCC5 GROUP CORP LTD

Freight robot autonomous navigation obstacle avoidance method based on multi-sensor fusion

The invention relates to the technical field of autonomous mobile robots, in particular to a freight robot autonomous navigation obstacle avoidance method based on multi-sensor fusion, which comprises the following steps of: identifying dynamic targets such as pedestrians and vehicles through data fusion of a depth camera and a laser radar, and predicting a future short-term movement track of the dynamic targets by utilizing a filtering algorithm; a risk corridor over time is generated, so that emergency braking or deadlock is avoided, and the operation efficiency and the traffic smoothness are greatly improved; a space-time consistency cross validation mechanism is established by utilizing the characteristics that the laser radar is insensitive to transparent objects and ultrasonic waves are sensitive to the transparent objects, so that false alarm and missing alarm are effectively eliminated, the robot can safely pass through a complex indoor environment, and the application boundary is greatly expanded; a depth camera is used for fitting a ground plane and analyzing point cloud height change in real time, so that obstacles which cannot be expressed by a two-dimensional navigation map can be identified; and an optimal track is generated by minimizing a multi-target cost function, so that the path is ensured to be safe and smooth.
Owner:合肥众安睿博智能科技有限公司

Collision risk prediction method for low-altitude aircraft during high-density flight in complex environment

The invention relates to the technical field of risk prediction, in particular to a collision risk prediction method of a low-altitude aircraft in high-density flight in a complex environment, which comprises the following steps: acquiring a point cloud through a three-dimensional laser radar, clustering to generate an obstacle trajectory, matching the trajectory to identify a disturbance characteristic segment, calculating a deviation angle by combining a path vector to generate a disturbance frequency graph, and calculating the collision risk of the low-altitude aircraft. And extracting a parameter modeling dynamic safety interval, and fusing multiple factors to evaluate a collision risk level. According to the method, obstacle trajectory topology is constructed through combination of three-dimensional laser radar point cloud time window division and density clustering, sudden change features are identified through trajectory similarity matching, a Gaussian kernel dynamic safety envelope is generated through combination of course offset statistics and included angle operation, and a self-matching threshold value is established through normalization parameters and radial basis weighting. The method improves the high-density flight collision prediction precision, enhances the weather and obstacle heterogeneity matching capability, reduces the misjudgment early warning delay, and achieves the multi-variable flight situation collaborative analysis.
Owner:CIVIL AVIATION FLIGHT UNIV OF CHINA

Ton bag hoisting unmanned control system based on binocular vision camera and laser radar

The invention relates to the technical field of machine vision and perception, in particular to a ton bag lifting unmanned control system based on a binocular vision camera and a laser radar, which comprises an intelligent control unit, a lifting appliance executing mechanism, a sensing unit and a special ton bag, the sensing unit comprises a binocular vision camera and a laser radar and is used for collecting depth vision and three-dimensional point cloud information of an operation area; the intelligent control unit fuses multi-source data, locates a lifting lug by improving a weighted multi-feature fusion algorithm, plans a safety path and generates a staged instruction; the lifting appliance executing mechanism lifts and pulls a collapsed lifting lug through an electromagnetic adsorption module, a mechanical gripper module clamps the lifting lug, and reliable operation is achieved in cooperation with a verification mechanism; the special ton bag is matched with a sensing and executing module through a high-contrast color and a pre-embedded metal piece. The full-process unmanned operation is achieved, the robustness and operation safety of the complex environment are improved, and the ton bag hoisting requirements of multiple industries are met.
Owner:ZIJIN ZHIXIN (XIAMEN) TECH CO LTD

Land resource dynamic monitoring and early warning method and system based on multi-source remote sensing data fusion

The invention relates to the technical field of land resource monitoring, in particular to a land resource dynamic monitoring and early warning method and system based on multi-source remote sensing data fusion, and the method comprises the steps: employing an unmanned plane to periodically collect optical images, SAR echoes and LiDAR point clouds, constructing a ground three-dimensional digital model, and carrying out the land parcel division; performing fusion to form a multi-dimensional feature vector, establishing an LSTM land parcel feature evolution model, and predicting a change rate interval of each feature in a current period based on a historical sequence; constructing a time sequence difference change detection algorithm, calculating a land parcel change rate, and screening potential abnormal land parcels by taking a prediction interval as an anomaly judgment threshold value; a double-branch convolutional neural network is adopted to identify crop states, growth stages and construction violation behaviors, abnormity is judged and determined, and confidence is given; spatial clustering is carried out on determined abnormal land parcels, accurate boundaries are obtained in combination with a three-dimensional model, multi-level early warning information is generated, and the decision-making efficiency and response speed of land resource monitoring are improved.
Owner:JIANGXI AGRICULTURAL UNIVERSITY

Unmanned system autonomous navigation method based on Beidou and multi-source information adaptive fusion

The invention provides an unmanned system autonomous navigation method based on Beidou and multi-source information adaptive fusion, and belongs to the technical field of high-precision intelligent navigation. According to the invention, autonomous navigation is realized by constructing a three-layer navigation architecture of space-time alignment, intelligent fusion and behavior control. In the space-time alignment layer, performing time and space alignment on the acquired multi-source sensing data; in the intelligent fusion layer, environment types are identified through CNN, modeling is carried out on observation uncertainty of GNSS, LiDAR and IMU in combination with variational Bayesian reasoning, confidence weights are dynamically updated, and a layered federated filtering architecture is adopted to output a full-parameter navigation solution; and in the behavior control layer, the trigger threshold value and the safety margin of the behavior state are dynamically adjusted in the path planning execution process, the different behavior states are subjected to priority ranking and dynamic switching, linear speed and angular speed control instructions are output according to the behavior states, and autonomous navigation is achieved. The problems of low navigation precision, high fusion rigidity, decision disjunction and the like are solved.
Owner:CHONGQING UNIV OF POSTS & TELECOMM

Cable trench inspection robot path planning method, equipment and medium

The invention discloses a cable trench inspection robot path planning method and device and a medium, a cable trench three-dimensional semantic map is constructed through multi-sensor fusion, and a laser radar and a depth camera are combined to accurately identify the spatial distribution of a cable support, a suspension cable and an obstacle. An improved directional path search algorithm is adopted, firewall passing sequential logic and lifting platform kinematics constraints are integrated, and a multi-mode inspection path is generated. The environment change is sensed in real time in the inspection process, the path is adjusted online through a dynamic path optimization engine, a planning strategy is iteratively optimized based on historical data, a digital twin system is introduced to realize path pre-verification, and the firewall interaction efficiency and the exception handling capacity are optimized by adopting reinforcement learning. According to the invention, the technical problems of poor real-time performance of path planning and low reliability of facility interaction in a complex cable trench environment are solved, and the inspection efficiency and safety are significantly improved.
Owner:NINGXIA TIANJING ELECTRIC POWER ENG CO LTD

Three-dimensional target detection model training method and device based on image-guided depth completion and multi-stage iterative fusion

The invention discloses a multi-modal three-dimensional target detection method and device based on image-guided depth completion and multi-stage iteration fusion, and the method comprises the steps: firstly, predicting a dense depth map through an image-guided depth completion module by using the context information of an image, and carrying out the image-guided depth completion; the depth map is fused with a sparse depth map generated by the laser radar in a mask guiding manner, so that a high-quality complemented depth map is generated, and the accuracy of subsequent view angle conversion is improved; and then, through a multi-stage iterative fusion module, iterative fine-grained fusion is carried out on the converted image aerial view features and point cloud aerial view features, so that modal conflicts are effectively relieved, and the expression ability of fusion features is enhanced. According to the invention, through accurate depth information completion and efficient multi-modal feature fusion, the precision and robustness of three-dimensional target detection can be significantly improved, and especially the effect is more obvious when a long-distance target or a blocked target and other difficult targets are processed.
Owner:ZHEJIANG COLLEGE OF ZHEJIANG UNIV OF TECHOLOGY

Underwater topographic survey method based on laser radar and vision fusion

The invention relates to an underwater topographic measurement method based on laser radar and visual fusion, which comprises the following steps: synchronously acquiring underwater point cloud, images and physical environment sensing data, and endowing a unified space-time label to realize the space-time consistency of multi-source data; according to the method, the data quality of different modes is improved by means of preprocessing, denoising, scale normalization, feature enhancement and the like, an environment interference weight matrix is constructed in combination with an environment sensing model, feature extraction and matching algorithm parameters are adaptively adjusted according to different environment states, and multi-scale feature description, spatial consistency and physical constraint criteria are established, so that the multi-modal data quality is improved. According to the scheme, high-reliability feature matching between the point cloud and the image is achieved, finally, through environment-driven iterative optimization and fusion, the robustness and precision of space registration are improved, high-precision multi-modal data automatic registration can be stably achieved in the underwater dynamic environment, adaptability is high, and environment perception and space measurement quality is effectively improved.
Owner:PEARL RIVER WATER RESOURCES PROTECTION INST

Landslide mass monitoring method based on unmanned aerial vehicle laser radar

The invention discloses a landslide mass monitoring method based on an unmanned aerial vehicle laser radar. The landslide mass monitoring method comprises the following steps: S1, constructing an exposed earth surface point cloud model of a first time phase; s2, constructing an exposed earth surface point cloud model of a second time phase; s3, establishing a standard point cloud data set; s4, constructing a multi-dimensional time sequence feature vector sequence; s5, introducing a fusion prediction model of the ARIMA and the neural network, and outputting a final prediction sequence of the deformation trend of the landslide mass; and S6, constructing a disaster chain propagation model, outputting a landslide early warning grade according to a preset grading threshold value, and performing real-time early warning information release and response linkage. According to the invention, through fusion of laser radar point cloud registration analysis and ARIMA-neural network prediction modeling, high-precision dynamic monitoring and early warning of tiny deformation of the landslide mass are realized, and the method is suitable for landslide early identification and disaster emergency response scenes in a complex terrain environment.
Owner:湖北煤炭地质物探测量队

Unmanned aerial vehicle positioning method and system in combination with environment characteristics

The invention relates to the technical field of unmanned aerial vehicle positioning, in particular to an unmanned aerial vehicle positioning method and system combining environment characteristics. According to the technical scheme, the method comprises the steps that multi-modal data of the environment where the unmanned aerial vehicle is located are collected through a multi-source heterogeneous sensor, and the multi-modal data comprise GNSS signal data, visual image data, laser radar point cloud data, inertia measurement data and electromagnetic interference monitoring data; and carrying out cooperative processing on the multi-modal data by utilizing the fusion deep learning model. A comprehensive basis is provided for subsequent processing through multi-source data collection, data quality and feature matching reliability are improved through fusion processing, timely and accurate positioning is guaranteed through real-time calculation, safe and efficient flight is achieved through a decision-making model based on accurate positioning, and the flight speed is high. The method not only solves the traditional technical problems of signal shielding, interference, dynamic interferent influence and contradiction between real-time performance and precision in a complex environment, but also shows excellent positioning stability and adaptability in various complex scenes.
Owner:CHONGQING JIANZHU COLLEGE

Offshore platform anti-collision device and method based on multi-mode BEV perception

The invention discloses an offshore platform anti-collision device and method based on multi-mode BEV perception, and the device comprises a three-dimensional fusion distance measurement module, a UWB distance measurement module, a ship navigation state monitoring module, a platform marine environment monitoring module, and a central processing unit. The three-dimensional fusion ranging module comprises a holder, a laser radar and a camera, and is used for performing 360-degree three-dimensional scanning on the periphery of the offshore platform; the UWB distance measuring modules are installed on the periphery of a ship and pile legs of an offshore platform. The ship navigation state monitoring module is used for acquiring ship position, navigational speed and course information in real time; the platform marine environment monitoring module collects wind wave data and weather data near the offshore platform and route information of passing ships through network communication. The invention discloses an offshore platform anti-collision device with real-time monitoring and collision risk assessment functions, the anti-collision safety of an offshore platform is improved, and the occurrence rate of collision accidents is reduced.
Owner:CHINA NAT OFFSHORE OIL CORP +1

Visual slope settlement monitoring and early warning method and platform

The invention relates to the technical field of slope settlement monitoring and early warning, in particular to a visual slope settlement monitoring and early warning method and platform. The method comprises the following steps: acquiring slope settlement monitoring data; preprocessing the acquired slope settlement monitoring data; respectively constructing a multi-scale slope digital twinborn model and a hybrid intelligent prediction model; constructing a multi-level early warning index system; constructing a fuzzy neural network early warning model based on a multi-stage early warning index system through a multi-scale slope digital twinborn model and a hybrid intelligent prediction model; and performing visual slope settlement early warning by using the fuzzy neural network early warning model. According to the space-air-ground integrated monitoring network constructed by the invention, a satellite InSAR, an unmanned aerial vehicle LiDAR and distributed optical fiber sensing are fused, and full-scale monitoring from regional macroscopic deformation to slope surface microcracks and deep soil displacement is realized.
Owner:SHANDONG LUQIAO CONSTR

Safety monitoring system of high transverse supporting system for cable-stayed bridge man-shaped tower column construction

The invention discloses a safety monitoring system of a high transverse support system for cable-stayed bridge man-shaped tower column construction, and relates to the technical field of bridge construction monitoring, the system comprises a creeping formwork integrated sensing module used for generating a point cloud model by using a mechanical arm integrated on a hydraulic creeping formwork platform and a laser radar scanning tower column curved surface, combining with a preset building information model coordinate, adaptively adjusting the mounting posture of the sensor, and outputting the mounting coordinate position of the sensor; the optical fiber sensing network module is used for collecting original strain and temperature data by using a distributed optical fiber sensor deployed along a main stress path of the support truss; an inertial navigation fusion positioning module; a digital twinning early warning module; and an edge calculation relay module. According to the invention, a full-process monitoring chain from data acquisition to risk early warning is constructed through cooperation of multiple modules, full-period and multi-dimensional dynamic control of construction of the human-shaped tower column high transverse support system is realized, and timely perception and overall control of potential risks are ensured.
Owner:CHINA COMMUNICATIONS COMMUNICATIONS SECOND AVIATION ADMINISTRATION JILIN CONSTRUCTION CO LTD +1

Global path planning and anti-swing control method for ship unloader

The invention relates to the crossing field of mechanical engineering and automatic control, in particular to a global path planning and anti-swing control method for a ship unloader, and aims to solve the problems of rigid path planning and poor synergism of out-of-control swing of a lifting appliance in traditional ship unloading operation. The method comprises the following steps: constructing a dynamic three-dimensional operation space model with fusion of a laser radar and binocular vision, and updating obstacle information in real time; an improved fast extended random tree algorithm is adopted to generate a high-smoothness initial path; establishing a six-degree-of-freedom lifting appliance swinging dynamic model and identifying parameters on line; path tracking and anti-swing torque are synchronously optimized through a model prediction controller, and the control period is smaller than or equal to 20 milliseconds; and closed-loop feedback correction is implemented by combining an encoder and an inertial measurement unit. According to the scheme, environment dynamic sensing, path-anti-swing depth cooperation and multi-disturbance self-adaptive compensation are achieved, the operation rhythm is improved by 30% or above, the system still operates stably under the 8-level wind condition, and high precision, high robustness and engineering implementability are achieved.
Owner:HUANENG SHANTOU HAIMEN POWER GENERATION CO LTD

Lidar sensors of legged robots and related technology

A robot in accordance with at least some embodiments of the present technology includes a neck region through which the robot is configured to transmit and receive light. The robot defines a robot height and includes a body, a head carried by the body, and a neck extending between the head and the body along the robot height. The robot further includes a structural neck frame at a periphery of the neck in a plane perpendicular to the robot height. The structural neck frame defines windows distributed around the periphery of the neck. The robot further includes a sensor disposed at least partially within the structural neck frame. The sensor includes a laser configured to transmit light via the windows and a detector configured to receive light via the windows. A field of view of the sensor extends at least 320 degrees around the neck.
Owner:AGILITY ROBOTICS INC

Laser radar point cloud data processing surveying and mapping method and system based on deep learning

The invention relates to the technical field of surveying and mapping, and discloses a laser radar point cloud data processing surveying and mapping method and system based on deep learning, and the method comprises the steps: obtaining original point cloud data collected by a laser radar, carrying out the preprocessing of the original point cloud data, and obtaining the preprocessed point cloud data; taking a U-Net network as a basic framework, and introducing residual connection and a multi-scale feature fusion mechanism to carry out de-noising processing on the preprocessed point cloud data to obtain de-noised point cloud data; inputting the denoised point cloud data into a Point CNN-GAT model to extract local geometric features and a global topological relation, introducing a dynamic cavity convolution module, and adaptively adjusting the sampling range of a convolution kernel; registering the comprehensive feature vector output by the Point CNN-GAT model, and generating a corresponding surveying and mapping result according to the registered point cloud data; according to the invention, the time cost of data circulation and manual intervention is reduced, and the overall processing efficiency is improved.
Owner:CHENGDU WELCH SPACE INFORMATION TECH CO LTD