37571results about "Electromagnetic wave reradiation" patented technology

A system and method are disclosed for generating hyperspectral images from multi-modal sensor data including RGB, LiDAR, thermal, and near-infrared inputs. Training data includes hyperspectral images and corresponding multi-modal measurements. Spectral band grouping is performed based on correlation coefficients. A multi-modal decomposition network with cross-modal attention mechanisms generate reconstructed hyperspectral images by fusing complementary sensor information. A fine-tuning network creates reconstructed RGB images. A comprehensive quality assurance system analyzes spectral consistency, cross-modal coherence, and fusion artifacts to generate quality metrics. Missing data compensation strategies handle corrupted sensor inputs using information from other modalities. The system includes temporal integration for video sequences and multi-resolution processing for different sensor resolutions. Quality metrics guide network weight adjustments to improve reconstruction accuracy while maintaining robustness to sensor failures and environmental variations.

A LIDAR system has a semiconductor chip configured to concurrently output multiple LIDAR output signals. The semiconductor chip includes alternate waveguides. Each of the alternate waveguides carries a different outgoing LIDAR signal. Each of the LIDAR output signals includes light from a different one of the LIDAR output signals. The semiconductor chip includes a reflecting surface that receives incoming LIDAR signals that each includes light from a different one of the LIDAR output signals. The semiconductor chip also includes comparative waveguides. Each of the comparative waveguides receives a comparative signal from the reflecting surface. Each of the comparative signals includes light from a different one of the incoming LIDAR signals.

The invention discloses an exhibition hall robot visual language navigation method based on a large model, belongs to the field of exhibition hall robots, and aims at solving the problems existing in an existing exhibition hall robot. According to the method, an exhibition hall robot multi-mode scene sensing system senses a current scene, and candidate target objects are obtained through fusion features of RGB images and laser point clouds; extracting image features of all candidate target objects in the scene; according to the exhibition hall robot multi-mode environment understanding system, an exhibition hall robot receives a voice instruction, a visual language multi-mode large model is used for understanding a target object and a user intention, then high-dimensional semantic features of a target object text are extracted from the system, and the target object is found out from candidate target objects; according to the exhibition hall robot intelligent navigation system based on the multi-modal large model, an exhibition hall robot carries out path planning and autonomous movement according to a pose sequence generated by an intention, and self behaviors are dynamically adjusted according to a real-time changing scene provided by the exhibition hall robot multi-modal scene sensing system.

A surgical visualization system for use with a robotic surgical system that includes a surgical tool movable with respect to a tissue of a patient in response to an instrument motion control signal is disclosed. The surgical visualization system includes a camera and a control circuit coupled to the camera. The control circuit is configured to determine a distance between the surgical tool and the tissue and adjust a magnification of the camera based on the distance between the surgical tool and the tissue.

Systems and methods described herein include implementation of road surface-based localization techniques for advanced vehicle features and control methods including advanced driver assistance systems (ADAS), lane drift detection, passing guidance, bandwidth conservation and caching based on road data, vehicle speed correction, suspension and vehicle system performance tracking and control, road estimation calibration, and others.

Disclosed are a high-performance loosely-coupled multi-modal data fusion system for a smart driving environmental perception system and a vehicle-mounted device, comprising: a fusion detection model based on a modality-independent feature interaction strategy, which is configured for converting a LiDAR point cloud, a camera image, and a millimeter-wave radar point cloud into a unified bird's-eye view representation, and performing multi-modal fusion; and a fusion tracking model based on a motion-appearance feature cascaded coupling data association strategy, which is configured for performing subsequent trajectory tracking and matching according to multi-modal fusion feature information. A VoD data set and a K-Radar data set are selected for training, verifying, and testing the comprehensive performance of the models, and a TensorRT accelerated inference model is applied, then quantized, and deployed to a vehicle-mounted computational testing platform. The present invention is compatible with mainstream sensor deployment solutions, and achieves the efficient complementary fusion of multi-source heterogeneous sensor information, significantly improving the reliability, accuracy, and adaptability of vehicle-mounted perception systems, thereby effectively responding to extreme operating conditions such as complex traffic scenarios and inclement weather.

The invention provides a multi-scale cloud system dynamic evolution simulation modeling method and system based on digital twinning, and relates to the technical field of digital twinning, and the method comprises the steps: obtaining cloud system multi-dimensional data through a multi-source cooperative sensing network, extracting cloud system primitive features through a recursive segmentation algorithm after data registration and quality evaluation, and dividing cloud cluster regions; then, constructing a deep digital twin mapping network of cloud system primitive features and a real cloud system, and carrying out feature verification and parameter optimization; and finally, carrying out self-adaptive multi-grid discretization on the cloud system, establishing cross-regional coupling constraint containing a conservation law, representing a dynamic evolution process of the cloud system as a partial differential equation set, carrying out integrated solution with the deep digital twinborn mapping network, and dynamically correcting an evolution prediction result by using real-time digital twinborn data.

The invention relates to the technical field of navigation, and particularly provides a quadruped robot autonomous navigation method and system for a special environment, and the method comprises the steps: generating a semantic tag for depth point cloud data corresponding to a depth image through employing a recognition result of a target detection network for the depth image; calculating local odometer information according to the laser point cloud data and the inertial sensor data by using a laser radar mileage calculation method; fusing the depth point cloud data with the semantic label, the laser point cloud data with the semantic label and the local speedometer information to obtain positioning data in a pre-constructed point cloud map; constructing a multi-layer cost map according to the pre-constructed point cloud map, the newly acquired depth image, the laser point cloud data and the inertial sensor data by using a sensing method of a region planner; and generating navigation path information according to the positioning data and the multi-layer cost map by using a global path planning algorithm and a local path planning algorithm. The method improves the navigation precision.

A Super System is disclosed and its inputs / outputs are coupled with a Mach-Zehnder interferometer (MZI), wherein the Mach-Zehnder interferometer (MZI) can be coupled with a first optical waveguide either in a two-dimensional (2-D) or in a three-dimensional (3-D) arrangement. The first optical waveguide can be then coupled with (i) a semiconductor optical amplifier (SOA) and / or (ii) a second optical waveguide (that can include an optical resonator) either in a two-dimensional (2-D) or in a three-dimensional (3-D) arrangement. The Super System can include multipliers of matrices and graphic processors.

An agricultural vehicle includes cameras and a LIDAR sensor operably coupled to the agricultural vehicle, and an imaging controller operably coupled to the LiDAR sensor and the cameras. The imaging controller includes at least one processor, and instructions that cause the processor to receive image data from the cameras, receive LiDAR data from the LiDAR sensor, analyze the image data from each of the cameras to generate labeled image data, analyze the LIDAR data to generate labeled LiDAR data, and fuse the labeled image data with the labeled LIDAR data. Related agricultural vehicles and methods are also disclosed.

An agricultural vehicle may include a propulsion system, a steering system, and a vehicle controller. An agricultural vehicle may include a camera sensor having a camera field of view (CFOV), a light detection and ranging (LiDAR) sensor having a LiDAR field of view (LFOV), and an imaging controller in operable communication with the camera sensor and the LiDAR sensor. The imaging controller may include a processor and at least one non-transitory computer-readable storage medium having instructions store thereon that, when executed by the at least one processor cause the imaging controller to, at least, receive image data, segment the image data, fuse LiDAR data and the image data, create a fused instance including depth information; and provide at least the fused instance to the vehicle controller, wherein the vehicle controller is configured to provide at least one navigational command based at least partially on the fused instance.

The invention belongs to the technical field of positioning and navigation, and discloses a high-reliability positioning and navigation method for an air-ground cooperative unmanned system. According to the method, a negative obstacle is accurately extracted by using an RANSAC algorithm and a region growing method, a two-dimensional grid map is generated through three-dimensional point cloud re-projection, a negative obstacle region is marked on the map, and a prior map is provided for an unmanned vehicle. The unmanned vehicle constructs a local map in combination with a sensor of the unmanned vehicle, and the local map is matched with a prior map through an ICP algorithm to accurately position a global pose. According to a priori map and real-time sensor data, a grid cost map containing static obstacles, dynamic obstacles and negative obstacles is generated, a TSCNN predicts dynamic obstacle tracks according to time sequence data, map cost values are updated, an A * algorithm carries out optimal path planning based on the updated dynamic cost map, and the optimal path planning is carried out based on the updated dynamic cost map. And dynamic obstacles and negative obstacles are avoided in real time. According to the invention, efficient, accurate and safe navigation and obstacle avoidance can be realized in a dynamic environment and a complex terrain.

The invention discloses a logistics robot path planning method based on multi-modal perception, and relates to the technical field of robot path planning. Laser radar, visual camera and IMU data are fused, and environment state feature vectors are generated through multi-modal data synchronization and space-time alignment; the method comprises the following steps: analyzing environmental semantics by using models such as PointPill and YOLOv8, extracting dynamic characteristics, and identifying obstacles; constructing a space-time risk field, searching a path by a space-time algorithm, converting path points into a continuous trajectory, and optimizing the continuous trajectory; deviation is evaluated in real time, dynamic re-planning is triggered, and multi-robot cooperation and environment semantic understanding are included. Through multi-mode perception fusion, hierarchical planning, multi-target optimization and a cooperation mechanism, the obstacle detection accuracy and the obstacle avoidance success rate are improved, the path planning time is shortened, the energy consumption is reduced, the multi-robot conflict is reduced, the task efficiency is improved, the environment semantic understanding and task adaptive ability is enhanced, and the method is suitable for scenes such as intelligent storage and the like and has wide application prospects. The automation level is improved.

The present invention relates to the technical field of terrestrial laser scanning-based forestry data processing, and disclosed are a broad-leaved forest individual tree segmentation method and system based on branch and trunk information guidance. The method comprises: taking a terrestrial laser scanning-based broad-leaved forest point cloud as a processing object, and using RANSAC cylinder fitting in combination with growth characteristics of a tree trunk to perform tree trunk detection; extracting, starting from the top of the tree trunk in a low-vegetation area, tree branches and trunk by means of segmented growth of the branches and trunk in combination with changes in the thickness of branch and trunk segments; and segmenting, starting from the tips of the branches, a tree crown leaf point cloud by means of layer-by-layer growth. The present invention achieves a stronger tree trunk detection capability under the conditions of lush low vegetation and complex terrain, and moreover, the present invention can achieve accurate segmentation of tree crowns when large and small tree crowns are intertwined and multiple tree crowns are closely surrounded. The algorithm is highly efficient and easy to use, and has great practical significance for improving the semantic understanding capability of forest scenes, and assisting in forest resource survey, vegetation ecology research, and calibration and verification of satellite remote sensing products.

The invention discloses a topographic surveying and mapping system and method of an unmanned aerial vehicle, and belongs to the technical field of topographic surveying and mapping. The system comprises the following modules: a data acquisition module which is responsible for acquiring high-precision terrain and environmental parameter data of a target area by using an unmanned aerial vehicle platform; the data fusion and correction module is responsible for fusing multi-source data and meteorological information and eliminating errors among sensors; the multi-dimensional feature analysis and recognition module is used for performing feature extraction and classification on data of each sensor through multi-dimensional feature analysis, and recognizing and separating an environment interference signal and a real building deformation signal; the interference elimination and deformation extraction module is used for carrying out pattern recognition and quantitative analysis on periodic non-deformation interference and accurately extracting real deformation characteristics of a building from complex dynamic noise; the real-time analysis module is used for realizing real-time data processing and feedback and ensuring that high-precision building change information is quickly provided; and the visualization module provides multi-dimensional dynamic visualization display including a building change heat map, an interference distribution map and a time sequence curve.

The present invention is directed to systems and methods for monitoring activities in an aviation environment. The system includes at least two monitoring units, each including at least two types of sensors, wherein: the sensors are mounted at a plurality of locations in the aviation environment. The system further includes a processing system being configured to receive said information from the sensors, to process said information to monitor and make predictions, and to combine sensor information by applying data fusion. The system is further configured to compare sensor information with predetermined safety operation criteria, and to generate an alert signal. The method of the invention includes obtaining sensor information, receiving said information from the sensors at a processing system, processing said information, comparing the processed information with predetermined safety operation criteria, and generating an alert signal.

The invention relates to an automatic driving vehicle path planning method and device based on a large language model, equipment and a medium. The method comprises the steps that a traffic scene RGB image, a traffic scene depth image, laser radar point cloud data and inertial measurement unit data of an automatic driving vehicle are acquired; performing feature extraction on the traffic scene RGB image, the traffic scene depth image, the laser radar point cloud data and the inertial measurement unit data to construct multi-modal traffic scene information; calling a preset large language model to determine the motion state of the autonomous vehicle and natural language description of traffic targets around the autonomous vehicle according to the multi-mode traffic scene information; and determining the attention weight of the target node by adopting an attention mechanism in a large language model according to the natural language description of the traffic target, and determining the optimal driving path by adopting a preset path planning algorithm according to the attention weight of the target node, the motion state of the autonomous vehicle and the target position. According to the invention, the adaptive capability of path planning is obviously improved.

Vehicle computing systems may receive and fuse long-wave infrared data with radar data to detect and track objects in low-visibility driving environments. In some examples, radar data including position and velocity data may be projected over infrared image data to detect, classify, and track infrared-emitting objects. Machine-learned transformer models with attention also may be trained to output object detections based on combined infrared and radar data. The fusion of infrared and radar data may be used individual and / or may be synchronized with other sensor modalities. In some examples, the fusion and analysis of infrared and radar data may be used in specific low-visibility driving environments, using low-light, fog, and shadowed areas of the environment, to detect and track infrared-emitting and / or moving objects such as pedestrians and animals that may be obscured from detection by other sensor modalities.

The invention belongs to the technical field of intelligent navigation, and discloses a navigation obstacle avoidance method and system in a low-confidence and feature similar environment. The method comprises the following steps: acquiring multi-modal sensor data of obstacles in a detection area in a preset low-confidence environment by using a sensor; preprocessing the data of the multi-modal sensor; introducing a generative adversarial network to carry out image enhancement processing on the denoised image; performing cross-domain fusion on the data by using a converter architecture; obtaining an obstacle position, an obstacle type and a confidence degree distribution value based on a deep neural network, and constructing and obtaining an obstacle confidence degree map; dynamically planning an obstacle avoidance path by combining a deep reinforcement learning algorithm based on an obstacle confidence map obtained in real time, and performing auxiliary planning of the obstacle avoidance path based on an MPC model; the method can effectively cope with high challenge scenes such as tunnels and is widely applied to the fields of industrial automation, intelligent transportation and the like.

The invention provides a multi-means fusion unmanned aerial vehicle countering method and system, and the method comprises the steps: obtaining three-dimensional topographic data, atmospheric turbulence features and electromagnetic spectrum features in real time through deploying a distributed sensing array in a target region, constructing a multi-layer virtual signal barrier boundary, and generating a frequency band interference parameter set; when it is detected that the unmanned aerial vehicle passes through the barrier boundary, the cooperative interference module is triggered to generate an initial interference signal weight, polarization direction distribution and power density distribution are dynamically corrected in combination with electromagnetic scattering characteristics fed back by the unmanned aerial vehicle in real time, and the initial interference signal weight serves as flight path modeling input and is used for generating a three-dimensional dynamic flight path model; according to the method, the azimuth angle correction, the elevation angle compensation coefficient and the energy gradient parameter of the ground interception equipment are calculated, and then the dynamic interception strategy is generated through the dynamic strategy fuser, so that the interference and interception efficiency of the unmanned aerial vehicle is improved through fusion and dynamic closed-loop control of excessive means, and the full-link closed loop from environmental perception to interception control is realized.

The invention discloses a multi-sensor fusion positioning mapping and thermal imaging device and a computer readable medium. The equipment integrates positioning mapping sensors such as a thermal imaging camera, a visible light camera, a laser radar and an inertial navigation system, and is specially designed for high-risk and complex fire emergency environments. Through an end-cloud integrated cluster cooperation system and a multi-link stable transmission technology and in combination with intelligent decision support, high-precision real-time positioning and dynamic 3D temperature measurement mapping can be realized in an environment in which satellite navigation signals are weak or unavailable. The multi-mode portability and environmental adaptability design of the system ensures the high efficiency and safety of an operator / unmanned system under extreme conditions, and the advanced data processing and analysis technology of the system significantly improves the accuracy and response speed of rescue operation. Due to the innovative characteristics, the method has remarkable practical application value and market prospect in the field of fire-fighting emergency rescue.

A map updating method and apparatus, and an autonomous moving apparatus and a storage medium, which relate to the technical field of autonomous navigation. The method comprises: acquiring a pre-constructed global map, a semantic map, the pose of an autonomous moving apparatus, and sensor data, wherein a static region and a dynamic region in the global map are labeled in the semantic map (S110); on the basis of the pose and the sensor data, periodically constructing a local map, so as to define the coverage range of the local map (S120); aligning the global map with the local map, so as to obtain a target local map aligned with the global map (S130); and on the basis of the global map, the semantic map and the target local map, updating the global map (S140). The consistency of a global map can be ensured, the quality of the global map is improved, and the efficiency and accuracy of updating a map are improved.

The invention relates to the technical field of road crack detection, in particular to a road crack detection method and system based on a fused image. The method comprises the following steps: acquiring road multi-source monitoring data including a visible light image, infrared thermal imaging data and laser radar point cloud data, and performing multi-modal image fusion and road three-dimensional point cloud reconstruction to generate a fused road image and road three-dimensional modeling data; performing crack curvature analysis based on the fused road image to generate crack curvature data; performing reflection crack contour recognition and positioning on the fused road image through the crack curvature data to generate reflection crack initial positioning data; obtaining road base material data; and performing reflection crack stress field reconstruction on the road area according to the reflection crack initial positioning data to obtain a reflection crack stress field. According to the invention, through multi-modal fusion, curvature identification, stress field modeling and crack channel analysis, the accuracy and strain of road reflection crack detection are improved.

In various examples, multimodal image data may be used to generate a set of top-down tile images, which are applied to a deep neural network generator architecture model to produce lane marking-specific heatmap images corresponding to the set of top-down tile images. The multimodal sensor data may include LIDAR-captured intensity channel data, LIDAR-captured feature height channel data, and optical color image channel data. The set of top-down tile images may be processed by the generator model to automatically detect lane boundaries and navigation boundaries to generate pixel-level heatmap images that may classify lane markings by marking characteristics such as line type and / or color. The generator model may comprise an encoder-decoder architecture, with multiscale feature extraction and / or context extraction functional layers intervening between the encoder model and the decoder model.

The invention relates to the field of unmanned aerial vehicle automation, in particular to a three-dimensional modeling and unmanned aerial vehicle landing area address selection method based on laser point cloud data. The method comprises the steps of collection and dynamic compensation of laser radar point cloud data, multi-scale adaptive registration of three-dimensional point cloud, topographic feature extraction and evaluation, selection of an optimal landing point, path planning based on an improved A algorithm, and real-time environmental data updating and dynamic adjustment mechanism. According to the method, point cloud data is dynamically compensated through Kalman filtering, a 3D-NDT algorithm is utilized to perform high-precision three-dimensional environment modeling, key topographic features are extracted through an RANSAC algorithm to comprehensively evaluate topographic complexity and safety distance, an optimal landing point is selected, an optimal path of an unmanned aerial vehicle is planned in combination with an improved A algorithm, and path safety and flight energy efficiency are ensured. By updating environment data in real time and dynamically adjusting a flight path and a landing point, the unmanned aerial vehicle is adapted to sudden environment changes, and safe and stable autonomous landing of the unmanned aerial vehicle in a complex and changeable environment is ensured.

The invention discloses a geological disaster deformation monitoring method based on remote sensing data, and relates to the technical field of environment monitoring, and the method comprises the following steps: S1, data source selection and preprocessing; s2, region feature extraction; s3, differentiating the multi-temporal remote sensing images; s4, analyzing a time sequence; s5, performing three-dimensional reconstruction on the deformation area; s6, settlement and landslide monitoring; s7, performing fusion analysis on environment and meteorological data; s8, performing data anomaly detection and automatic early warning; and S9, risk assessment and influence analysis. According to the geological disaster deformation monitoring method based on the remote sensing data, SAR, optical images and LiDAR data are combined, the defect of dependence of a single data source in the prior art is overcome, dynamic data fusion and time sequence analysis are used, multi-dimensional real-time monitoring of earth surface deformation is achieved, the monitoring precision and timeliness are improved, and the geological disaster deformation monitoring method based on the remote sensing data has good application prospects. More comprehensive geological disaster early warning can be provided, and the effectiveness of disaster prevention and control is greatly enhanced.

The invention belongs to the technical field of unmanned aerial vehicle intelligent navigation, and discloses a low-altitude economic unmanned aerial vehicle data processing method and system based on a large model, and the method comprises the steps: calculating the scene adaptation weight of multi-modal data through a dynamic attention mechanism based on a space-time alignment feature package, and carrying out the fusion to generate a multi-modal joint feature matrix; based on the multi-modal joint feature matrix, constructing a three-dimensional topological model of an urban airspace, predicting a dynamic obstacle trajectory in combination with a space-time diagram neural network, and generating a hierarchical navigation instruction set; the unmanned aerial vehicle executes a flight instruction according to the hierarchical navigation instruction set, and generates a flight state monitoring log by collecting data in flight of the unmanned aerial vehicle in real time; according to the method, the multi-modal joint feature matrix is generated through environment parameter driving weight distribution, and the complex scene sensing precision is remarkably improved.

The invention relates to the technical field of energy efficiency management, in particular to a water conservancy sensing system based on edge computing. The system comprises the following modules: a riverway edge sensing module, a water conservancy characteristic analysis module, a sediment migration simulation module and a deposition scouring early warning module. Constructing a river channel water conservancy sensing network; performing real-time water conservancy monitoring data acquisition according to the river channel water conservancy sensing network to obtain river channel water conservancy sensing data; performing three-dimensional flow field model processing on the river channel water conservancy sensing data to obtain a three-dimensional sediment flow field network model; carrying out particle flow field simulation on the three-dimensional sediment flow field network model to generate sediment migration space-time distribution data; and according to the sediment migration space-time distribution data, carrying out siltation and scour area identification, and uploading the siltation and scour area data to a cloud platform through an edge computing node to carry out abnormal event alarm so as to obtain river section monitoring data. According to the invention, real-time, accurate and intelligent monitoring and early warning of the sediment deposition and scouring process of the river channel are realized.

A multi-sensor fusion method and system for intelligent driving vehicles are provided, which relate to the technical field of intelligent driving vehicles. The method includes: establishing an extended target tracker based on a GM-PHD algorithm and a rectangular target model of a detected object; processing detection information of a millimeter-wave radar by using the extended target tracker to obtain millimeter-wave radar track information of the detected object; processing detection information of a laser radar by using the established bounding-box detector and a JPDA tracker provided with an IMM-UKF to obtain laser-radar track information of the detected object; processing the millimeter-wave radar track information and the laser-radar track information by performing time-space conversion to obtain a central fusion node; and processing the central fusion node by using an IMF algorithm to obtain global track information.

A sensor data evaluation device may include an artificial neural network, configured to receive and process first testing data, and output a first testing data output, wherein the first testing data represent sensor data of a first sensor detecting a sensor input; and one or more processors, configured to receive sensor deficiency information representing a deficiency of a second sensor; generate second testing data, wherein the second testing data are based on the sensor deficiency information; implement the artificial neural network to receive and process the second testing data; and output from the output layer a second testing data output; determine a difference between the first testing data output and the second testing data output; and if the difference is outside of one or more predetermined ranges or does not satisfy one or more predetermined criteria, send a signal representing a result of the determined difference.