113 results about "3d mapping" patented technology

The invention belongs to the field of three-dimensional surveying and mapping, and particularly relates to a multi-precision three-dimensional surveying and mapping data fusion method based on dynamic modeling, which comprises the following steps of: assigning low-level semantic tags to LiDAR point cloud geometric features, and assigning high-level semantic tags to optical image texture features; defining a semantic tree structure, and establishing a cross-scale semantic association initial anchor point; constructing a cross-modal graph structure, projecting LiDAR point cloud nodes to optical image neighborhood superpixel nodes, and connecting and aggregating multi-scale semantic features; inputting geometric and image residual texture features by using a U-Net generator and outputting virtual textures; geometry and texture feature fusion and semantic and geometry collaborative optimization are realized through gating weighted feature fusion. According to the method, the problem of inconsistent multi-precision data semantic expression is systematically solved, semantic consistency is improved, texture deficiency is filled, and dynamic balance between geometric fidelity and semantic enrichment is realized.

A method and system for 3D contour reconstruction of AM parts based on light field imaging, belonging to the field of image reconstruction technology is provided. The method includes constructing an EPI-UNet framework, where a preset light field dataset is used to construct a training set, learning labels from the disparity maps corresponding to the preset light field dataset are obtained, and EPI-UNet framework is trained to obtain a predicted disparity vector with the training set and learning labels. Two mappings including disparity and depth mapping, and disparity and 3D mapping, are established to get 3D contour of the AM part. The experiments of validation for accuracy and 3D contour reconstruction of AM parts were performed. By applying light field multi-view vision to the AM process and combining the rich angle and spatial domain view information of the light field, this disclosure provides a reliable quality assurance for AM monitoring.

The invention belongs to the technical field of three-dimensional mapping, and particularly relates to an occlusion area three-dimensional voxel reasoning method and system. The method comprises the following steps: S10, acquiring an RGB image containing a semantic segmentation result of an occlusion region and a corresponding depth map, and converting the depth map into an initial sparse three-dimensional voxel; and S20, constructing a three-dimensional voxel inference network, and inferring a three-dimensional voxel occupancy probability graph from the initial sparse three-dimensional voxels through the three-dimensional voxel inference network. The occlusion area can be reconstructed based on the monocular image; multi-format output and navigation interface butt joint are supported, and the method can be integrated to SLAM, 3D mapping or path search systems to serve as spatial feasibility constraints; the method can be used for querying whether any spatial position is passable; the method can be used for extracting a trafficability sub-graph from a designated area for path planning.

A medical system includes: a device to be placed at a distance from the puncture zone including: first illumination source arranged to illuminate the puncture zone, and a stereoscopic optical sensor arranged to take first images of the blood vessel, a computing module arranged to: calculate a 3D mapping of the blood vessel based on said first images, calculate a 3D mapping of the puncture zone, determine a 3D position of the piercing point of a needle and / or catheter in the blood vessel, determine a 3D position of the puncture point based on the 3D position of the piercing point and the 3D mapping of the puncture zone, and project the puncture point onto the puncture zone with a projector of the device at its 3D position determined by the computing module. This medical system allows to determine more accurately than known solutions, the position of the puncture point.

The invention discloses an LIBS (laser-induced breakdown spectroscopy) heterogeneous sample detection and analysis system and method based on 3D (three-dimensional) mapping. The system comprises a laser spectrum emission device for providing carrier waves required by LIBS, and a sample positioning and ablation point control and adjustment device for adjusting a heterogeneous sample detection position and accurately positioning a laser ablation position, the sample positioning and ablation point control adjusting device comprises a 3D scanning mechanism used for scanning the surface of a heterogeneous sample to obtain a three-dimensional model of the sample, and an electronic adjustable lens used for receiving laser emitted by the laser spectrum module and adjusting the focusing position. The electronic adjustable platform is used for adjusting an ablation point on the surface of the sample in cooperation with the electronic adjustable lens, LIBS and space mapping are combined, accurate detection and analysis of all position areas on the surface of the irregular heterogeneous sample are achieved through the electronic adjustable platform and the electronic adjustable lens, the consistency of laser focusing at all positions can be guaranteed, and the detection accuracy is improved. The accuracy of detection and analysis data is ensured.

The present disclosure is directed to systems and techniques for providing immersive and interactive three-dimensional (3D) mapping data and visualizations thereof for emergency response incidents. In one example, the systems and techniques can obtain location information associated with an incident and obtain one or more portions of three-dimensional (3D) mapping data based on the location information associated with the incident. A 3D scene associated with the incident can be generated, wherein the 3D scene is generated based on the one or more portions of 3D mapping data. A first 3D view of the 3D scene can be generated, wherein the first 3D view includes one or more incident location indicators representing the location information of the incident relative to the 3D scene.

A three-dimensional (3D) mapping system can be configured to generate a 3D map of a real-world environment using annotation of large image data sets, in which terrestrial imagery can be programmatically labeled with accurate labels using remotely sensed overhead image data. The 3D mapping system can implement photogrammetry to create a point cloud. Each pixel in the point cloud can be classified based on a consensus of each frame. The point cloud can be co-registered to a remotely sensed reference dataset to provide precise spatial coordinates for each pixel. Different patches of point clouds can be stitched together to provide a complete 3D map for a given area, such as a downtown area of a city.

The invention relates to a real-time laser radar point cloud 3d mapping method implemented on an FPGA (Field Programmable Gate Array), which is compatible with accuracy, efficiency and power consumption, and constructs a laser radar point cloud coordinate conversion algorithm based on the parallel capability of the FPGA to realize the acceleration processing of laser radar data coordinate conversion by the FPGA; violent nearest neighbor search with a nearest neighbor threshold value introduced is used as a nearest neighbor calculation method; the FPGA configures a processing element array for parallel calculation of the distance between point pairs according to a violent nearest neighbor search optimization data cache architecture with a nearest neighbor threshold introduced, and the violent nearest neighbor search is accelerated by hardware; the FPGA executes a P2P-ICP algorithm, point cloud alignment is carried out through violent nearest neighbor search, attitude parameters are generated, then the generated attitude parameters are used as attitude priori estimation, and Gaussian-Newton algorithm iteration is carried out through an improved ICP stage to obtain a final attitude; and the FPGA adopts a laser radar data processing mode of fixed-point number operation.

Systems and methods for generating a three-dimensional (3D) map of a physical structure are provided. A 3D mapping system may be configured to generate a 3D map of a physical structure using image data sets generated from different user devices. The mapping system may implement the reference geometry into a 3D structure generation pipeline to generate a more accurate 3D model.

The invention provides a security situation awareness method and system based on a three-dimensional GIS and a panoramic video, and the method comprises the steps: constructing a three-dimensional scene model of a monitoring region on a three-dimensional GIS platform, accessing a plurality of cameras and an environment sensor, and achieving the space-time alignment and coordinate unification of a video stream and multi-source sensing data; projecting a video frame to a three-dimensional scene based on internal and external parameters of a camera to generate a panoramic video picture, and performing detection and cross-camera tracking on pedestrians and vehicles by adopting a target detection model to obtain a target three-dimensional track; predicting a target position and local density change by using a time sequence prediction model, judging anomalies including congestion, retention and retrograde driving, and sending out an early warning; camera deployment and cooperative tracking are planned through a point location optimization algorithm, and monitoring blind areas are reduced; the system comprises a data acquisition module, a space-time alignment module, a three-dimensional mapping module, a target detection and tracking module, a situation analysis module, a point location planning module and a situation display module, and can improve the automation and precision of security situation awareness in a complex scene.

A system includes a phased array antenna, a signal processing module configured to detect wireless signals received from one or more target devices, a conversion module configured to determine 3D spatial data for the one or more target devices based on the wireless signals, an integration module configured to receive visual data from at least one camera, perform object detection and classification on the visual data to detect and classify one or more objects, and tag the one or more objects with 3D coordinates based on the 3D spatial data for the one or more target devices; and a correlation module configured to synchronize the 3D spatial data from the conversion module with the visual data from the integration module including object detection and classification information for use in a cloud-based augmented reality (AR) content to augment social networking and targeted advertising.

The invention provides a support hanger inclination angle adjusting method based on a 3D laser SLAM unmanned aerial vehicle, and relates to the technical field of unmanned aerial vehicle automatic inspection methods. Acquiring space attitude parameters of the support hanger suspender; processing the original point cloud through a downsampling algorithm to obtain a processed laser point cloud; 3D mapping is used for visual display, laser point clouds of other structures are deleted, and the support hanger suspender laser point clouds needing to be fitted are reserved; a least square fitting method is used for carrying out space straight line fitting calculation processing on the support and hanger suspender laser point cloud, and the axis position and the direction angle of the suspender in the space are obtained; and when the obtained actual inclination angle exceeds the standard, inclination angle data are measured under the cold state working condition and the hot state working condition, the reasonable hanging bracket adjusting distance is calculated and determined, the technical problems that the detection range is limited and the visual inspection error is large are solved, and the technical effects of breaking through the space reachability limitation, eliminating the manual measurement error and supporting the establishment of digital archives are achieved.

In this specification, beam splitters and uses thereof are disclosed. The beam splitter may split a light beam from the light source into a plurality of light beams having a desired shape and intensity, and the beam splitter may be implemented with a simple configuration and process. For example, the beam splitter may be used to construct various sensing devices, facial recognition devices, etc. for 3D mapping.

A wearable display device includes a light source, a beam scanner, a pupil-replicating lightguide, and a detector. The light source is configured to emit an image beam and a ranging beam. The beam scanner co-scans both beams. The image beam is used to form an image in angular domain for displaying to a user of the wearable display device, and a ranging beam is used to scan outside environment at the same time. Light reflected from objects in the outside environment is detected by the detector, and a 3D map of the outside environment is built using time-of-flight measurements of the reflected signal and / or triangulation. For triangulation measurements, the detector may include a digital camera.

The present specification discloses a beam splitter and a use thereof. The beam splitter can split a beam from a light source into multiple beams having desired shapes and intensities, and can be implemented to have a simple structure through a simple process. The beam splitter may be employed to construct, for example, facial recognition devices or various sensing devices for 3D mapping.

This invention proposes a multimodal semantically consistent Gaussian mapping and localization method for bridge unmanned aerial vehicle (UAV) inspection. By tightly coupling visual and LiDAR data and introducing semantic consistency constraints, this method achieves high-precision localization and detailed 3D mapping of UAVs in weakly textured environments, providing a reliable technical solution for unmanned bridge inspection and intelligent operation and maintenance in civil engineering.

This invention discloses a method, apparatus, device, and storage medium for constructing a 3D map, applicable to the field of 3D mapping. It involves determining a reference point within the view frustum of a viewpoint, constructing a reference plane containing the reference point and parallel to the view frustum, determining the height of the 3D map rendering interface window, and determining the height of the reference plane window. The unit of the 3D map rendering interface window height is pixels, while the unit of the reference plane window height is length. A distance-pixel ratio is determined based on the ratio of the reference plane window height to the 3D map rendering interface window height. The 3D map scale of the reference point is determined based on the distance-pixel ratio, constructing a 3D map containing the 3D map scale. Based on perspective projection rules, the scale information at any location in the 3D map can be calculated quickly and accurately, improving the efficiency of constructing a 3D map with a high-precision scale. The high-precision scale can assist in obtaining accurate geographic information within the 3D map, thereby improving modeling accuracy.

This invention discloses a tooling and method for precise mapping of deformation defects in subsea pipelines, relating to the field of subsea pipeline inspection technology. It includes an outer frame, a scanning chamber, a scanning chamber drive device, a 3D scanner, a 3D scanning drive device, and a scanning chamber pumping device. The scanning chamber is housed within the outer frame. The pumping device removes seawater from the scanning chamber. The scanning chamber comprises a left scanning chamber and a right scanning chamber, which can be closed by the drive device, sealing the target mapping section of the subsea pipeline within the scanning chamber. The 3D scanner and the 3D scanning drive device are both located within the scanning chamber. The drive device enables the 3D scanner to perform a 3D scan of the target mapping section within the scanning chamber. This invention allows for normal underwater mapping in turbid or turbulent waters, and possesses advantages such as high positioning accuracy and high shape adaptability, enabling non-contact and non-destructive 3D mapping.

This invention discloses a visual-tactile fusion multimodal tactile sensor and a three-dimensional pressure field reconstruction method, relating to the technical field of tactile perception. The sensor includes a visual acquisition unit, a tactile acquisition unit, a gel component, a data processing unit, and a display and interaction unit, achieving dual-modal collaborative perception. The three-dimensional pressure field reconstruction method sequentially executes steps such as force system initialization, synchronous acquisition, image preprocessing, pressure calibration calculation, cross-modal registration, dynamic Gaussian convolution fusion, 2D-to-3D mapping, point cloud and mesh reconstruction, real-time display and interaction, data recording, and reset maintenance. It utilizes dynamic Gaussian convolution kernels to simulate pressure diffusion and generates a three-dimensional pressure field model based on the Open3D library. This invention reduces the cost of the gel component, and the reconstruction delay of the three-dimensional pressure field does not exceed 8 milliseconds, making it suitable for fields such as robot operation, intelligent prosthetics, and human-computer interaction.

The embodiment of the invention discloses a tracking model training method and device, electronic equipment and a storage medium, is applied to the technical field of model training, and can solve the problems that according to an existing 3D target detection method, the problem of shielding and overlapping between targets may be serious, and the detection accuracy of long-distance pedestrians, vehicles or other obstacles is low. The method comprises the following steps: acquiring a training data set, wherein the training data set comprises a plurality of training samples and a pre-marking result corresponding to each training sample; based on the detection frames in the training samples, performing three-dimensional mapping on each training sample to obtain a plurality of initial three-dimensional reference points corresponding to each training sample; and processing the detection frame according to a preset action, screening the plurality of initial three-dimensional reference points according to the position change condition of the processed detection frame, and training the attention network model through the screened three-dimensional reference points and the training data set to obtain a target tracking query model.

The present invention discloses a method for extracting three-dimensional sliding trajectories of bobsleighs and luges based on video and point cloud data. The method comprises: camera calibration based on 3D point cloud and video frame key point matching point pairs; video data segmentation based on scene content; fitting curves on both sides of the track edge to avoid interference with detection by moving objects outside the track; detecting the position of the bobsleigh and luge using a background difference method; tracking using a Kalman filter; smoothing the trajectory after tracking is completed; and converting the 2D coordinates of the sliding trajectory into 3D coordinates. The present invention uses a set of video frame and point cloud key point coordinate pairs to estimate camera parameters, and can obtain accurate camera calibration results without calibration objects, saving manpower and costs. 2D coordinates are converted to 3D coordinates by establishing a 2D-3D mapping table using track surface constraints. Without the need for complex manual labeling, the 2D sliding trajectory of the bobsleigh and luge is accurately extracted and converted into a 3D trajectory.

Various implementations provide unvarnished video based on adjusting camera parameters according to environmental modeling. Environmental characteristics may be determined based on modeling a physical environment from sensor data captured via one or more sensors. For example, this may involve determining ambient light source optical characteristics, ambient surface optical characteristics, 3D mapping of the environment, user behavior, prediction of optical characteristics of light entering the camera, and the like. The method may involve determining camera parameters of an image captured via an image sensor based on environmental characteristics. For example, the method may determine exposure, gain, tone mapping, color balance, noise reduction, sharpness enhancement. The method may determine camera parameters based on user information (e.g., user preferences, user activity, etc.). The method may involve providing a transparent video of the physical environment based on the determined camera parameters.

A three-dimensional (3D) mapping system can be configured to generate a 3D map of a real-world environment using annotation of large image data sets, in which terrestrial imagery can be programmatically labeled with accurate labels using remotely sensed overhead image data. The 3D mapping system can implement photogrammetry to create a point cloud. Each pixel in the point cloud can be classified based on a consensus of each frame. The point cloud can be co-registered to a remotely sensed reference dataset to provide precise spatial coordinates for each pixel. Different patches of point clouds can be stitched together to provide a complete 3D map for a given area, such as a downtown area of a city.

1. The name of this design product: Rescue Mapping Navigator (Yingtong Real-time Mapping and Positioning Thermal Imaging Intelligent Equipment). 2. Application of this product design: Used for real-time 3D mapping, positioning, and thermal imaging temperature measurement. 3. The key point of the design of this product lies in its shape. 4. The picture or photo that best illustrates the design points: Stereoscopic drawing 1.

The invention discloses an unmanned aerial vehicle tractor path planning method and system based on an ROS2 robot system, the system comprises an RK3566 development board, a laser radar, a shell and a depth vision camera, the RK3566 development board is provided with an ROS2 system, and the laser radar, the development board and the depth camera are installed in the shell. According to the present invention, the use effect is good, the ROS2 system installed on the RK3566 development board is adopted to perform rtabmap vision and laser radar outdoor 3D mapping navigation so as to achieve the autonomous navigation and the automatic driving of the tractor, and the vision camera is adopted to detect and identify the mark and the target so as to substantially improve the automation degree, the maneuverability and the operation effect of the aircraft tractor.

This invention belongs to the field of robot environmental perception and navigation technology, and discloses a method and device for panoramic vision multi-sensor simultaneous localization and mapping based on 3D Gaussian splashing. In the multi-sensor fusion SLAM stage, multi-source observation information acquired by panoramic cameras, LiDAR, and inertial measurement units is used to achieve real-time estimation of the vehicle's pose through tightly coupled state estimation, constructing a globally consistent color point cloud map. In the 3D Gaussian splashing mapping stage, based on pose priors and the color point cloud, a continuous 3D Gaussian scene representation method is introduced to incrementally and densely model the environment in 3D. Differentiable rendering and geometric-photometric joint optimization are used to improve the geometric accuracy and visual consistency of the map. This invention achieves high-quality 3D mapping and representation in complex environments while ensuring system real-time performance and robustness, and can be applied to environmental perception and navigation in mobile robots, autonomous driving, augmented reality, and unmanned systems.

1. The name of this design product: Handheld multi-sensor fusion 3D mapping device. 2. Purpose of this design product: used for 3D scanning and modeling in various venues. 3. The key point of the design of this product lies in its shape. 4. The picture or photo that best illustrates the design points: three-dimensional picture.

A method for constructing a three-dimensional anatomical model of the heart and a three-dimensional mapping system for the heart are provided, wherein an atrial template model and point cloud data of the atrial to be modeled are acquired, the point cloud data is the position coordinate information of some feature points in the atrial to be modeled, some feature points in the atrial to be modeled are mapped to the atrial template model using an affine transformation network, the point cloud data mapped to the atrial template model is input to a prediction network, the displacement of control feature points in the atrial template model is acquired by prediction, and the atrial template model is deformed based on the displacement of the control feature points to acquire a three-dimensional anatomical model of the atrial to be modeled. Thus, the present invention makes it possible to construct a three-dimensional anatomical model of the atrial to be modeled using a trained neural network based on the position coordinate information of some feature points in the atrial to be modeled, and to achieve fully automated construction of a three-dimensional anatomical model of the atrial without requiring manual intervention.

In the present specification, a beam splitter and a use thereof are disclosed. The beam splitter can split a beam from a light source into a plurality of beams having a desired shape and intensity, and the beam splitter can be implemented with a simple configuration and process. For example, the beam splitter can be applied to configuration of various sensing devices, facial recognition devices and the like for 3D mapping.