45 results about "3d mapping" patented technology

The invention provides a security situation awareness method and system based on a three-dimensional GIS and a panoramic video, and the method comprises the steps: constructing a three-dimensional scene model of a monitoring region on a three-dimensional GIS platform, accessing a plurality of cameras and an environment sensor, and achieving the space-time alignment and coordinate unification of a video stream and multi-source sensing data; projecting a video frame to a three-dimensional scene based on internal and external parameters of a camera to generate a panoramic video picture, and performing detection and cross-camera tracking on pedestrians and vehicles by adopting a target detection model to obtain a target three-dimensional track; predicting a target position and local density change by using a time sequence prediction model, judging anomalies including congestion, retention and retrograde driving, and sending out an early warning; camera deployment and cooperative tracking are planned through a point location optimization algorithm, and monitoring blind areas are reduced; the system comprises a data acquisition module, a space-time alignment module, a three-dimensional mapping module, a target detection and tracking module, a situation analysis module, a point location planning module and a situation display module, and can improve the automation and precision of security situation awareness in a complex scene.

A system includes a phased array antenna, a signal processing module configured to detect wireless signals received from one or more target devices, a conversion module configured to determine 3D spatial data for the one or more target devices based on the wireless signals, an integration module configured to receive visual data from at least one camera, perform object detection and classification on the visual data to detect and classify one or more objects, and tag the one or more objects with 3D coordinates based on the 3D spatial data for the one or more target devices; and a correlation module configured to synchronize the 3D spatial data from the conversion module with the visual data from the integration module including object detection and classification information for use in a cloud-based augmented reality (AR) content to augment social networking and targeted advertising.

In this specification, beam splitters and uses thereof are disclosed. The beam splitter may split a light beam from the light source into a plurality of light beams having a desired shape and intensity, and the beam splitter may be implemented with a simple configuration and process. For example, the beam splitter may be used to construct various sensing devices, facial recognition devices, etc. for 3D mapping.

This invention proposes a multimodal semantically consistent Gaussian mapping and localization method for bridge unmanned aerial vehicle (UAV) inspection. By tightly coupling visual and LiDAR data and introducing semantic consistency constraints, this method achieves high-precision localization and detailed 3D mapping of UAVs in weakly textured environments, providing a reliable technical solution for unmanned bridge inspection and intelligent operation and maintenance in civil engineering.

This invention discloses a method, apparatus, device, and storage medium for constructing a 3D map, applicable to the field of 3D mapping. It involves determining a reference point within the view frustum of a viewpoint, constructing a reference plane containing the reference point and parallel to the view frustum, determining the height of the 3D map rendering interface window, and determining the height of the reference plane window. The unit of the 3D map rendering interface window height is pixels, while the unit of the reference plane window height is length. A distance-pixel ratio is determined based on the ratio of the reference plane window height to the 3D map rendering interface window height. The 3D map scale of the reference point is determined based on the distance-pixel ratio, constructing a 3D map containing the 3D map scale. Based on perspective projection rules, the scale information at any location in the 3D map can be calculated quickly and accurately, improving the efficiency of constructing a 3D map with a high-precision scale. The high-precision scale can assist in obtaining accurate geographic information within the 3D map, thereby improving modeling accuracy.

This invention discloses a visual-tactile fusion multimodal tactile sensor and a three-dimensional pressure field reconstruction method, relating to the technical field of tactile perception. The sensor includes a visual acquisition unit, a tactile acquisition unit, a gel component, a data processing unit, and a display and interaction unit, achieving dual-modal collaborative perception. The three-dimensional pressure field reconstruction method sequentially executes steps such as force system initialization, synchronous acquisition, image preprocessing, pressure calibration calculation, cross-modal registration, dynamic Gaussian convolution fusion, 2D-to-3D mapping, point cloud and mesh reconstruction, real-time display and interaction, data recording, and reset maintenance. It utilizes dynamic Gaussian convolution kernels to simulate pressure diffusion and generates a three-dimensional pressure field model based on the Open3D library. This invention reduces the cost of the gel component, and the reconstruction delay of the three-dimensional pressure field does not exceed 8 milliseconds, making it suitable for fields such as robot operation, intelligent prosthetics, and human-computer interaction.

Various implementations provide unvarnished video based on adjusting camera parameters according to environmental modeling. Environmental characteristics may be determined based on modeling a physical environment from sensor data captured via one or more sensors. For example, this may involve determining ambient light source optical characteristics, ambient surface optical characteristics, 3D mapping of the environment, user behavior, prediction of optical characteristics of light entering the camera, and the like. The method may involve determining camera parameters of an image captured via an image sensor based on environmental characteristics. For example, the method may determine exposure, gain, tone mapping, color balance, noise reduction, sharpness enhancement. The method may determine camera parameters based on user information (e.g., user preferences, user activity, etc.). The method may involve providing a transparent video of the physical environment based on the determined camera parameters.

This invention belongs to the field of robot environmental perception and navigation technology, and discloses a method and device for panoramic vision multi-sensor simultaneous localization and mapping based on 3D Gaussian splashing. In the multi-sensor fusion SLAM stage, multi-source observation information acquired by panoramic cameras, LiDAR, and inertial measurement units is used to achieve real-time estimation of the vehicle's pose through tightly coupled state estimation, constructing a globally consistent color point cloud map. In the 3D Gaussian splashing mapping stage, based on pose priors and the color point cloud, a continuous 3D Gaussian scene representation method is introduced to incrementally and densely model the environment in 3D. Differentiable rendering and geometric-photometric joint optimization are used to improve the geometric accuracy and visual consistency of the map. This invention achieves high-quality 3D mapping and representation in complex environments while ensuring system real-time performance and robustness, and can be applied to environmental perception and navigation in mobile robots, autonomous driving, augmented reality, and unmanned systems.

A method for constructing a three-dimensional anatomical model of the heart and a three-dimensional mapping system for the heart are provided, wherein an atrial template model and point cloud data of the atrial to be modeled are acquired, the point cloud data is the position coordinate information of some feature points in the atrial to be modeled, some feature points in the atrial to be modeled are mapped to the atrial template model using an affine transformation network, the point cloud data mapped to the atrial template model is input to a prediction network, the displacement of control feature points in the atrial template model is acquired by prediction, and the atrial template model is deformed based on the displacement of the control feature points to acquire a three-dimensional anatomical model of the atrial to be modeled. Thus, the present invention makes it possible to construct a three-dimensional anatomical model of the atrial to be modeled using a trained neural network based on the position coordinate information of some feature points in the atrial to be modeled, and to achieve fully automated construction of a three-dimensional anatomical model of the atrial without requiring manual intervention.

Provided is a method and system for calibrating a three-dimensional (3D) measurement system based on a ray model. The method includes: acquiring corresponding target images at multiple poses, as well as corresponding phase-shifted fringe images and Gray code images; performing center correction on each of the target images to acquire center coordinates of marker points in each of the target images; triangulating the center coordinates of the target images at each target pose to acquire triangular mesh data; calculating object points corresponding to each target pose in a camera coordinate system from each pixel of the target images based on the triangular mesh data, thereby acquiring an object point set corresponding to each pixel, and determining a ray parameter corresponding to the object point set; performing phase extraction on the phase-shifted fringe images and the Gray code images to acquire absolute phase data corresponding to each pixel; and determining a 3D mapping coefficient by coefficient fitting based on the object point set and the absolute phase data corresponding to each pixel, and constructing a lookup table based on the 3D mapping coefficient and the ray parameter to achieve camera calibration.

The invention discloses a vehicle-mounted ISP image 3D mapping visual field processing module. The module comprises a camera and an ISP image processing module, the camera is provided with an MIPI output interface, the FPGA is provided with an input MIPI interface and an output MIPI interface, and the FPGA is provided with a CAN bus interface. The ISP visual field processing program comprises an ISP image processing program and an ISP visual field processing program based on a physical rearview mirror visual field. In the prior art, technologies such as electronic rearview mirror projection and projection are not involved, the electronic rearview mirror projection technology can be completed only through complex technical design, and the correction method for the visual field conversion image of the commercial vehicle can effectively improve the image effect and solve the technical problem of distortion of the visual field of a camera.

This invention provides a centralized multi-robot cooperative SLAM method based on an FPGA platform. It uses a motion camera to acquire color images and IMU data of the surrounding environment; the color images are input into the FPGA platform of a single robot, converted into grayscale images, and subjected to image pyramid scaling, corner detection, and feature description before being transmitted to the processing system of the single robot; the processing system generates observation information, which in turn generates image frames; keyframes are generated and sent to a central server; the central server performs loop closure detection on the keyframes, performs map fusion on the local maps built by different single robots to obtain a global map, and optimizes the global map; finally, a 3D dense point cloud map is constructed. This method enables cooperative localization and 3D mapping of multiple robots in large-scale and complex environments, solving the problems of limited computing resources and detection range of a single robot in complex scenes, and improving the scale, accuracy, and robustness of map construction.

This application relates to a method and device for environmental perception and 3D mapping based on multi-sensor fusion. The device performs unified time synchronization and spatial calibration on multi-source perception data acquired by LiDAR, inertial measurement unit, image acquisition unit, and satellite navigation system. It then performs multi-sensor data fusion processing on the main control computing platform to obtain temporally and spatially consistent environmental perception information, achieving high-precision positioning and 3D environmental mapping for the device itself. Specifically, the time synchronization module uniformly triggers or aligns timestamps during the multi-sensor data acquisition process, and determines the spatial pose relationships between the sensors through extrinsic parameter calibration. During device movement, LiDAR acquires 3D point cloud data of the environment, and combines this with motion constraints provided by the inertial measurement unit, visual information acquired by the image acquisition unit, and absolute position information provided by the satellite navigation system to construct a device motion model and an observation model. A fusion algorithm is used to jointly optimize the multi-source sensor data to obtain the optimal pose estimation results of the platform at each moment, and the environmental spatial information is cumulatively updated to gradually construct a 3D environmental map. Based on the fusion and mapping results, a three-dimensional reconstruction and visualization of the surrounding environment structure is achieved, and a modular mechanical structure provides reliable support for the mobile platform's environmental perception, positioning, and spatial understanding.

This application relates to a vision-guided loading method and a vision-guided loading device. The method includes: acquiring workpiece image data of a target workpiece and a 3D mapping template; performing feature point detection on the workpiece image data to obtain pixel feature points; matching 3D model feature points in the 3D mapping template based on the pixel feature points to obtain 3D model feature points corresponding to the pixel feature points; determining the initial workpiece pose based on the correspondence between pixel feature points and 3D model feature points; determining the projection error based on the pixel feature points and the corresponding 3D model feature points under the initial workpiece pose; correcting the initial workpiece pose based on the projection error to obtain a corrected workpiece pose; updating the robot's standard grasping pose based on the difference between the corrected workpiece pose and the standard workpiece pose, and grasping the target workpiece to perform the loading action. This method improves the accuracy of workpiece positioning.

3D mapping of a sample in a charged particle microscope. A sample can be positioned on the optical axis of a charged particle microscope based on a 3D map of the sample. The 3D map is generated using back illumination and telecentric imaging of the sample to produce profile images. The profile images are combined to form the 3D map. The 3D map is used to couple a processor to a sample stage to position a selected sample or sample portion for imaging in the charged particle microscope. In some examples, the processor responds to a selection of a sample using a graphical interface so that the sample stage is controlled to safely position the selected sample without further operator intervention.

This specification discloses a beam splitter and its applications. The beam splitter can split a light beam from a light source into multiple beams with desired shapes and intensities, and can be implemented with a simple process to have a simple structure. The beam splitter can be used to construct various sensing devices, such as those for 3D mapping or facial recognition devices.

This invention provides a photovoltaic power plant operation and maintenance method and system based on digital twins, relating to the field of photovoltaic power plant technology. It includes acquiring and registering multi-source 3D mapping data, and performing spatial segmentation and parallel 3D reconstruction based on a cloud-distributed architecture. By matching real-time running data with spatial indexes, the data is dynamically mapped to a digital twin to achieve status updates, and finally, a complete 3D digital twin scene is generated for operation and maintenance monitoring and optimization. This invention improves the efficiency of 3D reconstruction and the real-time update capability of the digital twin model, providing support for refined operation and maintenance of photovoltaic power plants.

This invention discloses a 3D visualization-based intelligent equipment management platform for petrochemical enterprises, relating to the field of intelligent equipment management technology. The platform includes a visualization platform with the following modules: a 3D twin mapping module, which, based on digital twins and image classification algorithms, reconstructs the appearance features and operating status of petrochemical enterprise equipment in 3D visualization, constructing a dynamic 3D mapping model of equipment appearance and operating status. This invention utilizes multi-source perception fusion and dynamic 3D reconstruction technology to spatiotemporally align and fuse multimodal data, constructing a dynamic 3D mapping model of equipment appearance and operating status. This model presents the geometric shape of the equipment and intuitively maps physical attributes to a 3D surface, enabling accurate identification and location of hidden anomalies such as minor leaks and early faults. It overcomes the visual blind spots of traditional manual inspections, providing precise status perception capabilities for equipment management.

A computer-implemented method and apparatus for generating and refining synthetic images of customizable products. The method includes receiving a text prompt describing a product and a desired markup, generating a synthetic image using a generative AI system, validating the image against physical product specifications, mapping the image onto a 3D surface using quadrilateral grid interpolation, applying inpainting techniques to remove the markup while preserving fabric details, incorporating lighting and specular effects to enhance realism, and integrating the enhanced image into an interactive asset for user interaction and customization prior to manufacturing. The apparatus comprises a generative AI system, a validation and correction module, a 3D mapping and image synthesis module, an inpainting module, an interactive asset creation system, depth estimation and mapping tools, and a lighting and specular effects module. The system supports real-time customization and multiple design variations, ensuring conformity with physical specifications.

To execute a positioning of a sample in an electron microscopy in a short time without an error.SOLUTION: An arrangement of a sample on an optical shaft 110 of a charged-particle microscope 100 can be made on the basis of a 3D map of the sample. The 3D map is created by using a backside-illumination of the sample and a telecentric imaging for creating a profile image. The 3D map is created by combining the profile image. Since an imaging is made with the charged-particle microscope by using the 3D map, a processor is combined to a sample stage 114 for arranging a selected sample S or a sample part. In some examples, the processor responds to a selection of the sample by using a graphical interface so as to control the selected sample so as to be safely arranged without additional interposition of an operator in the sample stage 114.SELECTED DRAWING: Figure 1

This invention discloses an automatic identification method and system for mural protection and restoration based on image analysis. The method includes: generating the degradation state of the mural at different time points using an image simulation algorithm; converting two-dimensional damage images into a three-dimensional spatial model using 3D mapping technology to accurately pinpoint high-risk damage points; further integrating scattered damage points using a clustering analysis algorithm to extract the properties and spatial characteristics of damage groups; and automatically identifying damage boundaries by analyzing texture continuity and line direction using a curve feature detection algorithm. Dynamic sequence analysis tracks inter-frame differential changes to reveal the degradation propagation trajectory; encoding technology efficiently compresses and stores damage information; and historical comparison analysis uncovers matching degradation patterns and updates potential damage areas. This invention, with 3D spatial modeling as its core, integrates multi-dimensional analysis and efficient storage to achieve precise location, dynamic monitoring, and preventative protection of mural damage, significantly improving the scientific rigor and efficiency of cultural relic protection.

Systems and methods for optimal selection of beats for a 3D mapping are disclosed. A method in accordance with the present disclosure may be performed on a processor and may comprise receiving a plurality of beats from a catheter. The catheter may be located at a target mapping site, such as a chamber of the heart. A plurality of dynamic filters may be applied to the plurality of collected beats. The optimal beats may be determined and integrated as a beat in the 3D mapping system. This method enables the selection of more beats for a more comprehensive 3D mapping, as well as the selection of more quality beats that are representative of the target anatomy.

This invention discloses a method and system for monitoring tunnel leakage based on laser scanning and Brillouin sensing. The method includes using a 3D laser scanner to acquire spatial geometric point cloud data and reflection intensity data of the tunnel inner wall, and identifying and classifying risk areas; converting the identification and classification results into an executable sensor network deployment scheme; physically implementing the sensing optical fiber based on the sensor network deployment scheme, wherein the sensing optical fiber adopts a double-layer encapsulation structure, with the inner layer being a communication-grade tight-buffered optical fiber and the outer layer being water-swellable rubber; using the deployed sensing optical fiber, continuous sensing and location of leakage events are performed based on Brillouin optical time-domain analysis technology; mapping the fiber positioning data to a 3D tunnel model, and performing 3D mapping of abnormal events, finally displaying the location of leakage points and risk zones in the 3D tunnel model. This invention forms an integrated solution of "early identification—precise deployment—real-time monitoring—visualized backtracking".

This invention discloses a Bayesian fusion mapping method and system based on confidence propagation. Addressing the problems of traditional UAV mapping being prone to "map flickering" due to sensor noise interference and the inability of static obstacle avoidance boundaries to adapt to high-speed flight, this invention calculates instantaneous confidence based on measurement geometry and uses it as weights for spatial diffusion filtering. It compares the filtering differences to obtain spatial consistency and dynamic update gain, achieving adaptive cascaded updates of the posterior probability of the raster map. Furthermore, it combines real-time ground speed and heading to extract anisotropic physical occupancy states and constructs a dynamic safety repulsion field coupling kinematic braking and mapping uncertainties. This invention is mainly used for high-precision 3D mapping and high-speed dynamic obstacle avoidance of UAVs in complex and unknown environments, effectively filtering out instantaneous noise and providing dynamic collision avoidance safety margins.

A system is disclosed for identifying a drop point for packages using augmented reality (AR) and / or virtual reality (VR) devices. The system comprises packages with signal-emitting tags, such as RFID tags. The system includes a wireless base station with a phased antenna array and a physical location detection apparatus for 3D mapping. The system further comprises a signal processing module, a location module, and an overlap module which process and convert the detected signals into location data. This data is then transmitted to an AR / VR Device for real-time visualization and interaction. The AR / VR device includes an assist module to assist a package delivery person in delivering the tagged packages to the drop point.

A computer-implemented method and apparatus for generating and refining synthetic images of customizable products. The method includes receiving a text prompt describing a product and a desired markup, generating a synthetic image using a generative Al system, validating the image against physical product specifications, mapping the image onto a 3D surface using quadrilateral grid interpolation, applying inpainting techniques to remove the markup while preserving fabric details, incorporating lighting and specular effects to enhance realism, and integrating the enhanced image into an interactive asset for user interaction and customization prior to manufacturing. The apparatus comprises a generative Al system, a validation and correction module, a 3D mapping and image synthesis module, an inpainting module, an interactive asset creation system, depth estimation and mapping tools, and a lighting and specular effects module. The system supports real-time customization and multiple design variations, ensuring conformity with physical specifications.

A system includes a phased array antenna, a signal processing module configured to detect wireless signals received from one or more target devices, a conversion module configured to determine 3D spatial data for the one or more target devices based on the wireless signals, an integration module configured to receive visual data from at least one camera, perform object detection and classification on the visual data to detect and classify one or more objects, and tag the one or more objects with 3D coordinates based on the 3D spatial data for the one or more target devices; and a correlation module configured to synchronize the 3D spatial data from the conversion module with the visual data from the integration module including object detection and classification information for use in a cloud-based augmented reality (AR) content to augment social networking and targeted advertising.

This invention discloses an engineering real-scene 3D mapping system and method integrating UAV LiDAR fusion. The system includes: a multi-temporal data acquisition unit for performing multi-temporal and multi-view joint acquisition of the engineering area to obtain laser point cloud sequences, image sequences, and corresponding time marker information; and a feature registration and extraction unit for performing unified coordinate registration of the laser point cloud sequences and image sequences. This invention relates to the field of engineering surveying technology. This UAV LiDAR fusion engineering real-scene 3D mapping system and method, through joint registration of laser point clouds and images, multi-feature extraction, and echo-texture conflict determination, achieves boundary completion, pseudo-facet suppression, and geometric correction of 3D surfaces, improving the accuracy and reliability of the mapping results. Through modular system design, it realizes automatic acquisition, feature extraction, model correction, and fusion output of multi-temporal and multi-view data, reducing manual intervention and improving mapping efficiency.