4452 results about "Inertial measurement unit" patented technology

The embodiment of the invention provides a scene space model adaptive modeling method based on multi-source data fusion. Complete scene information is constructed by fusing a video sequence, point cloud data and IMU (Inertial Measurement Unit) data. A deep learning network is adopted to carry out scene analysis, a scene complexity score is calculated based on a scale coefficient, a shielding degree and a geometric deformation coefficient, and intelligent matching of a modeling strategy is realized. Meanwhile, a scene dynamic area is predicted by using an optical flow algorithm, a geometric deformation field and a camera pose change, the modeling quality is monitored through reconstruction errors, and self-adaptive switching of a modeling algorithm is realized. The method effectively solves the problems of unstable precision and poor adaptability of a traditional modeling scheme in a complex dynamic scene, and improves the quality and efficiency of three-dimensional scene reconstruction.

The invention relates to an automatic driving vehicle path planning method and device based on a large language model, equipment and a medium. The method comprises the steps that a traffic scene RGB image, a traffic scene depth image, laser radar point cloud data and inertial measurement unit data of an automatic driving vehicle are acquired; performing feature extraction on the traffic scene RGB image, the traffic scene depth image, the laser radar point cloud data and the inertial measurement unit data to construct multi-modal traffic scene information; calling a preset large language model to determine the motion state of the autonomous vehicle and natural language description of traffic targets around the autonomous vehicle according to the multi-mode traffic scene information; and determining the attention weight of the target node by adopting an attention mechanism in a large language model according to the natural language description of the traffic target, and determining the optimal driving path by adopting a preset path planning algorithm according to the attention weight of the target node, the motion state of the autonomous vehicle and the target position. According to the invention, the adaptive capability of path planning is obviously improved.

The invention relates to the technical field of unmanned aerial vehicles, and discloses an inspection unmanned aerial vehicle flight control management method, which comprises the following steps: step 1, an unmanned aerial vehicle obtains environment three-dimensional point cloud data through a laser radar, captures terrain visual information through an RGB camera and a depth camera, obtains real-time position and attitude information of the unmanned aerial vehicle through a GPS and an inertial measurement unit, and obtains the real-time position and attitude information of the unmanned aerial vehicle; and fusing the collected data to construct a spatial grid map, and taking the grid map as input data of path planning. A high-precision space grid map is generated through three-dimensional environment perception and modeling in combination with an unmanned aerial vehicle multi-sensor fusion technology, and a path is updated in real time by using dynamic environment data, and an air route is planned and optimized, so that path dynamic adjustment and energy consumption minimization of the unmanned aerial vehicle in a complex dynamic environment are realized; and the effects of improving the task execution efficiency, reducing the flight energy consumption and improving the flight safety are achieved.

The invention discloses an operation method of a humanoid agricultural robot based on path planning, which relates to the related technical field of agricultural robots and comprises the steps of multi-sensor data acquisition, data processing and map generation, map updating, target crop image recognition and positioning, global path planning, local path obstacle avoidance and picking action execution. The invention further discloses an operation system of the humanoid agricultural robot based on path planning. The operation system comprises a humanoid robot body, a visual sensor, a laser radar, a depth camera, an inertial measurement unit, an auxiliary sensor, an actuator module, a control system, a communication module and a power supply system. The inventor-shaped robot can recognize the positions and shapes of the tools in advance by using a sensitive visual perception system of the inventor-shaped robot, can skillfully cross over or bypass the tools by virtue of the flexibility of the inventor-shaped robot, can accurately determine the positions and distribution conditions of crops in a three-dimensional space, and generates a comprehensive picking environment map.

The invention relates to the technical field of computer vision and three-dimensional reconstruction, and discloses an exhibition hall three-dimensional modeling intelligent optimization system based on multi-modal data fusion, and the system comprises a data collection module which is configured to synchronously obtain laser radar point cloud data, a multispectral image sequence and inertial measurement unit data; the preprocessing module is used for receiving the output of the data acquisition module, aligning a multi-source sensor coordinate system through a space-time calibration algorithm, and separating a static scene from a dynamic interference element by using a dynamic segmentation network; and the multi-modal fusion module is used for receiving the preprocessed data and carrying out adaptive weighted fusion on the geometric features of the laser radar and the visual texture features through a cross-modal attention mechanism. According to the invention, through multi-modal data fusion and a dynamic scene adaptive mechanism, the modeling precision and the real-time updating capability in a complex exhibition hall environment are significantly improved.

The invention relates to an underwater robot navigation positioning method and system. The method comprises the following steps: S1, acquiring angular velocity and acceleration signals through an inertial measurement unit; s2, resolving a three-dimensional velocity observation value according to the beam radial velocity vector signal in combination with the angular velocity signal, and extracting environment feature point cloud data according to the acoustic image signal; s3, multi-source data time synchronization is carried out, and a fusion input signal with time-space alignment is generated; s4, constructing an adaptive factor graph optimization model, and dynamically adjusting an inertial navigation solution node based on a real-time weight coefficient; inputting the environment feature point cloud data into a closed-loop detection module to generate a loopback factor node, and adaptively correcting the weight of the node according to the feature matching degree; and S5, solving the adaptive factor graph optimization model through a nonlinear optimization algorithm. According to the underwater robot navigation positioning method and system, the problem that the fusion positioning precision of a multi-source heterogeneous sensor is insufficient in an underwater GPS-free environment can be solved.

The invention relates to a man-machine hybrid autonomous navigation system in an unknown dynamic environment, which comprises an environment sensing module for acquiring environment information by using sensors such as a laser radar, a camera and an inertial measurement unit and performing data preprocessing; the local target point selection module selects a local target point set meeting requirements in the environment according to the real-time information provided by the environment sensing module; the decision planning module is used for generating an optimal path and a navigation strategy based on mixed training of a deep reinforcement learning algorithm and artificial experience; and the learning optimization module improves the generalization ability of the algorithm through online learning and transfer learning technologies, and realizes effective introduction and strategy adjustment of human experience in combination with the man-machine interaction module. The man-machine interaction module can work in cooperation with the local target point selection module so as to dynamically adjust target point selection according to external input and optimize path planning. According to the method, high decision stability can be kept in an unseen environment, the training cost is reduced, and the method is more suitable for autonomous navigation application in the real world.

The present invention generally relates to a virtual reality (VR) navigation system using artificial intelligence (AI), thus enabling providing of individualized and context-aware navigation experience in VR environments. It consists of an AI-inclusive central processing unit (CPU) that receives and processes real-time data from multiple hardware sensors deployed in a wearable VR headset, e.g., inertial measurement units (IMUs), eye-tracking sensors, biometric ones. This is AI-driven CPU that dynamically changes the navigation path and sensory outputs such as visual, audio, haptic based on user input / interaction & environmental context. It consists of a hand-held controller with numerous input interfaces and a wireless communication module, enabling it to be easily linked or integrated into several VR applications.

The invention relates to the technical field of flight control, in particular to a fixed-wing unmanned aerial vehicle attitude correction and precise flight control method fused with visual navigation, which comprises the following steps: extracting ORB feature points and constructing a dynamic feature point cloud; simultaneously acquiring angular velocity and acceleration data of the inertial measurement unit; performing tight coupling fusion processing on the dynamic feature point cloud and the inertial measurement data to generate real-time pose data; inputting the real-time pose data into an attitude correction parameter calculation module, and generating an attitude correction parameter through a dynamic weight distribution algorithm in combination with a preset flight path planning model and GPS positioning data; and a control surface deflection instruction and an accelerator control instruction are generated through the multi-constraint optimization model, and unmanned aerial vehicle flight attitude closed-loop correction is completed. According to the method, aerodynamic parameters such as the air speed, the wind field lateral disturbance and the attack angle are introduced to serve as coupling input, the control surface deflection amount and limiting conditions are dynamically adjusted, and self-adaptive modeling and control over the nonlinear flight characteristics are achieved.

Three-dimensional outdoor positioning can be considerably enhanced by using various 3D imaging techniques, LiDAR ranging measurements of surrounding landmarks, and Inertial Measurement Units (IMUs) reaching accuracies in the centimetres range. These technologies, in conjunction with global navigation satellite systems (GNSS) such as GPS, GLONASS, Galileo, and BeiDou, provide autonomous geo positioning. It is crucial to acknowledge the constraints of dead reckoning, which may result in mistakes in positional precision. Integrating modern imaging and correction techniques can significantly improve the accuracy and dependability of outdoor localisation. The amalgamation of various 3D imaging methodologies with LiDAR enhancements improves the comprehension and ranging of the environment, tackling the difficulties presented by GNSS constraints. The integration of IMUs with satellite systems ensures the provision of continuous traveling positioning data, even in instances of obscured or faulty satellite signals. This comprehensive approach improves outdoor location precision and expands the use of these technologies across other domains, such as autonomous navigation, robotics, and geospatial analysis, resulting in more effective and dependable positioning solutions. The hardware system consists of a swarm of sensors, including GNSS, INS, IMU, LiDAR, stereo imaging, and RGB technologies, which are combined to generate three-dimensional colored representations of natural landscapes and urban environments. This system reconstructs topographical features, enabling detailed mapping and analysis. It produces comprehensive three- dimensional sensory data, including geo-location and POI identification, and incorporates advanced image processing techniques, such as edge detection, for precise spatial awareness and environmental understanding. The system is designed with a compact form factor, making it easily integrated into wearable devices and autonomous vehicles. The integration of these technologies forms a sophisticated network of swarm intelligence, crucial for autonomous vehicle positioning and navigation. Particle swarm optimization (PSO) is used to address non-deterministic navigation, with different coupling fusion methods available. The Neuro-fuzzy PSO AI Positioning and Navigation System generates three-dimensional sensory data, providing detailed information about geographical distribution and dead reckoning areas.

The invention discloses a visual language navigation method for cross-modal alignment in a dynamic shielding environment, and the method comprises the steps: collecting multi-modal data through a visual sensor, an inertial measurement unit, a laser radar and the like, and carrying out the preprocessing and time synchronization; sensing the dynamic shielding object through a model composed of a convolutional neural network and a long-short-term memory network, and estimating the future change of the dynamic shielding object in combination with a space-time sequence prediction algorithm; a double-branch convolutional neural network and a Transform based on a dynamic attention mechanism are adopted to respectively extract visual and semantic features and fuse the visual and semantic features; on the basis of occlusion prediction, potential occlusion region features are extracted in advance from a time dimension, an occluded image is repaired by using a generative adversarial network and geometric constraints in a space dimension, and cross-modal feature alignment is optimized through an attention mechanism; planning a path by using a hybrid reinforcement learning algorithm based on a deep Q network-space and a fast exploration random tree, and dynamically adjusting according to real-time shielding; according to the method, the accuracy, adaptability and reliability of visual language navigation in a dynamic shielding environment are improved.

The invention discloses a flight path planning method for unmanned aerial vehicle energy consumption optimization, and relates to the technical field of unmanned aerial vehicle energy consumption optimization, and the method comprises the following steps: 1, a multi-sensor fusion system is arranged on an unmanned aerial vehicle, and the multi-sensor fusion system comprises a visual sensor, an IMU inertial measurement unit and a GPS standby module; according to the flight path planning method for optimizing the energy consumption of the unmanned aerial vehicle, through a flight path optimization algorithm based on machine learning in combination with current position information, an original energy consumption optimization flight path and surrounding environment information, a connection path with the shortest connection path from a current offset position to the original flight path and the highest energy efficiency is calculated in real time; an improved path is obtained through optimization according to the current remaining electric quantity of the unmanned aerial vehicle and the target point distance, and it is ensured that the unmanned aerial vehicle can smoothly transition back to the original energy consumption optimized track and continue to fly in an energy-saving mode; the continuity and reliability of task execution of the unmanned aerial vehicle in a complex environment are improved, and the risk of task failure or great energy consumption increase caused by signal interruption is reduced.

The invention relates to the technical field of inertial assistance, in particular to a Beidou high-precision space-time reference dynamic compensation system based on inertial assistance, which is characterized in that an inertial measurement unit module is used for measuring original measurement data, and the original measurement data comprises a carrier phase and a Doppler observation value; the processing unit module is used for fusing the inertial measurement unit, executing real-time environment perception and dynamic modeling, classifying an operation environment and predicting error characteristics; performing an adaptive robust fusion filtering algorithm that dynamically adjusts filter parameters and switches a filter model to estimate the position and attitude of the carrier; and in combination with radio wave precision single-point positioning enhancement service, super-tight combination signal tracking and integrity monitoring are realized, an estimated inertial assistance system state is fed back to a tracking loop of the multi-frequency Beidou receiving module, and real-time fault detection is performed on original measurement data.

Embodiments of the present disclosure may include a method for optimizing flight of an unmanned aerial vehicle (UAV) including a payload, the method including receiving one or more human-initiated flight instructions. Embodiments may also include determining a UAV context based at least in part on Inertial Measurement Unit (IMU) data from the UAV. Embodiments may also include receiving payload identification data. Embodiments may also include accessing a laden flight profile based at least in part on the payload identification data. Embodiments may also include determining one or more laden flight parameters. In some embodiments, the one or more laden flight parameters may be based at least in part on the one or more human-initiated flight instructions, the UAV context, and the laden flight profile.

The invention provides a high-precision motion capture real-time calibration method based on multi-sensor fusion, and the method comprises the steps: obtaining motion data and environmental parameters collected by multiple sensors, the multiple sensors comprising an inertial measurement unit and an optical sensor; constructing a dynamic calibration model based on the action data and the environmental parameters, and performing real-time error compensation and fusion processing on the sensor data; and establishing a time-varying error dynamic model, and performing real-time compensation on zero offset drift, vibration noise and electromagnetic interference of the inertial measurement unit based on the environmental parameters. According to the invention, the IMU and the optical sensor are fused, respective advantages are exerted, and motion data are comprehensively collected. And meanwhile, the time-varying error dynamic model compensates errors generated by environmental interference in real time, so that real actions can be accurately restored through action capture.

The invention discloses an unmanned aerial vehicle monocular vision forest fire positioning method, and aims to realize rapid detection, accurate positioning and three-dimensional reconstruction of an early fire. According to the method, a comprehensive fire monitoring system is constructed by integrating various sensors such as an unmanned aerial vehicle platform, a visible light camera, an infrared camera and an inertial measurement unit (IMU). Through monocular vision simultaneous localization and mapping (SLAM) technology and IMU-GNSS information fusion, the attitude of the camera is recovered in real time. And carrying out three-dimensional positioning on a fire point by utilizing a triangulation method and combining semantic information of visible light and infrared images. According to the method, the SfM (Structural From Motion) technology is adopted, the attitude of a camera and image feature points are combined, and the attitude of the camera and the three-dimensional point cloud are optimized through GBA (Global Bundle Administration), so that the positioning precision is improved. The method has the characteristics of high efficiency, accuracy, real-time performance and remarkable cost effectiveness.

The invention discloses a multi-modal information fusion odometer construction method for star catalogue positioning, and relates to the technical field of star catalogue patroller positioning. The method comprises the following steps: carrying out space joint calibration on a monocular camera, a laser radar and an inertial measurement unit, reconstructing a laser radar point cloud by using a timestamp of a camera image, and realizing time synchronization of the camera image and the laser radar point cloud; establishing an IMU pre-integration error model; and performing motion compensation distortion removal on the laser point cloud by using an IMU pre-integration result, and extracting geometric features of the distorted laser point cloud based on a neighbor region smoothness calculation method of a fixed measurement distance. By researching a multimodal information fusion odometer method, the accumulative error of motion measurement is reduced, the positioning precision and stability are improved, technical support is provided for design and development of a star catalogue navigation system, and the problems that a single-modal star catalogue positioning method is weak in environment adaptive capacity and poor in algorithm generalization are solved.

The invention discloses a monocular vision inertial positioning method based on fine pre-integration and adaptive vision inertial weight, which comprises the following steps of: firstly, constructing key frames by using parallax by adopting a sliding window method, and processing the output of an inertial measurement unit between adjacent key frames by using fine pre-integration; initializing a visual inertial odometer to obtain external parameters and internal parameters of an initial sensor and scale and speed information of the odometer; normalizing the acceleration and the angular velocity of each pre-integration quantity by adopting an L2 norm, and weighting the components of the covariance matrix constrained by each fine pre-integration by taking the normalized acceleration and angular velocity as adaptive inertia optimization weights; based on the quality of feature matching after optical flow tracking, a visual weight is obtained according to the number of times of feature continuous tracking and changes of gray values before and after the feature continuous tracking, and the size of an information matrix of a visual re-projection residual error is adjusted in a self-adaptive mode; and finally, performing optimization iteration on the camera pose by adopting a sliding window and a factor graph to minimize a residual term based on mahalanobis distance measurement and obtain a final positioning result.

The invention discloses a three-dimensional panoramic intelligent monitoring method and device for a coal conveying gallery, and relates to the technical field of industrial automation and intelligent monitoring, and the method comprises the steps: obtaining initial point cloud data and an initial multispectral image of the coal conveying gallery through a rotary laser radar, a high-dynamic-range camera and an infrared thermal imager; inertial measurement units are arranged in the devices to collect vibration data, and the vibration data are used for carrying out vibration compensation on point cloud and images to generate target point cloud data and target multispectral images; thirdly, performing three-dimensional modeling and multispectral texture mapping on the coal conveying gallery based on the data to obtain a target three-dimensional model; and finally, mapping equipment, personnel and environment data into the three-dimensional model in real time, displaying each piece of state information, and realizing comprehensive monitoring. According to the application, high-precision three-dimensional panoramic monitoring can be realized in a complex vibration environment of the coal conveying gallery, and the safety management level and the operation and maintenance efficiency of the coal conveying gallery are effectively improved.

The invention provides an inertial navigation attitude resolving method and device based on sensor fusion. The method comprises the following steps: carrying out multi-clock domain synchronous calibration processing on a double-antenna GNSS system, an IMU inertial measurement unit and an antenna servo system in a vehicle-mounted communication-in-motion system; according to the time synchronization reference, carrying out quality evaluation and weight distribution processing on the GNSS satellite signal under the satellite communication in motion antenna pointing constraint; and carrying out multi-sensor fusion resolving processing on the inertial attitude of the vehicle body according to the time synchronization reference and the GNSS observation data weight distribution result. According to the method, millisecond-level time synchronization is realized by establishing a robust extended Kalman filtering model of a multi-dimensional extended state vector, GNSS signal quality is optimized by adopting an adaptive weight distribution strategy of antenna pointing constraint, and attitude fusion precision is enhanced by utilizing high-precision angle feedback of an antenna servo system. The problem that a traditional attitude resolving method in a vehicle-mounted communication-in-motion system is not high in precision is solved.

The invention discloses a shield attitude control method and system based on machine vision, and the method comprises the steps: constructing a motion state model of a shield tunneling machine according to the motion track of a feature point, and carrying out the prediction and correction of a motion state through a Kalman filtering algorithm, and obtaining the real-time attitude data of the shield tunneling machine; vibration data of the shield tunneling machine are obtained, the vibration data are obtained based on a vibration compensation model of an inertial measurement unit, the vibration data and visual sensor data are combined, a data fusion algorithm based on particle filtering is adopted to suppress vibration interference, and stable attitude information is obtained; and constructing a multi-modal data fusion model based on a graph convolutional neural network, and fusing the visual data, the inertial data and the motion state data to obtain a high-precision attitude estimation result.

The invention relates to the technical field of robot intelligent control, in particular to a humanoid robot multi-modal environment sensing and self-adaptive chassis control method, which comprises the following steps: monitoring a contact force vector and a sliding trend in real time through a multi-dimensional touch sensor, mapping pose drift to a chassis coordinate system based on a Lie group constraint space-time synchronization layer, and performing multi-modal environment sensing and self-adaptive chassis control on the basis of a multi-dimensional touch sensor; a compensation vector is generated, a three-level tactile response layer dynamic switching force / bit mixed impedance mode is adopted, reverse translation of an omnidirectional chassis is combined to counteract drift, compensation parameters are optimized through a depth deterministic strategy gradient algorithm, and the system ensures control instruction time sequence alignment through a time-space stamp synchronization engine. The attitude oscillation in the compensation process is suppressed by using the inertial measurement unit, the obstacle avoidance interference domain is constructed based on the kinematics chain of the operation arm, and the compensation trajectory is smoothed by using the B-spline curve, so that the precision, stability and safety of the humanoid robot in the complex contact operation are improved, and an efficient and reliable solution is provided for a man-machine cooperation scene.

The invention belongs to the technical field of robotics and computer vision, and relates to a multi-source information fusion outdoor inspection scene three-dimensional color geometric model reconstruction method, which comprises the following steps: (1) inertial measurement unit IMU internal reference calibration initialization, (2) laser radar and inertial measurement unit IMU combined external reference calibration, (3) state estimation, (4) using an i-Octree structure to store an updated map, and (5) performing multi-source information fusion. (5) carrying out loopback detection to solve the mileage drift problem; (6) carrying out data fusion of the laser radar and the color camera; and (7) carrying out 3D global positioning. The method has the advantages that the information of the laser radar and the information of the color camera are fused, the one-to-one mapping relation between each space point in the three-dimensional point cloud and a certain pixel point in the color image is established, visual information is more completely described, and the visual information is more accurately and accurately positioned by using a 3D global positioning method. And high-precision reconstruction of the three-dimensional color geometric model is realized.

The invention discloses a building engineering progress automatic identification early warning system based on computer vision, which relates to the field of building engineering informatization and comprises a synchronous calibration module, a joint calibration module, a pose generation module, a mapping construction module, a resampling module, a mapping registration module and a comparison early warning module. Clock synchronization and rolling readout calibration are carried out on a camera and an inertial measurement unit, a continuous time pose is established in a frame, sampling is carried out according to rows, and an equivalent global shutter frame is generated in combination with plane and pixel-level geometric mapping; outputting a camera pose track and a local measurement map by adopting back-end optimization containing a rolling mechanism, and registering with the building information model; component detection, instance segmentation and state discrimination are completed on an equivalent global shutter frame, pixel domain measurement is unified into engineering quantity under pose and registration constraints, the engineering quantity is mapped to a work decomposition structure and a progress plan, deviation is calculated, and graded early warning is output according to a multi-threshold rule. Long-term stable and reliable operation and evidence traceability of the system are guaranteed through whole-course quality monitoring and threshold grading.

The invention relates to an unmanned aerial vehicle autonomous flight and inspection system based on a multi-sensor fusion technology, which integrates various sensors such as a visual camera, a laser radar, an inertial measurement unit and a GPS (Global Positioning System), and realizes hierarchical fusion processing of multi-sensor data based on improved adaptive extended Kalman filtering. And a high-precision three-dimensional environment map and pose estimation of the unmanned aerial vehicle are generated in combination with a synchronous positioning and mapping algorithm. And then, the path planning module generates an optimal flight path according to the inspection task area and the environment structure, and automatically calls an obstacle avoidance algorithm to perform dynamic path adjustment when encountering an obstacle. And then, the visual detection module analyzes, identifies and marks the real-time image data through a deep learning algorithm, and locates abnormal conditions in the target area. The system has remarkable advantages in the aspects of inspection precision, stability and adaptability, and is suitable for multiple fields such as geological inspection, road inspection, power inspection, traffic facility detection and disaster monitoring.

The invention discloses a graph optimization-based UWB / IMU / GNSS multi-unmanned vehicle cooperative positioning method, which comprises a global satellite navigation system GNSS, an ultra wide band (UWB) system, an inertial measurement unit IMU and a robot motion control system, and is characterized in that the UWB system comprises a UWB label and three UWB base stations, the UWB label is deployed on a target unmanned vehicle to be positioned, and the UWB label is deployed on the target unmanned vehicle to be positioned; and the three UWB base stations are respectively arranged on the other three unmanned vehicles as mobile base station unmanned vehicles. The GNSS module and the IMU module are deployed on the unmanned vehicle to serve as a movable UWB base station, and GNSS absolute position information and IMU relative motion information are fused by adopting an extended Kalman filtering algorithm; and according to the determined position of the unmanned vehicle in the movable base station, a distance observation value between the label and the base station is obtained based on a single-side bidirectional distance measurement method, a factor graph model fusing UWB distance measurement constraint and IMU motion constraint is constructed, and a factor graph optimization algorithm is adopted to optimize the position of the target unmanned vehicle. According to the method, the cost of a traditional fixed base station is reduced through the deployment of a mobile base station unmanned vehicle, and the precision and robustness of UWB system positioning in a complex environment are improved in combination with a multi-source sensor data fusion strategy.

The invention focuses on enhancing indoor positioning and navigation through advanced synchronous fusion methodologies that integrate various technologies, including Inertial Navigation Systems (INS), Inertial Measurement Units (IMU), LiDAR, stereo vision, and Sonar. This comprehensive system aims to achieve high-precision data collection with centimeter-level accuracy, crucial for creating detailed three-dimensional indoor maps. A significant aspect of this innovation is its ability to address privacy concerns by incorporating measures that abstract sensitive segments of the environment when necessary, ensuring personal privacy is maintained during data collection. Additionally, the system tackles challenges such as voids in stereo imaging and temperature variations in ultrasound and LiDAR measurements through sophisticated algorithms and corrections, including back propagation techniques that utilize stereo depth data. By employing particle swarm optimization and Neuro-Fuzzy algorithms, the framework enhances the accuracy and reliability of navigation in complex environments, making it particularly beneficial for emergency responders and personal navigation in unfamiliar settings.

The deep water port steel pipe pile foundation construction method comprises the steps that three-dimensional geological modeling and pile position positioning are conducted, specifically, a construction area is scanned through an unmanned aerial vehicle carrying a multispectral radar, geological data are obtained, a dynamic three-dimensional geological model is constructed based on a random forest algorithm, and the pile position layout and the pile sinking path of steel pipe piles are planned; multi-parameter data real-time collection and transmission: collecting perpendicularity, pile body stress and hammering vibration data in real time, uploading encrypted data to a cloud platform through a 5G / Beidou dual channel, and storing the encrypted data; the cloud platform calculates the optimal hammering energy, the vibration frequency and the hammer stopping standard by using a reinforcement learning algorithm in combination with the dynamic three-dimensional geological model and the real-time data; and pile sinking is conducted, specifically, the posture of a pile body is monitored through a laser radar and an inertial measurement unit, a PID control algorithm is adopted to drive a walking type pile driver hydraulic system, and pile sinking is conducted. According to the method, the scientificity of pile position layout and the reasonability of a pile sinking path are improved; the pile sinking efficiency is improved; the energy consumption is reduced; the pile foundation stability is guaranteed.

The invention discloses a multi-sensor fusion SLAM (Simultaneous Localization and Mapping) method in a dynamic scene, which belongs to the field of robot perception and comprises the following steps of: preprocessing visual, laser and IMU (Inertial Measurement Unit) data, including time synchronization and space synchronization; a sensor mathematical model is established, a visual inertia subsystem and a laser inertia subsystem are constructed at the same time, and the two systems are fused in a tight coupling mode. The laser inertial subsystem assists the visual inertial subsystem to complete scale recovery, and the visual inertial subsystem assists the laser inertial subsystem to carry out loopback detection. And finally, establishing a global nonlinear optimized factor graph model in a graph optimization mode, and adding a laser odometer factor, an IMU pre-integration factor, a visual factor and a loopback detection factor into a factor graph to obtain global optimal pose estimation and a three-dimensional map. In a dynamic environment, information of a plurality of sensors is fused, so that the influence of a dynamic object on positioning is reduced, and higher positioning precision and robustness are achieved.

The invention relates to the technical field of digital surveying and mapping of constructional engineering and construction quality control, and discloses a house surveying and mapping system for constructional engineering, which comprises a data acquisition module for synchronously generating a panoramic image signal and an inertial measurement unit signal; the preprocessing module receives a panoramic image signal and an inertial measurement unit signal, and fuses the panoramic image signal and the inertial measurement unit signal through a visual inertial odometer to generate a pose calibration signal; the fusion modeling module receives the purification point cloud signal and the pose calibration signal, and generates building component parameterized data based on a deep learning component recognition algorithm; the result output module receives the building component parameterized data and generates a construction deviation analysis report based on a preset tolerance threshold value; the intelligent control module generates an acquisition quality feedback signal through a real-time quality evaluation algorithm to the data acquisition module so as to adjust a scanning path, and sends a dynamic sampling rate control signal to the preprocessing module so as to optimize a calculation load. The problems of low house surveying and mapping efficiency, poor modeling precision and weak field real-time feedback are solved.