Patents
Literature
Patsnap Eureka AI that helps you search prior art, draft patents, and assess FTO risks, powered by patent and scientific literature data.

6498 results about "Obstacle avoidance" patented technology

In robotics, obstacle avoidance is the task of satisfying some control objective subject to non-intersection or non-collision position constraints. In unmanned air vehicles, it is a hot topic. What is critical about obstacle avoidance concept in this area is the growing need of usage of unmanned aerial vehicles in urban areas for especially military applications where it can be very useful in city wars. Normally obstacle avoidance is considered to be distinct from path planning in that one is usually implemented as a reactive control law while the other involves the pre-computation of an obstacle-free path which a controller will then guide a robot along. With recent advanced in the autonomous vehicles sector, a good and dependable obstacle avoidance feature of a driverless platform is also required to have a robust obstacle detection module.

Task planning system and method for intelligent robot with body based on multi-dimensional situation awareness

The invention discloses a system and a method for task planning of an intelligent robot with a body based on multi-dimensional situation awareness, and particularly relates to the technical field of task planning of the intelligent robot with the body, space-time alignment is carried out on asynchronous heterogeneous data generated by a multi-modal sensor channel, and cross-modal space-time features are extracted through a cross-modal feature fusion network; a fusion situation matrix is generated, dynamic causal modeling is used to update association strength among the multi-modal data, an anti-factual reasoning engine is used to identify and trace abnormities, and an abnormities traceability result is output; dynamically adjusting the reliability weight of each sensing channel through a multi-modal credibility evaluation model by using the fusion situation matrix and an abnormal traceability result; and on the basis of the reliability weight, inputting the fusion situation matrix into a real robot dynamic model and a digital twin virtual model, executing collaborative predictive control, and starting an adaptive rule evolution mechanism when a safety score is lower than a threshold value, thereby solving the problem of fusion matrix distortion in dynamic obstacle avoidance and precise grabbing tasks.
Owner:ZHIMOU (ZHEJIANG) TECHNOLOGY DEVELOPMENT CO LTD

Industrial robot walking control system based on obstacle recognition

The invention relates to the technical field of industrial robots, in particular to an industrial robot walking control system based on obstacle recognition. Comprising an environment sensing unit; the obstacle analysis and decision-making unit is used for processing the multi-dimensional data output by the environment sensing unit based on a deep reinforcement learning framework, accurately identifying static obstacle and dynamic obstacle types, motion trails and interaction influences, constructing a two-dimensional decision-making model of static obstacle avoidance and dynamic obstacle avoidance, and carrying out obstacle avoidance and obstacle avoidance on the basis of the two-dimensional decision-making model. A differential obstacle avoidance strategy is triggered; the path planning unit is based on a dynamic game path algorithm under space-time constraint; and an instruction transceiving unit. Through the multi-modal fusion sensing technology and the adaptive parameter adjustment module, space-time alignment and feature fusion of multi-source data such as three-dimensional point cloud, texture features and vibration spectrum are realized, a high-dimensional environment state model is constructed, and the problem of insufficient data fusion depth in the prior art is effectively solved.
Owner:JIANGSU ZHENG MAO MFG CO LTD

Unmanned aerial vehicle autonomous obstacle avoidance decision-making method and system based on multi-source sensor fusion

The invention relates to the technical field of unmanned aerial vehicle control, in particular to an unmanned aerial vehicle autonomous obstacle avoidance decision-making method and system based on multi-source sensor fusion, and the method comprises the steps: achieving the time-space synchronization of a laser radar, a visual camera and a millimeter-wave radar through timestamp alignment and coordinate mapping, and constructing a dynamic obstacle grid map; fusing multi-source data based on a dynamic Bayesian network, and dynamically adjusting the confidence coefficient weight of the sensor in combination with the environment illumination intensity and the barrier surface material; and adopting a reinforcement learning model to generate an incremental obstacle avoidance strategy, and triggering a grading response instruction according to the risk assessment grade. The problem of fusion errors caused by spatial-temporal asynchronization of multi-source sensor data is solved, and the real-time obstacle avoidance success rate of dynamic obstacles is increased.
Owner:GUILIN UNIV OF AEROSPACE TECH

Automatic route planning method of unmanned aerial vehicle for electric power inspection

The invention discloses an unmanned aerial vehicle route automatic planning method for electric power inspection, and relates to the technical field of unmanned aerial vehicle inspection. Comprising the following steps: starting an unmanned aerial vehicle, carrying out environment perception initialization, calculating the total cruise mileage, evaluating the interference risk, carrying out real-time obstacle avoidance, dynamically optimizing an inspection route, carrying out energy monitoring management, generating a return flight strategy, recording an inspection task and carrying out adaptive learning. Through dynamic electromagnetic interference modeling, multi-modal fusion perception, self-adaptive risk decision and cloud collaborative learning, the problem of insufficient adaptability of a traditional electric power inspection unmanned aerial vehicle in a complex electromagnetic environment and a dynamic obstacle scene is solved, the safety and the inspection efficiency are improved, the robustness is enhanced, and the method is suitable for popularization and application. Intelligent upgrading is carried out through continuous learning and multi-machine cooperation, the overall operation and maintenance cost of the system is reduced, a high-reliability and full-automatic inspection solution is provided for intelligent power grid construction, and the industrial application value is remarkable.
Owner:SUZHOU TIANJING YUNHU INTELLIGENT TECH CO LTD

Unmanned aerial vehicle low-altitude intelligent traffic dynamic airspace management and control method and system

The invention provides an unmanned aerial vehicle low-altitude intelligent traffic dynamic airspace management and control method and system, and relates to the technical field of intelligent control, and the method comprises the steps: taking an electronic fence geographic coordinate set as a monitoring reference boundary, fusing ADS-B data, meteorological information and an unmanned aerial vehicle equipment state, generating a real-time risk thermodynamic diagram, and outputting a grading alarm instruction; receiving a real-time risk thermodynamic diagram and a grading alarm instruction, and combining wind speed prediction and dynamic airspace occupation data; when the grading alarm instruction is triggered, executing the following operations: constructing a route feasible solution space by taking a no-fly zone and a high-risk zone in the risk thermodynamic diagram as constraint conditions; and iterating an evolutionary path population through selection, intersection and mutation operations of a genetic algorithm by taking the lowest energy consumption as an optimization target, so as to output a global final obstacle avoidance bypassing path, and issuing a route updating instruction to an unmanned aerial vehicle flight control system. According to the invention, the utilization of airspace resources is maximized on the premise of ensuring safety.
Owner:HUNAN LIXIANG INTELLIGENT TECH CO LTD

Robot dynamic risk assessment and decision-making system and method based on multi-modal perception

The invention relates to the technical field of intelligent assessment and decision making, in particular to a robot dynamic risk assessment and decision making system and method based on multi-modal perception, and the system comprises a multi-modal sensor module which is used for collecting environment vision, acoustics, mechanics and position data in real time; the edge calculation unit is used for carrying out space-time alignment and feature fusion on the sensor data; the dynamic risk assessment model is used for integrating the environment uncertainty quantification module and the robot state prediction module based on a reinforcement learning framework; the decision execution interface is used for outputting a risk level and obstacle avoidance, speed reduction and shutdown instructions; by integrating visual, acoustic, mechanical and position multi-source sensor data and the like, the system can comprehensively capture various risk factors in a complex dynamic environment, so that the defect that a traditional single sensor system is insufficient in sensing dimension is overcome, and the system is particularly suitable for terrains and weather conditions with variable regions.
Owner:SICHUAN SANSIDE TECH CO LTD

Underwater robot autonomous obstacle avoidance and path planning system based on multi-modal sensor

The invention discloses an underwater robot autonomous obstacle avoidance and path planning system based on a multi-modal sensor, particularly relates to the field of underwater robot navigation, solves the problems of multi-modal sensing and path planning in a complex environment, and unifies the feature space of a multi-source heterogeneous sensor based on a physical field correction mode of an acousto-optic fluctuation rule. Fusion deviation caused by physical property difference of sonar and visual data is overcome, and obstacle characterization precision and dynamic environment adaptability are remarkably improved; a dynamic confidence decision-making mechanism is combined with a path curvature-moment constraint model, the environmental perception credibility and the robot motion performance are synchronously fused into a path generation process, the feasibility of motion control is ensured while the geometric collision risk is avoided, and the contradiction between the safety and the performability in path planning is solved; the global path optimization eliminates the hidden danger of local path sudden change through iterative smoothing under double constraints of physical field and dynamics, and forms an optimal navigation scheme considering obstacle avoidance efficiency, energy consumption and motion stability.
Owner:SHENZHEN CHASING INNOVATION TECH CO LTD

Logistics robot path planning method based on multi-modal perception

The invention discloses a logistics robot path planning method based on multi-modal perception, and relates to the technical field of robot path planning. Laser radar, visual camera and IMU data are fused, and environment state feature vectors are generated through multi-modal data synchronization and space-time alignment; the method comprises the following steps: analyzing environmental semantics by using models such as PointPill and YOLOv8, extracting dynamic characteristics, and identifying obstacles; constructing a space-time risk field, searching a path by a space-time algorithm, converting path points into a continuous trajectory, and optimizing the continuous trajectory; deviation is evaluated in real time, dynamic re-planning is triggered, and multi-robot cooperation and environment semantic understanding are included. Through multi-mode perception fusion, hierarchical planning, multi-target optimization and a cooperation mechanism, the obstacle detection accuracy and the obstacle avoidance success rate are improved, the path planning time is shortened, the energy consumption is reduced, the multi-robot conflict is reduced, the task efficiency is improved, the environment semantic understanding and task adaptive ability is enhanced, and the method is suitable for scenes such as intelligent storage and the like and has wide application prospects. The automation level is improved.
Owner:TIANJIN SINO GERMAN VOCATIONAL TECHNICAL COLLEGE

Patrol route self-adjusting method and system based on unmanned aerial vehicle inspection

The invention provides a patrol route self-adjusting method and system based on unmanned aerial vehicle patrol, and the method comprises the steps: firstly obtaining a multi-source environment perception data set of a target area, then carrying out the feature extraction of the multi-source environment perception data set, inputting a dynamic route planning model, generating an obstacle avoidance correction vector set and an environment adaptation parameter set, and carrying out the feature extraction of the multi-source environment perception data set; and carrying out spatial position offset compensation on the reference route based on the obstacle avoidance correction vector set to generate an initial correction path node set, carrying out path smoothness optimization processing on the initial correction path node set according to the environment adaptation parameter set to generate a final dynamic patrol route, and finally, carrying out dynamic patrol. The dynamic patrol route is converted into a waypoint control instruction stream which can be executed by the unmanned aerial vehicle flight control system, and the waypoint control instruction stream is transmitted to the airborne controller in real time to drive the unmanned aerial vehicle to execute the patrol task, so that dynamic self-adjustment of the unmanned aerial vehicle patrol route is realized, and the patrol flexibility and safety are improved.
Owner:DEYANG JINGKAI ZHIHANG TECH CO LTD

Rescue robot path planning method and system under industrial vision assistance

The invention discloses a rescue robot path planning method and system under industrial vision assistance, and relates to the field related to industrial vision, and the method comprises the steps: collecting three-dimensional space data of a rescue environment in real time, generating a dynamic environment point cloud data set, and constructing a three-dimensional semantic map of a rescue area; thermal imaging data updated in real time are called, path analysis is carried out in combination with the three-dimensional semantic map, and a path planning strategy set is obtained; and predicting the motion track of the dynamic obstacle based on the local dynamic obstacle avoidance strategy, optimizing the global path planning strategy according to obstacle prediction track data, and generating a motion control instruction of the rescue robot. The technical problem of poor real-time performance and adaptability of path planning caused by insufficient perception of environment dynamic information in path planning of an existing rescue robot is solved, the strong perception capability depending on industrial vision is achieved, the environment dynamic information is accurately captured in real time, and the real-time performance of path planning is improved. And the real-time response speed of path planning and the adaptability to a dynamic environment are improved.
Owner:JIANGSU SANMING ZHIDA TECH CO LTD

Disaster area unmanned aerial vehicle cluster dynamic task allocation and cooperative control method and system

The invention provides a disaster area unmanned aerial vehicle cluster dynamic task allocation and cooperative control method and system. The method comprises the steps that S1, original data of a disaster area scene are collected in real time through ground IoT equipment; s2, performing dynamic task priority marking on the original data, and integrating multi-dimensional information of the unmanned aerial vehicle; s3, tasks are allocated to the unmanned aerial vehicle based on a hybrid allocation strategy, and an initial obstacle avoidance path is generated; s4, when the unmanned aerial vehicle executes the task, the flight path is updated in real time, temporary obstacles are avoided, path conflicts are coordinated through a conflict detection algorithm, and task redistribution or degradation is carried out if necessary; s5, periodically, globally and dynamically adjusting task priorities or correcting paths; and S6, constructing a self-adaptive closed-loop control mechanism, and tracking multi-dimensional information and task attributes of the unmanned aerial vehicle in real time. According to the method, the global resource utilization rate is maximized while the second-level response of the high-priority task is guaranteed, and finally, the robustness and the adaptive ability of the unmanned aerial vehicle cluster in a complex scene are realized.
Owner:WUHAN UNIV

Unmanned aerial vehicle real-time path planning system and method based on dynamic weight distribution and multi-source data fusion

The invention relates to the technical field of unmanned aerial vehicle flight path planning, in particular to an unmanned aerial vehicle real-time path planning system and method based on dynamic weight distribution and multi-source data fusion. The system comprises a multi-source data fusion module, an integrated laser radar, a millimeter wave radar, a visual sensor and a Beidou positioning unit. The dynamic weight distribution module dynamically adjusts the weight coefficient of each sensor according to the environmental complexity, the threat level and the state of the unmanned aerial vehicle by adopting a mixed decision-making mechanism combining fuzzy logic and reinforcement learning; an improved RRT * algorithm and a Markov decision process are built in the real-time path planning module, and a global optimal path and a local obstacle avoidance track are generated by adopting a layered planning architecture; the unmanned aerial vehicle cooperative control module comprises a dual-redundancy flight control system and a dynamic obstacle avoidance unit; and the communication relay module supports 5G and low-orbit satellite dual-mode communication, updates an environment cognitive model of each unmanned aerial vehicle through federated learning, and realizes multi-source fusion real-time path planning based on dynamic weight distribution and the unmanned aerial vehicles.
Owner:四川电力设计咨询有限责任公司

Unmanned aerial vehicle multi-source sensing fusion AI real-time intelligent guidance and adaptive obstacle avoidance method

The invention relates to an AI real-time intelligent guidance and self-adaptive obstacle avoidance method for multi-source sensing fusion of an unmanned aerial vehicle, and the method comprises the steps: collecting flight data through a visual sensor and an infrared sensor, obtaining a timestamp and space coordinate information, calculating a sampling frequency difference, and generating a fusion data set of time-space alignment through a self-adaptive interpolation algorithm; image and heat source features in the fusion data set are extracted, and a multi-dimensional feature set is generated, so that whether an obstacle exists or not is judged, and related information is extracted; and analyzing environment data, calculating an environment complexity index, generating a risk level in combination with obstacle information, predicting a dynamic weight of the sensor, and adjusting a working mode of the sensor. And then based on the obstacle condition, calculating a comprehensive risk value and predicting a motion trend through a path risk model, and finally generating an optimal obstacle avoidance path and a flight instruction, thereby realizing high-efficiency processing of sensor data, accurate risk assessment and real-time obstacle avoidance planning, and ensuring stable and safe flight of the unmanned aerial vehicle in a complex environment.
Owner:DOTTED & LINE DIGITAL INTELLIGENT TECHNOLOGY (SHENZHEN) CO LTD

Unmanned aerial vehicle trajectory planning and tracking method, system and device based on deep reinforcement learning and adaptive nonlinear model predictive control, and medium

The invention discloses an unmanned aerial vehicle trajectory planning and tracking method, system and device based on deep reinforcement learning and adaptive nonlinear model predictive control, and a medium. The method comprises the following steps: constructing various static multi-obstacle and dynamic multi-obstacle simulation environments; constructing a kinetic model of the unmanned aerial vehicle; constructing an adaptive nonlinear model predictive control (ANMPC) algorithm; constructing a reward function of the tracking performance of the unmanned aerial vehicle to the reference trajectory generated by the adaptive nonlinear model predictive control algorithm; constructing a network framework based on deep reinforcement learning and an adaptive nonlinear model predictive control algorithm; setting network parameters; training a network framework, and selecting an optimal weight file; outputting a test result; the system, the device and the medium are used for realizing the unmanned aerial vehicle trajectory planning and tracking method. The method can effectively cope with changes of targets and environments, shows strong obstacle avoidance capability and anti-interference performance when facing dynamic obstacles and wind noise interference, and embodies a high intelligent decision-making level.
Owner:XIDIAN UNIV

Unmanned aerial vehicle patrol path optimization method and system based on mobile unmanned aerial vehicle nest

The invention relates to the technical field of patrol path optimization, and particularly discloses an unmanned aerial vehicle patrol path optimization method and system based on a mobile unmanned aerial vehicle nest, and the method comprises the steps: carrying out the dynamic environment perception and multi-source data fusion, generating a global environment situation map, carrying out the task intelligent analysis and dynamic priority sorting, and obtaining a task distribution matrix; the method comprises the steps of performing multi-target hierarchical path planning, outputting a dynamic flight path set with a timestamp, constructing a real-time obstacle avoidance and emergency self-healing system, obtaining a safety correction path set, performing mobile nest collaborative scheduling and energy optimization, outputting a nest mobile instruction set, triggering global environment situation map updating, obtaining an unmanned aerial vehicle execution log, and performing knowledge evolution. And end-to-end technical iteration is completed. According to the method, the problems that the route planning of the traditional patrol path planning unmanned aerial vehicle cannot achieve refinement and is not high in applicability under complex terrain conditions are solved.
Owner:BEIJING HUALIAN POWER ENG SUPERVISION CO +2

Dynamic obstacle-oriented reinforcement learning unmanned forklift obstacle avoidance scheduling method and system

The invention discloses a reinforcement learning unmanned forklift truck obstacle avoidance scheduling method and system for a dynamic obstacle, relates to the technical field of unmanned driving, and discloses the reinforcement learning unmanned forklift truck obstacle avoidance scheduling method for the dynamic obstacle. According to the method, the system and the system, the system and the system, global path planning and local obstacle avoidance decision making are carried out in combination with the reinforcement learning network, the problems of obstacle avoidance response delay and unreasonable path planning in a dynamic environment are solved, the obstacle avoidance response speed, the path planning rationality and the multi-modal data fusion precision in the dynamic environment are improved, and then the safety and efficiency of unmanned forklift dispatching are improved.
Owner:四川参盘供应链科技有限公司

Control method and system for precise landing of unmanned aerial vehicle

A control method and system for precise landing of an unmanned aerial vehicle. The method comprises the following steps: on the basis of a multi-sensor fusion technique, using a lidar and a stereo vision algorithm to collect environmental data and perform primary processing, and generating comprehensive environmental perception data (step S1); on the basis of the comprehensive environmental perception data, using a digital elevation model algorithm to re-construct a three-dimensional terrain of a landing area, and generating a three-dimensional terrain model (step S2); on the basis of the three-dimensional terrain model, using an A* search path-planning algorithm to perform risk assessment and plan a safe landing path, and generating an optimized landing path (step S3); on the basis of the optimized landing path, using an adaptive control algorithm to adjust a flight attitude in real time by means of a fuzzy logic controller, and generating flight parameter adjustment (step S4); on the basis of the flight parameter adjustment, using machine vision and a decision tree algorithm to execute autonomous obstacle avoidance and emergency response, and generating a safe landing execution scheme (step S5); and on the basis of the safe landing execution scheme, using an ultrasonic sensor and a ground feedback system to confirm and fine-adjust a landing point, and completing final landing confirmation (step S6).
Owner:GUANGDONG VISION FIELD ROBOTIC TECH CO LTD

Multi-robot collaborative scheduling system in automatic warehousing system

The invention discloses a multi-robot collaborative scheduling system in an automatic warehousing system, which relates to the technical field of robot collaborative scheduling and comprises a task management module, a path planning module, a communication collaborative module, an exception handling module, a warehousing space dynamic partition module and a task fusion scheduling module. The task management module comprises a task priority calculation unit, a task distribution unit and a dynamic energy consumption evaluation unit, the path planning module comprises a global path optimization unit, a local path adjustment unit and an obstacle avoidance path optimization unit, and by arranging the task management module, the dynamic task priority calculation and distribution function is achieved, and the dynamic energy consumption is evaluated. The problem of adaptation of dynamic task requirements and complex environments is solved, and the completion speed of task allocation and path planning is increased; by arranging the path planning module, the function of dynamically optimizing the path according to the real-time environment is realized, the problem of path conflict optimization in multi-robot scheduling is solved, and the path obstacle avoidance and execution efficiency is ensured.
Owner:WUHU INST OF TECH

Land surveying and mapping path planning method based on unmanned aerial vehicle technology

The invention discloses a land surveying and mapping path planning method based on an unmanned aerial vehicle technology, and the method comprises the steps: enabling an unmanned aerial vehicle to achieve the precise perception and recognition of static and dynamic obstacles in a dynamic environment through a self-adaptive multi-mode perception fusion algorithm; on the basis of multi-modal state estimation and the game theory, modeling and predicting behaviors and future trajectories of the dynamic obstacles; an obstacle avoidance path is generated and optimized in combination with an adaptive fast random tree and deep reinforcement learning; the unmanned aerial vehicle tracks a planned path and deals with dynamic environment changes in real time; the multiple unmanned aerial vehicles realize cluster cooperation through a group self-organizing flight optimization algorithm, and dynamically adjust task allocation and flight strategies; and through incremental environmental perception updating and feedback-based path planning optimization, the perception and decision model is automatically updated after each task is executed. According to the method, the defects of a traditional path planning algorithm in a complex dynamic environment are overcome, and the real-time performance and adaptability of the unmanned aerial vehicle for executing the land surveying and mapping task are greatly improved.
Owner:徐柽煜

Multi-unmanned aerial vehicle formation efficient cooperative control method

The invention discloses a multi-unmanned aerial vehicle formation efficient cooperative control method, and belongs to the field of unmanned aerial vehicles. According to the method, through cooperation of the generator and the discriminator, a multi-level reward function is designed and dynamically adjusted by using diversified scenes and fault model training strategies in the digital twin model, so that complex tasks and scenes can be better coped with, and the cooperation efficiency is comprehensively improved. When a complex search rescue task is executed, search areas and tasks can be distributed more reasonably, and the rescue efficiency is improved. The state of the unmanned aerial vehicle is simulated and predicted by means of digital twin dynamics, errors are corrected, a real-time closed-loop optimization mechanism can rapidly re-plan a path when flight is abnormal, and the difference between virtual data and reality data is reduced through a domain self-adaptive module. When a new obstacle is encountered, the technical scheme of the invention can re-plan a safe path, and at the same time, through collaborative planning and obstacle avoidance of multi-technology fusion, the safety and reliability of unmanned aerial vehicle formation collaborative flight are improved.
Owner:HARBIN ENG UNIV

Bionic swarm intelligence low-altitude logistics unmanned aerial vehicle cluster anti-wind interference cooperation method

The invention discloses a bionic group intelligent low-altitude logistics unmanned aerial vehicle cluster anti-wind interference cooperation method, and the method comprises the steps: collecting the historical flight data and three-dimensional wind field data of an unmanned aerial vehicle cluster, and generating a bionic formation feature set with a wind field label; inputting the bionic formation feature set into a swarm intelligence model fused with fluid mechanics, and generating a dynamic formation topology instruction; according to the dynamic formation topology instruction, adjusting the relative position and attitude angle of each unmanned aerial vehicle through a distributed cooperative control algorithm, and generating an anti-wind disturbance cooperative flight state; and continuously monitoring the deviation between the three-dimensional wind field change and the cooperative flight state, dynamically correcting the weight of the formation density-anti-wind disturbance intensity mapping relation through a reinforcement learning algorithm, updating a dynamic formation topology instruction, and realizing adaptive control of bionic group anti-wind disturbance cooperation. According to the embodiment of the invention, high-disturbance-rejection cooperative flight of the unmanned aerial vehicle cluster in the dynamic wind field can be realized, the formation energy consumption is reduced, and the obstacle avoidance capability under the sudden wind condition is improved.
Owner:ZHEJIANG COMM SERVICES

Robot obstacle avoidance and navigation method based on multi-modal fusion and visual language model

The invention provides a robot obstacle avoidance and navigation method based on multi-modal fusion and a visual language model, and the method comprises the steps: collecting different modal data in real time through a plurality of sensors, and carrying out time synchronization processing and normalization processing; extracting features of different modal data and fusing the features through an intermediate layer; and inputting the fused multi-modal data into a visual language model, generating a semantic map of the environment by utilizing semantic segmentation of the model and a target detection result, generating an action strategy in combination with a natural language instruction and a visual analysis result, and converting the generated action strategy into a control signal which can be executed by the robot to realize closed-loop control. According to the method, the visual language model and the multi-modal sensor fusion technology are combined, and the perception, decision making and real-time response capabilities of the mobile robot in a complex dynamic environment are improved.
Owner:ZHUHAI MAKERWIT TECH CO LTD

Building appearance defect detection method and system based on unmanned aerial vehicle

The invention relates to the technical field of building appearance defect detection, in particular to a building appearance defect detection method and system based on an unmanned aerial vehicle, and the method comprises the steps: obtaining the building information of a target building, and generating a hierarchical scanning path and a three-dimensional obstacle avoidance flight path, a visible light image, an infrared thermodynamic diagram and laser radar point cloud information are collected for space-time alignment processing, and an attention mechanism neural network is used for extracting multi-scale features to generate a detection report containing defect three-dimensional coordinates, damage levels and safety risk assessment. The method achieves the purpose of efficiently and accurately detecting the building appearance defects, can adapt to complex building structures and environmental conditions, supports defect trend prediction and maintenance decision, and remarkably improves the building safety management efficiency.
Owner:ZHEJIANG NONFERROUS GEOPHYSICAL TECH APPL RES INST CO LTD

Forklift self-adaptive safety early warning decision-making method for multiple scenes

The invention relates to the technical field of forklift risk management, in particular to a multi-scene-oriented forklift self-adaptive safety early warning decision-making method, which comprises the following steps of: through multi-scene dynamic modeling, constructing multi-dimensional scene feature vectors according to forklift operation environment spatial features, cargo physical attributes and driver behavior parameters; establishing a scene classification model by means of transfer learning; a multi-modal sensor data fusion technology is utilized, a heterogeneous sensor network is deployed to collect data, and data reliability is optimized through space-time alignment and confidence evaluation; a dynamic safety threshold value is generated through fuzzy logic and reinforcement learning, and a driver behavior correction factor is introduced for real-time adjustment; calculating a comprehensive risk index by using a dynamic weight distribution algorithm, and triggering graded early warning and response; a federated learning closed-loop optimization risk assessment model is adopted, robustness is verified in combination with digital twinning, and cooperative obstacle avoidance of multiple forklifts is achieved through inter-vehicle communication. According to the method, the operation safety and decision-making accuracy of the forklift in a complex and changeable scene are remarkably improved.
Owner:FUQING BRANCH OF FUJIAN NORMAL UNIV

Dynamic obstacle avoidance system in unmanned ship path planning

The invention relates to the technical field of autonomous navigation and intelligent control of an ocean unmanned system, in particular to a dynamic obstacle avoidance system in unmanned ship path planning, which comprises a multi-source sensing module, a global path planning module, a remote obstacle avoidance decision module, a short-range dynamic obstacle avoidance module and a multi-stage cooperative control unit, and is also provided with a semi-physical verification module. The multi-source sensing module fuses multi-source data to construct a layered map; the global path planning module generates and optimizes a path by adopting an improved algorithm; the long-range and short-range obstacle avoidance modules cope with far and near obstacles based on different algorithms; the multi-stage cooperative control unit coordinates the output of each module; the functions of all the modules are achieved through specific algorithms and formulas, and the semi-physical verification module simulates a real environment to conduct system testing. According to the invention, the environment can be sensed in all directions, intelligent path planning and multi-stage obstacle avoidance decision are realized, an optimal instruction is output through cooperative control, the reliability is improved by combining virtual verification, and safe and efficient navigation of the unmanned ship in a complex water area is effectively ensured.
Owner:NINGDE NORMAL UNIV

Unmanned aerial vehicle inspection method and system based on AI visual control

The invention discloses an unmanned aerial vehicle inspection method and system based on AI visual control, and belongs to the technical field of unmanned aerial vehicle automatic control, and the method comprises the steps: carrying out the feature component extraction and compression according to discontinuous frame image data collected by an airborne camera and preset inertial navigation data, and obtaining a compressed feature flow; performing multi-mode obstacle safety level parameter analysis, generating an obstacle avoidance decision priority map, constructing a safety corridor, and generating a real-time self-correction route; semantic analysis is carried out on the deviation between the real-time flight trajectory and the real-time self-correction route, and target area abnormal mark data is generated; and dynamically adjusting the bandwidth allocation of the dual-channel communication network, and transmitting the abnormal mark data of the target area to a ground control terminal. According to the method, a non-continuous frame image and inertial navigation fusion modeling mechanism is adopted, and a multi-mode obstacle safety grading and double-channel dynamic bandwidth allocation strategy is combined, so that real-time response of dynamic obstacle avoidance, accurate judgment of anomaly detection and efficient transmission of key data can be realized.
Owner:QINGDAO SARNATH INTELLIGENCE TECH CO LTD

Forklift dynamic path planning method based on deep reinforcement learning

The invention relates to the technical field of intelligent warehousing and logistics automation, in particular to a forklift dynamic path planning method based on deep reinforcement learning, and the method comprises the steps: deploying multi-view vision, geomagnetism and other multi-source sensors, achieving data calibration and fusion through employing an insect compound eye-imitating vision model, and constructing a high-dimensional state space vector; heuristic models such as migrant bird navigation and biological stress response are adopted, deep reinforcement learning is combined, decision instructions are generated from the three aspects of path planning, dynamic obstacle avoidance and energy efficiency management, actions are executed through a control system, and deviation is fed back; a reward function is used for evaluating the decision effect, rewards are formed by weighting path efficiency, obstacle avoidance success and energy consumption penalty, the weight can be updated in a self-adaptive mode, and therefore the deep reinforcement learning model is optimized. According to the method, the accuracy, safety and efficiency of forklift path planning are effectively improved, the method can adapt to complex dynamic environments, and the requirements of intelligent logistics and industrial automation for forklift intelligent operation are met.
Owner:FUQING BRANCH OF FUJIAN NORMAL UNIV

AR-fused remote driving vehicle virtual-real interaction hardware-in-the-loop test system

The invention discloses an AR-fused remote driving vehicle virtual-real interaction hardware-in-the-loop test system, particularly relates to the technical field of automatic driving test, and is used for solving the problems of inaccurate coupling between a virtual scene and a real vehicle behavior and lack of AR prompt response evaluation. The method comprises the following steps: firstly, constructing a dynamic obstacle intention-driven prediction model based on time series data of a multi-modal sensor, and generating a trajectory probability distribution and risk thermodynamic diagram; then, space-time alignment of the virtual accident scene and the real environment is achieved through a dynamic binding algorithm, and the virtual-real shielding priority of an AR interface is dynamically adjusted; by simulating abnormal disturbance of a vehicle actuator, synchronously collecting control and watching responses of a driver, and extracting obstacle avoidance path deviation degree and takeover timeliness parameters; and finally, separating and compensating virtual and actual residual errors based on a path deviation index, realizing online correction of a virtual scene attitude and a dynamic trajectory, constructing a closed-loop optimization mechanism, and improving the precision and stability of a test system.
Owner:城市之光(深圳)无人驾驶有限公司

Dynamic weight correction and path deviation probability prediction method for vehicle track

The invention discloses a dynamic weight correction and path deviation probability prediction method for a vehicle track, which comprises the following steps of: acquiring vehicle data and multi-source dynamic data of the vehicle track in real time through an optical sensor, a radio wave sensor and an inertial navigation sensor, carrying out space-time calibration, extracting obstacle characteristics and road structure characteristics, and predicting the path deviation probability of the vehicle track. The obstacle movement trend is quickly captured through a space-time diagram sequence and a diagram convolutional neural network, real-time obstacle avoidance is realized in combination with dynamic weight adjustment, a driving intention is predicted by using a Bayesian neural network, a trajectory planning strategy is adjusted through weight correction, and uncertainty is reduced by using multi-source data fusion and probabilistic prediction. A closed-loop feedback mechanism continuously optimizes the model, and efficient operation is kept in complex scenes such as intersections and roundabout through real-time weight adjustment and closed-loop feedback, so that the purpose of quickly responding to dynamic obstacles or driving behavior changes can be achieved, and the precision of the path deviation prediction probability is improved.
Owner:JARVIS INTELLIGENCE (SHENZHEN) CO LTD

Unmanned aerial vehicle autonomous obstacle avoidance and path planning method and system based on deep learning

The invention provides an unmanned aerial vehicle autonomous obstacle avoidance and path planning method and system based on deep learning, and relates to the field of unmanned aerial vehicle control, and the method comprises the steps: obtaining position information and environment perception data, constructing a spatial-temporal feature matrix, extracting target motion and background feature vectors, and mapping the target motion and background feature vectors into a target-environment fusion feature field; calculating an accessibility matrix and a cost matrix to construct a track search space, generating a candidate track set and determining an optimal planned track; and performing segmented optimization on the planned track to obtain a continuous attitude sequence, and generating an adaptive control strategy. According to the invention, intelligent obstacle avoidance and efficient path planning of the unmanned aerial vehicle in a complex environment are realized.
Owner:ZHONGDIAN GUOKE TECH CO LTD +1