4462 results about "Autopilot" patented technology

The invention relates to the technical field of automatic driving, and discloses an automatic driving lane changing trajectory planning method based on deep learning, and the method comprises the steps: carrying out the data collection and preprocessing of a multi-modal sensor; performing spatial feature extraction and time sequence modeling on the preprocessed multi-modal data by adopting a CNN-LSTM hybrid architecture, performing feature fusion through an attention mechanism, and outputting a first feature extraction vector; taking the detected vehicles as graph nodes to construct a traffic graph, learning an interaction relationship between the vehicles through a graph attention network and a message passing mechanism, and calculating a scene urgency score and a safety score; generating a lane changing decision based on the deep Q network and the strategy gradient; and generating a trajectory based on the generative adversarial network. The technical problems that an existing lane changing track planning method cannot adapt to the dynamic traffic environment, lacks the ability of understanding complex multi-vehicle interaction and is difficult to balance safety and urgent conflict requirements are solved, and intelligent, safe and efficient automatic driving lane changing track planning is achieved.

The invention discloses a sky-ground integrated automatic driving intelligent decision-making system and method driven by a large language model, and the system comprises a satellite layer, a vehicle end layer and a cloud end layer, and achieves the precise, intelligent and efficient automatic driving decision-making through efficient data interaction and cooperative processing. The satellite layer comprises a low-orbit satellite constellation, transmits high-precision positioning information to a vehicle in real time and provides a space-time reference; the vehicle end layer is an executor, collects environment data in real time through a sensor, generates a preliminary driving decision by using high-precision positioning data and an end-to-end rapid decision model built in the vehicle end layer, and uploads driving data, environment sensing data and decision requirements to a cloud end; the cloud end carries out remote monitoring and management on the system, evaluates the vehicle state and carries out early warning, when the vehicle runs safely, the vehicle end is adopted for decision making, when potential risks or abnormal conditions exist, the large language model is adopted for decision making, optimization instructions are pushed to the vehicle end, model parameters or emergency disposal schemes are updated, and the vehicle end is assisted to correct the decision.

The invention provides an end-to-end automatic driving decision control method and system, and belongs to the technical field of automatic driving. The invention relates to an end-to-end automatic driving decision control method based on multi-modal perception and hierarchical trajectory optimization, and the method comprises the steps: constructing an end-to-end decision closed loop through combining the zero sample migration capability of a vision-language-action (VLA) model with a hierarchical optimization architecture: analyzing multi-modal input (vision, language and point cloud) by using a pre-trained VLA model to generate path points; the vehicle pose is dynamically adjusted through upper-layer optimization to expand a feasible solution space, a smooth track meeting dynamics and collision avoidance constraints is solved in real time through lower-layer optimization, and finally a vehicle control instruction is output. According to the method, a multi-modal sensing and hierarchical trajectory optimization mechanism is fused, and the sensing generalization ability, the path planning feasibility and the control execution robustness of the system in a complex traffic environment are effectively improved.

The present application relates to the technical field of autonomous driving functions, and in particular to a control method and device integrating predictive cruise and lane changing decision-making. The method comprises: receiving the accelerations, speeds and positions of a controlled autonomous driving vehicle and surrounding traffic vehicles at a current moment so as to construct an IDM microscopic following model to predict surrounding traffic vehicle states in a preset future long time domain; on the basis of the surrounding traffic vehicle states in the preset future long time domain, constructing an optimization cost function, so as to plan a lane keeping strategy or lane changing strategy; on the basis of the lane keeping strategy or lane changing strategy, using a quintic polynomial to solve for a reference path; on the basis of the reference path, establishing an optimal control problem cost function for continuous intersection predictive cruise control, so as to solve for the optimal cruise speed within a traveling lane; and sending the reference path and the optimal cruise speed within the traveling lane to the controlled autonomous driving vehicle for control. Thus, the problems that existing lane changing decision-making only considers longitudinal motion and fails to pay attention to a development trend of the surrounding environment, possible dangers and the like are solved.

Aspects of the present invention relate to an apparatus for providing driver assistance of a vehicle, an autonomous system, a vehicle, a method, a controller and a non-transitory computer readable medium. The apparatus comprises a first sensor and a second sensor mounted on a vehicle. The first sensor is configured to transmit and receive electromagnetic radiation to detect the presence of an object in a first area, and the second sensor is configured to transmit and receive electromagnetic radiation to detect the presence of an object in a second area. The first area and the second area overlap to define an overlapping area forward of the vehicle. The first area extends from the overlapping area to a first extreme direction having a rearward component and a leftward component, and the second area extends from the overlapping area to a second extreme direction having a rearward component and a rightward component.

The invention provides an automatic driving-oriented kinematics priori guided vehicle trajectory generation method, and belongs to the technical field of trajectory generation and motion control in automatic driving. Comprising the following steps: constructing a vehicle kinematics differential equation, performing nonlinear compensation and control correction based on a double-flow mechanism to obtain a vehicle explicit physical state, and converting the vehicle explicit physical state into a vehicle implicit physical state; feature extraction, target detection and multi-mode fusion are carried out on the collected point cloud data and the vehicle surrounding image data, and environment information of a scene where the vehicle is located is provided; anchoring Gaussian distribution to simulate a feasible noise track of a vehicle in a current scene, generating a noise track candidate sample through sampling and noise adding, performing reverse denoising reasoning on the noise track candidate sample, generating a track anchor point, and generating a reasoning noise track around the track anchor point; environment information of a scene where the vehicle is located, a reasoning noise track and an implicit physical state are input into a diffusion decoder for iterative training, and kinematic prior guides generation of a future track of the vehicle in the denoising process.

The invention provides a high-precision perception-driven automatic driving positioning method and system, and relates to the technical field of automatic driving, and the method comprises the steps: collecting vehicle environment data in real time through a multi-mode sensor array, and generating a multi-source perception data set; performing time-space synchronization processing; performing motion distortion correction on the fused sensing data stream to generate dynamic compensation sensing data; inputting a multi-source fusion positioning model, and performing three-dimensional space matching in combination with high-precision map data to obtain real-time positioning coordinates; and performing iterative optimization on the real-time positioning coordinates through an adaptive error correction module to generate a vehicle positioning result. According to the method and the device, the technical problem that the positioning precision is affected due to data distortion caused by the influence of the vehicle motion on the sensor data is solved, the distortion caused by the vehicle motion is eliminated through motion distortion correction and compensation, and the positioning precision and stability are improved.

The invention relates to the technical field of automatic driving, and particularly provides an automatic driving vehicle track re-planning method, which comprises the following steps of: firstly, evaluating stability risk and defining three states of vehicle stability through real-time vehicle dynamic parameters, and designing intervention and exit criteria of track re-planning according to the three states; when the vehicle driving is evaluated to be in an unstable state, generating a virtual obstacle by using prediction information of a path tracking module, and converting a dynamic stability boundary into a spatial constraint; performing trajectory re-planning by adopting nonlinear model predictive control, and adjusting the weight between the path tracking precision and the obstacle avoidance demand according to the relative position of the virtual obstacle in combination with a dynamic weight adjustment mechanism; and finally, generating an optimized trajectory containing stability constraint, and realizing high-precision tracking through linear MPC. The method can effectively balance the path tracking precision and the vehicle stability under a complex working condition, and prevents the vehicle from entering a dynamic unstable region.

The embodiment of the invention provides an automatic driving method and device based on a multi-dimensional reward function, and the method and device achieve the control of a driving motion through the combination of an imitation learning framework and a reinforcement learning framework, collection of environment information through a plurality of cameras, and construction of a strategy generation network and a discriminator network. A multi-dimensional reward function model is designed, behaviors such as red light running, line pressing, lane departure and collision are detected and evaluated in real time, and a driving behavior reward and punishment matrix is constructed. Based on an actor evaluation network architecture, environment information and a navigation instruction are input into an actor network to generate an optimal driving action, and the action value is evaluated through the evaluation network to realize dynamic parameter optimization. According to the method, the defects of the traditional technology in the aspects of driving behavior evaluation, action value judgment and the like are effectively overcome, and the safety and reliability of the automatic driving system are remarkably improved.

Provided are a vehicle control method and apparatus, and a vehicle-mounted device, a vehicle and a storage medium. The vehicle control method comprises: on the basis of environmental perception data, position data of a vehicle, and map data, determining behavior trajectory information of a target object in an environment where the vehicle is located; sending the behavior trajectory information of the target object and ego-vehicle trajectory information of the vehicle to a server, so that the server processes the behavior trajectory information of the target object and the ego-vehicle trajectory information on the basis of a target model to generate planning and decision-making information, wherein the target model is a generative pretrained transformer and is obtained by means of performing training on the basis of a plurality of types of training sample data; receiving the planning and decision-making information fed back by the server, and on the basis of the behavior trajectory information of the target object and the planning and decision-making information, generating planning trajectory information and driving strategy information for the vehicle; and on the basis of the planning trajectory information and the driving strategy information, controlling the vehicle to travel. The safety of autonomous driving and the driving and riding experience of users can be improved.

The present disclosure provides an example method for obtaining labeled trajectories. The example method can include obtaining log data describing a trajectory of a vehicle traveling through an environment. The example method can include determining a suboptimal condition associated with the trajectory. The example method can include generating label data that characterizes the suboptimal condition along one or more constraint dimensions of a motion planner of the autonomous vehicle control system. The example method can include generating a training example for training the one or more machine-learned models of the autonomous vehicle control system to decrease a probability of the autonomous vehicle control system inducing the suboptimal condition.

The invention discloses a unified framework for solving automatic driving track prediction and planning consistency based on a world model. According to the method, through cooperative work of the automatic driving domain controller and the vehicle-mounted sensing system, end-to-end joint optimization of track prediction and planning in a complex traffic scene is realized, time sequence dependence and interaction dynamics among intelligent agents are accurately captured, and the prediction capability and robustness of a model are remarkably improved. The method comprises the following specific steps: firstly, constructing a generative world model, and generating potential future state representation by utilizing a behavior conditional and backtracking expansion technology; secondly, in combination with global modeling and a local convolutional network, multi-scale features are extracted, adaptive fusion is carried out, and a multi-modal prediction trajectory is generated; then, a multi-target planning model is adopted to integrate various driving indexes, and a track with the minimum loss function is generated; finally, path planning parameters are dynamically optimized through real-time environment perception and decision feedback, and the problems of prediction uncertainty and planning consistency of the automatic driving track are effectively solved.

The invention discloses an improved hybrid A star path planning method for an automatic driving vehicle, and relates to the technical field of automatic driving, laser radar sensing and unmanned vehicle navigation. According to the method, on the basis of inheriting the advantages of high global search efficiency, strong kinematics feasibility and the like of a hybrid A star algorithm, a multi-factor cost function is designed, a trajectory smooth constraint is introduced, and the feasibility and execution quality of a path are improved from two aspects of cost evaluation and path construction. In order to further enhance the smoothness and the dynamic controllability of the local path, the initial path is optimized and adjusted by fusing a time elastic band (TEB) algorithm in the method, so that the continuity and the stability of the path in a complex dynamic environment are improved. The method is suitable for a high-precision path planning task in an automatic driving system, and the comprehensive requirements of a path generation result in the aspects of reliability and environmental adaptability can be well met.

An example method includes (a) obtaining a pull-over command indicating the autonomous vehicle is to pull-over to a side of a travel way; (b) in response to the pull-over command, obtaining map data indicative of a plurality of pull-over locations for the autonomous vehicle; (c) determining one or more candidate pull-over locations for the autonomous vehicle based on the map data and a route of the autonomous vehicle; (d) determining a ranking of the candidate pull-over locations based on a feasibility of the autonomous vehicle completing a stop at each respective candidate pull-over location and a quality of each respective candidate pull-over location; (e) based on the ranking of the candidate pull-over locations, determining a selected pull-over location for the autonomous vehicle; and (f) controlling a motion of the autonomous vehicle based on the selected pull-over location.

The invention relates to a memory enhanced vision-language-action submerged space dynamic fusion automatic driving method. Comprising the following steps: generating a bird's-eye view feature map; extracting scene, agent and map marks from the aerial view feature map, and fusing the mark at the current moment and the previous i historical marks to generate memory enhanced visual marks; the memory enhanced visual mark and the vehicle state information are converted into a submerged space, text input of a driver is marked and unified into the submerged space, the submerged space is represented and fused, and fusion representation is generated; an automatic driving instruction data set is introduced for adjustment, and a large language model adapting to an automatic driving task is obtained; according to the fusion representation, track planning is carried out in an autoregression mode by using a large language model, and path point coordinates are obtained; and designing a transverse controller and a longitudinal controller based on PID (Proportion Integration Differentiation) to track and control the coordinates of the path points. According to the invention, the visual representation capability of end-to-end driving is improved, and the visual-language-action fusion effect is improved.

The invention provides an automatic driving vehicle track prediction method and device, electronic equipment and a storage medium. The method comprises the following steps: acquiring scene information and initial noise of a target vehicle; the scene information comprises surrounding vehicle information, road information, static object information and navigation information; predicting a future trajectory of the target vehicle according to the scene information and the initial noise based on a pre-trained automatic driving trajectory prediction model; the automatic driving track prediction model comprises an adaptive layer normalization sub-module and a scale adaptive self-attention sub-module; the automatic driving track prediction model is obtained by training according to a scene information sample and a real self-vehicle track sample added with noise, and the automatic driving track prediction model can predict a conditional velocity field and an unconditional velocity field at the same time during training. According to the method, efficient space-time fusion of multi-source input information is realized, and a multi-vehicle game / interaction behavior in a high-interaction scene is effectively simulated.

The invention discloses an automatic driving planning method, device and equipment for a two-wheeled mobile robot and a storage medium, and the method comprises the steps: collecting environment data and vehicle body posture information through a multi-source sensor, and constructing a space-time joint map under a dynamic aerial view coordinate system; a hierarchical trajectory planning architecture is designed based on the four-dimensional state space, an initial path is generated by adopting an improved algorithm, and space-time joint optimization is performed through quadratic programming; a smooth trajectory meeting dynamic constraints is generated in combination with a differential flatness parameterization method, and accurate execution of attitude and motion instructions is realized based on feedforward-feedback cooperative control. According to the method, the problem that the trajectory is not feasible due to neglect of the inclination angle in the traditional automatic driving planning of the two-wheeled vehicle is solved, and the motion stability and safety in a dynamic scene are improved.

The invention discloses an automatic driving track prediction method and device, a storage medium and a program product, and relates to the technical field of automatic driving, on the basis of obtaining vehicle collection information and driving navigation information of a target vehicle, a pre-trained visual language model is used for processing the vehicle collection information and the driving navigation information, and the automatic driving track prediction accuracy is improved. Outputting a multi-modal joint feature; further, enabling the original trajectory prediction model to output a first prediction trajectory according to the multi-modal joint feature; determining a target time sequence trajectory prediction model based on the first prediction trajectory; outputting a second prediction trajectory through a target time sequence trajectory prediction model according to the multi-modal joint feature and the first prediction trajectory; and then, inputting the multi-modal joint feature and the second prediction trajectory into a generative strategy optimization model, and outputting a target prediction trajectory. The problem of inaccurate trajectory prediction in the prior art is solved.

Provided method for training an autonomous driving model including a video prediction model, and the method including: determining, according to at least one of an initial video frame collected by a target vehicle or scenario description metadata of an initial video frame, a scenario context of the initial video frame; determining a vehicle movement instruction of the target vehicle according to at least one of the initial video frame or trajectory data of the target vehicle corresponding to the initial video frame; and training an initial model using the initial video frame and a control text corresponding to the initial video frame, to obtain the video prediction model, where the control text comprises the scenario context and the vehicle movement instruction, and the video prediction model is configured to output a predicted video frame.

The invention relates to the technical field of intelligent ship automatic control and navigation, and discloses a ship automatic driving path planning method and system based on multi-sensor fusion, and the method comprises the following steps: obtaining multi-source sensor data around a ship for environment perception; preprocessing and fusing the sensor data to form unified modeling input; constructing an environment model based on the fused data, and inputting the environment model to a path planning module to generate an optimal path; dynamic obstacle avoidance is executed in combination with the path and the current ship state, and a corrected path is obtained; performing closed-loop control according to feedback information, and updating a state and environment model in real time; and outputting the control instruction to an execution mechanism to drive the ship to run according to the corrected path. According to the method, a closed-loop path correction mechanism based on model predictive control is adopted, the technical effects of dynamically responding to environment changes and optimizing control input in real time are achieved, and the problem of ship yawing caused by path error accumulation and control response delay is solved.

Aspects an autonomous driving system with air support are described herein. The aspects may include an unmanned aerial vehicle (UAV) in the air and a land vehicle on the ground communicatively connected to the UAV. The UAV may include at least one UAV camera configured to collect first ground traffic information and a UAV communication module configured to transmit the collected first ground traffic information. The land vehicle may include one or more vehicle sensors configured to collect second ground traffic information surrounding the land vehicle, a land communication module configured to receive the first ground traffic information from the UAV, and a processor configured to combine the first ground traffic information and the second ground traffic information to generate a world model.

The invention relates to the field of decision planning of automatic driving vehicles, in particular to an automatic driving vehicle decision planning method based on deep reinforcement learning. The method comprises the following steps: when a vehicle runs on a structured road, acquiring position information of an environmental vehicle, and introducing historical position data of the environmental vehicle into a long short-term memory network to obtain a driving intention hiding state of surrounding vehicles; and generating a polynomial curve-based planning track through an SAC algorithm according to the obtained hidden state and vehicle motion information fusion. The problem of poor safety and stability of deep reinforcement learning in the field of automatic driving decision planning is solved, the overall training difficulty of reinforcement learning is reduced, and the method can be widely applied to the technical field of automatic driving decision planning.

The invention relates to an automatic driving risk quantification method based on a conflict risk field. Comprising the steps of 1, constructing a basic risk field; step 2, under a basic risk field framework, constructing a conflict risk field by taking an ADV as a center; step 3, regarding the conflict risk field as a repulsive force acting on the ADV, and using the repulsive force to quantify the dynamic influence of the environmental elements and various TP states on the driving safety of the ADV; the method comprises the following steps: firstly, constructing a basic risk field on the basis of traffic vehicle distribution and motion characteristics, further forming a vehicle forward, lateral, backward and traffic regulation constraint multi-dimensional conflict risk field on the basis, and converting an abstract traffic conflict relationship into a computable repulsive force model; dynamic quantitative characterization of driving risks in a state dimension, a space dimension and a time dimension is realized, and continuous optimization and evolution of an end-to-end automatic driving algorithm are supported by means of a repulsive force model constructed based on a conflict risk field.

The invention discloses an Internet of Vehicles network selection and switching decision system supporting access of multiple operators. According to the method and the device, the timeliness and the continuity of network switching are remarkably improved through prediction and planning in advance. The module depends on a trajectory-network matching prediction sub-module, combines a vehicle navigation trajectory and a global digital twinborn model, identifies a base station coverage area in a future driving path and the network service quality of each operator in advance, and avoids the lag problem that switching is triggered only after signals are weakened in traditional passive switching. The pre-switching resource reservation sub-module further sends a resource request to a target operator base station and confirms reservation before the vehicle enters a new road section, ensures that resources such as bandwidth and time slot required during switching are in place, reduces switching failure or interruption caused by resource competition, avoids common communication interruption after signal sudden drop in traditional switching, and improves the switching efficiency. And continuous transmission of key businesses such as automatic driving control instructions and real-time road conditions is ensured.

The invention discloses an intelligent automobile cooperative cruise safety control method under Dos attacks and physical faults, and relates to automobile intelligent safety and automatic driving. A hierarchical control framework is adopted and comprises an observer layer and a tracking layer. The method comprises the following steps: establishing a vehicle longitudinal dynamics model and a DoS attack model for DoS attack in a V2X communication network and the problems of sensor and actuator faults and parameter isomerism of a vehicle; a completely distributed self-adaptive preset time observer based on event triggering is designed for each following vehicle in the observer layer, and rapid and accurate estimation of the state of the pilot vehicle is achieved; the method comprises the following steps: constructing an augmentation system at a tracking layer, designing a distributed intermediate observer, carrying out online estimation and compensation on faults of a sensor and an actuator, designing a distributed active fault-tolerant controller based on a fault estimation value and a pilot vehicle state estimation value, and calculating a wheel driving torque to realize safe cruise control. Multiple threats of coexistence of network attacks and physical faults are effectively handled, and the stability and safety of the cooperative cruise system are ensured.

A method performed by an apparatus for controlling autonomous driving of a vehicle is introduced. The method may comprise generating, based on a segmentation model processing point cloud data, a first semantic grid map, generating, based on an object detection model, a second semantic grid map, adjusting a probability regarding whether occupancy exists for an element included in each grid of the first semantic grid map and the second semantic grid map, and generating a fused grid map by determining, as a representative label, at least one label corresponding to a highest value among final probabilities of the at least one label, wherein the final probabilities are determined based on whether the at least one label matches the element, outputting, based on the fused grid map, a signal, and controlling, based on the signal, autonomous driving of the vehicle.

The invention is oriented to the field of autonomous vehicle perception planning, and discloses an autonomous vehicle trajectory prediction method fusing a Mama backbone network and a graph attention mechanism. According to the method, vehicle track, state, road and environment information is acquired, a Mamba backbone network is utilized to extract time sequence characteristics of tracks of an automatic driving vehicle and surrounding vehicles, and meanwhile, a spatial interaction relationship between the surrounding vehicles and other objects in a traffic scene is modeled through a graph attention network. In the feature fusion layer, the time sequence and space features are pooled to form high-dimensional space-time coding features. And the fusion features are input into a decoder, the decoder uses a Mamba module as a core to decode and output the information of the model coding, and the predicted trajectory of the vehicles around the autonomous vehicle is obtained. The provided model has the advantages that the mapping relation between the historical track and the predicted track is accurately modeled through deep learning, the mode of combining a Mama backbone network and a graph attention mechanism is utilized, the model is helped to understand the influence of scene features on the future driving track of the vehicle, and accurate, efficient and scene-robust prediction is achieved.

The invention relates to the field of automatic driving vehicle control, in particular to a sightseeing vehicle anti-collision control method and system based on a multi-mode radar. Comprising the following steps: acquiring a multi-modal radar original signal, and performing timestamp alignment and noise reduction processing to generate standardized fusion data; performing multi-target classification based on a convolutional neural network, and outputting a target recognition result in combination with Doppler frequency shift compensation and distance calculation; generating a hierarchical response strategy through dual-threshold comparison and environment interference dynamic weight adjustment; the strategy is converted into a PWM control signal, and a control instruction is generated through relay driving adaptation and hardware compatibility detection; a relay is driven in real time, motor response is collected, and execution effect evaluation and time sequence marking are completed; and brake release and system parameter synchronization are realized through PID closed-loop control. The problems of insufficient multi-target identification precision, poor environmental interference adaptability and response delay are solved, and the active safety performance of the sightseeing vehicle is remarkably improved.

The invention discloses an automatic driving vehicle path planning method and system combined with high-precision perception, and relates to the technical field of automatic driving vehicles, and the method comprises the steps: obtaining the multi-mode real-time data of the surrounding environment of a target vehicle through a sensor module; performing fusion processing to generate a high-precision environment perception map; generating a global path and an initial local path by combining the current position and the target position of the target vehicle; dynamically optimizing the initial local path based on model predictive control to obtain a final local path; and controlling the target vehicle according to the global path and the final local path. The technical problem that in the prior art, due to the fact that environment sensing precision is insufficient, path planning is not flexible enough and dynamic obstacle effective prediction is lacked, automatic driving safety and path planning real-time performance are poor is solved, and the technical effects of improving automatic driving safety and enhancing path planning real-time performance and adaptability are achieved.

The invention provides an anthropomorphic automatic driving simulation test scene construction method. The method comprises the steps that all vehicles in a traffic scene are divided into two types of intelligent agents including a test vehicle and an environment vehicle, the traffic scene is modeled into a Markov decision process, the test vehicle is a vehicle controlled by an automatic driving algorithm, and the environment vehicle is a vehicle controlled by a GAIL-GRU driving strategy model; a Markov decision process is utilized to extract a driving track from the human driving data set, and an expert track data set is generated; and training a GAIL-GRU driving strategy model by using the expert track data set, realizing interaction between an environment vehicle and a test vehicle by using the trained GAIL-GRU driving strategy model, and constructing a simulation test scene. The automatic driving simulation test scene constructed by the invention can effectively expose decision defects of an automatic driving algorithm in a complex interaction situation, has good anthropomorphism and relatively high risk scene coverage, and provides support for a decision control simulation test of a high-level automatic driving vehicle.