Sensor parameter calibration method, device, computer equipment and storage medium
By using the method of updating constraints based on preset information matrix and vehicle control quantity in the field of unmanned driving, the problems of low sensor calibration efficiency and poor adaptability are solved, and efficient and accurate sensor parameter calibration is achieved, which is suitable for dynamic environments.
Patent Information
- Application Number
- CN202410843050.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2024-06-27
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2044-06-27
AI Technical Summary
The prior art sensor calibration method in the field of unmanned driving is low efficiency and has high computational complexity, making it difficult to adapt to calibration requirements in dynamic environments, especially in multi-sensor fusion, and it is difficult to ensure accuracy and flexibility.
By determining the first function based on the preset information matrix, solving the vehicle control amount, updating the preset constraints to calculate the sensor objective function, judging the rationality of the sensor parameters using the value of the target information matrix trace, improving data acquisition efficiency and saving computing resources.
It improves the efficiency of sensor parameter calibration, reduces the calculation complexity and time, adapts to calibration requirements in dynamic environments, and enhances calibration accuracy and flexibility.
Smart Images

Figure CN118392215B_ABST
Abstract
Description
Technical Field
[0001] The present invention relates to the field of unmanned driving technology, and in particular to a sensor parameter calibration method, device, computer equipment and storage medium. Background Art
[0002] In the field of unmanned driving, multi-sensor fusion is the key to achieving autonomous navigation and environmental perception. Taking the camera as an example, the on-board camera is one of the important sensors, which is used to capture image information of the road and the surrounding environment in real time. However, in order to correctly understand the image and perform effective environmental perception, the camera must be accurately calibrated. Camera calibration plays a vital role in the field of computer vision, especially in the context of applications such as unmanned driving. Camera calibration refers to determining the internal parameters of the camera (such as focal length, optical center, etc.) and external parameters (the transformation relationship between the camera and the world coordinate system) in order to accurately correspond the image observed by the camera to the position of objects in the real world.
[0003] Traditional camera calibration methods usually require a large number of calibration images or complex calibration plates. During calibration, a large amount of data needs to be collected, the calculation complexity is high, and it takes a long time to calculate. At the same time, there are many types of sensors installed on the vehicle. In a dynamic environment, the relative position relationship of the sensors may change. The existing calibration methods are difficult to meet the calibration needs in such a dynamic environment. Summary of the invention
[0004] In view of this, the present invention provides a sensor parameter calibration method, apparatus, computer equipment and storage medium to improve the efficiency of sensor parameter calibration.
[0005] In a first aspect, the present invention provides a method for calibrating sensor parameters, the method comprising:
[0006] Determine a first function based on a preset information matrix, and solve the first function to determine a vehicle control amount corresponding to a minimum value of the preset information matrix, wherein the preset information matrix is a function of the vehicle control amount and a sensor parameter;
[0007] Based on the vehicle control amount, a preset first constraint and a preset second constraint are updated, and a sensor objective function is calculated based on the updated preset first constraint and the preset second constraint, so as to determine corresponding sensor parameters based on the sensor objective function, wherein the preset first constraint is used to characterize the relative transformation relationship between the odometer and the sensor, the preset second constraint is used to characterize the relative transformation relationship between the sensors, and the sensor objective function is determined by fusing the preset first constraint and the preset second constraint;
[0008] updating the preset information matrix based on the sensor parameters to obtain a target information matrix, and determining a value of the target information matrix trace;
[0009] When the value of the target information matrix trace is not greater than a preset threshold, a target parameter of the sensor corresponding to the target information matrix is determined.
[0010] In a second aspect, the present invention provides a sensor parameter calibration device, the device comprising:
[0011] A vehicle control amount module, used to determine a first function based on a preset information matrix, and solve the first function to determine the vehicle control amount corresponding to the minimum value of the preset information matrix, wherein the preset information matrix is a function of the vehicle control amount and sensor parameters;
[0012] a sensor parameter determination module, used for updating a preset first constraint and a preset second constraint based on the vehicle control amount, and calculating a sensor objective function based on the updated preset first constraint and the preset second constraint, so as to determine corresponding sensor parameters based on the sensor objective function, wherein the preset first constraint is used to characterize the relative transformation relationship between the odometer and the sensor, the preset second constraint is used to characterize the relative transformation relationship between sensors, and the sensor objective function is determined by fusing the preset first constraint and the preset second constraint;
[0013] A matrix updating module, used for updating the preset information matrix based on the sensor parameters, obtaining a target information matrix, and determining a value of the target information matrix trace;
[0014] The target parameter determination module is used to determine the target parameter of the sensor corresponding to the target information matrix when the value of the target information matrix trace is not greater than a preset threshold.
[0015] In a third aspect, the present invention provides a computer device, comprising: a memory and a processor, the memory and the processor being communicatively connected to each other, the memory storing computer instructions, and the processor executing the method of the first aspect or any corresponding embodiment thereof by executing the computer instructions.
[0016] In a fourth aspect, the present invention provides a computer-readable storage medium having computer instructions stored thereon, the computer instructions being used to cause a computer to execute the method of the first aspect or any corresponding embodiment thereof.
[0017] The sensor parameter calibration method provided by the present disclosure determines a first function based on a preset information matrix, solves the first function, determines the vehicle control amount corresponding to the minimum value of the preset information matrix, updates the preset first constraint and the preset second constraint through the vehicle control amount, and then calculates the sensor target function, and determines the corresponding sensor parameters based on the sensor target function. The preset information matrix is updated based on the sensor parameters to obtain the target information matrix, and the value of the target information matrix trace is determined. When the value of the target information matrix trace is not greater than the preset threshold, the target parameters of the sensor corresponding to the target information matrix are determined. By judging whether the value of the information matrix trace is not greater than the preset threshold, it is possible to autonomously judge whether the sensor parameters currently optimized are reasonable, without the need for additional calculations. The information matrix is used to calculate the vehicle control amount, which can improve the efficiency of data collection and save computing resources. BRIEF DESCRIPTION OF THE DRAWINGS
[0018] In order to more clearly illustrate the specific implementation methods of the present invention or the technical solutions in the prior art, the drawings required for use in the specific implementation methods or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are some implementation methods of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.
[0019] Figure 1 is a flow chart of a method for calibrating sensor parameters according to an embodiment of the present invention;
[0020] Figure 2 is a flow chart of another sensor parameter calibration method according to an embodiment of the present invention;
[0021] Figure 3 is a structural block diagram of a sensor parameter calibration device according to an embodiment of the present invention;
[0022] Figure 4 It is a schematic diagram of the hardware structure of a computer device according to an embodiment of the present invention. DETAILED DESCRIPTION
[0023] In order to make the purpose, technical solution and advantages of the embodiments of the present invention clearer, the technical solution in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.
[0024] In the field of unmanned driving, multi-sensor fusion is the key to achieving autonomous navigation and environmental perception. The on-board camera is one of the important sensors on the vehicle, which is used to capture image information of the road and the surrounding environment in real time. In order to correctly understand the image and perform effective environmental perception, the camera needs to be accurately calibrated.
[0025] Usually, various sensors are installed on autonomous driving vehicles, including odometers, cameras, lidar, etc. In autonomous driving and intelligent driving systems, sensor external parameter calibration is a key link, which can ensure that the data between different sensors can be accurately integrated, thereby improving the accuracy of the entire system. In related technologies, batch calibration, specific calibration plates or manual settings are used for parameter calibration. The batch calibration method requires a large amount of data to be collected before calibration, resulting in an increase in computational complexity as the amount of data increases. This means that in practical applications, as the amount of data increases, the computational cost of the calibration process will increase significantly, limiting its application in real-time systems. The use of specific calibration plates or manual calibration methods limits the flexibility and scope of application of the calibration method. In some scenarios, setting a specific calibration plate or landmark may be very inconvenient, and the applicability of this calibration method is limited. Some methods perform poorly when dealing with dynamic environments. For scenarios such as unmanned driving, the relative position relationship of sensors may change, and traditional methods are difficult to adapt to the calibration requirements in such dynamic environments. When processing large-scale data or complex scenarios, a long computing time is required, and the calibration time is time-consuming and inefficient. Based on this, the present invention provides a sensor parameter calibration method to improve the efficiency of sensor parameter calibration.
[0026] According to an embodiment of the present invention, an embodiment of a method for calibrating sensor parameters is provided. It should be noted that the steps shown in the flowchart of the accompanying drawings can be executed in a computer system such as a set of computer executable instructions, and although a logical order is shown in the flowchart, in some cases, the steps shown or described can be executed in an order different from that shown here.
[0027] In this embodiment, a sensor parameter calibration method is provided. Figure 1 is a flow chart of a method for calibrating sensor parameters according to an embodiment of the present invention. Figure 1 As shown, the process includes the following steps:
[0028] Step S101, determining a first function based on a preset information matrix, and solving the first function to determine a vehicle control amount corresponding to a minimum value of the preset information matrix.
[0029] The preset information matrix is a function of vehicle control variables and sensor parameters.
[0030] The sensor in this embodiment refers to various sensors installed on the vehicle, including but not limited to cameras, laser radars, and odometers. The sensor parameters in this embodiment refer to the external parameters of the sensors on the vehicle, which are used to determine the conversion relationship between the sensor and an external coordinate system. The vehicle control quantity may include speed control, steering control, braking control, power control, etc. Define functions about the vehicle control quantity and sensor parameters to obtain a preset information matrix. Design the optimal experimental problem for inputting the vehicle control quantity, that is, the first function, and calculate the corresponding value of the vehicle control quantity when the preset information matrix takes the minimum value by solving the first function.
[0031] In some optional implementations, the preset information matrix is determined according to the following formula:
[0032]
[0033] in, represents the preset information matrix, represents the information matrix of the preset first constraint, represents the information matrix of the preset second constraint, express The amount of vehicle control at the time, represents elementary row transformation, represents the sensor obtained by solving the sensor objective function Parameters, represents the sensor obtained by solving the sensor objective function Parameters, set Represents the sensor pair ( , ) between observable transformations;
[0034] The first function is determined according to the following formula:
[0035]
[0036] in, represents the vehicle control quantity, express The amount of vehicle control at any given moment, represents the preset information matrix, represents the standard function, represents the set of control constraints. In practical applications, two common criteria are trace and determinant. Here we consider .
[0037] Step S102 , updating the preset first constraint and the preset second constraint based on the vehicle control amount, and calculating the sensor objective function based on the updated preset first constraint and the preset second constraint, so as to determine the corresponding sensor parameters based on the sensor objective function.
[0038] The preset first constraint is used to characterize the relative transformation relationship between the odometer and the sensor, and the preset second constraint is used to characterize the relative transformation relationship between the sensors.
[0039] The first preset constraint is the odometer-sensor constraint, describing arrive The relative transformation relationship between the sensor and the odometer at the moment, the preset second constraint is the sensor-sensor constraint, describing The relative transformation relationship between sensors at each moment.
[0040] For the preset first constraint, we can first determine arrive The attitude of the sensor relative to the odometer at this time, determined by the attitude of the sensor relative to the odometer arrive A sensor observation error function within time is used to describe the calibration target of the odometer-sensor constraint in a least squares form based on the sensor observation error function to obtain a preset first constraint.
[0041] For the preset second constraint, first determine The error function between sensors at each moment is then used to describe the calibration objective of the sensor-sensor constraint in the least squares form according to the error function, thereby obtaining the preset second constraint. The benefit of the least squares method is that it provides a systematic method to minimize the sum of squares of the errors, thereby finding the best fitting model for the data.
[0042] The sensor objective function is used to characterize the final problem of multi-sensor calibration, and the sensor objective function is determined by fusing the preset first constraint and the preset second constraint.
[0043] After the vehicle control amount is calculated in step S101, due to the change in the vehicle control amount, the posture of the sensor relative to the odometer and the posture between the sensors will change, and the measurement value of the relative posture of the sensor will be obtained, and then the values of the preset first constraint and the preset second constraint will change. Based on this, the sensor objective function is solved, and the value of the sensor objective function is the sensor parameter.
[0044] Step S103, updating the preset information matrix based on the sensor parameters and determining the target information matrix.
[0045] The preset information matrix is a function of the vehicle control amount and the sensor parameters. It can be understood that there is an initial preset information matrix. After the sensor parameters are obtained in step S102, the sensor parameters are substituted into the original preset information matrix for calculation to obtain The information matrix at each moment is The information matrix at the moment is added to the initial preset information matrix to obtain the updated information matrix (i.e., the target information matrix).
[0046] Set the default information matrix to , express The information matrix of the moment, Represents the target information matrix, and the target information matrix is updated: .
[0047] Step S104, when the value of the target information matrix trace is not greater than a preset threshold, determining the target parameters of the sensor corresponding to the target information matrix.
[0048] Assume the target information matrix is , the preset threshold is ,when , then stop the calculation and use the target parameters corresponding to the target information matrix as the optimal sensor extrinsic parameters for the final solution.
[0049] when , then repeat the above steps until the .
[0050] The sensor parameter calibration method provided in this embodiment determines a first function based on a preset information matrix, solves the first function, determines the vehicle control amount corresponding to the minimum value of the preset information matrix, updates the preset first constraint and the preset second constraint through the vehicle control amount, and then calculates the sensor target function, and determines the corresponding sensor parameters based on the sensor target function. The preset information matrix is updated based on the sensor parameters to obtain the target information matrix, and the value of the target information matrix trace is determined. When the value of the target information matrix trace is not greater than the preset threshold, the target parameters of the sensor corresponding to the target information matrix are determined. By judging whether the value of the information matrix trace is not greater than the preset threshold, it is possible to autonomously judge whether the sensor parameters currently optimized are reasonable, without the need for additional calculations. The information matrix is used to calculate the vehicle control amount, which can improve the efficiency of data collection and save computing resources.
[0051] In some optional implementations, step S102 includes:
[0052] Step S1021, determining the posture of the sensor relative to the odometer within the target time and the error function between the sensors at the target time according to the vehicle control amount, wherein the error function between the sensors is used to update the preset second constraint.
[0053] Step S1022, performing vector processing on the posture of the sensor relative to the odometer within the target time to determine the sensor observation error function within the target time;
[0054] Step S1023: determining a calibration target of the sensor relative to the odometer based on the sensor observation error function within the target time, so as to determine the preset first constraint.
[0055] Consider an autonomous vehicle with N sensors. The transformation from the sensor coordinate system to the vehicle coordinate system is: ,in, represents the three-dimensional special Euclidean group, represents the translation vector, Indicates The vector representation of the transformation from the sensor coordinate system to the vehicle coordinate system, Represents with corresponding Euler angles 3D rotation matrix, SO(3) represents a three-dimensional special orthogonal group. In this embodiment, a group operation is defined ,satisfy:
[0056] ,
[0057] in, Represents the Euler angle and translation vector The 3D Euclidean transformation matrix composed of Represents the Euler angle and translation vector The 3D Euclidean transformation matrix composed of Euler Angles The corresponding 3D rotation matrix, Represents with Euler angles The 3D rotation matrix, represents the translation vector 1, represents the translation vector 2, Represents its inverse operation.
[0058] For any given autonomous vehicle, its motion model is represented by the following ordinary differential equations:
[0059]
[0060] in, Indicates the state, which may include position, orientation, etc. Represents control input, which includes speed, steering wheel angle, etc. express The status of the vehicle at the moment, express Control the input function at all times, Indicates status Dimensions , Indicates the control amount Dimensions .
[0061] In practical situations, a constant control input is used over a certain time interval. .
[0062] in, express time, express time, express The amount of vehicle control at a given moment.
[0063] From time arrive The relative position of the vehicle can be expressed as:
[0064]
[0065] in, is the solution of the differential equation of the motion model, that is, the vector expression of the vehicle posture, and They are and Vehicle posture Expression form.
[0066] (1) Preset the first constraint
[0067] Within target time Within time :
[0068]
[0069] in, Indicates The transformation from the sensor coordinate system to the vehicle coordinate system, Indicates time arrive The transformation of the vehicle’s position, Indicates time arrive Internal sensor The posture transformation.
[0070] Furthermore, within the target time
[0071]
[0072] in, Indicates time arrive Internal sensor The actual measured value of the pose transformation.
[0073] The calibration objective based on the odometry-sensor constraint can be described in the least squares form:
[0074]
[0075] in, Indicates the preset first constraint, represents the error between the sensor and the odometer, Indicates time arrive Sensors The observation error function is Indicates The vector representation of the transformation from the sensor coordinate system to the vehicle coordinate system, express Moment The information matrix of the sensors.
[0076] (2) Preset the second constraint
[0077] Target time The error function between sensors can be expressed as:
[0078]
[0079] in, express time , Indicates The transformation from the sensor coordinate system to the vehicle coordinate system, Indicates Transformation from the sensor coordinate system to the vehicle coordinate system.
[0080] The calibration objective based on sensor-to-sensor constraints can be described in least squares form:
[0081]
[0082] in, Indicates the preset second constraint, Represents the error between sensors, express Time sensor With sensor The error function between Indicates The sensor coordinate system to the The vector representation of the transformation between the sensor coordinate systems, express Time sensor and sensors Information matrix of all , Represents a set of natural numbers, a set Represents the sensor pair ( , ) between the two.
[0083] In some optional implementations, step S102 further includes: solving the sensor objective function to determine sensor parameters corresponding to minimum values of the preset first constraint and the preset second constraint.
[0084] The sensor objective function is determined by fusing the preset first constraint and the preset second constraint. Combining the two constraints, the sensor objective function can be obtained, that is, the final problem form of multi-sensor calibration is:
[0085] in, Indicates the preset first constraint, Indicates the preset second constraint, represents the error between the sensor and the odometer, Represents the error between sensors, represents the weight coefficient, represents the sensor parameters, represents the sensor parameters obtained by solving the sensor objective function at the last moment, express The information matrix of the moment, represents the sensor parameters obtained by solving the sensor objective function.
[0086] Specifically, the Gauss-Newton method can be used to solve this problem.
[0087]
[0088] in, After optimization, , represents the update amount obtained by solving the problem, Indicates The update amount of each sensor, Indicates The update amount of each sensor, and is the information matrix. Specifically, Indicates the preset first constraint relative to the sensor The information matrix, Indicates the preset second constraint relative to the sensor , The information matrix, and is the gradient, as follows:
[0089]
[0090]
[0091] in, represents a 6x6 symmetric positive definite matrix, represents a 12x12 symmetric positive definite matrix, represents a 6-dimensional vector, represents a 12-dimensional vector, Indicates time arrive Sensors The observation error function is express Time sensor With sensor The error function between express Moment The information matrix of sensors, express Time sensor and sensors information matrix.
[0092] In some optional implementations, for any sensor, each sensor parameter is calculated, and based on each sensor parameter, a sub-information matrix corresponding to each sensor is updated, where the sub-information matrix is a subset of the target information matrix.
[0093] The parameters of each sensor of the vehicle can be calculated independently and in parallel to improve the calculation efficiency. The sensor parameters are calculated as follows:
[0094]
[0095] in, Indicates The sensors in The optimal external parameter at time, represents the sensor-to-sensor error, represents the error between the odometer and the sensor, express Time sensor The external reference, represents the weight coefficient, Indicates sensor The corresponding information matrix is Indicates sensor Neighboring sensors, i.e. sensors There are sensors with constraints between them. Calculated by the following formula:
[0096]
[0097]
[0098] in, express Medium sensor The sub-matrix blocks of autocorrelations, express Medium sensor and other sensor cross-correlation sub-matrix blocks, express The transpose of express Neutralization sensor The associated other sensor autocorrelation sub-matrix blocks, represents the elementary row transformation matrix, Represents an elementary column transformation matrix.
[0099] In this embodiment, a method for calibrating sensor parameters is provided. The process of the method is as follows: Figure 2 As shown, given the initial sensor external parameters and the information matrix , solve the optimal vehicle control quantity according to the first function , based on the measured value of the relative position of the sensor, the sensor objective function is solved, and the information matrix is updated to obtain the target information matrix , when the value of the target information matrix trace is not greater than the preset threshold, the calculation is stopped and the parameters are output.
[0100] In this embodiment, a sensor parameter calibration device is also provided, which is used to implement the above-mentioned embodiments and implementation methods, and will not be repeated here. As used below, the term "module" can implement a combination of software and / or hardware for a predetermined function. Although the device described in the following embodiments is preferably implemented in software, the implementation of hardware, or a combination of software and hardware, is also possible and conceivable.
[0101] This embodiment provides a sensor parameter calibration device, such as Figure 3 As shown, including:
[0102] A vehicle control amount module 301 is used to determine a first function based on a preset information matrix, and solve the first function to determine the vehicle control amount corresponding to the minimum value of the preset information matrix, wherein the preset information matrix is a function of the vehicle control amount and sensor parameters;
[0103] A sensor parameter determination module 302, configured to update a preset first constraint and a preset second constraint based on the vehicle control amount, and calculate a sensor objective function based on the updated preset first constraint and the preset second constraint, so as to determine corresponding sensor parameters based on the sensor objective function, wherein the preset first constraint is used to characterize the relative transformation relationship between the odometer and the sensor, and the preset second constraint is used to characterize the relative transformation relationship between sensors, and the sensor objective function is determined by fusing the preset first constraint and the preset second constraint;
[0104] A matrix updating module 303 is used to update the preset information matrix based on the sensor parameters, obtain a target information matrix, and determine the value of the target information matrix trace;
[0105] The target parameter determination module 304 is used to determine the target parameter of the sensor corresponding to the target information matrix when the value of the target information matrix trace is not greater than a preset threshold.
[0106] In some optional implementations, the sensor parameter determination module 302 includes:
[0107] A second constraint updating unit, used to determine the posture of the sensor relative to the odometer within the target time and the error function between the sensors at the target time according to the vehicle control amount, wherein the error function between the sensors is used to update the preset second constraint;
[0108] An error function determination unit, configured to perform vector processing on the posture of the sensor relative to the odometer within the target time, and determine the sensor observation error function within the target time;
[0109] The first constraint updating unit is used to determine a calibration target of the sensor relative to the odometer based on the sensor observation error function within the target time, so as to determine the preset first constraint.
[0110] In some optional implementations, the preset first constraint is determined according to the following formula:
[0111]
[0112] in, Indicates the preset first constraint, represents the error between the sensor and the odometer, Indicates time arrive Sensors The observation error function is Indicates The vector representation of the transformation from the sensor coordinate system to the vehicle coordinate system, express Moment The information matrix of sensors;
[0113] The preset second constraint is determined according to the following formula:
[0114]
[0115] in, Indicates the preset second constraint, Represents the error between sensors, express Time sensor With sensor The error function between Indicates The sensor coordinate system to the The vector representation of the transformation between the sensor coordinate systems, express Time sensor and sensors Information matrix of all , Represents a set of natural numbers, a set Represents the sensor pair ( , ) between the two.
[0116] In some optional implementations, the sensor parameter determination module 302 further includes:
[0117] The parameter determination unit is used to solve the sensor objective function to determine the sensor parameters corresponding to the minimum values of the preset first constraint and the preset second constraint.
[0118] The sensor objective function is determined according to the following formula:
[0119]
[0120] in, Indicates the preset first constraint, Indicates the preset second constraint, represents the error between the sensor and the odometer, Represents the error between sensors, represents the weight coefficient, represents the sensor parameters, represents the sensor parameters obtained by solving the sensor objective function at the last moment, express The information matrix of the moment, represents the sensor parameters obtained by solving the sensor objective function.
[0121] In some optional implementations, the preset information matrix is determined according to the following formula:
[0122]
[0123] in, represents the preset information matrix, represents the information matrix of the preset first constraint, represents the information matrix of the preset second constraint, express The amount of vehicle control at the time, represents elementary row transformation, represents the sensor obtained by solving the sensor objective function Parameters, represents the sensor obtained by solving the sensor objective function Parameters, set Represents the sensor pair ( , ) between observable transformations;
[0124] The first function is determined according to the following formula:
[0125]
[0126] in, represents the vehicle control quantity, express The amount of vehicle control at any given moment, represents the preset information matrix, represents the standard function, Represents a set of controlling constraints.
[0127] In some optional embodiments, the device further comprises:
[0128] The parallel computing module is used to calculate the parameters of each sensor for any sensor, and determine to update the sub-information matrix corresponding to each sensor based on the parameters of each sensor, wherein the sub-information matrix is a subset of the target information matrix.
[0129] The further functional description of each of the above modules and units is the same as that of the above corresponding embodiments and will not be repeated here.
[0130] The sensor parameter calibration device in this embodiment is presented in the form of a functional unit, where the unit refers to an ASIC (Application Specific Integrated Circuit) circuit, a processor and memory that executes one or more software or fixed programs, and / or other devices that can provide the above functions.
[0131] The embodiment of the present invention also provides a computer device having the above Figure 3 Calibration device for the sensor parameters shown.
[0132] See also Figure 4 , Figure 4 is a schematic diagram of the structure of a computer device provided by an optional embodiment of the present invention, such as Figure 4 As shown, the computer device includes: one or more processors 10, a memory 20, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. Various components are connected to each other using different buses for communication, and can be installed on a common mainboard or installed in other ways as needed. The processor can process the instructions executed in the computer device, including instructions stored in or on the memory to display the graphical information of the GUI on an external input / output device (such as, a display device coupled to the interface). In some optional embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple computer devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Figure 4 A processor 10 is taken as an example.
[0133] The processor 10 may be a central processing unit, a network processor or a combination thereof. The processor 10 may further include a hardware chip. The hardware chip may be a dedicated integrated circuit, a programmable logic device or a combination thereof. The programmable logic device may be a complex programmable logic device, a field programmable gate array, a general purpose array logic or any combination thereof.
[0134] The memory 20 stores instructions executable by at least one processor 10, so that the at least one processor 10 executes the method shown in the above embodiment.
[0135] The memory 20 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the computer device, etc. In addition, the memory 20 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some optional embodiments, the memory 20 may optionally include a memory remotely arranged relative to the processor 10, and these remote memories may be connected to the computer device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.
[0136] The memory 20 may include a volatile memory, such as a random access memory; the memory may also include a non-volatile memory, such as a flash memory, a hard disk or a solid state drive; the memory 20 may also include a combination of the above types of memory.
[0137] The computer device further comprises a communication interface 30 for the computer device to communicate with other devices or a communication network.
[0138] The embodiment of the present invention also provides a computer-readable storage medium. The method according to the embodiment of the present invention can be implemented in hardware, firmware, or can be implemented as a computer code that can be recorded in a storage medium, or can be implemented as a computer code that is originally stored in a remote storage medium or a non-temporary machine-readable storage medium and will be stored in a local storage medium through a network download, so that the method described herein can be stored in such software processing on a storage medium using a general-purpose computer, a dedicated processor, or programmable or dedicated hardware. Among them, the storage medium can be a magnetic disk, an optical disk, a read-only storage memory, a random access memory, a flash memory, a hard disk or a solid-state hard disk, etc.; further, the storage medium can also include a combination of the above types of memories. It can be understood that a computer, a processor, a microprocessor controller, or programmable hardware includes a storage component that can store or receive software or computer code. When the software or computer code is accessed and executed by a computer, a processor, or hardware, the method shown in the above embodiment is implemented.
[0139] Although the embodiments of the present invention have been described in conjunction with the accompanying drawings, those skilled in the art may make various modifications and variations without departing from the spirit and scope of the present invention, and such modifications and variations are all within the scope defined by the appended claims.
Claims
1. A method for calibrating sensor parameters, characterized in that: The method comprises: Determine a first function based on a preset information matrix, and solve the first function to determine a vehicle control amount corresponding to a minimum value of the preset information matrix, wherein the preset information matrix is a function of the vehicle control amount and a sensor parameter; Based on the vehicle control amount, a preset first constraint and a preset second constraint are updated, and a sensor objective function is calculated based on the updated preset first constraint and the preset second constraint, so as to determine corresponding sensor parameters based on the sensor objective function, wherein the preset first constraint is used to characterize the relative transformation relationship between the odometer and the sensor, the preset second constraint is used to characterize the relative transformation relationship between the sensors, and the sensor objective function is determined by fusing the preset first constraint and the preset second constraint; updating the preset information matrix based on the sensor parameters to obtain a target information matrix, and determining a value of the target information matrix trace; When the value of the target information matrix trace is not greater than a preset threshold, determining a target parameter of a sensor corresponding to the target information matrix; The updating of the preset first constraint and the preset second constraint based on the vehicle control amount includes: Determine the posture of the sensor relative to the odometer within the target time and the error function between the sensors at the target time according to the vehicle control amount, respectively, wherein the error function between the sensors is used to update the preset second constraint; Performing vector processing on the attitude of the sensor relative to the odometer within the target time to determine the sensor observation error function within the target time; Determining a calibration target of the sensor relative to the odometer based on the sensor observation error function within the target time to determine the preset first constraint; The preset first constraint is determined according to the following formula: in, Indicates the preset first constraint, represents the error between the sensor and the odometer, Indicates time arrive Sensors The observation error function is Indicates The vector representation of the transformation from the sensor coordinate system to the vehicle coordinate system, express Moment The information matrix of sensors; The preset second constraint is determined according to the following formula: in, Indicates the preset second constraint, Represents the error between sensors, express Time sensor With sensor The error function between Indicates The sensor coordinate system to the The vector representation of the transformation between the sensor coordinate systems, express Time sensor and sensors Information matrix of all , Represents a set of natural numbers, a set Represents the sensor pair ( , ) between the associated pairs; The determining corresponding sensor parameters based on the sensor objective function includes: Solving the sensor objective function to determine sensor parameters corresponding to minimum values of the preset first constraint and the preset second constraint; The sensor objective function is determined according to the following formula: in, Indicates the preset first constraint, Indicates the preset second constraint, represents the error between the sensor and the odometer, Represents the error between sensors, represents the weight coefficient, represents the sensor parameters, represents the sensor parameters obtained by solving the sensor objective function at the last moment, express The information matrix of the moment, represents the sensor parameters obtained by solving the sensor objective function.
2. The method according to claim 1, characterized in that The preset information matrix is determined according to the following formula: in, represents the preset information matrix, represents the information matrix of the preset first constraint, represents the information matrix of the preset second constraint, express The amount of vehicle control at the time, represents elementary row transformation, represents the sensor obtained by solving the sensor objective function Parameters, represents the sensor obtained by solving the sensor objective function Parameters, set Represents the sensor pair ( , ) between observable transformations; The first function is determined according to the following formula: in, represents the vehicle control quantity, express The amount of vehicle control at any given moment, represents the preset information matrix, represents the standard function, Represents a set of controlling constraints.
3. The method according to claim 1, characterized in that: The method further includes: for any sensor, calculating each sensor parameter, and determining to update a sub-information matrix corresponding to each sensor based on each sensor parameter, wherein the sub-information matrix is a subset of the target information matrix.
4. A sensor parameter calibration device, characterized in that: The device comprises: A vehicle control amount module, used to determine a first function based on a preset information matrix, and solve the first function to determine the vehicle control amount corresponding to the minimum value of the preset information matrix, wherein the preset information matrix is a function of the vehicle control amount and sensor parameters; a sensor parameter determination module, used for updating a preset first constraint and a preset second constraint based on the vehicle control amount, and calculating a sensor objective function based on the updated preset first constraint and the preset second constraint, so as to determine corresponding sensor parameters based on the sensor objective function, wherein the preset first constraint is used to characterize the relative transformation relationship between the odometer and the sensor, the preset second constraint is used to characterize the relative transformation relationship between sensors, and the sensor objective function is determined by fusing the preset first constraint and the preset second constraint; A matrix updating module, used for updating the preset information matrix based on the sensor parameters, obtaining a target information matrix, and determining a value of the target information matrix trace; a target parameter determination module, configured to determine a target parameter of a sensor corresponding to the target information matrix when the value of the target information matrix trace is not greater than a preset threshold; The sensor parameter determination module includes: A second constraint updating unit, used to determine the posture of the sensor relative to the odometer within the target time and the error function between the sensors at the target time according to the vehicle control amount, wherein the error function between the sensors is used to update the preset second constraint; An error function determination unit, configured to perform vector processing on the posture of the sensor relative to the odometer within the target time, and determine the sensor observation error function within the target time; A first constraint updating unit, configured to determine a calibration target of the sensor relative to the odometer based on the sensor observation error function within the target time, so as to determine the preset first constraint; The preset first constraint is determined according to the following formula: in, Indicates the preset first constraint, represents the error between the sensor and the odometer, Indicates time arrive Sensors The observation error function is Indicates The vector representation of the transformation from the sensor coordinate system to the vehicle coordinate system, express Moment The information matrix of sensors; The preset second constraint is determined according to the following formula: in, Indicates the preset second constraint, Represents the error between sensors, express Time sensor With sensor The error function between Indicates The sensor coordinate system to the The vector representation of the transformation between the sensor coordinate systems, express Time sensor and sensors Information matrix of all , Represents a set of natural numbers, a set Represents the sensor pair ( , ) between the associated pairs; The sensor parameter determination module also includes: A parameter determination unit, used for solving the sensor objective function to determine the sensor parameters corresponding to the minimum values of the preset first constraint and the preset second constraint; The sensor objective function is determined according to the following formula: in, Indicates the preset first constraint, Indicates the preset second constraint, represents the error between the sensor and the odometer, Represents the error between sensors, represents the weight coefficient, represents the sensor parameters, represents the sensor parameters obtained by solving the sensor objective function at the last moment, express The information matrix of the moment, represents the sensor parameters obtained by solving the sensor objective function.
5. A computer device, characterized in that: include: A memory and a processor, wherein the memory and the processor are communicatively connected to each other, the memory stores computer instructions, and the processor executes the sensor parameter calibration method according to any one of claims 1 to 3 by executing the computer instructions.
6. A computer-readable storage medium, characterized in that: The computer-readable storage medium stores computer instructions, and the computer instructions are used to enable a computer to execute the sensor parameter calibration method according to any one of claims 1 to 3.
