Automatic test method for camera calibration precision and related equipment

Through automated testing tools, the true value car and camera identification data are structured and time-aligned, which solves the problem of low manual testing efficiency and realizes rapid automated testing of camera calibration accuracy, reducing costs and improving efficiency.

CN119048888APending Publication Date: 2024-11-29TUS CLOUD CONTROL (BEIJING) TECH LTD
View PDF 0 Cites 1 Cited by

Patent Information

Application Number
CN202410873436.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-07-01
Publication Date
2024-11-29

AI Technical Summary

Technical Problem

In the prior art, manual camera calibration accuracy tests are used to consume a lot of time and human resources, and the test efficiency is low, so the accuracy test of camera positioning cannot be completed quickly.

Method used

An automated testing tool is adopted to obtain true vehicle trajectory data and original camera identification data, and perform data structure and time alignment, and automatically compare the two to calculate camera calibration accuracy errors, providing position positioning, heading angle and speed accuracy test results.

Benefits of technology

Automatic testing of camera calibration accuracy is realized, which significantly reduces test time, reduces manual analysis costs and improves testing efficiency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119048888A_ABST
    Figure CN119048888A_ABST
Patent Text Reader

Abstract

The invention provides an automatic test method for camera calibration precision and related equipment, and the method comprises the steps: obtaining true-value vehicle track data and original camera recognition data, the true-value vehicle track data being real-time vehicle track data collected when a selected true-value vehicle runs in a preset area, and the original camera recognition data being real-time vehicle track data collected when the selected true-value vehicle runs in the preset area; the original camera identification data is vehicle track data identified by an original camera through an algorithm; starting an automatic test tool, and inputting the true-value vehicle track data and the original camera identification data into the automatic test tool; and the automatic test tool automatically compares the true value vehicle track data with the original camera identification data to carry out camera calibration precision test, and a test result of the camera calibration precision is obtained. According to the invention, for the vehicle track data corresponding to the true value vehicle and the original camera, a full-automatic test process from data structuring to precision test through a time alignment method is completed, automatic test analysis of camera calibration precision is realized, and the efficiency of camera calibration precision test is improved.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to the technical field of camera calibration, and in particular to an automated testing method for camera calibration accuracy and related equipment. Background Art

[0002] Camera calibration is a basic work in computer vision and is of great significance in applications such as perception recognition and target prediction in autonomous driving. For a monocular camera, the calibration process is the process of obtaining the internal and external parameters of the camera. The accuracy and stability of camera calibration have an important impact on subsequent computer vision tasks and applications, so it is very important to test the accuracy of camera calibration.

[0003] For analysis scenarios such as multiple intersections or road sections where cameras are deployed, the camera calibration accuracy is tested and verified by manual data processing. This method consumes a lot of time and human resource costs, has low test efficiency, and cannot quickly complete the camera positioning accuracy test. Summary of the invention

[0004] The present invention provides an automated testing method for camera calibration accuracy and related equipment, aiming to solve the problem of low testing efficiency in the prior art of performing camera calibration accuracy testing in a manual data processing manner.

[0005] The purpose of the present invention is achieved by the following technical solutions:

[0006] In a first aspect, the present invention provides an automated testing method for camera calibration accuracy, comprising:

[0007] Acquire true value vehicle trajectory data and original camera recognition data, wherein the true value vehicle trajectory data is real-time vehicle trajectory data collected by RTK equipment when the selected true value vehicle is driving in a preset area, and the original camera recognition data is vehicle trajectory data recognized by the original camera through an algorithm;

[0008] Activate an automated testing tool, and input the true value vehicle trajectory data and the original camera recognition data into the automated testing tool;

[0009] The automated testing tool automatically compares the true value vehicle trajectory data and the original camera recognition data to perform a camera calibration accuracy test to obtain a test result of the camera calibration accuracy.

[0010] According to an automated testing method for camera calibration accuracy provided by the present invention, the true value vehicle trajectory data and the original camera recognition data both include data information of latitude and longitude, speed, heading angle and timestamp;

[0011] The step of the automated testing tool automatically comparing the true value vehicle trajectory data with the original camera recognition data to perform a positioning accuracy test to obtain a test result of the camera calibration accuracy includes:

[0012] The true value vehicle trajectory data and the original camera recognition data are respectively structured to obtain the true value vehicle structured data and the original camera structured data containing the vehicle trajectory timestamp;

[0013] The true value vehicle structured data and the original camera structured data are time-aligned according to the vehicle trajectory timestamp, and the camera calibration accuracy error is calculated for the aligned true value vehicle structured data and the original camera structured data to obtain the test result.

[0014] According to an automated testing method for camera calibration accuracy provided by the present invention, according to the test requirements, the corresponding camera calibration accuracy test type is selected on the interface provided by the automated testing tool, wherein the test type includes: at least one of: position positioning accuracy test, heading angle accuracy test and speed accuracy test.

[0015] According to an automated test method for camera calibration accuracy provided by the present invention, when the selected test type is a position positioning accuracy test, the obtained test results include: a position positioning accuracy comparison analysis summary graph and a position positioning accuracy comparison trend graph;

[0016] The step of time-aligning the true value vehicle structured data and the original camera structured data according to the vehicle trajectory timestamp, and calculating the camera calibration accuracy error of the aligned true value vehicle structured data and the original camera structured data to obtain the test result includes:

[0017] Respectively obtain the true vehicle longitude and latitude and the true vehicle timestamp of each frame of data in the true vehicle trajectory data, and the camera longitude and latitude and the camera timestamp of each frame of data in the original camera recognition data;

[0018] Using the timestamp of each frame of the true value vehicle trajectory data as a reference timestamp, aligning the camera timestamp of the original camera recognition data, and after completing the time alignment, determining the two closest data frames according to the camera timestamps closest to each of the reference timestamps, so as to form at least one data frame group;

[0019] For the two closest data frames in each data frame group, the position error between the two data frames is calculated according to the corresponding true value vehicle longitude and latitude and the camera longitude and latitude to obtain the corresponding test result.

[0020] According to an automated test method for camera calibration accuracy provided by the present invention, when the selected test type is a heading angle accuracy test, the test results obtained include: a heading angle accuracy comparison analysis summary graph and a heading angle accuracy comparison trend graph;

[0021] The step of time-aligning the true value vehicle structured data and the original camera structured data according to the vehicle trajectory timestamp, and calculating the camera calibration accuracy error of the aligned true value vehicle structured data and the original camera structured data to obtain the test result includes:

[0022] Respectively obtain the true value vehicle heading angle and the true value vehicle timestamp of each frame of data in the true value vehicle trajectory data, and the camera heading angle and the camera timestamp of each frame of data in the original camera recognition data;

[0023] Using the timestamp of each frame of the true value vehicle trajectory data as a reference timestamp, aligning the camera timestamp of the original camera recognition data, and after completing the time alignment, determining the two closest data frames according to the camera timestamps closest to each of the reference timestamps, so as to form at least one data frame group;

[0024] For the two closest data frames in each data frame group, the heading angle error between the two data frames is calculated according to the corresponding true value vehicle heading angle and the camera heading angle to obtain the corresponding test result.

[0025] According to an automated test method for camera calibration accuracy provided by the present invention, when the selected test type is a speed accuracy test, the obtained test results include: a speed accuracy comparison analysis summary graph and a speed accuracy comparison trend graph;

[0026] The step of time-aligning the true value vehicle structured data and the original camera structured data according to the vehicle trajectory timestamp, and calculating the camera calibration accuracy error of the aligned true value vehicle structured data and the original camera structured data to obtain the test result includes:

[0027] Respectively obtaining the true vehicle speed and the true vehicle timestamp of each frame of data in the true vehicle trajectory data, and the camera speed and the camera timestamp of each frame of data in the original camera recognition data;

[0028] Using the timestamp of each frame of the true value vehicle trajectory data as a reference timestamp, aligning the camera timestamp of the original camera recognition data, and after completing the time alignment, determining the two closest data frames according to the camera timestamps closest to each of the reference timestamps, so as to form at least one data frame group;

[0029] For the two closest data frames in each data frame group, the speed error between the two data frames is calculated according to the corresponding true value vehicle speed and the camera speed to obtain the corresponding test result.

[0030] According to an automated testing method for camera calibration accuracy provided by the present invention, after the step of selecting a corresponding camera calibration accuracy test type on an interface provided by the automated testing tool, the method further comprises:

[0031] Obtain parameter data that affects the camera calibration accuracy test, input the parameter data into the automated testing tool, and use the parameter data in the camera calibration accuracy error calculation process, wherein the parameter data includes: calibration point information and camera delay time.

[0032] In a second aspect, the present invention provides an electronic device, the electronic device comprising:

[0033] one or more processors;

[0034] and a memory storing computer program instructions, wherein when the computer program instructions are executed, the processor executes the steps of any of the above-mentioned automated testing methods for camera calibration accuracy.

[0035] In a third aspect, the present invention provides a computer-readable storage medium having a computer program / instruction stored thereon, which, when executed by a processor, implements the steps of the automated testing method for camera calibration accuracy as described in any one of the above.

[0036] In a fourth aspect, the present invention provides a computer program product, comprising a computer program / instruction, which, when executed by a processor, implements the steps of the automated testing method for camera calibration accuracy as described in any one of the above.

[0037] The present invention provides an automated testing method and related equipment for camera calibration accuracy, which obtains true value vehicle trajectory data and original camera recognition data, wherein the true value vehicle trajectory data is the real-time vehicle trajectory data collected by the RTK device when the selected true value vehicle is driving in a preset area, and the original camera recognition data is the vehicle trajectory data recognized by the original camera through an algorithm; the automated testing tool is enabled, and the true value vehicle trajectory data and the original camera recognition data are input into the automated testing tool; the automated testing tool automatically compares the true value vehicle trajectory data and the original camera recognition data to perform a camera calibration accuracy test to obtain a test result of the camera calibration accuracy. Compared with the prior art that uses manual data processing and analysis to test and verify the camera calibration accuracy, the present invention uses an automated testing tool to complete the fully automatic testing process from data structuring to accuracy testing through a time alignment method for the vehicle trajectory data corresponding to the true value vehicle and the original camera, thereby realizing automated testing and analysis of camera calibration accuracy, greatly reducing the time of camera calibration accuracy testing, reducing the cost of manual analysis, and improving the efficiency of camera calibration accuracy testing. BRIEF DESCRIPTION OF THE DRAWINGS

[0038] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other implementation methods can be obtained based on these drawings without paying any creative work.

[0039] Figure 1 This is one of the flow charts of the automated testing method for camera calibration accuracy provided by an embodiment of the present invention;

[0040] Figure 2 This is a second flow chart of the automated testing method for camera calibration accuracy provided by an embodiment of the present invention;

[0041] Figure 3 It is a structural schematic diagram of the electronic device provided by the present invention. DETAILED DESCRIPTION

[0042] The above description is only an overview of the technical solution of the present invention. In order to more clearly understand the technical means of the present invention, it can be implemented in accordance with the contents of the specification. In order to make the above and other purposes, features and advantages of the present invention more obvious and easy to understand, the following specifically cites a preferred embodiment and describes it in detail with the accompanying drawings as follows.

[0043] It should be noted that it is explicitly and implicitly understood by those of ordinary skill in the art that the embodiments described in the present invention can be combined with other embodiments without conflict. Unless otherwise defined, the technical terms or scientific terms involved in the present invention should be the usual meanings understood by people with ordinary skills in the technical field to which the present invention belongs. The words "one", "a", "a", "the" and the like involved in the present invention do not indicate a quantitative limitation and may represent the singular or plural. The terms "including", "comprising", "having" and any of their variations involved in the present invention are intended to cover non-exclusive inclusions; the terms "first", "second", "third", etc. involved in the present invention are merely to distinguish similar objects and do not represent a specific ordering of objects.

[0044] When it comes to method steps, the sequence illustrated in this document represents an exemplary solution, but does not mean a limitation on the sequence.

[0045] The applicant found that in the process of camera calibration for autonomous driving of vehicles, we need to test and verify the accuracy of the camera calibration algorithm. The relevant indicators that can reflect whether the vehicle trajectory is accurately positioned include position, speed, heading angle, etc. In the scenario where cameras are deployed at different intersections or sections of the road, how to quickly verify the accuracy of indicators of different camera points is a problem of concern to those skilled in the art. In the prior art, the test and verification of camera calibration accuracy is performed by manual data processing and analysis, which consumes a lot of time and human resource costs. As the speed of algorithm iteration becomes faster and faster, it is impossible to quickly perform corresponding accuracy tests on the calibration results. Therefore, an embodiment of the present invention provides an automated test method and related equipment for camera calibration accuracy, which aims to realize the whole process of camera calibration accuracy testing for a large number of points, so as to reduce human resource costs and comprehensively improve the efficiency of the overall test.

[0046] Reference Figure 1 , 2 As shown, an automatic testing method for camera calibration accuracy provided by an embodiment of the present invention includes:

[0047] Step S1: Obtain true value vehicle trajectory data and original camera recognition data, wherein the true value vehicle trajectory data is the real-time vehicle trajectory data collected by the RTK device when the selected true value vehicle is driving in a preset area, and the original camera recognition data is the vehicle trajectory data recognized by the original camera through the algorithm.

[0048] Among them, the true value vehicle can be a vehicle equipped with a positioning device, which can be a motorcycle, car, van, truck, bus, etc. The vehicle can have assisted driving or automatic driving functions. The selected true value vehicle is tested at a normal road traffic speed in the set driving area. By installing RTK (Real Time Kinematic, real-time dynamic measurement) equipment on the vehicle, the true value vehicle records the real-time vehicle trajectory data of the vehicle, such as the latitude and longitude, speed, heading angle and vehicle trajectory timestamp data information of the real-time trajectory of the vehicle. If the true value vehicle leaves the set driving area, the collection of the real-time vehicle trajectory data of the vehicle will be stopped.

[0049] When the driving truth car obtains the real-time vehicle trajectory data, the original camera is turned on simultaneously to perform target recognition through the algorithm, identify the vehicle trajectory target, and then obtain the corresponding vehicle trajectory data at a fixed frequency of 10Hz. The vehicle trajectory data also includes the corresponding longitude and latitude, speed, heading angle and vehicle trajectory timestamp data information.

[0050] Step S2: Activate the automated testing tool and input the true value vehicle trajectory data and the original camera recognition data into the automated testing tool.

[0051] Among them, the automated testing tool is a tool used to implement the accuracy test of camera calibration accuracy. The true vehicle trajectory data and the original camera recognition data are input into the automated testing tool. The automated testing tool outputs the comparison results of indicators for determining the accuracy of camera calibration accuracy, such as position positioning accuracy comparison results, heading angle accuracy comparison results, speed accuracy comparison results, etc.

[0052] According to the test requirements, select the corresponding camera calibration accuracy test type on the interface provided by the automated test tool, wherein the test type includes: at least one of a position positioning accuracy test, a heading angle accuracy test, and a speed accuracy test.

[0053] Step S3: The automated testing tool automatically compares the true value vehicle trajectory data and the original camera recognition data to perform a camera calibration accuracy test to obtain a test result of the camera calibration accuracy.

[0054] In this embodiment, step S3 specifically includes:

[0055] Step S31: respectively structuring the true value vehicle trajectory data and the original camera recognition data to obtain the true value vehicle structured data and the original camera structured data containing the vehicle trajectory timestamp;

[0056] Step S32: Time-align the true value vehicle structured data and the original camera structured data according to the vehicle trajectory timestamp, and calculate the camera calibration accuracy error of the aligned true value vehicle structured data and the original camera structured data to obtain a test result.

[0057] The true value vehicle trajectory data and camera recognition data are structured according to the automated testing tool. The structured data mainly includes information such as vehicle trajectory timestamp, trajectory longitude and latitude, speed and heading angle.

[0058] The automated testing tool is used to time-align the true value vehicle structured data and the original camera structured data according to the vehicle trajectory timestamp. After the data is aligned, the error calculation of the camera calibration accuracy of the position positioning and / or heading angle and / or speed is automatically performed, and finally the corresponding comparative analysis summary diagram and comparative trend diagram are obtained. Therefore, the entire process of camera calibration accuracy automation testing is realized, which reduces the cost of manual analysis and improves the efficiency of camera calibration accuracy test verification. The test results are displayed in a visual form for accuracy test statistical analysis and graphical comparison, making the test results more intuitive and efficient.

[0059] When the selected test type is a position positioning accuracy test, the obtained test results include: a position positioning accuracy comparison analysis summary chart and a position positioning accuracy comparison trend chart; correspondingly, step S32 specifically includes:

[0060] Step S32A1: respectively obtaining the true vehicle longitude and latitude and the true vehicle timestamp of each frame of data in the true vehicle trajectory data, and the camera longitude and latitude and the camera timestamp of each frame of data in the original camera recognition data;

[0061] Step S32A2: using the timestamp of each frame of the true value vehicle trajectory data as a reference timestamp, aligning the camera timestamp of the original camera recognition data, and after completing the time alignment, determining the two closest data frames according to the camera timestamps closest to each reference timestamp, so as to form at least one data frame group;

[0062] Step S32A3: For the two closest data frames in each data frame group, the position error between the two data frames is calculated according to the corresponding true value vehicle longitude and latitude and camera longitude and latitude to obtain the corresponding test result.

[0063] Specifically, the true vehicle longitude and latitude and the true vehicle timestamp of each frame of data in the true vehicle trajectory data, as well as the camera longitude and latitude and camera timestamp of each frame of data in the original camera recognition data are respectively obtained; the true vehicle timestamp of each frame of data in the true vehicle trajectory data is used as the reference timestamp, and the camera timestamp of the original camera recognition data is aligned with it. After completing the time alignment, the camera timestamp closest to each reference timestamp is found, and the data frames corresponding to the reference timestamp and the camera timestamp closest to it are determined as the two closest data frames to form at least one data frame group; according to the true vehicle longitude and latitude and the camera longitude and latitude corresponding to the two data frames, the geodesic distance between the two longitudes is calculated by the geodesic calculation formula to obtain the position error between the two data frames in each data frame group, and then the position error is graphically obtained in the form of a related position positioning accuracy comparison analysis summary diagram and a position positioning accuracy comparison trend diagram.

[0064] When the selected test type is the heading angle accuracy test, the obtained test results include: a heading angle accuracy comparison analysis summary chart and a heading angle accuracy comparison trend chart; correspondingly, step S32 specifically includes:

[0065] Step S32B1: respectively obtaining the true value vehicle heading angle and the true value vehicle timestamp of each frame of data in the true value vehicle trajectory data, and the camera heading angle and the camera timestamp of each frame of data in the original camera recognition data;

[0066] Step S32B2: using the timestamp of each frame of the true value vehicle trajectory data as a reference timestamp, aligning the camera timestamp of the original camera recognition data, and after completing the time alignment, determining the two closest data frames according to the camera timestamps closest to each reference timestamp, so as to form at least one data frame group;

[0067] Step S32B3: For the two closest data frames in each data frame group, the heading angle error between the two data frames is calculated according to the corresponding true value vehicle heading angle and camera heading angle to obtain the corresponding test result.

[0068] Specifically, the true vehicle heading angle and the true vehicle timestamp of each frame of data in the true vehicle trajectory data, as well as the camera heading angle and the camera timestamp of each frame of data in the original camera recognition data are respectively obtained; the true vehicle timestamp of each frame of data in the true vehicle trajectory data is used as the reference timestamp, and the camera timestamp of the original camera recognition data is aligned therewith, and after completing the time alignment, the camera timestamp closest to each reference timestamp is found, and the data frames corresponding to the reference timestamp and the camera timestamp closest thereto are determined as the two closest data frames to form at least one data frame group; for each data frame group, the heading angle error between the true vehicle heading angle and the camera heading angle corresponding to the two data frames is calculated, and then the heading angle error is graphically obtained to obtain the relevant heading angle accuracy comparison analysis summary diagram and heading angle accuracy comparison trend diagram.

[0069] When the selected test type is a speed accuracy test, the obtained test results include: a speed accuracy comparison analysis summary chart and a speed accuracy comparison trend chart; correspondingly, step S32 specifically includes:

[0070] Step S32C1: respectively obtaining the true value vehicle speed and the true value vehicle timestamp of each frame of data in the true value vehicle trajectory data, and the camera speed and the camera timestamp of each frame of data in the original camera recognition data;

[0071] Step S32C2: using the timestamp of each frame of the true value vehicle trajectory data as a reference timestamp, aligning the camera timestamp of the original camera recognition data, and after completing the time alignment, determining the two closest data frames according to the camera timestamps closest to each reference timestamp, so as to form at least one data frame group;

[0072] Step S32C3: For the two closest data frames in each data frame group, the speed error between the two data frames is calculated according to the corresponding true value vehicle speed and camera speed to obtain the corresponding test result.

[0073] Specifically, the true vehicle speed and true vehicle timestamp of each frame of data in the true vehicle trajectory data, as well as the camera speed and camera timestamp of each frame of data in the original camera recognition data are obtained respectively; the true vehicle timestamp of each frame of data in the true vehicle trajectory data is used as the reference timestamp, and the camera timestamp of the original camera recognition data is aligned with it. After completing the time alignment, the camera timestamp closest to each reference timestamp is found, and the data frames corresponding to the reference timestamp and the camera timestamp closest to it are determined as the closest two data frames to form at least one data frame group; for each data frame group, the speed error between the true vehicle speed and the camera speed corresponding to the two data frames is calculated, and then the speed error is graphically obtained to obtain the relevant speed accuracy comparison analysis summary diagram and speed accuracy comparison trend diagram.

[0074] In this embodiment, after the step of selecting the corresponding camera calibration accuracy test type on the interface provided by the automated testing tool, the following steps are further included:

[0075] Obtain the parameter data that affects the camera calibration accuracy test, input the parameter data into the automated testing tool, and use the parameter data in the process of calculating the camera calibration accuracy error. The parameter data includes: calibration point information and camera delay time. After selecting the required test type on the interface provided by the automated testing tool, fill in the calibration point information and camera delay time and other parameter data that affect the accuracy test in the corresponding input box of the graphical interface. Use the parameter data in the process of calculating the camera calibration accuracy error, so that the accuracy error calculation result is more accurate, so as to further improve the accuracy of the camera calibration accuracy test verification.

[0076] In summary, the present invention provides an automated testing method for camera calibration accuracy, which obtains true value vehicle trajectory data and original camera recognition data, wherein the true value vehicle trajectory data is the real-time vehicle trajectory data collected by the RTK device when the selected true value vehicle is driving in a preset area, and the original camera recognition data is the vehicle trajectory data recognized by the original camera through the algorithm; the automated testing tool is enabled, and the true value vehicle trajectory data and the original camera recognition data are input into the automated testing tool; the automated testing tool automatically compares the true value vehicle trajectory data and the original camera recognition data to perform a camera calibration accuracy test to obtain a test result of the camera calibration accuracy. Compared with the prior art that uses manual data processing and analysis to test and verify the camera calibration accuracy, the present invention uses an automated testing tool to complete the fully automatic testing process for the vehicle trajectory data corresponding to the true value vehicle and the original camera, from data structuring to accuracy testing through a time alignment method, and realizes the automated testing and analysis of the camera calibration accuracy of large-scale positioning, which greatly reduces the time of camera calibration accuracy testing, reduces the cost of manual analysis, and improves the efficiency of camera calibration accuracy testing.

[0077] In addition, some embodiments of the present application also provide an electronic device. The electronic device may be a digital computer in various forms, such as a laptop computer, a desktop computer, a workbench, a personal digital assistant, a server, a blade server, a mainframe computer, etc. The electronic device may also be a mobile device in various forms, such as a personal digital processing, a cellular phone, a smart phone, a wearable device, and other similar computing devices.

[0078] The electronic device includes: one or more processors; and a memory storing computer program instructions, wherein when the computer program instructions are executed, the processor executes the steps of the automated testing method for camera calibration accuracy provided in any one or more of the above embodiments. Figure 3An exemplary structural diagram of the electronic device is disclosed. Figure 3 As shown, the electronic device includes: one or more processors 1101, memory 1102, and interfaces for connecting various components, including high-speed interfaces and low-speed interfaces. The various components are connected to each other using different buses and can be installed on a common mainboard or installed in other ways as needed. The processor can process instructions executed in the electronic device, including instructions stored in or on the memory to display graphical information of the GUI on an external input / output device (such as a display device coupled to the interface). In some other embodiments, if necessary, multiple processors and / or multiple buses can be used together with multiple memories and multiple memories. Similarly, multiple electronic devices can be connected, and each device provides some necessary operations (for example, as a server array, a group of blade servers, or a multi-processor system). Among them, the components shown in this article, their connections and relationships, and their functions are only used as examples, and are not intended to limit the implementation of the present application described and / or required herein.

[0079] The electronic device may further include: an input device 1103 and an output device 1104. The processor 1101, the memory 1102, the input device 1103 and the output device 1104 may be connected via a bus or other means. Figure 3 The example of connecting through bus is taken in the following.

[0080] The input device 1103 can receive input digital or character information, and generate key signal input related to the user settings and function control of the electronic device, such as a touch screen, a keypad, a mouse, a track pad, a touch pad, an indicator bar, one or more mouse buttons, a trackball, a joystick and other input devices. The output device 1104 may include a display device, an auxiliary lighting device (e.g., an LED) and a tactile feedback device (e.g., a vibration motor), etc. The display device may include, but is not limited to, a liquid crystal display (LCD), a light emitting diode (LED) display and a plasma display. In some embodiments, the display device may be a touch screen.

[0081] To provide interaction with a user, the electronic device may be a computer. The computer has: a display device (e.g., a CRT (cathode ray tube) or LCD (liquid crystal display) monitor) for displaying information to the user; and a keyboard and a pointing device (e.g., a mouse or a trackball), through which the user can provide input to the computer. Other types of devices may also be used to provide interaction with the user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).

[0082] In the embodiment of the present application, a computer program / instruction is stored on a computer-readable medium, and when the computer program / instruction is executed by a processor, the steps of the automated test method for camera calibration accuracy provided in any one or more of the above embodiments are implemented. The computer-readable medium may be included in the electronic device described in the above embodiment; or it may exist independently without being assembled into the device. The above computer-readable medium carries one or more computer-readable instructions.

[0083] The memory 1102 can be used as a non-transient computer-readable storage medium, which can be used to store non-transient software programs, non-transient computer executable programs and modules. The processor 1101 executes various functional applications and data processing of the server by running the non-transient software programs, instructions and modules stored in the memory 1102, so as to implement the program instructions / modules corresponding to the method provided by any one or more embodiments in the embodiments of the present application.

[0084] The memory 1102 may include a program storage area and a data storage area, wherein the program storage area may store an operating system, an application required for at least one function; the data storage area may store data created according to the use of the electronic device, etc. In addition, the memory 1102 may include a high-speed random access memory, and may also include a non-transient memory, such as at least one disk storage device, a flash memory device, or other non-transient solid-state storage device. In some embodiments, the memory 1102 may optionally include a memory remotely arranged relative to the processor 1101, and these remote memories may be connected to the electronic device via a network. Examples of the above-mentioned network include, but are not limited to, the Internet, an intranet, a local area network, a mobile communication network, and combinations thereof.

[0085] It should be noted that more specific examples of computer-readable storage media may include, but are not limited to: an electrical connection with one or more wires, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination thereof. In the present application, a computer-readable storage medium may be any tangible medium containing or storing a program that may be used by or in conjunction with an instruction execution system, apparatus, or device.

[0086] Computer readable storage media include permanent and non-permanent, removable and non-removable media, and can be implemented by any method or technology to store information. Information can be computer readable instructions, data structures, modules of programs or other data. Examples of computer storage media include, but are not limited to, phase change memory (PRAM), static random access memory (SRAM), dynamic random access memory (DRAM), other types of random access memory (RAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), flash memory or other memory technology, read-only compact disk (CD-ROM), digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape disk storage or other magnetic storage devices or any other non-transmission medium that can be used to store information that can be accessed by a computing device.

[0087] Computer program code for performing the operations of the present application may be written in one or more programming languages ​​or a combination thereof, including object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" or similar programming languages. The program code may be executed entirely on the user's computer, partially on the user's computer, as a separate software package, partially on the user's computer and partially on a remote computer, or entirely on a remote computer or server. In cases involving a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer (e.g., via the Internet using an Internet service provider).

[0088] In the above-described embodiments, it can be implemented in whole or in part by software, hardware, firmware or any combination thereof. For example, it can be implemented by using an application specific integrated circuit (ASIC), a general-purpose computer or any other similar hardware device. In certain embodiments, the software program of the present application can be executed by a processor to implement the above steps or functions. Similarly, the software program of the present application (including relevant data structures) can be stored in a computer-readable recording medium, for example, a RAM memory, a magnetic or optical drive or a floppy disk and similar devices. In addition, some steps or functions of the present application can be implemented by hardware, for example, as a circuit that cooperates with a processor to perform each step or function.

[0089] The computer program product provided in the embodiment of the present application includes one or more computer programs / instructions, and when the computer program / instructions are executed by the processor, the process or function described in the embodiment of the present application is generated in whole or in part. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or other programmable devices. The computer instructions may be stored in a computer-readable storage medium, or transmitted from a computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, a computer, a server or a data center by wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) mode to another website site, computer, server or data center. The computer-readable storage medium may be any available medium that a computer can access or a data storage device such as a server or a data center that includes one or more available media integrations. The available medium may be a magnetic medium, (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a DVD), or a semiconductor medium (e.g., a solid state disk (SSD)), etc.

[0090] The flow chart or block diagram in the accompanying drawings shows the possible architecture, function and operation of the equipment, method and computer program product according to various embodiments of the present application. In this regard, each box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some alternative implementations, the functions marked in the box can also occur in a different order from the order marked in the accompanying drawings. For example, two boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each box in the block diagram and / or flow chart, and the combination of the boxes in the block diagram and / or flow chart can be implemented with a dedicated system for hardware that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

[0091] The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any person skilled in the art can easily mention changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims, and the above embodiments should be regarded as exemplary and non-restrictive.

Claims

1. An automated testing method for camera calibration accuracy, characterized in that: include: Acquire true value vehicle trajectory data and original camera recognition data, wherein the true value vehicle trajectory data is real-time vehicle trajectory data collected by RTK equipment when the selected true value vehicle is driving in a preset area, and the original camera recognition data is vehicle trajectory data recognized by the original camera through an algorithm; Activate an automated testing tool, and input the true value vehicle trajectory data and the original camera recognition data into the automated testing tool; The automated testing tool automatically compares the true value vehicle trajectory data and the original camera recognition data to perform a camera calibration accuracy test to obtain a test result of the camera calibration accuracy.

2. The automated test method for camera calibration accuracy according to claim 1, characterized in that: The true value vehicle trajectory data and the original camera recognition data both include data information of longitude and latitude, speed, heading angle and timestamp; The step of the automated testing tool automatically comparing the true value vehicle trajectory data with the original camera recognition data to perform a positioning accuracy test to obtain a test result of the camera calibration accuracy includes: The true value vehicle trajectory data and the original camera recognition data are respectively structured to obtain the true value vehicle structured data and the original camera structured data containing the vehicle trajectory timestamp; The true value vehicle structured data and the original camera structured data are time-aligned according to the vehicle trajectory timestamp, and the camera calibration accuracy error is calculated for the aligned true value vehicle structured data and the original camera structured data to obtain the test result.

3. The automated test method for camera calibration accuracy according to claim 2, characterized in that: According to the test requirements, the corresponding camera calibration accuracy test type is selected on the interface provided by the automated testing tool, wherein the test type includes at least one of a position positioning accuracy test, a heading angle accuracy test, and a speed accuracy test.

4. The automated test method for camera calibration accuracy according to claim 3, characterized in that: When the selected test type is a position positioning accuracy test, the obtained test results include: a position positioning accuracy comparison analysis summary chart and a position positioning accuracy comparison trend chart; The step of time-aligning the true value vehicle structured data and the original camera structured data according to the vehicle trajectory timestamp, and calculating the camera calibration accuracy error of the aligned true value vehicle structured data and the original camera structured data to obtain the test result includes: Respectively obtain the true vehicle longitude and latitude and the true vehicle timestamp of each frame of data in the true vehicle trajectory data, and the camera longitude and latitude and the camera timestamp of each frame of data in the original camera recognition data; Using the timestamp of each frame of the true value vehicle trajectory data as a reference timestamp, aligning the camera timestamp of the original camera recognition data, and after completing the time alignment, determining the two closest data frames according to the camera timestamps closest to each of the reference timestamps, so as to form at least one data frame group; For the two closest data frames in each data frame group, the position error between the two data frames is calculated according to the corresponding true value vehicle longitude and latitude and the camera longitude and latitude to obtain the corresponding test result.

5. The automated testing method for camera calibration accuracy according to claim 3, characterized in that: When the selected test type is a heading angle accuracy test, the test results obtained include: a heading angle accuracy comparison analysis summary graph and a heading angle accuracy comparison trend graph; The step of time-aligning the true value vehicle structured data and the original camera structured data according to the vehicle trajectory timestamp, and calculating the camera calibration accuracy error of the aligned true value vehicle structured data and the original camera structured data to obtain the test result includes: Respectively obtain the true value vehicle heading angle and the true value vehicle timestamp of each frame of data in the true value vehicle trajectory data, and the camera heading angle and the camera timestamp of each frame of data in the original camera recognition data; Using the timestamp of each frame of the true value vehicle trajectory data as a reference timestamp, aligning the camera timestamp of the original camera recognition data, and after completing the time alignment, determining the two closest data frames according to the camera timestamps closest to each of the reference timestamps, so as to form at least one data frame group; For the two closest data frames in each data frame group, the heading angle error between the two data frames is calculated according to the corresponding true value vehicle heading angle and the camera heading angle to obtain the corresponding test result.

6. The automated test method for camera calibration accuracy according to claim 3, characterized in that: When the selected test type is a speed accuracy test, the obtained test results include: a speed accuracy comparison analysis summary graph and a speed accuracy comparison trend graph; The step of time-aligning the true value vehicle structured data and the original camera structured data according to the vehicle trajectory timestamp, and calculating the camera calibration accuracy error of the aligned true value vehicle structured data and the original camera structured data to obtain the test result includes: Respectively obtain the true value vehicle speed and the true value vehicle timestamp of each frame of data in the true value vehicle trajectory data, and the camera speed and the camera timestamp of each frame of data in the original camera recognition data; Using the timestamp of each frame of the true value vehicle trajectory data as a reference timestamp, aligning the camera timestamp of the original camera recognition data, and after completing the time alignment, determining the two closest data frames according to the camera timestamps closest to each of the reference timestamps, so as to form at least one data frame group; For the two closest data frames in each data frame group, the speed error between the two data frames is calculated according to the corresponding true value vehicle speed and the camera speed to obtain the corresponding test result.

7. The automated testing method for camera calibration accuracy according to claim 3, characterized in that: After the step of selecting a corresponding camera calibration accuracy test type on the interface provided by the automated testing tool, the method further includes: Obtain parameter data that affects the camera calibration accuracy test, input the parameter data into the automated testing tool, and use the parameter data in the camera calibration accuracy error calculation process, wherein the parameter data includes: calibration point information and camera delay time.

8. An electronic device, characterized in that: The electronic device comprises: one or more processors; and a memory storing computer program instructions, wherein when the computer program instructions are executed, the processor executes the steps of the automated testing method for camera calibration accuracy as described in any one of claims 1 to 7.

9. A computer-readable storage medium having a computer program / instruction stored thereon, characterized in that: When the computer program / instructions are executed by a processor, the steps of the automated testing method for camera calibration accuracy as described in any one of claims 1 to 7 are implemented.

10. A computer program product comprising a computer program / instructions, characterized in that When the computer program / instruction is executed by a processor, the steps of the automated testing method for camera calibration accuracy as described in any one of claims 1 to 7 are implemented.

Citation Information

Cited By

  • Automatic test performance benchmark construction method and device and storage medium

    CN120388255A