Multi-camera in-loop simulation test method and system facing panoramic vision perception

Abstract

The present invention discloses a multi-camera in-loop simulation test method facing panoramic vision perception. The method comprises the steps of: establishing a target traffic scene model by employing an industrial personal computer, collecting panoramic image data by a camera, uploading the panoramic image data to a display screen, performing location parameter calibration of the camera by employing a sensor calibration module, performing feature point detection and matching and retaining effective matching pairs to complete image stitching and fusion, employing a target panoramic perception algorithmic routine to perform vision perception of the environment around a vehicle in real time, and finally, performing comparison and verification of the perception result obtained through thepanoramic perception algorithm and all the panoramic image data of virtual modeling to analyze the panoramic perception algorithm to obtain an in-loop simulation test estimation result. The multi-camera in-loop simulation test method facing panoramic vision perception generates a target panoramic image based on a virtual scene, the system provided by the invention comprises complete virtual traffic scene information to automatically perform image real information and perception information verification to perform estimation so as to greatly reduce human cost, consider the human marking errorsand improve the accuracy of estimation of the perception information result.

Description

technical field [0001] The invention relates to the technical field related to data acquisition, in particular to a multi-camera in-the-loop simulation test method and system for panoramic vision. Background technique [0002] With the rapid development of computer and microelectronic technology, the development of intelligent technology is getting faster and faster, the degree of intelligence is getting higher and higher, and the scope of application has also been greatly expanded. The intelligent driving system is based on the rapid development of automotive electronics technology, covering multiple disciplines such as electronics, computers, machinery, and sensor technology. Autonomous intelligent driving vehicle is the development direction of future automobiles, and it is also a means of transportation that has a revolutionary impact on road traffic. With the breakthrough and improvement of core technologies such as artificial intelligence and sensor detection, as well...

AI Technical Summary

Problems solved by technology

[0003] In smart driving cars, the surrounding environment is sensed by the camera sensor, and then the automatic driving of the smart car is realized through decision-making control. In many cases, a single camera layout cannot meet the needs of smart cars, such as a rear camera is required for reversing; Smart logistics vehicles need a side camera to sense the use of the storage box on the side of the vehicle; more generally, in order to improve driving safety, it is necessary to take 360-degree shots of the surrounding environment without dead ends

Images