Test method and test system based on depth estimation performance of depth camera

A depth camera and depth estimation technology, applied in computing, image data processing, instruments, etc., can solve problems such as single scene, poor performance of depth estimation performance, difficulty in reflecting the performance of depth estimation of the entire image, etc., to achieve high The effect of precision

Pending Publication Date: 2020-12-18
上海西虹桥导航技术有限公司
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, the evaluation of the depth estimation performance of the depth camera often adopts the test and evaluation of a single feature point or the test and evaluation based on the calibration board. The test and evaluation based on a single feature point has a certain degree of one-sidedness and it is difficult to reflect the performance of the depth estimation of the entire image. Based on The test and evaluation method of the calibration board has the problem of a single scene and cannot well represent the depth estimation performance in actual use.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Test method and test system based on depth estimation performance of depth camera
  • Test method and test system based on depth estimation performance of depth camera
  • Test method and test system based on depth estimation performance of depth camera

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0036] In view of the deficiencies of the existing testing methods, this embodiment proposes a testing method for the depth map of the depth camera, which obtains the true value of the depth map through laser total station sweeping, joint calibration of the camera and total station, and point cloud back projection , to conduct a more comprehensive evaluation by directly comparing the depth map, and at the same time have rich scenes that are not limited by physical devices, and have higher accuracy. Provide more objective, comprehensive and effective R&D and testing services for the performance of depth cameras to accelerate the development process and problem iterations of depth cameras. For this purpose, a corresponding test method for depth estimation performance of depth cameras and a laser total station, scene props, The calibration board, the camera bracket, and the computer form a set of test system to realize the above test method. The current method is aimed at a depth ...

Embodiment 2

[0095] refer to figure 2 The figure shows a laser total station 100 , a test scene 200 , a depth camera 300 , a host computer 400 , a checkerboard calibration board 500 , and an environment control device 600 . In this embodiment, a test system based on the depth estimation performance of a depth camera is proposed, including a depth camera 300 , a computer, and a laser total station 100 . More specifically, the depth camera 300 is a sensor to be tested, capable of acquiring depth maps, color or black and white images; the computer (ie, the host computer 400) is used to collect images and depth information output by the depth camera, and is capable of calibration and data analysis and processing equipment , and the computer is equipped with relevant SDK and codes collected by the depth camera 300, algorithm codes for calibration of internal and external parameters, relevant codes for reading and analyzing total station data, and relevant algorithm codes for data processing an...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a test method and a test system based on depth estimation performance of a depth camera. The test method comprises the following steps of constructing a scene, and erecting thedepth camera and a laser total station; storing the color image and the depth image; the laser total station scanning the field to obtain a projected color image and a depth map; evaluating an overlap degree projection error between the projected color image and a color image acquired by a camera; if the projection error does not meet the requirement, carrying out calibration again; and if a projection error meets the requirement, comparing and evaluating the depth map acquired by the camera and the depth map projected by the total station pixel by pixel, and calculating the error condition of depth estimation of the depth camera. The method is advantaged in that the true value of the depth map is obtained through field scanning of the laser total station, joint calibration of the cameraand the total station and point cloud back projection, more comprehensive evaluation is conducted by directly comparing the depth map, meanwhile, rich scenes are provided, physical equipment is not limited, and higher precision is achieved.

Description

technical field [0001] The invention relates to the technical field of sensor testing, in particular to a testing method and testing system based on the depth estimation performance of a depth camera. Background technique [0002] In recent years, a depth camera refers to a visual sensor with depth measurement capabilities. It has been widely used in unmanned systems such as robots, drones, and unmanned vehicles. The depth camera obtains the depth value of each pixel in the image. It is mainly divided into three methods: binocular, structured light, and light time of flight to form a depth map containing depth information. [0003] At present, the evaluation of the depth estimation performance of the depth camera often adopts the test and evaluation of a single feature point or the test and evaluation based on the calibration board. The test and evaluation based on a single feature point has a certain degree of one-sidedness and it is difficult to reflect the performance of ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06T7/521G06T7/80G06T7/90
CPCG06T7/521G06T7/80G06T7/90
Inventor 郁文贤裴凌刘海春李岚臻
Owner 上海西虹桥导航技术有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products