Unlock instant, AI-driven research and patent intelligence for your innovation.

System and Method for Field Calibrating Video and Lidar Subsystems Using Independent Measurements

Active Publication Date: 2018-06-28
AEVA INC
View PDF6 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

The invention combines measurements from a lidar system with images from a video system to create a three-dimensional image of a target with 6 degrees of freedom. The video and lidar systems are aligned by mapping features on the target using both systems. This allows for more accurate and detailed image data.

Problems solved by technology

Obtaining accurate three-dimensional (3D) images of a target using a two-dimensional (2D) video camera subsystem integrated with a three-dimensional lidar (laser radar) subsystem is difficult unless the two subsystems are calibrated with one another.
In particular, various moving mechanical parts included in or associated with the lidar subsystem (e.g., scanning mirrors and their alignment to one another and also to the laser beams) are susceptible to such changes.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • System and Method for Field Calibrating Video and Lidar Subsystems Using Independent Measurements
  • System and Method for Field Calibrating Video and Lidar Subsystems Using Independent Measurements
  • System and Method for Field Calibrating Video and Lidar Subsystems Using Independent Measurements

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0030]FIG. 1 illustrates a combined lidar and video camera system 100 (or three-dimensional measurement system 100) according to various implementations of the invention. Various implementations of the invention utilize synergies between lidar measurements and video images to resolve six degrees of freedom for motion of a target to a degree not otherwise possible with either a lidar or video camera alone.

[0031]Combined system 100 includes a lidar subsystem 130, a video subsystem 150, and a processing system 160. As illustrated, lidar subsystem 130 includes two or more lidar beam outputs 112 (illustrated as a beam 112A, a beam 1128, a beam 112(n−1), and a beam 112n); two or more reflected beam inputs 114 each corresponding to one of beams 112 (illustrated as a reflected beam 114A, a reflected beam 114B, a reflected beam 114(n−1), and a reflected beam 114n); two or more lidar outputs 116 each associated with a pair of beam 112 / reflected beam 114 (illustrated as a lidar output 116A ass...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

A system uses range and Doppler velocity measurements from a lidar subsystem and images from a video subsystem to estimate a six degree-of-freedom trajectory of a target. The video subsystem and the lidar subsystem may be aligned with one another, and hence calibrated, by determining, for example, a centroid of an iris determined from the lidar subsystem and a centroid of the iris determined from the video subsystem and determining a calibration offset between the two centroids.

Description

FIELD OF THE INVENTION[0001]The invention is generally related to calibrating video and lidar subsystems with one another and more particularly, to calibrating the video and lidar subsystems using independent measurements from each of these systems.BACKGROUND OF THE INVENTION[0002]Obtaining accurate three-dimensional (3D) images of a target using a two-dimensional (2D) video camera subsystem integrated with a three-dimensional lidar (laser radar) subsystem is difficult unless the two subsystems are calibrated with one another. Calibration may refer to the registration of the two subsystems with one another such that measurements of points on a surface made by the lidar subsystem are accurately mapped to the same points as measured by the video subsystem (or substantially so within the measurement tolerances, etc., of each subsystem). In other words, accurate three-dimensional images require correspondence between measurements of the 3D coordinates obtained from the lidar subsystem w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G01S7/497G06T7/70G06T7/80G01S7/4913G01S17/86G01S17/89
CPCG01S7/497G01S7/4972G06T7/70G06T7/80G01S17/89G06T2207/10028G06T2207/10016G01S17/42G01S17/58G01S17/66G01S7/4817G01S7/4913G01S17/86
Inventor SEBASTIAN, RICHARD L.ZHELEZNYAK, ANATOLEY T.
Owner AEVA INC
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More