Check patentability & draft patents in minutes with Patsnap Eureka AI!

Event camera-based high-speed structured light three-dimensional reconstruction system and reconstruction method

A 3D reconstruction and structured light technology, which is applied in 3D modeling, details related to processing steps, image data processing, etc., can solve problems such as high power consumption, limited transmission bandwidth of limited cameras, and lack of high-speed 3D measurement. Achieve the effect of improving scanning speed and accuracy

Pending Publication Date: 2021-10-08
UNIV OF SCI & TECH OF CHINA
View PDF3 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The traditional structured light system is limited by the limited transmission bandwidth of the camera (the scanning speed is usually 30 to 60 frames per second), which is far from meeting the requirements of high-speed three-dimensional measurement
Although the structured light system using a high-speed camera can achieve high-speed measurement results, it is often criticized for its high price and high power consumption.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Event camera-based high-speed structured light three-dimensional reconstruction system and reconstruction method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0021] Event Camera is a new type of retina-like sensor, which can respond to local brightness changes and has the advantages of low latency (1 microsecond), high dynamic range (140dB), and low power consumption (1mW). These characteristics of event cameras are very suitable for application in the field of structured light. However, the unique imaging mechanism of event cameras hinders their further application in structured light systems. In recent years, there have been some related researches on structured light systems based on event cameras in foreign countries: Brandli et al. used lasers to flash at a fixed frequency and projected onto the surface of objects to trigger events, and then scanned the objects in rows with lasers to restore the three-dimensional results of the objects ; Mangalore et al. use a projector to continuously project moving stripes to trigger events, which is equivalent to scanning lines in parallel. However, these existing structured light systems ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an event camera-based high-speed structured light three-dimensional reconstruction system and reconstruction method, and the method comprises the steps: generating random speckles, projecting the random speckles to the surface of a target object through a projector, triggering an event after the random speckles are reflected, and generating an event flow; for the event stream received by the event camera, converting the event stream into a picture frame form by adopting a self-adaptive event frame extraction algorithm; taking an event frame extracted from the data containing the target object as a deformation frame; taking the event frame extracted from the other group of data not containing the target object as a reference frame, and calculating the pixel offset between the reference frame and the deformation frame; and carrying out triangulation by combining the offset with the spatial positions of the event camera and the projector to obtain a three-dimensional point cloud of the object, and completing three-dimensional reconstruction.

Description

technical field [0001] The invention relates to the field of computer image processing, in particular to a high-speed structured light three-dimensional reconstruction system and reconstruction method based on an event camera. Background technique [0002] A structured light system usually consists of a projector and a camera. The projector projects a picture template containing specific structural information to the surface of the object, and the camera synchronously collects the corresponding pictures. The position and depth information of the object is calculated by comparing the original image template with the image template offset by the reflection of the object. The traditional structured light system is limited by the limited transmission bandwidth of the camera (the scanning speed is usually 30 to 60 frames per second), which is far from meeting the requirements of high-speed three-dimensional measurement. Although the structured light system using a high-speed cam...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06T17/00G06T17/20
CPCG06T17/00G06T17/20G06T2200/08
Inventor 张越一熊志伟黄雪岩
Owner UNIV OF SCI & TECH OF CHINA
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More