Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Non-line-of-sight image reconstruction method, device and system and computer readable storage medium

An image reconstruction, non-line-of-sight technology, applied in the field of non-line-of-sight imaging, can solve the problems of time-consuming and non-line-of-sight imaging difficulties, and achieve the effect of fast parallel non-line-of-sight imaging

Pending Publication Date: 2021-12-24
宁波未感半导体科技有限公司
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, since the current non-line-of-sight imaging method requires the laser to use galvanometer scanning to collect data, and the mechanical movement of the galvanometer takes time, and each scanning point needs to be exposed separately, the time to acquire a frame of image can be as long as Minutes or even hours, it is very difficult to obtain high-resolution real-time or near-real-time non-line-of-sight imaging

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Non-line-of-sight image reconstruction method, device and system and computer readable storage medium
  • Non-line-of-sight image reconstruction method, device and system and computer readable storage medium
  • Non-line-of-sight image reconstruction method, device and system and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0058] Please refer to figure 1 and 2 , this embodiment proposes a non-line-of-sight image reconstruction method, which can be applied to scenes that require non-line-of-sight imaging, such as industrial monitoring, vehicle navigation, and collision avoidance.

[0059] Such as figure 1 As shown, in a non-line-of-sight imaging scene, there are usually non-line-of-sight targets, relays (here, a relay wall is taken as an example) and occluders. Since the target is occluded, it is impossible to directly obtain the Therefore, the non-line-of-sight image reconstruction method of this embodiment will use lasers, optical sensor array components, etc. to obtain the image of the occluded target object. In addition, the data collected by the optical sensor array will be synchronized to the computer and other terminal equipment , to perform data analysis and finally obtain the reconstructed image of the target object.

[0060] Among them, the laser is mainly used to emit high-frequency...

Embodiment 2

[0111] Please refer to Figure 7 , based on the method of the above-mentioned embodiment 1, this embodiment also proposes a non-line-of-sight image reconstruction method. The difference from the above-mentioned embodiment 1 is that the above-mentioned embodiment is mainly based on the modulated illumination phasor of a virtual light source with a set frequency. reconstruction, and this embodiment performs reconstruction by combining at least two modulated illumination phasors, so as to optimize the reconstructed image quality during non-line-of-sight imaging.

[0112] Exemplarily, the non-line-of-sight image reconstruction method includes:

[0113] Step S310, controlling the laser to emit laser light to the relay surface, receiving photons reflected by the relay surface to the sensor array through the sensor array, obtaining photon distribution data at each pixel point in the sensor array, and pre-processing the photon distribution data deal with.

[0114] Wherein, step S310...

Embodiment 3

[0127] Please refer to Figure 8 , based on the method of Embodiment 1 or 2 above, this embodiment also proposes a non-line-of-sight image reconstruction device 100. Exemplarily, the non-line-of-sight image reconstruction device 100 includes:

[0128] The acquisition module 110 is configured to control the laser to emit laser light to the relay surface, receive photons reflected by the relay surface to the sensor array through the sensor array, obtain photon distribution data at each pixel point in the sensor array, and Preprocessing is performed on the photon distribution data.

[0129] The extraction module 120 is configured to perform frequency-domain transformation on the modulated lighting phasor constructed based on a virtual light source with a preset frequency to extract main frequency components, and perform frequency-domain transformation on the preprocessed photon distribution data to obtain frequency-domain photon distribution data, extracting main photon distribu...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a non-line-of-sight image reconstruction method, device and system and a computer readable storage medium. The method comprises the following steps: controlling a laser to emit laser to a relay surface, and receiving photons reflected to a sensor array through the relay surface through the sensor array, so as to obtain the photon distribution data of each pixel point; extracting a main frequency component from the preprocessed photon distribution data by using a modulation illumination phasor constructed by a virtual light source so as to obtain main photon distribution data; calculating an equivalent receiving phasor according to the main frequency component of the modulation illumination phasor and the main photon distribution data; and performing back projection on the equivalent receiving phasor to reconstruct an image of the shielded target object. According to the technical scheme of the invention, through a mode of reconstructing a scene based on a sensor array and a phasor field, galvanometer-free scanning and rapid parallel non-line-of-sight imaging can be realized.

Description

technical field [0001] The present application relates to the technical field of non-line-of-sight imaging, and in particular to a non-line-of-sight image reconstruction method, device, system, and computer-readable storage medium. Background technique [0002] Non-line-of-sight imaging uses narrow-pulse light sources and time-sensitive optical sensors to image hidden non-line-of-sight scenes from multiple diffuse reflections by computational optics to reconstruct the occluded scene geometry. This special capability makes non-line-of-sight imaging have broad application prospects in the fields of planetary research, industrial monitoring, vehicle navigation and collision avoidance, law enforcement, and military intelligence. [0003] In time-of-flight non-line-of-sight imaging measurements, a point on the relay surface is illuminated by pulsed laser light, which in turn illuminates the hidden scene after scattering, and a time-of-flight detector captures the light signal ret...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06T5/00G06T7/514
CPCG06T7/514G06T2207/10012G06T2207/10052G06T5/00
Inventor 顾超颖杨川川陈浩严伟振
Owner 宁波未感半导体科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com