Systems and methods for determining depth from multiple views of a scene that include aliasing using hypothesized fusion

a technology of multiple views and depth, applied in the field of super resolution processing, can solve the problems of affecting the overall form factor of the mobile device, image sensors are subject to various performance constraints,

Inactive Publication Date: 2013-03-21
FOTONATION CAYMAN LTD
View PDF2 Cites 290 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

[0038]In still another additional embodiment, light is prevented from entering the pixel stacks through the gaps between the microlenses by a light blocking material.

Problems solved by technology

Image sensors are subject to various performance constraints including, among others, dynamic range, signal to noise (SNR) ratio and low light sensitivity.
A challenge associated with increasing the number of pixels in an image sensor is that the lens system is dimensioned to span the image sensor.
The problem is most acute with mobile cameras, such as those used in mobile phones and consumer electronics devices, where the form factor of the lens system can significantly impact the overall form factor of the mobile device.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Systems and methods for determining depth from multiple views of a scene that include aliasing using hypothesized fusion
  • Systems and methods for determining depth from multiple views of a scene that include aliasing using hypothesized fusion
  • Systems and methods for determining depth from multiple views of a scene that include aliasing using hypothesized fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0060]Turning now to the drawings, systems and methods for controlling the amount of aliasing in images captured by an array camera and for synthesizing higher resolution images from the captured images using super resolution (SR) processing in accordance with embodiments of the invention are illustrated. Images exhibit aliasing when they are sampled at too low a sampling frequency, resulting in visible steps on diagonal lines or edges (also referred to as “jaggies”) and artificial low frequency patterns (often referred to as Moiré). These artifacts are a product of the incorrect sampling of higher frequencies, which results in the higher frequencies folding back (being aliased) into lower frequencies. Aliasing is generally undesirable, however, array cameras in accordance with embodiments of the invention can utilize the high frequency information folded into the lower frequencies during SR processing. In a SR process, low resolution (LR) images that include sampling diversity (i.e...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Array cameras in accordance with embodiments of the invention perform super resolution processing using images of a scene that contain aliasing. In several embodiments, the depth of pixels is determined by fusing portions of a higher resolution image at a number of hypothesized depths and determining the depth at which the portion of the higher resolution image best matches the scene captured in the lower resolution images used to fuse the higher resolution image.

Description

RELATED APPLICATIONS[0001]This application claims priority to U.S. Provisional Application 61 / 536,500 filed Sep. 19, 2011, the disclosure of which is incorporated herein by reference.FIELD OF THE INVENTION[0002]The present invention relates to super resolution processing and more specifically to super resolution processes that determine pixel depth using multiple images of a scene captured from different viewpoints, where the captured images of the scene include aliasing.BACKGROUND[0003]In a typical imaging device, light enters through an opening (aperture) at one end of the imaging device and is directed to an image sensor by one or more optical elements such as lenses. The image sensor includes pixels that generate signals upon receiving light via the optical element. Commonly used image sensors include charge-coupled device image sensors (CCDs) and complementary metal-oxide semiconductor (CMOS) sensors.[0004]Conventional digital cameras typically achieve color separation by perfo...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(United States)
IPC IPC(8): G06K9/36H04N13/02H04N13/232
CPCH04N5/2258H04N13/0232H04N9/097H04N2013/0081H04N13/0271H04N13/232H04N13/271H04N23/45H04N25/41H04N23/951H04N23/16
Inventor CHATTERJEE, PRIYAMMOLINA, GABRIELLELESCU, DAN
Owner FOTONATION CAYMAN LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap