Combining data from multiple image sensors

a technology of image data and data, applied in the field of combining data from multiple image sensors, can solve the problems of synchronization and alignment challenges, the filtering of image data from multiple sensors, and the complexity of interleaving such image data, so as to avoid stream contamination

Inactive Publication Date: 2011-10-06
QUALCOMM INC
View PDF15 Cites 270 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

[0021]One particular advantage provided by at least one of the disclosed embodiments is that a single image signal processor may be used to synchronize and control image data from multiple image sensors. Another particular advantage is that having gaps between streams offers the flexibility of processing the combined stream in an image signal processor as a single frame, and avoids contamination of streams by subsequent block-based processing (i.e., if the gap is equal with the biggest block-based processing contamination of streams is avoided).

Problems solved by technology

Combining image data from each of the sensors typically involves performing frame synchronization and line synchronization, which may result in synchronization and alignment challenges.
In addition, filtering of image data from multiple sensors and interleaving such image data may be further complicated when source sensors provide data at different frequencies or phases.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Combining data from multiple image sensors
  • Combining data from multiple image sensors
  • Combining data from multiple image sensors

Examples

Experimental program
Comparison scheme
Effect test

embodiment 300

[0062]The image signal processor 208 is configured to process the line data 218 and to generate processed line data 240. In a particular embodiment, the processed line data 240 may be provided as processed frame data. While two sensors have been shown, it should be understood that other embodiments may include more than two sensors. For example, FIG. 3 depicts an embodiment 300 that includes more than two sensors. An Nth sensor 305 is configured to generate an Nth data stream, illustrated as an Nth image data stream 315. The Nth image data stream 315 includes an Nth data line 325. The Nth sensor 305 may be substantially similar to the first and second image sensors 202, 204 and may receive the common control signal 234 from the sensor synchronizer 230, enabling the first, second, and Nth sensors 202, 204, 305 to generate closely aligned data streams 212, 214, 315. For example, the data streams 212, 214, 315 may have substantially the same timing characteristics, such as frequency an...

second embodiment

[0085]Referring to FIG. 7, a diagrammatic representation of a first data stream at an output of a first image sensor and a second data stream at an output of a second image sensor being combined to form a synchronized data line is depicted and generally designated as 700. A first sensor, such as the first image sensor 202 of FIG. 2, generates a first data stream 702 that corresponds to first image data of an image. A second sensor, such as the second image sensor 204 of FIG. 2, generates a second data stream 704 that corresponds to second image data of the image. Data from the first data stream 702 and data from the second data stream 704 are combined to form a data out data stream 706.

[0086]In a particular embodiment, the first data stream 702 includes data associated with a first line of the first image data of the image and the second data stream 704 includes data associated with a corresponding line of the second image data of the image. The first data stream 702 includes line d...

first embodiment

[0091]Referring to FIG. 8, a diagrammatic representation of a phase diagram illustrating a two line phase difference between a first data stream from a first sensor and a second data stream from a second sensor is depicted and generally designated 800. A first sensor, such as the first sensor 202 of FIG. 2, generates a first data stream that includes first sensor first line data 802, first sensor second line data 804, and first sensor third line data 806. A second sensor, such as the second sensor 204 of FIG. 2, generates a second data stream that includes second sensor first line data 812, second sensor second line data 814, and second sensor third line data 816. Data from the first data stream and data from the second data stream are combined to form a combined line 820. In the particular embodiment illustrated in FIG. 8, first, second and third line data is illustrated. Alternatively, any number of line data may be generated (e.g., 720 lines as illustrated in FIGS. 6 and 7).

[0092...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

A method of combining data from multiple sensors is disclosed. The method includes providing a common control signal to multiple image sensors. Each of the multiple image sensors is responsive to the common control signal to generate image data. The method also includes receiving synchronized data output from each of the multiple image sensors, combining the synchronized data output from each of the multiple image sensors to generate a synchronized data line, and providing the synchronized data line to an image processor via a single camera input of the image processor.

Description

PRIORITY CLAIM[0001]This application claims the benefit of, and incorporates by reference, each of U.S. Provisional Application No. 61 / 320,940 filed Apr. 5, 2010, U.S. Provisional Application No. 61 / 324,259 filed Apr. 14, 2010, U.S. Provisional Application No. 61 / 359,312 filed Jun. 28, 2010, and U.S. Provisional Application No. 61 / 412,755, filed Nov. 11, 2010.FIELD[0002]The present disclosure is generally related to combining data from multiple image sensors.DESCRIPTION OF RELATED ART[0003]Advances in technology have resulted in smaller and more powerful computing devices. For example, there currently exist a variety of portable personal computing devices, including wireless computing devices, such as portable wireless telephones, personal digital assistants (PDAs), and paging devices that are small, lightweight, and easily carried by users. More specifically, portable wireless telephones, such as cellular telephones and internet protocol (IP) telephones, can communicate voice and d...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(United States)
IPC IPC(8): H04N5/228H04N13/239
CPCH04N5/2258H04N5/232H04N5/23238H04N13/0296H04N9/045H04N13/0048H04N13/0239H04N5/247H04N13/239H04N13/161H04N13/296H04N23/45H04N23/665H04N23/698H04N23/90H04N23/10H04N25/134
Inventor GOMA, SERGIU R.HWANG, HAUCHEUNG, JOSEPHALEKSIC, MILIVOJE
Owner QUALCOMM INC
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap