Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Image pickup apparatus, image processing apparatus, image processing method, program and recording medium

a technology of image processing and image pickup, which is applied in the direction of panoramic photography, television systems, instruments, etc., can solve the problems of inability to obtain desirable composite images, inability to accurately calculate the moving distance between images, and high cost of memory area, so as to reduce the memory area for storing images and detect accurately

Inactive Publication Date: 2010-03-04
SONY CORP
View PDF7 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Benefits of technology

[0007]In any of the above-mentioned methods, it is important to calculate accurate moving distances between sequentially captured images in order to combine the images seamlessly. In addition, it is necessary to temporarily store the sequentially captured images before composing a panoramic image. It is desirable to minimize a memory area to temporarily store the images in order to keep the cost of the memory area low.
[0010]Accordingly, it is desirable to provide an image pickup apparatus, an image processing apparatus, an image processing method, a program, and a recording medium for enabling the accurate detection of moving distances, the reduction of a memory area, the easy shooting as intended by a photographer.
[0016]In embodiments of the present invention, because moving distances between images are detected based on the images with a wide first field angle, the moving distances can be detected accurately. In embodiments of the present invention, a memory area to store the images can be reduced because only images with a second field angle that is less than the first field angle are stored. In addition, in embodiments of the present invention, undesirable movement of an imaging apparatus, for example, in a direction perpendicular to the moving direction of the imaging apparatus can be reduced by displaying an image with a wide first field angle on a display unit during shooting, so that the shooting can be easily performed as intended by a photographer.

Problems solved by technology

Therefore, if the moving distances between images are calculated from the images with a narrow slit-like angle of view, there is a high possibility that objects with some features are not included in images in the overlap areas, so that it often happens that the accurate calculation of the moving distances between images may not be obtained.
As mentioned above, if the accurate calculation of the moving distances between images may not be obtained, misalignments at the junctions of the images become conspicuous when a panoramic image is composed by combining a plurality of images, with the result that a desirable composite image may not be obtained.
On the other hand, if moving distances are calculated from images with a wide angle of view (wide field angle), the accuracy of the calculation of the moving distances between images is improved, but because a large memory area to temporarily store the sequentially captured images may be provided, the cost of the memory area becomes high.
In addition, when capturing a panoramic image, an imaging apparatus is often caused to move undesirably, so that it is difficult to capture a panoramic image easily as intended by a photographer.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image pickup apparatus, image processing apparatus, image processing method, program and recording medium
  • Image pickup apparatus, image processing apparatus, image processing method, program and recording medium
  • Image pickup apparatus, image processing apparatus, image processing method, program and recording medium

Examples

Experimental program
Comparison scheme
Effect test

first embodiment

1. First Embodiment

[0030]FIG. 1 is a block diagram showing a configuration of an image pickup apparatus 1 according to a first embodiment. The image pickup apparatus 1 according to the first embodiment includes a lens system 10, an image pickup device 11, an image signal processing unit 12, a display unit 13, a moving-distance-detection image temporary storing unit 14, a moving distance detecting unit 15, a moving distance storing unit 16, a partial image storing unit 17, a panorama composing unit 18, and a recording medium 19.

[0031]In the image pickup apparatus 1, the image of an object is captured by the image pickup device 11 through the lens system 10. A CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, or the like is used as the image pickup device 11. The image of the object captured by the image pickup device 11 is converted into an electric signal (image pickup signal) by the image pickup device 11. The image pickup device 11 has a ...

second embodiment

2. Second Embodiment

[0043]An image pickup apparatus 2 according to a second embodiment will be described below. FIG. 3 is a block diagram showing a configuration of the image pickup apparatus 2 according to the second embodiment. The image pickup apparatus 2 includes a lens system 10, an image pickup device 11, an image signal processing unit 12, a display unit 13, a moving distance detecting unit 15, a moving distance storing unit 16, a partial image storing unit 17, a panorama composing unit 18, a recording medium 19, and a wide-field-angle image temporary storing unit 21. Compared with the above-mentioned image pickup apparatus 1 according to the first embodiment, the image pickup apparatus 2 is different in the following points. Specifically, the image pickup apparatus 2 is different from the image pickup apparatus 1 in that the image pickup apparatus 2 includes the wide-field-angle image temporary storing unit 21 instead of the moving-distance-detection image temporary storing ...

third embodiment

3. Third Embodiment

[0055]An image pickup apparatus 3 according to a third embodiment will be described below. FIG. 6 is a block diagram showing a configuration example of an image pickup apparatus 3 according to a third embodiment. The image pickup apparatus 3 includes a lens system 10, an image pickup device 11, an image signal processing unit 12, a display unit 13, a moving-distance-detection image temporary storing unit 14, a moving distance detecting unit 15, a moving distance storing unit 16, a partial image storing unit 17, a panorama composing unit 18, a recording medium 19, a partial image compressing unit 23, and a partial image decompressing unit 25. Compared with the above-mentioned image pickup apparatus 1 according to the first embodiment, the image pickup apparatus 3 is different in the following points. Specifically, the image pickup apparatus 3 is different from the image pickup apparatus 1 in that the image pickup apparatus 3 includes the partial image compressing u...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

An image pickup apparatus includes an image pickup device that converts an image entering through a lens system into a captured image; a display unit that displays an image with a first field angle obtained from the captured image that is currently being shot; a moving distance detecting unit that detects a moving distance between images with the first field angle based on a plurality of images with the first angle sequentially captured; a partial image storing unit that stores an image with a second field angle that is less than the first field angle; and a panorama composing unit that composes a panoramic image based on a plurality of images with the second field angle stored in the partial image storing unit and the moving distances between the images with the first field angle that are respectively associated with the plurality of images with the second field angle.

Description

CROSS-REFERENCE TO RELATED APPLICATION[0001]The present application claims priority from Japanese Patent Application No. JP 2008-227582 filed in the Japanese Patent Office on Sep. 4, 2008, the entire content of which is incorporated herein by reference.BACKGROUND OF THE INVENTION[0002]1. Field of the Invention[0003]The present invention relates to image pickup apparatuses, image processing apparatuses, image processing methods, programs and recording media for composing panoramic images from images captured with an image pickup apparatus being moved.[0004]2. Description of the Related Art[0005]In recent years, various camera systems for capturing panoramic images have been proposed. These camera systems are roughly categorized into multi-eyed camera systems in which the whole image of a wide field of view is captured at once using a camera with multiple lenses and single-eyed camera systems in which individual images constituting a wide field of view are continuously captured using ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(United States)
IPC IPC(8): H04N7/00G06T3/00H04N23/40
CPCG03B37/00H04N5/23238H04N5/23293H04N23/698H04N23/63
Inventor HAYASHI, NAOKIKIMURA, ATSUSHISHIKATA, YASUHITO
Owner SONY CORP
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products