Imaging device

The imaging device addresses the fixed overlap issue in compound eye cameras by allowing adjustable overlap and stereoscopic capture, enhancing imaging flexibility and depth perception.

JP2025163307APending Publication Date: 2025-10-28NIKON CORP
View PDF 7 Cites 0 Cited by

Patent Information

Application Number
JP2025138715
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2025-08-22
Publication Date
2025-10-28

AI Technical Summary

Technical Problem

Existing compound eye cameras have a fixed overlap between the imaging ranges of their units, limiting flexibility and functionality in capturing and stitching images.

Method used

An imaging device with two imaging units connected by a hinge-like connection unit, allowing adjustable overlap of their imaging ranges, and a control unit to manage image capture across various overlap states, including 360-degree and stereoscopic views.

Benefits of technology

Enables seamless image capture of a celestial sphere, stereoscopic viewing, and depth information generation, with adjustable overlap ranges for enhanced imaging capabilities.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2025163307000001_ABST
    Figure 2025163307000001_ABST
Patent Text Reader

Abstract

To provide an imaging device that can change the amount of overlap of photographing areas.SOLUTION: An imaging device comprises: two imaging parts connected by a connection part in which an overlapping range of the photographing areas of the two imaging parts is changed; and a control part for permitting the two imaging parts to perform imaging in a second state in which the photographing areas of the two imaging parts overlap in a second range in the middle of the process of changing the overlapping range of the photographing areas of the two imaging parts from a first state in which the photographing areas of the two imaging parts overlap in a first range to a third state in which the photographing areas of the two imaging parts overlap in a third range.SELECTED DRAWING: Figure 4
Need to check novelty before this filing date? Find Prior Art

Description

[Technical Field]

[0001] The present invention relates to an imaging device. [Background technology]

[0002] Compound eye cameras that capture parallax images for the right and left eyes are known (see Patent Document 1). The amount of overlap between the imaging ranges of the imaging units of the compound eye camera is fixed. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-188931 Summary of the Invention

[0004] An imaging device according to one aspect of the present invention includes two imaging units connected by a connection unit, and in which the overlapping range of their respective imaging ranges is changed, and a control unit that permits the two imaging units to capture images in a second state in which their respective imaging ranges overlap in a second range, while the overlapping range of their respective imaging ranges is being changed from a first state in which their respective imaging ranges overlap in a first range to a third state in which their respective imaging ranges overlap in a third range. [Brief explanation of the drawings]

[0005] [Figure 1] FIG. 1(a) is a schematic diagram of the imaging device according to this embodiment as seen from the front, and FIG. 1(b) is a schematic diagram of the imaging device as seen from the side. [Figure 2] 2(a) to 2(c) are schematic diagrams of the two imaging units in FIG. 1 as viewed from above, showing different open states of the two imaging units. [Figure 3] 3(a) to 3(e) are schematic diagrams showing the orientations of the two imaging units in various open states. [Figure 4] FIG. 1 is a diagram illustrating a configuration of an imaging device. [Figure 5]5A and 5B are schematic diagrams illustrating the operation of the display unit, with FIG. 5A showing the display unit when stored and FIG. 5B showing the display unit when in use. [Figure 6] FIG. 1 is a schematic diagram showing an imaging device and an object. [Figure 7] FIG. 2 is a schematic diagram illustrating a photographing range of an imaging device. [Figure 8] Figure 8(a) is a diagram showing the overlap range DUP when the opening angle θ=360 degrees, Figure 8(b) is a diagram showing the overlap range DUP when the opening angle θ=270 degrees, Figure 8(c) is a diagram showing the overlap range DUP when the opening angle θ=180 degrees, and Figure 8(d) is a diagram showing the overlap range DUP when the opening angle θ=90 degrees. DETAILED DESCRIPTION OF THE INVENTION

[0006] An imaging device according to one embodiment of the present invention has multiple imaging units. Each imaging unit has a lens (fisheye lens) for capturing an image over a range of 180 degrees or more, and an imaging element provided on the imaging plane of the fisheye lens. In each imaging unit, the imaging element captures the subject image captured by the fisheye lens. A lens that can capture an image over a range of 180 degrees or less may be used. Such an imaging device will be described in detail with reference to the drawings.

[0007] <External view of the imaging device> FIG. 1(a) is a schematic diagram of an imaging device 100 according to this embodiment, as viewed from the front, and FIG. 1(b) is a schematic diagram of the imaging device 100 as viewed from the side. FIGS. 2(a) to 2(c) are schematic diagrams of the two imaging units of the imaging device 100 of FIG. 1, as viewed from above, illustrating different opening states of the two imaging units. In the imaging device 100, a first imaging unit 200 and a second imaging unit 300 are supported by a connecting unit 400. The connecting unit 400 has a function similar to a hinge, and the first imaging unit 200 and the second imaging unit 300 can rotate around an axis Ax. This configuration allows the opening state of the second imaging unit 300 relative to the first imaging unit 200 (opening angle θ around the axis Ax) to be adjusted. In this example, the opening angle θ can be adjusted within a range from 360 degrees to 0 degrees.

[0008] Figures 1(a) and 1(b) both illustrate an open state where the opening angle is θ=360 degrees, while Figures 2(a) to 2(c) illustrate open states where the opening angles are θ=270 degrees, θ=180 degrees, and θ=90 degrees, respectively.

[0009] The imaging device 100 is provided with a rod-shaped grip portion 450. The grip portion 450 is provided along an axis Gx that is parallel to the axis Ax of the connection portion 400. The reason why the axis Gx of the grip portion 450 is not provided coaxially with the axis Ax of the connection portion 400 is to prevent the hand of the user holding the grip portion 450 from appearing in the first imaging unit 200 and the second imaging unit 300.

[0010] When using the imaging device 100, for example, a user holds the grip portion 450 of the imaging device 100 in their hand and holds it in front of their body, with the connection portion 400 facing the main subject (the direction of the arrow in FIG. 1(a)). If the main subject side (the direction of the arrow) is considered to be the front when viewed from the connection portion 400, the grip portion 450 is located behind the connection portion 400, and therefore the user's hand holding the grip portion 450 is unlikely to be captured in the first imaging unit 200 or the second imaging unit 300. At this time, the user holds the grip portion 450 in a direction perpendicular to the ground (floor surface) and faces the connection portion 400 of the imaging device 100 toward the main subject. In addition, if it is acceptable for the user's hands holding the grip portion 450 to be captured in the first imaging unit 200 and the second imaging unit 300, the axis Gx of the grip portion 450 may be arranged coaxially with the axis Ax of the connection portion 400.

[0011] A release button 810 is provided on the surface of the gripping unit 450 facing the connection unit 400, i.e., the surface that faces the main subject (indicated by the arrow) during photography. The release button 810 can be operated with the index finger. An open / close button 820 is provided on the opposite side (rear) of the gripping unit 450 from the connection unit 400. The open / close button 820 can be operated with the thumb. The operation unit 820 is used to open and close the first and second image capturing units 200 and 300 around the axis Ax of the connection unit 400. The open / close button 820 is configured, for example, with a rocker-type operating member. When one end is pressed, a signal is output to increase the opening angle θ, and when the other end is pressed, a signal is output to decrease the opening angle θ. The first and second image capturing units 200 and 300 may be opened and closed manually (to change the angle θ).

[0012] The first imaging unit 200 is provided with a fisheye lens 210, and the second imaging unit 300 is provided with a fisheye lens 310. Both the fisheye lens 210 and the fisheye lens 310 have an angle of view exceeding 180 degrees. Therefore, the first imaging unit 200 and the second imaging unit 300 can each capture an image of a range wider than a hemisphere. As a result, when capturing an image of a 360-degree celestial sphere in the horizontal and vertical directions at an opening angle θ=360 degrees (first opening state), a margin for stitching together the image captured by the first imaging unit 200 and the image captured by the second imaging unit 300 can be secured. Furthermore, at an opening angle θ=180 degrees (third opening state), images can be captured from different positions in the same direction over an area wider than a hemisphere.

[0013] <Various opening states> 3(a) to 3(e) are schematic diagrams showing the image capturing directions of the first image capturing unit 200 and the second image capturing unit 300 in various open states. The first image capturing unit 200 has a fisheye lens 210 and an image capturing element 220 disposed on the image capturing plane of the fisheye lens 210. The second image capturing unit 300 has a fisheye lens 310 and an image capturing element 320 disposed on the image capturing plane of the fisheye lens 310.

[0014] 3(a) is a diagram showing the first open state, which corresponds to the case of FIGS. 1(a) and 1(b). The imaging direction of the first imaging unit 200 and the imaging direction of the second imaging unit 300 are opposite and 180 degrees apart. Therefore, the optical axis X200 of the fisheye lens 210 constituting the optical system of the first imaging unit 200 and the optical axis X300 of the fisheye lens 310 constituting the optical system of the second imaging unit 300 are coaxial. As described above, in the first open state, an image of the celestial sphere is obtained by stitching together the image acquired by the first imaging unit 200 and the image acquired by the second imaging unit 300.

[0015] 3(b) is a diagram showing a second open state (180 degrees<opening angle θ<360 degrees), in which the direction of imaging by the first imaging unit 200 differs by θ-180 degrees from the direction of imaging by the second imaging unit 300. For example, when the opening angle θ=270 degrees, this corresponds to the case of FIG. 2(a), and the direction of imaging by the first imaging unit 200 differs by 270-180=90 degrees from the direction of imaging by the second imaging unit 300.

[0016] Figure 3(c) shows a third open state, which corresponds to the case of Figure 2(b). The imaging direction of the first imaging unit 200 and the imaging direction of the second imaging unit 300 are parallel. In other words, the optical axis X200 of the fisheye lens 210 that constitutes the optical system of the first imaging unit 200 and the optical axis X300 of the fisheye lens 310 that constitutes the optical system of the second imaging unit 300 are parallel and do not intersect.

[0017] 3(d) is a diagram showing a fourth open state (0 degrees < opening angle θ < 180 degrees), in which the imaging direction of the first imaging unit 200 and the imaging direction of the second imaging unit 300 differ by θ -180 degrees. For example, when the opening angle θ = 90 degrees, this corresponds to the case of FIG. 2(c), in which the imaging direction of the first imaging unit 200 and the imaging direction of the second imaging unit 300 differ by 90 - 180 = -90 degrees. When the imaging directions of the first imaging unit 200 and the second imaging unit 300 differ by a negative angle, the optical axes X200 and X300 of the imaging units intersect with each other.

[0018] 3(e) is a diagram showing the fifth open state (opening angle θ=0 degrees), in which the imaging direction of the first imaging unit 200 and the imaging direction of the second imaging unit 300 are opposite to each other. In other words, the optical axis X200 of the fisheye lens 210 that constitutes the optical system of the first imaging unit 200 and the optical axis X300 of the fisheye lens 310 that constitutes the optical system of the second imaging unit 300 are coaxial.

[0019] <Configuration of imaging device> The configuration of the imaging device 100 will be described with reference to the block diagram shown in Fig. 4. The imaging device 100 includes a first imaging section 200, a second imaging section 300, a connection section 400, a control section 500, a display control section 600, a display section 700, and an operation member 800, and is configured so that a storage medium 900 is detachable.

[0020] (First imaging unit 200, second imaging unit 300) As shown in FIG. 3(c), when the aperture angle θ is set to 180 degrees, the first and second image capture units 200 and 300 form a stereo camera with optical axes X200 and X300 spaced a predetermined distance L (referred to as the baseline length). The fisheye lenses 210 and 310 are, for example, equidistant projection fisheye lenses. In this configuration, the distance from each optical axis X200 or X300 in the images captured by the image capture elements 220 and 320 represents the direction of the target (subject). Furthermore, the difference in the position of the same target captured in the images captured by the image capture elements 220 and 320 represents parallax. Therefore, the distance to the target can be calculated using the principle of triangulation based on the image signals from the image capture elements 220 and 320. Obtaining distance information from the images captured by the image capture elements 220 and 320 of the stereo camera is also referred to as stereo matching. Light from the object passes through the fisheye lens 210 and enters the image sensor 220, and then passes through the fisheye lens 310 and enters the image sensor 320. Image signals output from the image sensor 220 of the first image capturing unit 200 and the image sensor 320 of the second image capturing unit 300 are each sent to the control unit 500.

[0021] (Connection part 400) The connection unit 400 is provided with an angle sensor 410 that detects the open state (opening angle θ around the axis Ax) between the first imaging unit 200 and the second imaging unit 300, and a drive unit 420 that changes the open state. The detection signal output from the angle sensor 410 is sent to the control unit 500. The drive unit 420 has a motor and a speed reduction mechanism that transmits the drive force of the motor to the first and second image capture units 200, 300. The drive unit 420 drives the motor based on a drive signal sent from the control unit 500, thereby rotating the first image capture unit 200 and the second image capture unit 300 in opposite directions around the axis Ax (FIG. 1) by an equal angle via the speed reduction mechanism. This controls the opening angle θ around the axis Ax.

[0022] (control unit 500) The control unit 500 is composed of a CPU, a ROM, a RAM, etc., and controls the operation of each unit of the imaging device 100 based on a control program. The control unit 500 includes an imaging control unit 510, a signal processing unit 520, a recording / reading control unit 530, and an opening / closing control unit 540.

[0023] The imaging control unit 510 causes the first imaging unit 200 and the second imaging unit 300 to perform imaging operations, respectively, based on an operation signal from the release button 810 of the operation member 800. The signal processing unit 520 performs predetermined signal processing on the image signals output from the imaging element 220 of the first imaging unit 200 and the imaging element 320 of the second imaging unit 300. In addition to interpolation processing and tone correction processing, the signal processing unit 520 can also perform conversion processing to convert the celestial spherical image into a two-dimensional image, for example, an equirectangular projection image. The imaging control unit 510 can determine whether or not imaging is possible based on the opening angle θ detected by the angle sensor 410. For example, in the first, second, third, and fourth opening states, the first imaging unit 200 and the second imaging unit 300 are permitted to capture images, and in the fifth opening state (opening angle θ=0 degrees), imaging is prohibited. The reason for prohibiting imaging in the fifth opening state is that the first imaging unit 200 and the second imaging unit 300 only capture images of each other and cannot actually capture images of other subjects.

[0024] The recording / reading control unit 530 performs a recording process to record image data captured by the first imaging unit 200 and the second imaging unit 300, respectively, and signal processed by the signal processing unit 520, onto the storage medium 900, and a reading process to read out the image data recorded on the storage medium 900.

[0025] Data of a first image captured by the first imaging unit 200, data of a second image captured by the second imaging unit 300, and information indicating the opening angle θ detected by the angle sensor 410 at the time of imaging are recorded in association with each other in the storage medium 900. By recording the information indicating the opening angle θ at the time of imaging, it becomes possible to determine an overlapping range DUP (FIGS. 7 and 8) where an imaging range B200 captured by the first imaging unit 200 and an imaging range B300 captured by the second imaging unit 300 overlap, which will be described later, based on the opening angle θ and design information of the optical systems of the first imaging unit 200 and the second imaging unit 300.

[0026] The opening / closing control unit 540 sends a drive signal to the drive unit 420 based on an operation signal from the opening / closing button 820 of the operation member 800. When the motor of the drive unit 420 is driven, the first and second imaging units 200, 300 rotate in opposite directions around the axis Ax of the connection unit 400, changing the opening angle θ. As described above, based on the operation signal from the opening / closing button 820, the opening / closing control unit 540 sends a drive signal to drive the drive unit 420 in a direction that increases the opening angle θ, or sends a drive signal to drive the drive unit 420 in a direction that decreases the opening angle θ.

[0027] For example, when the user operates the opening / closing button 820, the motor starts to drive and rotates the first and second imaging units 200, 300. In the imaging device 100 according to the embodiment, the operation of changing the opening angle θ continues while the user continues to operate the opening / closing button 820, and when the user recognizes the first to fifth opening states and stops operating the opening / closing button 820, the operation of changing the opening angle θ stops. It is also possible to configure the device so that when the user operates the open / close button 820 once, the motor continues to be driven automatically until the angle sensor 410 detects one of the first to fifth opening angles set in advance. The setting of the first to fifth open states is not limited to the above example. For example, even if the opening / closing button 820 is continuously operated in a direction that increases the opening angle θ, the driving of the motor may be stopped once the angle corresponding to each opening state is detected by the angle sensor 410, and when the opening / closing button 820 is operated again, the driving of the motor may be resumed until the next opening angle is detected. Furthermore, the opening angle is not limited to the first to fifth opening angles, and may be stopped at any opening angle between the first to fifth opening angles.

[0028] (Display control unit 600) The display control unit 600 generates a display image to be displayed on the display unit 700 based on at least one of the data of the first and second images captured and acquired by the first imaging unit 200 and the second imaging unit 300, or at least one of the data of the first and second images recorded on the storage medium 900, based on instructions sent from the control unit 500 when the user operates the operating member 800.

[0029] (Display section 700) The display unit 700 is configured with, for example, a liquid crystal display panel, an organic EL display panel, or the like, and the liquid crystal display panel is configured to be openable and closable as shown in Fig. 5. Based on instructions transmitted from the control unit 500, the display unit 700 displays a display image generated by the display control unit 600, a setting menu screen, and the like.

[0030] The display unit 700 is provided with an operation detection unit 710, such as a touch panel switch, on its display surface. The operation detection unit 710 detects a contact operation (touch operation, swipe operation, etc.) made by the user on the display surface, and sends an operation signal indicating the contact position to the display control unit 600. The operation signal from the operation detection unit 710 may be sent to the control unit 500.

[0031] (Operation member 800) The operating member 800 includes buttons and switches such as the release button 810 and the open / close button 820 shown in FIG. 1, and sends an operation signal to the control unit 500 in response to a user's operation.

[0032] (Storage medium 900) The storage medium 900 is configured by, for example, a memory card that is detachable from the image capture device 100. Recording and reading of data on the storage medium 900 is controlled by the recording / reading control unit 530 described above.

[0033] <Storing the display unit> 5A and 5B are schematic diagrams illustrating the operation of the display unit 700. FIG. 5A shows the display unit 700 when stored (not in use), and FIG. 5B shows the display unit 700 when in use. The display unit 700 can be stored behind the first imaging unit 200 or behind the second imaging unit 300. As shown in FIG. 5A, in this embodiment, the display unit 700 is stored behind the first imaging unit 200. Therefore, in the first open state (opening angle θ=360 degrees), the display unit 700 is not visible.

[0034] In the second open state (180 degrees<open angle θ<360 degrees), the display unit 700 gradually appears as the opening angle θ decreases. When the opening angle θ becomes smaller than 270 degrees, for example, the display unit 700 can be opened in the direction of the arrow, as shown in FIG. 5(b).

[0035] <Overlapping of shooting range> The overlapping (overlapping) of the imaging ranges of the first imaging unit 200 and the second imaging unit 300 will be described with reference to Fig. 6. Fig. 6 is a schematic diagram showing the imaging device 100 and the object P. The imaging device 100 in Fig. 6 corresponds to the fourth open state (Fig. 3(d)). Therefore, the first imaging unit 200 and the second imaging unit 300 image the object P from different positions. That is, when comparing the image of the object P imaged by the first imaging unit 200 and the image of the object P imaged by the second imaging unit 300, the viewing direction of the object P is different.

[0036] 7 is a schematic diagram illustrating the imaging ranges imaged by the first imaging unit 200 and the second imaging unit 300, where reference symbol B200 denotes the imaging range by the first imaging unit 200 and reference symbol B300 denotes the imaging range by the second imaging unit 300. Reference symbol DUP denotes the overlapping range where the imaging ranges B200 and B300 overlap. In this embodiment, the opening state of the first imaging unit 200 and the second imaging unit 300 is configured to be changeable, and therefore the overlapping range DUP where the imaging range B200 by the first imaging unit 200 and the imaging range B300 by the second imaging unit 300 overlap can be widened or narrowed to change the amount of overlap (i.e., the size of the overlapping range DUP).

[0037] FIG. 8 is a diagram illustrating the relationship between the opening state of the second imaging section 300 relative to the first imaging section 200 (opening angle θ around the axis Ax) and the overlapping range DUP. FIG. 8(a) shows the overlapping range DUP in the first open state in which the optical axes X200 and X300 of the first and second imaging units 200 and 300 are coaxial at an opening angle θ of 360 degrees, as shown in FIG. 3(a). A small area of ​​each of the imaging ranges B200 and B300 is included in the overlapping range DUP as the overlap margin described above. Because both the fisheye lens 210 and the fisheye lens 310 have an angle of view exceeding 180 degrees, there are two overlapping ranges DUP, one on each side of the imaging range B200 and the other on the left side of the imaging range B300. The right side of the imaging range B200 and the left side of the imaging range B300 shown in FIG. 8(a) overlap (shown overlapping in the center of FIG. 8(a)). The left side of the imaging range B200 and the right side of the imaging range B300 also overlap (shown separately on both sides in FIG. 8(a)). 8(b) is a diagram showing overlap range DUP in the second open state in which the optical axes X200 and X300 of the first and second imaging units 200 and 300 intersect at an opening angle θ=270 degrees as shown in FIGS. 2(a) and 3(b), and approximately half of each of the imaging ranges B200 and B300 is included in overlap range DUP. Unlike when the opening angle θ=360 degrees (FIG. 8(a)), there is only one overlap range DUP. Figure 8(c) is a diagram showing the overlap range DUP in the third opening state in which the optical axes X200 and X300 of the first and second imaging units 200 and 300 are coaxial at an opening angle θ = 180 degrees, as shown in Figures 2(b) and 3(c), and the entire area of ​​each of the shooting ranges B200 and B300 is included in the overlap range DUP. Figure 8(d) is a diagram showing the overlap range DUP in the fourth opening state in which the optical axes X200 and X300 of the first and second imaging units 200, 300 intersect at an opening angle θ = 90 degrees, as shown in Figures 2(c) and 3(d), and approximately half of each of the shooting ranges B200 and B300 is included in the overlap range DUP. The overlap amount of the overlap range DUP of the first to fourth opening states is as follows: first overlap amount in the first opening state (θ=360 degrees)<second overlap amount in the second opening state (θ=270 degrees)<third overlap amount in the third opening state (θ=180 degrees). The second overlap amount and the fourth overlap amount in the fourth opening state (θ=90 degrees) are equal. In addition, the horizontally long rectangular shooting range (effective shooting area of ​​the image capturing elements 220 and 320) in Figures 7 and 8 contains images captured by the first image capturing unit 200 and the second image capturing unit 300 through the fisheye lenses 210 and 310, which have a field of view of more than 180 degrees.

[0038] In the overlapping range DUP within the imaging range of the imaging device 100, data of the first image captured by the first imaging section 200 and data of the second image captured by the second imaging section 300 are obtained. In the overlapping range DUP, the data of the first image and the data of the second image have parallax information, and therefore the overlapping range DUP is an area having depth information. The user can view the first image and the second image in the overlapping range DUP on an external device capable of stereoscopic viewing, thereby achieving stereoscopic vision (in other words, obtaining a sense of depth based on parallax).

[0039] For example, when a head-mounted display (HMD) (not shown) serving as a stereoscopic image observation device is connected to the imaging device 100 via wireless or wired communication, the control unit 500 reads out data of a first image and data of a second image stored in association with each other in the storage medium 900. The control unit 500 then transmits image data corresponding to the overlap range DUP from the data of the first image and the data of the second image to the head-mounted display. As described above, the image data corresponding to the overlap range DUP is image display data calculated based on the opening angle θ stored in the storage medium 900 in association with the image data and design information of the optical systems of the first imaging unit 200 and the second imaging unit 300. This image display data is drawing data to be displayed on the head-mounted display, or data necessary for the head-mounted display to create drawing data.

[0040] With this configuration, an image of a region of the first image captured by the first imaging unit 200 that overlaps with the data of the second image captured by the second imaging unit 300 is displayed on the left-eye display unit of the head-mounted display and viewed with the left eye of the user, and an image of a region of the second image captured by the second imaging unit 300 that overlaps with the data of the first image captured by the first imaging unit 200 is displayed on the right-eye display unit of the head-mounted display and viewed with the right eye of the user. The user can achieve stereoscopic vision by viewing the images displayed on the right-eye display unit and left-eye display unit of the head-mounted display. As for an object captured in an area having depth information (overlapping area DUP), the distance from the image capturing device 100 to the object can be calculated using the principle of triangulation, as described above.

[0041] In contrast, neither the image data of the area other than the overlapping range DUP in the data of the first image captured by the first imaging section 200 nor the image data of the area other than the overlapping range DUP in the data of the second image captured by the second imaging section 300 has parallax information. In other words, the area excluding the overlapping range DUP in the shooting range of the imaging device 100 is an area that does not have depth information.

[0042] When a stereoscopic image observation device such as the head-mounted display is not connected to the imaging device 100 by wireless or wired communication, the control unit 500 displays only the first image of the imaging range B200 captured by the first imaging unit 200 or only the second image of the imaging range B300 captured by the second imaging unit 300 on the display unit 700, allowing the user to observe a planar image (2D image) without using an external device. In this way, the user can also observe a planar image, not a stereoscopic image, based on the data of the image captured by the imaging device 100. It is also possible to configure the display unit 700 so that the image data to be displayed on the display unit is output to an external device and displayed on that display unit. The display unit 700 may be a display device that allows a stereoscopic image to be observed (stereoscopic viewing).

[0043] According to the above-described embodiment, the following effects can be obtained. (1) The imaging device 100 includes two imaging units (a first imaging unit 200 and a second imaging unit 300) connected by a connection unit 400, and in which an overlapping range DUP of each other's imaging ranges B100 and B200 is changed, and a first state (opening angle θ=360 degrees) in which each other's imaging ranges B100 and B200 overlap in a first range to a third state (opening angle θ=360 degrees) in which each other's imaging ranges B100 and B200 overlap in a third range. and a control unit 500 that permits the two imaging units (first imaging unit 200, second imaging unit 300) to capture images in a second state (180 degrees < opening angle θ < 360 degrees) in which the imaging ranges B100, B200 of the two imaging units (first imaging unit 200, second imaging unit 300) overlap in a second range while the overlapping range DUP of their imaging ranges B100, B200 is being changed to an overlapping range DUP of 180 degrees (opening angle θ = 180 degrees). With this configuration, it is possible to cause the two imaging units (first imaging unit 200 and second imaging unit 300) to capture images while the overlapping range DUP of their imaging ranges B100, B200 is being changed.

[0044] (2) The control unit 500 allows the two imaging units to capture images in the first state (opening angle θ=360 degrees) and the second state (180 degrees<opening angle θ<360 degrees). Therefore, in the first state, an image of the entire celestial sphere can be acquired, and in the second state, an image that can be viewed stereoscopically in the overlap range DUP and depth information can be generated.

[0045] (3) The first overlap amount of the imaging ranges B100, B200 in the first state, the second overlap amount of the imaging ranges B100, B200 in the second state, and the third overlap amount of the imaging ranges B100, B200 in the third state are such that the second overlap amount is greater than the first overlap amount, and the third overlap amount is greater than the second overlap amount. With this configuration, it is possible to cause the two imaging units (first imaging unit 200 and second imaging unit 300) to capture images in which the overlap amounts of the imaging ranges B100, B200 change seamlessly and continuously.

[0046] (4) The control unit 500 allows the two imaging units (the first imaging unit 200 and the second imaging unit 300) to capture images in a fourth state (0 degrees < opening angle θ < 180 degrees) in which the imaging ranges B100 and B200 overlap in a fourth range that is larger than the third range. Therefore, even in the fourth range, the control unit 500 can cause the two imaging units (the first imaging unit 200 and the second imaging unit 300) to capture images in which the amount of overlap between the imaging ranges B100 and B200 changes seamlessly and continuously.

[0047] (5) The control unit 500 associates two captured images (data of the first image and data of the second image) obtained by capturing images using the two imaging units (first imaging unit 200 and second imaging unit 300) and records them in the storage medium 900. This configuration makes it possible to appropriately record the data of the first image and the data of the second image having an overlapping range DUP.

[0048] (6) The control unit 500 associates information indicating the relative angle between the two imaging units (first imaging unit 200, second imaging unit 300) at the time of imaging with the two captured images and records the information in the storage medium 900. With this configuration, it is possible to obtain information regarding the overlap range DUP (e.g., the amount of overlap between the imaging ranges B100 and B200) from the data of the first image and the data of the second image based on the opening angle θ recorded in the storage medium 900 and design information of the optical systems of the first imaging unit 200 and the second imaging unit 300.

[0049] (7) The open state of the connection unit 400 is changed from the third state (open angle θ=180 degrees) to a fifth state (open angle θ=0 degrees) in which the imaging ranges B100 and B200 face each other. In the fifth state, the control unit 500 does not allow the two imaging units (the first imaging unit 200 and the second imaging unit 300) to capture images. This configuration makes it possible to prohibit imaging in a state in which the first imaging unit 200 and the second imaging unit 300 only capture images of each other and are unable to capture images of other subjects.

[0050] (8) The connection unit 400 includes a first axis Ax, a support unit (400) to which two imaging units (first imaging unit 200, second imaging unit 300) are rotatably attached around the first axis Ax, and a grip unit 450 provided coaxially with a second axis Gx parallel to the first axis Ax. This configuration allows the opening state of the second imaging unit 300 relative to the first imaging unit 200 (opening angle θ around the axis Ax) to be adjusted. Furthermore, because the axis Gx of the grip unit 450 is not configured coaxially with the axis Ax of the connection unit 400, it is possible to prevent the user's hand holding the grip unit 450 from appearing in the image.

[0051] (9) The release button 810 is provided on the grip 450 and instructs the two imaging units (the first imaging unit 200 and the second imaging unit 300) to take an image, which improves usability for the user.

[0052] The following modifications are also within the scope of the present invention. (Variation) In the above embodiment, an example has been described in which the imaging ranges DUP of the first imaging unit 200 and the second imaging unit 300 overlap (overlap) in the left-right direction, but the imaging ranges DUP of the first imaging unit 200 and the second imaging unit 300 may be configured to overlap (overlap) in the up-down direction. Also, the imaging ranges DUP of the first imaging unit 200 and the second imaging unit 300 may be configured to overlap (overlap) in the diagonal direction.

[0053] The present invention is not limited to the above. The scope of the present invention also includes combinations of the configurations shown in the embodiments and modifications. Furthermore, other aspects conceivable within the scope of the technical concept of the present invention are also included within the scope of the present invention. [Explanation of symbols]

[0054] 100...imaging device, 200...first imaging unit, 210, 310...fisheye lenses, 220, 320...imaging element, 400...connection unit, 500...control unit, 600...display control unit, 700...display unit, 800...operation member, Ax, Gx...axis, B200, B300...shooting range, DUP...overlapping range

Claims

[Claim 1] two imaging units connected by a connection unit, and whose imaging ranges overlap with each other and whose imaging ranges overlap with each other; a control unit that permits the two imaging units to capture images in a second state where the imaging ranges of the two imaging units overlap in a second range, while the overlapping range of the imaging ranges of the two imaging units is being changed from a first state where the imaging ranges of the two imaging units overlap in a first range to a third state where the imaging ranges of the two imaging units overlap in a third range; An imaging device comprising:

Citation Information

Patent Citations

  • Portable communication equipment

    JP2003051872A

  • Information terminal device

    JP2004220449A

  • Photographing apparatus

    JP2004235926A

  • Imaging device and imaging system

    JP2019117330A

  • Imaging apparatus

    US20170111578A1