Distance detection system, imaging apparatus, and control method

Abstract

To provide a distance detection device that can irradiate an object with irradiation light for detecting the distance to a subject without being blocked by constitutional members such as lens barrels and the like included in an imaging apparatus.SOLUTION: A distance detection device 300 is provided, which is attached to a position surrounding a lens device 200 of a camera 100. The distance detection device 300 has a light emitting device 309 that irradiates a target area with irradiation light, and a light receiving device 310 that receives the irradiation light reflected on an object on the target area. The distance detection device 300 acquires distance information indicating the distance to the object on the basis of the time from when the light emitting device 309 irradiates the target area with the irradiation light until when the light receiving device 310 receives the reflected light, and communicates the distance information with the camera.SELECTED DRAWING: Figure 1

Description

[Technical field]

[0001] The present invention relates to a distance detection device for obtaining distance information of a subject. [Background technology]

[0002] With the widespread use of smartphones and other devices, the number of opportunities to take photographs and the number of photographs taken have increased significantly, and the image quality and resolution of captured images have improved due to the advancement of peripheral technologies. In order to further improve image quality and resolution, there is a technology that acquires distance information from an imaging device to a subject (depth information of an image) for each pixel. By acquiring distance information before shooting, it is possible to speed up AF (autofocus adjustment), supplement shooting areas such as whiteout and blackout, and create three-dimensional images for two-dimensional images. Using distance information at the time of shooting, it is possible to set a contrast difference between the background and the main subject image, emphasize the outline of the main subject, and adjust the shadows generated by the external light directed at the main subject. Using the distance information held at the time of shooting, it is possible to perform image processing that changes the direction of the external light irradiated to the main subject after shooting, and the above-mentioned complementation. In addition, in the fields of multi-view shooting, augmented reality, virtual reality, and the like, distance information is used for mapping three-dimensional space. A distance image for acquiring distance information from an image or video is an image that represents the distance information of a subject for each pixel.

[0003] The TOF (Time of Flight) method is a method of calculating distance from the time it takes for a distance measuring light to be emitted from an imaging device toward a subject and the reflected light to be received by an imaging element for acquiring a distance image. For example, infrared light intensity-modulated by a predetermined irradiation pattern is irradiated onto the subject. The infrared light reflected by the subject is received by an imaging element, and the time difference between the time of irradiation and the time of reception of the irradiation pattern is detected to calculate the distance value. The distance values ​​are collected in a bitmap form for each pixel and stored as distance image data. The device disclosed in Patent Document 1 uses an actuator to change the irradiation direction of a distance measuring light emitter arranged on the imaging device body, and emits distance measuring light to the entire shooting range. Regardless of the shooting angle at which the user shoots, a distance image can be correctly acquired over the entire shooting image. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2014-157044 A Summary of the Invention [Problem to be solved by the invention]

[0005] Fig. 24 is a diagram showing a side of an imaging device in which a distance measurement light irradiator is disposed, and an example of a distance image. As shown in Fig. 24(A), a distance measurement light irradiator 301 is provided in the imaging device body 100. In order to acquire a distance image, distance measurement light 354 irradiated from the distance measurement light irradiator 301 needs to reach a subject. If the distance measurement light irradiator 301 is disposed in the imaging device body 100 according to the disclosure of Patent Document 1, as shown in Fig. 24(A), the distance measurement light 354 is blocked by the lens barrel 200 provided in the imaging device body 100 and does not reach the subject (vignetting occurs).

[0006] Fig. 24(B) shows distance image 359 when distance measurement light 354 is blocked by lens barrel 200. If there is an area in the angle of view region including the subject where distance measurement light 354 is not irradiated, the image sensor for acquiring the distance image cannot receive distance measurement light 354 for the range of the unirradiated area. Fig. 24(B) shows the area where distance measurement light 354 is not irradiated and where a distance image cannot be acquired as area 365. Area 365 is output as being at infinity.

[0007] The present invention aims to provide a distance detection device that can be attached to an imaging device and can irradiate light for detecting the distance to a subject onto the target object without being obstructed by components such as a lens barrel of the imaging device. [Means for solving the problem]

[0008] According to an embodiment of the present invention, a distance detection device includes a light emitting means for irradiating a target area with irradiation light, a light receiving means for receiving light reflected by an object on the target area, an acquisition means for acquiring distance information indicating a distance to the object based on a time difference between when the light emitting means irradiates the irradiation light and when the light receiving means receives the reflected light, and a communication means for communicating the distance information. The distance detection device is attached to a lens device provided in an imaging device at a position surrounding the lens device. Effect of the Invention

[0009] According to the distance detection device of the present invention, the light for detecting the distance to a subject can be irradiated onto the object without being blocked by components such as a lens barrel of the imaging device. [Brief description of the drawings]

[0010] [Figure 1] FIG. 2 is an external perspective view of the camera system. [Diagram 2] FIG. 2 is an exploded perspective view illustrating the distance detection device. [Diagram 3] FIG. 2 is a diagram illustrating a circuit configuration of the camera system. [Figure 4] FIG. 1 is a diagram illustrating a TOF system. [Diagram 5] 3A and 3B are diagrams illustrating a captured image and a distance image. [Figure 6] 10A to 10C are diagrams illustrating a method for adjusting the mounting position of the distance detection device. [Figure 7] FIG. 2 is a diagram illustrating a circuit configuration of the camera system. [Figure 8] 1A and 1B are diagrams illustrating the arrangement of light-emitting elements and the illumination range of light emitted from the light-emitting elements. [Figure 9] FIG. 2 is a diagram illustrating a circuit configuration of the camera system. [Figure 10] 3A and 3B are diagrams illustrating the configuration and irradiation range of a scanning device. [Figure 11] FIG. 2 is a diagram showing a captured image and a distance image. [Figure 12]FIG. 2 is an example of an exploded perspective view of a mounting mechanism. [Figure 13] FIG. 2 is a diagram showing a state before the distance detection device is attached to the lens device. [Figure 14] 5A to 5C are diagrams illustrating states of the distance detection device when the operating lever is operated. [Figure 15] 5A to 5C are diagrams illustrating states of the distance detection device when the operating lever is operated. [Figure 16] 5A to 5C are diagrams illustrating states of the distance detection device when the operating lever is operated. [Figure 17] 5A and 5B are diagrams illustrating a state of the distance detection device when the operating lever is not operated. [Figure 18] FIG. 1 illustrates an example of the configuration of a distance detection device. [Figure 19] 1A and 1B are diagrams illustrating an example of signal wiring provided on an FPC. [Figure 20] 1A and 1B are diagrams illustrating an example of signal wiring provided on an FPC. [Figure 21] FIG. 2 is a diagram illustrating signal wiring provided on an FPC. [Figure 22] FIG. 2 is a diagram illustrating signal wiring provided on an FPC. [Figure 23] FIG. 2 is a diagram illustrating signal wiring provided on an FPC. [Figure 24] 1 is a diagram showing an example of a side view of an imaging device in which a distance measuring light emitter is disposed, and a distance image; DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0011] Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In each embodiment, an example of a camera system 1 in which a distance detection device 300 is attached to a lens device 200 included in an imaging device (hereinafter also referred to as a camera) 100 is shown.

[0012] [First embodiment] A first embodiment of the present invention will be described with reference to Figs. 1 to 6. Fig. 1 is an external perspective view of a camera system 1. For ease of explanation, an X-axis and a Z-axis perpendicular to each other are defined on the bottom surface of a camera 100, and an axis perpendicular to each of the X-axis and the Z-axis is defined as a Y-axis. The direction of the optical axis O of the camera 100 is parallel to the Z-axis, and the subject side is defined as the front side. In addition, in the radial direction centered on the optical axis O of the lens device 200, the side closer to the optical axis O is defined as the inner circumferential side or radially inner side, and the side away from the optical axis is defined as the outer circumferential side or radially outer side.

[0013] Lens device 200 is provided in front of camera 100. Distance detection device 300 is attached to the subject-side end (front end) of lens device 200 by an attachment mechanism (not shown) at a position surrounding the periphery (outer periphery) of lens device 200. Lens device 200 may be detachable from the main body of camera 100, or the two may be configured integrally.

[0014] The distance detection device 300 is detachable from the lens device 200, or is configured integrally with the lens device 200. For example, the distance detection device 300 is attached so that its central axis is approximately aligned with the optical axis O of the imaging optical system of the lens device 200. Therefore, the term "optical axis O" used in the following description of the distance detection device 300 can be appropriately interpreted as meaning the same as the central axis of the distance detection device 300. The distance detection device 300 has an annular shape centered on the optical axis O, and includes a light emitting unit 301 and a light receiving unit 302. The front lens of the lens device 200 is exposed to the front side from an opening of the distance detection device 300. The distance detection device 300 is electrically connected to the camera 100 via a cable 2, and various information is communicated and power is supplied.

[0015] Since the distance detection device 300 is disposed so as to surround the periphery of the front end portion of the lens device 200, the light (distance measurement light) emitted by the distance detection device 300 is not vignetted by obstacles such as the lens device 200. The light is emitted within the field of view of the imaging device, and the distance measurement light is received by an imaging section for acquiring a distance image, thereby acquiring a distance image. The distance image is an image that represents distance information indicating the distance between the camera 100 and the subject.

[0016] 2 is an exploded perspective view of the distance detection device 300. The distance detection device 300 includes a front cover 304, a light emitting unit 301, a light receiving unit 302, a flexible printed circuit board (hereinafter abbreviated as FPC) 306, a connection terminal 307, an attachment mechanism 303, and a rear cover 305.

[0017] The light emitting unit 301 irradiates the target area with irradiation light. The light emitting unit 301 includes a light emitting element 309. The light receiving unit 302 includes a light receiving element (TOF sensor) 310 and a lens unit 308. The lens unit 308 includes an imaging lens arranged on the front side of the light receiving element 310, that is, on the side of the subject that is the target object on the target area.

[0018] The light emitting element 309, the light receiving element 310, and the control IC (TOF-CPU) 350 (FIG. 3) are electrically connected to the FPC 306. The control IC (TOF-CPU) 350 controls the light emitting element 309 and the light receiving element 310. The connection terminal 307 is mounted on the FPC 306, and is exposed to the outside at the boundary between the front cover 304 and the rear cover 305 when the front cover 304 and the rear cover 305 are fastened and fixed with screws or the like. The attachment mechanism 303 functions as an attachment / detachment means used to attach and detach the distance detection device 300 to and from the lens device 200. The lens device 200 and the distance detection device 300 can be attached by sliding an operation lever, which is an operation member in the attachment mechanism 303.

[0019] FIG. 3 is a block diagram showing the main electrical configuration of the camera system 1 of this embodiment. First, the configuration of the camera 100 and the lens device 200 will be described. The camera 100 has an MPU 101 to an aperture device 206. A microcomputer (hereinafter referred to as "MPU") 101 built into the main body of the camera 100 controls the operation of the camera 100. The MPU 101 executes various processes and instructions for each component. The MPU 101 is a one-chip IC circuit configuration built into a microcomputer, including a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), an input / output control circuit (I / O CONTROL), a multiplexer, a timer circuit, and the like. The MPU 101 can control the camera system 1 by software. A battery 102 is a power source for the camera 100, and is connected to a power supply circuit 103. The power supply circuit 103 supplies an output voltage to each circuit described later.

[0020] The switch group 106 includes, for example, a switch (SW1) that is turned on when the release button 118 is pressed halfway, and a switch (SW2) that is turned on when the release button 118 is pressed all the way. The switch group 106 also includes various operation switches such as a switch for setting exposure (aperture, shutter speed setting switch). The MPU 101 acquires signals from the switch group 106.

[0021] The distance measuring circuit 108 measures the subject distance and outputs the measurement data to the MPU 101. Regarding the method of measuring the subject distance, for example, in an active method, the subject distance information can be obtained by irradiating light from the camera 100 side and receiving the reflected light from the subject. In a passive method, the image signal of an imaging sensor such as a line sensor provided corresponding to the screen is read, and a calculation is performed using a phase difference detection method from the focal position corresponding to the subject image, thereby making it possible to detect the subject distance information. Furthermore, when the subject is a person, the distance measuring circuit 108 can detect characteristic areas such as face detection and pupil detection.

[0022] The MPU 101 communicates with the lens device 200 via the camera-side contact 116 and the lens-side contact 207. The lens control circuit 201 included in the lens device 200 communicates with the MPU 101, drives the photographing lens 205 via an AF (autofocus) drive circuit 203, and controls focus adjustment. For convenience, only one photographing lens 205 is shown in FIG. 3, but in reality, the imaging optical system is composed of a number of lenses such as a focus lens. The AF drive circuit 203 includes, for example, a stepping motor, and changes the position of the focus lens according to a control command from the lens control circuit 201 to perform focusing. The lens control circuit 201 also drives the aperture device 206 via an aperture drive circuit 204 to perform exposure control. The aperture drive circuit 204 includes, for example, an auto iris, and changes the aperture diameter of the aperture device 206 according to a control command from the lens control circuit 201 to optically adjust the aperture value.

[0023] A focal length detection circuit 109 provided in the main body of the camera 100 outputs focal length information of the photographing lens 205 to the MPU 101. For example, if the photographing lens 205 is a fixed focal length lens, data indicating a fixed focal length is sent to the MPU 101. If the photographing lens 205 is a zoom lens, data indicating a focal length according to a zoom stop position of the photographing lens 205 detected by a zoom encoder (not shown) is sent to the MPU 101.

[0024] The display unit 110 includes a display device such as a liquid crystal display (LCD), a liquid crystal viewfinder (EVF), an organic electroluminescence (EL) display, etc., and displays information related to shooting, image information, etc. Note that the display unit 110 may use an organic EL display, etc.

[0025] Shutter 114 is provided on the front side of image sensor 113 and can be moved between a position where image sensor 113 is in a light-shielded state and a position where image sensor 113 is in an exposed state. Image sensor 113 uses a CCD (charge-coupled device) or CMOS (complementary metal-oxide semiconductor) type image sensor, and outputs an image signal according to the light flux received during exposure by photoelectric conversion. In this way, an image of the subject is captured.

[0026] The cable 2 is a connection member that connects the connection terminal 115 on the camera body side to the connection terminal 307 on the distance detection device 300 side. Through the cable 2, the connection terminal 115, and the connection terminal 307, the MPU 101 and the TOF-CPU 350 can communicate with each other, and power can be supplied from the camera body to the distance detection device 300. That is, the connection terminal 307 is a first communication means that communicates various information (for example, distance information) to the camera 100, and the connection terminal 115 is a second communication means that communicates various information to the distance detection device 300. In this embodiment, the camera body is provided with the battery 102, but the distance detection device 300 may also be configured to be provided with a battery.

[0027] Next, the circuit configuration of the distance detection device 300 will be described. The distance detection device 300 has a light emitting unit 301 to a posture detection unit 353. The light emitting unit 301 has a light emitting element 309. The light receiving unit 302 has a light receiving element 310 and a lens unit 308. The TOF-CPU 350 controls the entire distance detection device 300. The light emitting unit 301 is electrically connected to a light source driving unit 351, and the light source driving unit 351 causes the light emitting element 309 to emit light in response to a control signal from the TOF-CPU 350. Generally, an LED (light emitting diode), a VCSEL (vertical cavity surface emitting laser), or the like is used for the light, and the wavelength range of the light used is an invisible light range such as near infrared rays.

[0028] The subject 356 is an object on the irradiation target area. The irradiation light 354 is reflected by the subject 356, and the reflected light 355 is received by the light receiving unit 302. The light receiving unit 302 includes a lens unit 308 and a light receiving element 310. The reflected light 355 from the subject 356 is imaged by the lens unit 308, and then received by the light receiving element 310, which performs photoelectric conversion and outputs an analog signal for generating a distance image. The analog signal output by the light receiving element 310 is acquired by the A / D converter 352 and converted into a digital signal. The digital signal is transmitted to the TOF-CPU 350. The attitude detection unit 353 includes a level function such as an angular velocity sensor, an acceleration sensor, or an inclination sensor, detects attitude information of the distance detection device 300, and outputs a detection signal to the TOF-CPU 350. The installation adjustment of the camera 100 and the distance detection device 300 can be performed based on the attitude information.

[0029] Distance detection using the light emitting unit 301 and the light receiving unit 302 is performed by the TOF-CPU 350 sending control signals to each unit according to a command from the MPU 101 of the camera 100. For example, when it is detected that a power switch included in the switch group 106 is turned on, the display unit 110 performs a first live view display by the imaging element 113 of the camera 100 and a second live view display by the light receiving element 310 of the distance detection device 300 on the screen. The display state and display contents of the live view display by the distance detection device 300 can be changed by stopping the irradiation of the subject from the light emitting element 309 or adjusting the amount of irradiation of the irradiation light 354. As a method of displaying an image on the display unit 110, there is a method of displaying the first live view display and the second live view display on two divided screens, and a method of displaying each display image by superimposing them. Alternatively, there is a method of arbitrarily selecting and displaying the first or second live view display.

[0030] In camera system 1, when release button 118 is pressed all the way down to turn on switch (SW2), the photographing operation of camera 100 and the photographing operation of distance detection device 300 start. Alternatively, when release button 118 is pressed halfway down to turn on switch (SW1), an instruction to prepare for irradiation of light emitting unit 301 is issued and power is supplied. If necessary, the functions of switch (SW1) and switch (SW2) can be divided. For example, the photographing operation of distance detection device 300 can be started by turning on switch (SW1), and the photographing operation of camera 100 can be started by turning on switch (SW2).

[0031] The TOF-CPU 350 transmits the digital signal acquired from the A / D converter 352, that is, a signal corresponding to the distance image data, to the MPU 101 via the connection terminal 307 on the distance detection device side, the cable 2, and the connection terminal 115 on the camera side.

[0032] MPU 101 acquires the captured image captured by camera 100 and the distance image captured by distance detection device 300 and performs image processing. MPU 101 generates 3D image data by synthesizing the captured image and the distance image, and stores the data in a recording device (not shown). There are several ways to store the 3D image data after synthesis, add a distance image to the captured image and store the data, and store the captured image and distance image data separately.

[0033] FIG. 4A is a diagram illustrating a TOF system. The light emitting element 309 generates irradiation light 354 modulated at, for example, 10 MHz in response to a control signal from the TOF-CPU 350, and irradiates the subject 356 with the generated irradiation light 354. The reflected light 355 from the subject 356 is imaged by the lens unit 308 and reaches the light receiving element 310 with a delay time according to the distance from the subject 356. From this delay time, the TOF-CPU 350 calculates the distance from the camera system 1 to the subject 356 (TOF method). For example, when the delay time is 10 nanoseconds, the speed of light is 300,000 km / second, so the subject distance 357 is 3 m (= 10 nanoseconds (0.00000001) seconds × 300,000 km / second). That is, the TOF-CPU 350 calculates (acquires) distance information based on the time from when the light emitting unit 301 irradiates the irradiation light to when the light receiving unit 302 receives the reflected light.

[0034] Fig. 4(B) is a diagram showing the distance between distance detection device 300 and image sensor 113 of camera 100. In Fig. 4(B), subject distance 357 acquired by distance detection device 300 is set as distance information L. Here, distance information L is set as the distance to lens unit 308, but in reality it is the distance to light receiving element 310.

[0035] Since the distance detection device 300 is attached to the front end of the lens apparatus 200, the image sensor 113 and the lens unit 308 of the camera 100 are fixed at a distance of l (small L) apart in the optical axis direction. Therefore, the lens apparatus 200 holds (retains) position information of the distance detection device 300, and when the lens apparatus 200 is attached to the camera 100, the MPU 101 acquires the distance information l (protrusion amount information). Therefore, based on the distance information L acquired from the distance detection device 300, the MPU 101 stores the distance l between the image sensor 113 and the lens unit 308 as a correction value, and the MPU 101 records the distance information to the subject by adding the distance l, which is the correction value, as L+l.

[0036] When the photographer replaces the lens device 200, the distance l, which is the correction value, changes based on the position information of the replaced lens device 200. The MPU 101 detects that the lens device 200 has been replaced, and obtains the position information of the distance detection device 300 to record the distance l, which is the correction value, in the storage unit as the correction value.

[0037] Furthermore, when the overall length of the lens device 200 varies due to zooming or focus driving, the distance detection device 300 moves forward and backward in association with the advancement and retreat of the lens device 200 in the optical axis direction O.

[0038] 4C shows that the distance detection device 300 has moved by Δl toward the subject 356. At this time, the MPU 101 adds the amount of movement Δl of the distance detection device 300 to the distance information l, and records it as distance information l+Δl. Similarly, when the distance detection device 300 has moved away from the subject 356 by the amount of movement Δl, the distance information is recorded as distance information l-Δl. Therefore, the MPU 101 continuously obtains the amount of movement Δl (amount of movement) in conjunction with the zoom operation and focus drive.

[0039] FIG. 5 is a diagram illustrating a captured image and a range image acquired by the camera system 1. As shown in FIG. FIG. 5A shows the distance detection device 300 as viewed from the front. Distance detection device 300 includes light emitting element 309 and light receiving element 310 at the positions shown in Fig. 5(A), for example. Fig. 5(B) shows captured image 358 captured by camera 100. Fig. 5(C) shows distance image 359 captured by distance detection device 300.

[0040] In FIG. 5(C), the subject distance acquired by the TOF system is represented by black and white shading. The subject distance is acquired with high accuracy near the center of the angle of view corresponding to the face (characteristic region) of the person who is the subject. The accuracy of acquiring the subject distance varies depending on the irradiation range of the light-emitting element 309 and the distance to the subject. The peripheral area near the center of the angle of view is outside the irradiation range of the light-emitting element 309, so the accuracy of acquiring the subject distance is poor. A map showing the subject distance corresponding to the characteristic region of the subject is called subject distance map 364.

[0041] In the camera system 1, the distance detection device 300 is disposed at the tip of the lens device 200. Therefore, the irradiation light 354 from the light emitting unit 301 is not blocked by the camera 100 or the lens device 200 in the process until it reaches the subject (no vignetting occurs). Similarly, the reflected light 355 from the subject 356 is not blocked by the camera 100 or the lens device 200 in the process until it reaches the light receiving unit 302. Then, the camera system 1 can output a three-dimensional image with a stereoscopic effect by synthesizing the captured image and the distance image obtained with high accuracy. For example, when the captured image 358 shown in FIG. 5(B) and the distance image 359 shown in FIG. 5(C) are synthesized, an image expressing three-dimensionality (such as a sense of unevenness) of the face part of the person for which the subject distance map 364 has been obtained can be obtained.

[0042] FIG. 6 is a diagram for explaining a method for adjusting the mounting position of distance detection device 300 relative to camera 100. In FIG. When distance detection device 300 is attached to lens device 200, a rotational misalignment may occur around optical axis O between the captured image captured by camera 100 and the capture angle of view of the distance image captured by distance detection device 300. In this case, when the captured image captured by camera 100 and the distance image captured by distance detection device 300 are combined, the images with different capture angles of view overlap, making it difficult to obtain a three-dimensional image. A position adjustment method for suppressing or correcting the misalignment that may occur when distance detection device 300 is attached will be described below.

[0043] First, a method of adjusting the mounting position by detecting the attitude will be described with reference to FIG. 6(A). FIG. 6(A) shows a state in which a live view image is displayed on a display unit 110 such as an LCD or a liquid crystal viewfinder (EVF) (not shown) of the camera 100. As shown in FIG. 6(A), the MPU 101 of the camera 100 displays horizontal / vertical reference lines 361 for the display unit 110, superimposed on the live view image displayed on the display unit 110. The horizontal / vertical reference lines 361 are, for example, grid lines or lines perpendicular to the optical axis O. The MPU 101 also acquires attitude information of the distance detection device 300 detected by an attitude detection unit 353 of the distance detection device 300 from the distance detection device 300 via the connection terminal 307 and the connection terminal 115. The MPU 101 then displays a bar 360 indicating the acquired attitude information, superimposed on the live view image. This allows the photographer to easily recognize how much the distance detection device 300 is misaligned in the rotational direction around the optical axis O. The photographer can then adjust the attachment position of the distance detection device 300 relative to the camera 100 while looking at the reference line 361 and the bar 360 displayed on the display unit 110.

[0044] 6(A), MPU 101 displays the attitude of distance detection device 300 with bar 360, but other display methods are applicable as long as the photographer can recognize the inclination of distance detection device 300 with respect to reference line 361. Also, while it is sufficient that attitude detection section 353 is disposed within distance detection device 300, it is preferable to dispose it at a position farther away from optical axis O within distance detection device 300 in order to improve detection accuracy.

[0045] Next, a method for adjusting the mounting position based on image information will be described with reference to Fig. 6(B) to Fig. 6(D). Fig. 6(B) shows a live view image of an image captured by camera 100. Fig. 6(C) shows a live view image of a distance image captured by distance detection device 300 that is mounted on camera 100 with a predetermined amount of rotational shift around optical axis O. Fig. 6(D) shows the live view image being displayed on display unit 110 of camera 100.

[0046] As shown in Fig. 6(D), MPU 101 displays on display unit 110 a live view image of the distance image shown in Fig. 6(C) superimposed on a live view image of the captured image shown in Fig. 6(B). This allows the photographer to easily recognize how much distance detection device 300 is misaligned in the rotational direction around optical axis O. In addition, the photographer can adjust the mounting position of distance detection device 300 relative to camera 100 while viewing the live view image of the captured image and the live view image of the distance image displayed on display unit 110.

[0047] Next, a method of correcting the rotational misalignment between images around the optical axis O by image processing in the camera 100 after shooting will be described. The MPU 101 extracts the edge part of the captured image shown in FIG. 6B and the edge part of the distance image shown in FIG. 6C. The edge part of the captured image is, for example, a place where the color or contrast of the subject changes suddenly. The edge part of the distance image is, for example, a place where the distance information changes suddenly. The MPU 101 rotates and moves the distance image, corrects it so that the edge parts match, and displays it superimposed on the captured image. When the captured image and the distance image are combined, the MPU 101 cuts (trims) the distance image shown in FIG. 6C, which is tilted with respect to the captured image, to create a three-dimensional image.

[0048] Next, a method for attaching and fixing the distance detection device 300 to the tip of the lens device 200 using the attachment mechanism 303 will be described with reference to FIGS. FIG. 12 is an example of an exploded perspective view of the attachment mechanism 303. An attachment base 311 of the attachment mechanism 303 is fixed to the front cover 304 by using a screw 312. The attachment base 311 may be formed integrally with the front cover 304, or may be attached to the rear cover 305.

[0049] The slider 313, which is a sliding member, is assembled into the mounting base 311. The slider 313 is biased in the -Z direction by a spring 314 so as to be movable in a direction parallel to the optical axis O relative to the mounting base 311, and slides against a rib (not shown) of the mounting base 311. The slider 313 is also formed with a plurality of stepped portions (first lock wall 313a to fifth lock wall 313f).

[0050] The operating lever 315 is disposed at a position where the slider 313 is sandwiched between the mounting base 311 and the operating lever 315. The operating lever 315 is biased in a radial direction from the optical axis O, that is, toward the outside in the radial direction of the distance detection device 300, by a spring 316 incorporated in a portion (not shown) of the mounting base 311. The operating lever 315 is enabled to move along the radial direction by the spring 316. The operating lever 315 is also sandwiched between the front cover 304 and the rear cover 305, and enabled to move in the circumferential direction of the outer circumference of the distance detection device 300.

[0051] The sliding blade 317 is disposed between the slider 313 and the operating lever 315, and is held by a rib (not shown) of the mounting base 311 and the rear cover 305. The operation of the sliding blade 317 will be described later. The sliding blade 317 is formed in a thin plate shape and has a metal part 317a. The sliding blade 317 also has an end part formed of a flexible material, for example, a rubber part 317b.

[0052] FIG. 13 is a diagram showing a state before the distance detection device 300 is attached to the lens device 200. As shown in FIG. FIG. 13A shows the distance detection device 300 as viewed from the optical axis O side. Before the distance detection device 300 is attached to the lens device 200, that is, when the operating lever 315 is not operated, the operating lever 315 is disposed at a position extending radially outward from the outer circumferential surface of the distance detection device 300. The distance detection device 300 shown in Fig. 13(A) is provided with a plurality of operating levers 315. Therefore, the distance detection device 300 has a plurality of mounting mechanisms 303 disposed at positions facing each other across the optical axis O.

[0053] Fig. 13(B) is a side view corresponding to Fig. 13(A), and Fig. 13(C) shows a cross section taken along line AA in Fig. 13(B). 13(C), the sliding blade 317 and the lens device 200 are not in contact with each other. The operating lever 315 is biased by the spring 316 and is in a position protruding in the radial direction E based on the optical axis O. At this time, the notch 315a of the shaft 315 of the operating lever 315 and the upright bent portion 317c of the sliding blade 317 are in a fitted relationship. Also, the cam hole 317d of the sliding blade 317 is in a sliding relationship with the sliding dowel 304a of the front cover 304.

[0054] In the state shown in Fig. 13(C), the locking portion 317e of the sliding blade 317, which is the locked member, and the first locking wall 313a of the slider 313 are in contact or close proximity to each other. Therefore, even if the operating lever 315 is operated in the circumferential direction F of the distance detection device 300 (clockwise in Fig. 13(C)), the locking portion 317e of the sliding blade 317 is in contact with and locked by the first locking wall 313a of the slider 313. As a result, the rotation of the operating lever 315 is restricted, and the operating lever 315 cannot move in the circumferential direction around the optical axis O.

[0055] On the other hand, when the operating lever 315 is operated in the circumferential direction F' of the distance detection device 300 (counterclockwise in FIG. 13C), the front cover 304 and the operating lever 315 come into contact with each other, so that the rotation of the operating lever 315 is restricted.

[0056] 14 to 16 show the state of the distance detection device 300 when the operating lever 315 is operated. When the operating lever 315 is operated, the locked state of the sliding blade 317 is released. Fig. 14(A) shows the state of the distance detection device 300 when the photographer presses the operating lever 315 in the direction opposite to the radial direction E. When the operating lever 315 is pressed, the operating lever 315 moves so as to enter the inside of the distance detection device 300.

[0057] FIG. 14(B) shows a cross section in the state of FIG. 14(A). When the photographer presses the operation lever 315 in a direction (-E direction) against the biasing force of the spring 316, the notch portion 315a moves along the upright bent portion 317c of the slide blade 317. At this time, as shown in FIGS. 15(A) and 15(B), the inclined surface portion 315b of the operation lever 315 comes into contact with the inclined surface portion 313b of the slider 313, and the slider 313 moves in the Z direction. When the operation lever 315 is pressed down, the slider 313 is pressed in the Z direction, so that the first lock wall 313a of the slider 313 separates from the lock portion 317e of the slide blade 317. This releases the lock of the slide spring 317, and the rotation restriction of the operation lever 315 is also released, and the operation lever 315 becomes able to move in the circumferential direction around the optical axis O.

[0058] FIG. 16 shows the state of the distance detection device 300 when the photographer rotates the operation lever 315 in the circumferential direction F while keeping the operation lever 315 pressed down. As shown in Fig. 16(A), when the photographer rotates the operating lever 315 in the circumferential direction F, the sliding blade 317 moves toward the inner periphery of the distance detection device 300, i.e., toward the lens device 200. Fig. 16(B) shows a cross section of the attachment mechanism 303 after the operating lever 315 has been rotated. When the sliding blade 317 moves to the position shown in Fig. 16(B), the lens device 200 is clamped by the rubber portion 317b of the sliding blade 317. This makes it possible to fix and hold the distance detection device 300 to the lens device 200.

[0059] When the photographer rotates operation lever 315 in circumferential direction F while pressing it in the -E direction, notch 315a of operation lever 315 and upright bent portion 317c of sliding blade 317 move in conjunction with each other. When sliding blade 317 moves in circumferential direction F, sliding dowel 304a of front cover 304 slides against cam hole 317d, and sliding blade 317 moves in the direction toward lens device 200 (-E direction).

[0060] 16(B), the rubber portion 317b of the sliding blade 317 is pressed against the groove portion 200a of the lens device 200. As shown in Fig. 16(A), the attachment mechanism 303 is arranged in two locations facing each other across the optical axis O, and the rubber portion 317b is pressed against the groove portion 200a of the lens device 200, whereby the distance detection device 300 clamps and fixes the lens device 200.

[0061] FIG. 17 is a diagram showing the state of distance detection device 300 when the photographer releases operation lever 315 from the state of FIG. 16(A), that is, when the operation lever is not pressed (not operated). 17(A) and (B), when the photographer releases the operating lever 315 from the pressed state, the operating lever 315 protrudes in the E direction from the outer circumferential surface of the distance detection device 300. Meanwhile, since the sliding blade 317 maintains the state shown in FIG. 16, the distance detection device 300 is fixed to the lens device 200.

[0062] FIG. 17(B) shows a cross section of the attachment mechanism 303 in the state shown in FIG. 17(A). The operating lever 315 is pushed out towards the outer periphery of the distance detection device 300 by the biasing force of the spring 316 while the notch 315a and the slide blade 317c slide in contact with each other. 17(B), the slider is released from the state in which it is biased in the Z direction by the operating lever 315. Therefore, the locking portion 317e of the sliding blade 317 and the second locking wall 313c of the slider 313 are arranged in a state of abutment or closeness to each other. This locks the sliding blade 317, and the distance detection device 300 can maintain a state in which it clamps and fixes the lens device 200.

[0063] Even if the operating lever 315 is rotated in the circumferential direction F, the engagement between the sliding dowel 304a and the cam hole 317d and the abutment between the locking portion 317e and the second locking wall 313c maintain the distance detection device 300 in a fixed state holding the lens device 200. In addition, since the sliding blade 317 fits into the groove portion 200a of the lens device 200, the distance detection device 300 will not move inadvertently.

[0064] With the above-described configuration, the distance detector 300 is fixed to the lens device 200. If the outer diameter of the lens device 200 is different from that of the above example, the distance detector 300 can maintain a state in which the lens device 200 is sandwiched by the third lock wall 313d, the fourth lock wall 313e, or the fifth lock wall 313f instead of the second lock wall 313c. The second lock wall 313c to the fifth lock wall 313f are formed with surfaces having different angles. That is, the surfaces formed on the second lock wall 313c to the fifth lock wall 313f have angles according to the position of the sliding blade 317. The angle of the surface forming the first lock wall 313a may be made different from the angles of the surfaces forming the other lock walls.

[0065] 13, the operating lever 315 is disposed at a position protruding radially outward from the outer periphery of the distance detection device 300 for the following reason. If the operating lever 315 is disposed on the front side (front cover 304 side) of the distance detection device 300, the photographer's hand or the like will be blocked by the lens device 200 when the photographer operates the operating lever 315. On the other hand, if the operating lever 315 is disposed on the rear side (rear cover 305 side) of the distance detection device 300, the photographer will inadvertently touch the operating lever 315 when operating the lens device 200. Therefore, it is preferable that the operating lever 315 is disposed at a position protruding radially outward from the distance detection device 300.

[0066] As shown in FIG. 13(A), the operating lever 315 is disposed in an area surrounded by an outer diameter arc of the distance detection device 300, a first tangent at a first point on the outer circumference of the distance detection device 300, and a second tangent at a second point. The first tangent and the second tangent are perpendicular to each other. The outer diameter arc is an outer diameter arc from the first point to the second point. For example, the first tangent is a tangent X' in the X direction, and the second tangent is a tangent Y' in the Y direction. As a result, even if the distance detection device 300 is placed on a desk or the like with the lens device 200 fixed thereto, the operating lever 315 does not come into direct contact with the desk, and the lock of the mounting mechanism 303 is not inadvertently released.

[0067] FIG. 18 is a diagram showing an example of the configuration of a distance detection device 300 in which heat generation from a light emitting section 301 and a light receiving section 302 is taken into consideration. The light emitting element 309 and the light receiving element (TOF sensor) 310 arranged in the distance detection device 300 each become a heat source, which may affect the detection accuracy and operation of the distance detection device 300. Hereinafter, the light emitting unit 301 including the light emitting element 309 and the light receiving unit 302 including the light receiving element (TOF sensor) 310 are referred to as heat sources.

[0068] Fig. 18(A) shows the distance detection device 300 as viewed from the front with the front cover 304 removed. As shown in Fig. 18(A), an FPC 306, which is a wiring board in the distance detection device 300, includes a light emitting unit 301, a light receiving unit 302, and a connection terminal 307. The FPC 306 is arranged along the rear cover 305 side, but may be arranged on the front cover 304 side. In the example shown in Fig. 18, a light emitting element 309 in the light emitting unit 301, a light receiving element (TOF sensor) 310 in the light receiving unit 302, and the connection terminal 307 are mounted on the FPC 306.

[0069] In the example shown in Fig. 18(A), the light-emitting unit 301 and the light-receiving unit 302 are arranged on the Y axis centered on the optical axis O. The distance from the light-emitting unit 301 to the light-receiving unit 302 is defined as distance H1. The distance from the optical axis O, i.e., the central axis of the distance detection device, to the light-emitting unit 301 is defined as distance H2. The light-emitting unit 301 and the light-receiving unit 302 are arranged such that the distance H1 is longer than the distance H2. In the configuration shown in Fig. 18(A), the distance between the light-emitting unit 301 and the light-receiving unit 302, which are heat sources, is long, so that a local temperature rise in the distance detection device 300 can be suppressed.

[0070] The light-emitting unit 301 and the light-receiving unit 302 do not have to be arranged on the Y axis centered on the optical axis O. Even if the light-emitting unit 301 and the light-receiving unit 302 cannot be arranged on the Y axis, it is sufficient that the distance H1 from the light-emitting unit 301 to the light-receiving unit 302 is longer than the distance H2 from the optical axis O to the light-emitting unit 301. By arranging the light-emitting unit 301 and the light-receiving unit 302 at positions facing each other across the optical axis O in a plane perpendicular to the optical axis O, it is possible to set the distance H1 longer than the distance H2 within the distance detection device 300.

[0071] The connection terminal 307 is disposed at a position midway between the light-emitting unit 301 and the light-receiving unit 302 disposed on the FPC 306. Therefore, as viewed from the connection terminal 307, the FPC 306 branches into two branches toward the light-emitting unit 301 and the light-receiving unit 302. With this configuration, it is possible to suppress a temperature rise due to heat transferred from the light-emitting unit 301 and the light-receiving unit 302 in the connection terminal 307 exposed on the exterior of the distance detection device 300. Note that the position of the connection terminal 307 is not limited to a position midway between the light-emitting unit 301 and the light-receiving unit 302 on the FPC 306.

[0072] FIG. 18B shows an example of the arrangement of the connection terminals 307 in the distance detection device 300. The distance from the light emitting unit 301 to the connection terminal 307 is defined as a distance H3. The distance from the light receiving unit 302 to the connection terminal 307 is defined as a distance H4. The connection terminal 307 is disposed so that the distance H3 is longer than the distance H4. Therefore, the connection terminal 307 shown in FIG. 18(B) is disposed closer to the light receiving unit 302 side than the connection terminal 307 shown in FIG. 18(A). In this configuration, even if the light emitting unit 301 includes a light emitting element 309 that generates heat more than the light receiving unit 302, the temperature rise of the connection terminal 307 can be suppressed. On the other hand, when the light receiving unit 302 includes a light receiving element (TOF sensor) 310 that generates heat more than the light emitting unit 301, the connection terminal 307 is disposed on the light emitting unit 301 side.

[0073] 1, the camera 100 and the distance detection device 300 are electrically connected by the cable 2. Therefore, it is preferable to connect the connection terminal 307 of the distance detection device 300 to the connection terminal 115 of the camera 100 by the cable 2 at the shortest distance. For this reason, the connection terminal 307 of the distance detection device 300 and the connection terminal 115 of the camera 100 are arranged in the same direction with respect to the optical axis O on a plane perpendicular to the optical axis O.

[0074] 18C shows an example in which a heat countermeasure member 330 is arranged in the distance detection device 300. As the heat countermeasure member 330, a heat dissipation member such as a metal plate made of copper or aluminum, or a graphite sheet is used. The heat countermeasure member 330 is disposed at a position facing the FPC 306 across the optical axis O, i.e., the central axis of the distance detection device 300 (a position facing the Y-axis as a reference). The mounting position of the heat countermeasure member 330 is not limited to the position shown in FIG. 18(C). The heat countermeasure member 330 may be disposed on substantially the same plane as the FPC 306. With this configuration, the heat countermeasure member 330 can be disposed without increasing the thickness of the distance detection device 300 in the Z-axis direction. In the configuration example shown in FIG. 18(C), the heat countermeasure member 330 is disposed at a position facing the position of the connection terminal 307 across the optical axis O, so that the temperature rise of the connection terminal 307 can be suppressed compared to the configuration example shown in FIG. 18(B). Note that, in FIG. 18(C), the FPC 306 and the heat countermeasure member 330 have substantially the same length, but the FPC 306 and the heat countermeasure member 330 do not have to have the same length. 18C is disposed so as to connect the light-emitting unit 301 and the light-receiving unit 302, the heat countermeasure member 330 may be disposed in each of the light-emitting unit 301 and the light-receiving unit 302.

[0075] 19 and 20 are diagrams illustrating an example of signal wiring provided on the FPC 306. FIG. Fig. 19 shows a plan view of signal wiring provided on the FPC 306. Fig. 20 shows a cross-sectional view of the FPC 306. Fig. 20(A) shows the cross-section along the line S1-S1 in Fig. 19, and Fig. 20(B) shows the cross-section along the line S2-S2 in Fig. 19.

[0076] The configuration of the FPC 306 and the wiring positions of each signal provided on the FPC 306 will be described. As shown in Fig. 19, the light emission signal wiring 721b, which is the first signal wiring, electrically connects the light emitting element 309 and the connection terminal 307. An analog signal for driving the light emitting element 309 from the light source driving unit 351 (Fig. 3) is transmitted to the light emitting element 309 via the light emission signal wiring 721b. The analog signal for driving the light emitting element 309 includes, for example, a modulation signal for modulating the irradiated light 354 from the light emitting element 309 at a high frequency.

[0077] Further, light receiving signal wirings 721c and 721d, which are second signal wirings, electrically connect the light receiving element 310 and the connection terminal 307. The analog signal output from the light receiving element 310 is converted into a digital signal by the A / D converter 352 (shown in FIG. 3) and transmitted to the connection terminal 307 via the light receiving signal wirings 721c and 721d. This digital signal is transmitted as a distance image to the MPU 101 via the cable 2 and the connection terminal 115. As shown in FIG. 20, the FPC 306 includes an insulator layer 720, a first wiring layer 721 formed by laminating on one surface of the insulator layer 720, and a second wiring layer 722 formed by laminating on the other surface of the insulator layer 720. As shown in FIG. 20(A), a GND wiring 721a and a pair of light receiving signal wirings 721c and 721d are wired on the first wiring layer 721. In addition, a GND wiring 721a is wired on the second wiring layer 722. In addition, as shown in FIG. 20(B), a light emitting signal wiring 721b is also wired on the first wiring layer 721. The first wiring layer 721 and the second wiring layer 722 are covered with a coverlay 723 which is an insulator, and the GND wiring 721a, the light emitting signal wiring 721b, and the light receiving signal wirings 721c and 721d are protected.

[0078] Next, the wiring method of the light receiving signal wirings 721c and 721d will be described. In the first wiring layer 721, the light receiving signal wirings 721c and 721d are surrounded from the sides by the GND wiring 721a, and are also surrounded from below by the GND wiring 721a provided in the second wiring layer 722 via the insulating layer 720. In addition, the light receiving signal wirings 721c and 721d are wired in parallel, and gaps 724 are provided between the GND wiring 721a and the light receiving signal wirings 721c and 721d, and between the light receiving signal wiring 721c and the light receiving signal wiring 721d. With the above-described configuration, the light receiving signal wirings 721c and 721d form differential signal wiring. This suppresses signal waveform interference (crosstalk) caused by electromagnetic coupling between the light receiving signal wirings 721c and 721d, which are high-speed transmission signal wirings, and adjacent signal wirings.

[0079] Next, a method for wiring the light emission signal wiring 721b will be described. As shown in FIG. 19, the light emission signal wiring 721b is wired clockwise from the light emitting element 309 toward the connection terminal 307 when viewed from the front of the distance detection device 300 (when viewed from the -Z direction).

[0080] Assume that the light emission signal wiring 721b is wired on the wiring route (counterclockwise route) of the line segment L6 shown in FIG. 19. In this case, the light emission signal wiring 721b passes through a position facing the light receiving element 310 or the light receiving signal wirings 721c, 721d in the stacking direction of the FPC 306, sandwiching the insulating layer 720. At this position, crosstalk occurs between the light receiving signal wirings 721c, 721d and the light emitting element signal wiring 724, reducing the accuracy of the amount of light emitted from the light emitting element 309, or generating noise in the analog signal output from the light receiving element 310. As a result, the accuracy of the distance image acquired by the distance detection device 300 decreases.

[0081] In order to prevent crosstalk, a method of wiring the light emission signal wiring 721b at a distance from the light reception signal wirings 721c and 721d in the stacking direction and the surface direction of the FPC 306 can be considered. However, by wiring the light emission signal wiring 721b at a distance, the FPC 306 expands in the stacking direction and the surface direction, and the distance detection device 300 becomes larger.

[0082] 19, by providing the light emission signal wiring 721b in a clockwise direction, the light emission signal wiring 721b can be wired without overlapping with the light reception signal wirings 721c and 721d in the stacking direction of the FPC 306 and without being adjacent to them in the surface direction. With the above configuration, crosstalk occurring between the light reception signal wirings 721c and 721d and the light emitting element signal wiring 724 can be prevented, and a distance image can be acquired with high accuracy.

[0083] The distance detection device 300 of the present embodiment described above is attached to the end of the lens device 200 on the subject side, and therefore can acquire distance image information without the light emitted from the light emitting unit 301 being blocked by the lens device 200. In the present embodiment, an example in which the distance detection device 300 is ring-shaped has been described, but the distance detection device 300 may have a configuration other than a ring shape as long as it is disposed near the tip of the lens device 200.

[0084] [Second embodiment] A second embodiment will be described with reference to FIGS. FIG. 7 is a block diagram showing the main electrical configuration of the camera system 1. As shown in FIG. The same parts as those of the camera system 1 described in the first embodiment are given the same reference numerals, and detailed description thereof will be omitted. As shown in FIG. 7, the light-emitting unit 301 is provided with a plurality of light-emitting elements 501A to 501H. In the light-emitting unit 301, the light source driving unit 351 drives the plurality of light-emitting elements in response to a signal controlled by the TOF-CPU 350, and causes each of the light-emitting elements to irradiate the subject with the irradiation light 354. In this manner, by arranging a plurality of light-emitting elements in the light-emitting unit 301, it is possible to increase the irradiation range of the irradiation light 354 relative to the shooting angle of view of the camera 100. Therefore, by considering the irradiation range and the number of the light-emitting elements, it is also possible to irradiate the entire area of ​​the shooting angle of view with the irradiation light 354.

[0085] When each light-emitting unit 301 simultaneously irradiates the subject with irradiation light 354 from each light-emitting element, the detection accuracy of distance information may deteriorate if the irradiation light 354 overlaps with each other. Therefore, each light-emitting unit 301 may emit light at different timings instead of simultaneously.

[0086] FIG. 8 is a diagram illustrating the arrangement of a plurality of light-emitting elements and the illumination range of the light emitted from each light-emitting element in the second embodiment. In Fig. 8, an example is described in which distance detection device 300 is equipped with eight light-emitting elements, but the number of light-emitting elements may be any number. Fig. 8(A) shows distance detection device 300 viewed from the front, in which each light-emitting element is arranged to irradiate irradiation light parallel to optical axis O. Fig. 8(B) shows the irradiation range of irradiation light from each light-emitting element relative to the shooting angle of view 500 of camera 100 in the arrangement example shown in Fig. 8(A).

[0087] In Fig. 8(A), the light emitting elements 501A, 501B, 501C, 501D, 501E, 501F, 501G, and 501H are arranged at equal distances from the optical axis O and at equal intervals between the light emitting elements. In Fig. 8(B), the irradiation ranges 501a to 501h correspond to the irradiation ranges of the light emitting elements 501A to 501H in Fig. 8(A), respectively. By arranging a plurality of light emitting elements in the distance detection device 300, it is possible to increase the irradiation range of the irradiated light relative to the shooting angle of view 500 of the camera 100. This makes it possible to widen the range in which the subject distance can be obtained by the above-mentioned TOF system.

[0088] 8B, a typical photographing angle of view 500 is shorter in the Y-axis direction due to a different aspect ratio of the image sensor 113. Therefore, the illumination ranges 501a, 501d, 501e, and 501h of the light-emitting elements 501A, 501D, 501E, and 501H that are disposed away from the optical axis O in the Y direction tend to extend beyond the photographing angle of view 500.

[0089] A suitable arrangement of the multiple light-emitting elements will be described below. In a suitable arrangement example, for example, the irradiation optical axis of at least one light-emitting element is not parallel to the optical axis O. Fig. 8(C) shows a side view of the distance detection device 300 in which the light-emitting elements are arranged to irradiate light at a predetermined angle inclined with respect to the optical axis O. Fig. 8(D) shows the irradiation range of the irradiation from each light-emitting element relative to the shooting angle of view 500 of the camera 100 in the arrangement example shown in Fig. 8(C).

[0090] In the example shown in FIG. 8(C), each light-emitting element in FIG. 8(A) is arranged at a predetermined angle with respect to the optical axis O. An example will be described with the light-emitting element 502C and the light-emitting element 502D. The angle between the optical axis O and the irradiation optical axis C of the light irradiated to the subject by the light-emitting element 502C is set to angle θ1. The angle between the optical axis O and the irradiation optical axis D of the light irradiated to the subject by the light-emitting element 502D is set to angle θ2. The irradiation optical axis C and the irradiation optical axis D are not parallel to the optical axis O. The light-emitting elements 502C and 502D are arranged so that the angle θ2 is larger than the angle θ1. The first light-emitting means (light-emitting element 502D) having a first vertical distance from the central axis (optical axis O) of the distance detection device 300 has a larger inclination of the irradiation optical axis than the second light-emitting means (light-emitting element 502C) having a second vertical distance from the central axis that is smaller than the first distance. This allows the illumination range 502d to be located on the central side of the photographing angle of view 500, as shown in FIG. 8(D).

[0091] Also, as shown in FIG. 8B, the illumination range 501c of the light emitted from the light emitting element 501C has less deviation in the Y-axis direction with respect to the photographing angle of view 500 compared to the illumination range 501d. Therefore, as shown in FIG. 8C, the light emitting element 502C emits light at an angle θ1 smaller than the angle θ2 corresponding to the light emitted from the light emitting element 502D. That is, the light emitting element farther away from the optical axis O in the vertical direction (Y-axis direction) needs to be arranged with a larger angle between the illumination direction with respect to the subject and the optical axis O. However, the larger the angle between the illumination direction with respect to the subject and the optical axis O, the narrower the range of subject distance that can be photographed. Therefore, more preferable arrangement examples shown in FIG. 8E and FIG. 8F may be applied.

[0092] Fig. 8(E) shows the state of the distance detection device 300 in which some of the light-emitting elements are arranged close to the optical axis O, as viewed from the front. Fig. 8(F) shows an arrangement example corresponding to Fig. 8(E), in which the distance detection device 300 is viewed from the side when each light-emitting element is arranged to irradiate light at a predetermined angle inclined with respect to the optical axis O. The positions of the light-emitting elements 503B, 503C, 503F, and 503G are the same as the positions of the light-emitting elements 501B, 501C, 501F, and 501G in Fig. 8(A). The light-emitting elements 503A, 503D, 503E, and 503H shown in Fig. 8(E) are closer to the optical axis O and are arranged on the radially inner side (inner circumference side) of the distance detection device 300 compared to the light-emitting elements 501A, 501D, 501E, and 501H shown in Fig. 8(A).

[0093] As shown in Fig. 8(F), the angle between the optical axis D' of the light irradiated from the light emitting element 503D to the subject and the optical axis O is set as angle θ3. By arranging the light emitting elements as shown in Fig. 8(E), the angle θ3 shown in Fig. 8(F) is smaller than the angle θ2 between the optical axis D of the light irradiated from the light emitting element 502D to the subject and the optical axis O shown in Fig. 8(C). In other words, by arranging the light emitting elements such as the light emitting elements 503A, 503D, 503E, and 503H, which are far from the optical axis O in the Y-axis direction, on the radial inner side of the distance detection device 300 so as to be closer to the optical axis O, the inclination of the irradiated light with respect to the optical axis O can be minimized.

[0094] Next, the order of emitting the illumination light from each light-emitting element will be described. As an example, a case will be described in which a subject for which a distance image is to be obtained is present near the center of the photographing angle of view 500. The camera system 1 emits illumination light from the light-emitting elements 503A, 503D, 503E, and 503H that illuminate the vicinity of the center of the photographing angle of view 500 first, and then emits illumination light from the light-emitting elements 503B, 503C, 503F, and 503G. By emitting illumination light from each light-emitting element in such an order, the subject near the center of the photographing angle of view 500 can be irradiated first, so that the photographer is less likely to miss the subject. The arrangement of the light-emitting elements relative to the photographing angle of view 500 has been described with respect to the Y-axis direction, but the same is true for the X-axis direction.

[0095] [Third embodiment] FIG. 9 is a block diagram showing the main electrical configuration of a camera system 1 according to the third embodiment. The same parts as those of the camera system 1 described in the first embodiment are given the same reference numerals, and detailed description thereof will be omitted. In the third embodiment, a distance detection device 300 has a light emitting unit 301 having a light emitting element and a scanning device of a micro-electro-mechanical system (MEMS) type fabricated using a semiconductor process. MEMS is an abbreviation for Micro Electro Mechanical System.

[0096] 9, the light emitting unit 301 is provided with a MEMS scanning device 400 together with a light emitting element 309. The distance detection apparatus 300 also has a SUB-TOF-CPU 401 as a control unit for operating the scanning device 400. The SUB-TOF-CPU 401 receives a control signal from the TOF-CPU 350 and drives the scanning device 400.

[0097] A light source driving unit 351 drives the light emitting element 309 to emit light in response to a control signal from the TOF-CPU 350, and the light is reflected by a reflecting mirror 402 of the scanning device 400 to illuminate the subject. According to the configuration shown in Fig. 9, the illumination range can be expanded compared to the first embodiment. Also, the TOF-CPU 350 may directly control the scanning device 400 without providing the SUB-TOF-CPU 401.

[0098] FIG. 10 is a diagram illustrating the configuration of a scanning device 400 and how the irradiation light 354 scanned by the scanning device 400 forms an irradiation range 405 two-dimensionally. 10, a reflecting mirror 402 is formed in the center of the scanning device 400. The scanning device 400 has a so-called gimbal structure that includes a torsion bar 403 for oscillating the reflecting mirror 402 around a vertical axis (B axis) and a torsion bar 404 for oscillating the reflecting mirror 402 around a horizontal axis (A axis).

[0099] The scanning device 400 has an actuator (not shown) that uses electromagnetic force, electrostatic force, or the like to drive the reflecting mirror 402 around a vertical axis (B axis), and the reflecting mirror 402 oscillates at high speed due to the resonance effect of this structure. The scanning device 400 also has an actuator (not shown) that uses electromagnetic force, electrostatic force, or the like to oscillate the reflecting mirror 402 around a horizontal axis (A axis) in synchronization with the oscillation around the vertical axis (B axis).

[0100] In Fig. 10, line 407 indicates the outgoing path of the light beam (scanning line) scanned horizontally by the oscillation of reflecting mirror 402 around the vertical axis (axis B), and line 408 indicates the returning path. In reality, the number of scanning lines is greater than the number shown in Fig. 10, but a smaller number is shown for ease of explanation.

[0101] The scanning device 400 further oscillates the reflecting mirror 402 around the horizontal axis (A axis) in synchronization with the oscillation of the reflecting mirror 402 around the vertical axis (B axis), thereby scanning the scanning line in the vertical direction (V direction). When the scanning line reaches a scanning end 409 in the vertical direction, it returns to the scanning start point 410. In this way, the scanning device 400 can form the irradiation range 405 two-dimensionally by continuously oscillating the reflecting mirror 402.

[0102] FIG. 11 is a diagram showing a captured image and a distance image acquired in the third embodiment. 11(A) shows a captured image 362 captured by the camera 100. Also, Fig. 11(B) shows a distance image 363 captured by the distance detection device 300 equipped with the light emitting unit 301 shown in Fig. 9.

[0103] Light emitting unit 301 illuminates illumination range 405 formed by scanning device 400 continuously swinging reflecting mirror 402. In this way, distance detection device 300 acquires subject distance map 364 near the center of the angle of view corresponding to the face of the person who is the subject. Therefore, the subject distance can be acquired with high accuracy near the center of the angle of view corresponding to the face of the person. When camera system 1 combines captured image 362 shown in FIG. 11(A) with distance image 363 shown in FIG. 11(B), it is possible to obtain an image expressing a three-dimensional shape (such as a sense of unevenness) of the face of the person for which the distance image was acquired (subject distance map 364).

[0104] 5C, the illumination range is expanded by driving the scanning device 400, and therefore the acquisition range of the corresponding distance information is wider in the distance image 363. In general, the acquisition range of the distance image 363 is determined by the type and arrangement of the light-emitting unit 301 and the scanning range of the scanning device 400. By using the light-emitting unit 301 having the light-emitting element 309 and the scanning device 400 as in the third embodiment, it is possible to expand the illumination range. Depending on the driving range of the scanning device 400, an illumination method may be adopted in which an arbitrary range within the shooting angle of view is selected and the illumination range is set.

[0105] Generally, compared to a light-emitting unit having only a light-emitting element, the light-emitting unit 301 having the light-emitting element 309 and the scanning device 400 can use a light-emitting element such as a laser having a small irradiation angle, and can therefore irradiate a distant subject. In order to further expand the irradiation range, a configuration including a plurality of combinations of the light-emitting unit 301 having the light-emitting element 309 and the scanning device 400 may be adopted.

[0106] 21 to 23 are diagrams illustrating signal wiring provided on the FPC 306 in the third embodiment. Fig. 21 shows a plan view of the signal wiring provided on the FPC 306. Fig. 22 shows a cross section taken along line S3-S3 in Fig. 21. Note that the same parts as those in the first embodiment are given the same reference numerals, and the description thereof will be omitted in this embodiment. As shown in Fig. 21, the scanning signal wiring 721e, which is the third signal wiring, electrically connects the scanning device 400 and the connection terminal 307.

[0107] A rectangular pulse signal (digital signal) for driving the scanning device 400, which is transmitted from the SUB-TOF-CPU 401 (FIG. 9), is transmitted to the scanning device 400 via the scanning signal wiring 721e. The first wiring layer 721 is covered with a coverlay 723, which is an insulator, to protect the GND wiring 721a, the light emission signal wiring 721b, the light reception signal wiring 721c, 721d, and the scanning signal wiring 721e. As in the first embodiment described with reference to FIGS. 19 and 20, the light emission signal wiring 721b and the light reception signal wiring 721c, 721d are arranged so as not to overlap with each other in the stacking direction of the FPC 306.

[0108] Next, a wiring method of the scanning signal wiring 721e will be described. As shown in FIG. 22, in the first wiring layer 721, the scanning signal wiring 721e is surrounded by the GND wiring 721a from the side, and the GND wiring 721a forms a guard GND wiring for the scanning signal wiring 721e. In addition, the light-emitting signal wiring 721b, the GND wiring 721a, the scanning signal wiring 721e, and the GND wiring 721a are wired in parallel in this order from the outer periphery side of the rear cover 305. A gap 724 is provided between each wiring. This allows the GND wiring 721a to suppress signal leakage from the scanning signal wiring 721e, and suppresses crosstalk occurring between the scanning signal wiring 721e and the light-emitting signal wiring 721b. In this embodiment, the scanning signal wiring 721e is surrounded only from the side by the GND wiring 721a. The scanning signal wiring 721e may be surrounded not only from the sides by the GND wiring 721a but also from below by the GND wiring 721a that is wired to the second wiring layer 722 via the insulating layer 720.

[0109] Next, a wiring method of the light emission signal wiring 721b will be described. As shown in Fig. 21, the light emission signal wiring 721b is wired clockwise from the light emitting element 309 toward the connection terminal 307 when viewed from the front of the distance detection device 300 (when viewed from the -Z direction). Assume that the light emission signal wiring 721b is wired on the wiring route (counterclockwise route) of the line segment L7 shown in FIG. 21. In this case, the light emission signal wiring 721b passes through a position facing the scanning device 400 in the stacking direction of the FPC 306 with the insulating layer 720 sandwiched therebetween. At this position, crosstalk occurs between the scanning device 400 or the scanning signal wiring 721e and the light emitting element signal wiring 724. Therefore, the accuracy of the amount of irradiation light irradiated from the light emitting element 309 decreases, or the accuracy of the swinging operation of the reflection mirror 402 provided in the scanning device 400 decreases. As a result, the accuracy of the distance image acquired by the distance detection device 300 decreases. In order to prevent such crosstalk, a method of wiring the light emission signal wiring 721b at a distance from the scanning signal wiring 721e in the stacking direction and the surface direction of the FPC 306 is considered. However, the FPC 306 expands in the stacking direction and the surface direction by the amount of the light emission signal wiring 721b wired at a distance, and the distance detection device 300 becomes large.

[0110] In this embodiment, as shown in FIG. 21, by arranging the light emitting signal wiring 721b in a clockwise direction, the light emitting signal wiring 721b can be wired without overlapping with the scanning signal wiring 721e in the stacking direction of the FPC 306 and without being adjacent to the scanning signal wiring 721e in the surface direction. As with the light-emitting signal wiring 721b, when the scanning signal wiring 721e and the light-receiving signal wirings 721c and 721d pass through positions opposing each other in the stacking direction of the FPC 306, crosstalk occurs between the scanning signal wiring 721e and the light-receiving signal wirings 721c and 721d. Therefore, the scanning signal wiring 721e is wired without overlapping with the light-receiving signal wirings 721c and 721d in the stacking direction of the FPC 306. Such a wiring method can be implemented by replacing the light-emitting signal wiring 721b with the scanning signal wiring 721e in the positional relationship between the light-emitting signal wiring 721b and the light-receiving signal wirings 721c and 721d shown in FIGS. 19 and 20, and detailed description thereof will be omitted.

[0111] The digital signals held by the distance detection device 300 include a clock signal (not shown) for synchronizing the timing of transmitting and receiving a distance image between the distance detection device 300 and the camera 100. The clock signal wiring is also one of the high-speed signal wirings, and by providing a guard GND wiring similar to the scanning signal wiring 721e, crosstalk occurring between the clock signal wiring and the light emission signal wiring 721b is suppressed. Such a wiring method can be implemented by replacing the scanning signal wiring 721e with the clock signal wiring in the positional relationship between the light emission signal wiring 721b and the scanning signal wiring 721e shown in Figures 21 and 22, and a detailed description will be omitted.

[0112] 23 shows an example of an arrangement of light emitting elements 309 in which crosstalk cannot be prevented. The FPC 306 is not shown. In the distance detection device 300, depending on the arrangement of the light emitting element 309, it may not be possible to prevent crosstalk between the light emitting signal wiring 721b and the light receiving signal wiring 721c, 721d or the scanning signal wiring 721e. In the arrangement example shown in Fig. 23, the light emitting element 309 is arranged at a position farther away from the connection terminal 307 than the light receiving element 310 and the scanning device 400. In this arrangement example, in order to electrically connect the light emitting element 309 and the connection terminal 307, the light emitting signal wiring 721b must be routed on the wiring route of the line segment L8 or the line segment L9.

[0113] When the light-emitting signal wiring 721b is wired on the wiring route of the line segment L8, the light-emitting signal wiring 721b passes through a position facing the light-receiving element 310 and the light-receiving signal wirings 721c and 721d in the stacking direction of the FPC 306, sandwiching the insulator layer 720. When the light-emitting signal wiring 721b is wired on the wiring route of the line segment L9, the light-emitting signal wiring 721b passes through a position facing the scanning device 400 and the scanning signal wiring 721e in the stacking direction of the FPC 306, sandwiching the insulator layer 720. Therefore, crosstalk between the light-emitting signal wiring 721b and the light-receiving signal wirings 721c and 721d or the scanning signal wiring 721e cannot be prevented.

[0114] On the other hand, in the distance detection device 300 of this embodiment shown in FIG. 21, the light emitting element 309 is disposed at a position closer to the connection terminal 307 than the light receiving element 310 and the scanning device 400. In such an arrangement of the light emitting element 309, the light emitting signal wiring 721b does not pass through a position facing the scanning device 400 and the scanning signal wiring 721e in the stacking direction of the FPC 306 with the insulating layer 720 sandwiched therebetween. In addition, the light emitting signal wiring 721b does not pass through a position facing the light receiving element 310 and the light receiving signal wirings 721c and 721d in the stacking direction of the FPC 306 with the insulating layer 720 sandwiched therebetween. Therefore, crosstalk between the light emitting signal wiring 721b and the light receiving signal wirings 721c and 721d or the scanning signal wiring 721e can be prevented. Although the preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present invention. It is also possible to appropriately combine the above-mentioned embodiments. For example, the distance detection device 300 shown in FIG. 9 may have a plurality of light emitting elements.

[0115] (Other embodiments) The present invention can also be realized by a process in which a program for implementing one or more of the functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., ASIC) that implements one or more of the functions. [Explanation of symbols]

[0116] 100 Imaging device 200 Lens device 300 Distance detection device

Claims

1. A light emitting means for illuminating a target area with illumination light; a light receiving means for receiving reflected light of the irradiation light by an object on the target area; an acquisition means for acquiring distance information indicating a distance to the object based on a time from when the light emitting means emits the irradiation light to when the light receiving means receives the reflected light; A communication means for communicating the distance information, The lens device is attached to the imaging device at a position surrounding the lens device. A distance detection device comprising:

2. The lens device is detachably attached to the subject side end of the lens device.

2. The distance detection device according to claim 1.

3. A plurality of the light emitting means are provided, The plurality of light emitting means emit light at different timings.

3. The distance detection device according to claim 1 or 2.

4. The irradiation optical axis of at least one of the light emitting means is not parallel to the optical axis of the imaging optical system of the lens device.

4. The distance detection device according to claim 3.

5. Among the plurality of light emitting means, a first light emitting means having a first distance in a vertical direction from a central axis of the distance detection device has a larger inclination of the irradiation optical axis than a second light emitting means having a second distance in a vertical direction from the central axis that is smaller than the first distance.

5. The distance detection device according to claim 4.

6. The first light emitting means is disposed radially inward of the second light emitting means in the distance detection device.

6. The distance detection device according to claim 5.

7. Among the plurality of light emitting means, the first light emitting means irradiates the target area with irradiation light before the second light emitting means.

7. The distance detection device according to claim 5 or 6.

8. The distance from the light emitting means to the light receiving means is longer than the distance from the light emitting means to the central axis of the distance detection device.

8. The distance detection device according to claim 1,

9. The light emitting means and the light receiving means are disposed at positions facing each other across the central axis in a plane perpendicular to the central axis.

9. The distance detection device according to claim 8.

10. a wiring board including the light emitting means, the light receiving means, and the communication means; The communication means is disposed at a position intermediate between the light emitting means and the light receiving means on the wiring board.

10. The distance detection device according to claim 8 or 9.

11. The communication means of the distance detection device is arranged in the same direction as the communication means of the imaging device in a plane perpendicular to the optical axis of the imaging optical system of the lens device.

11. The distance detection device according to claim 8,

12. The distance from the light emitting means to the communication means of the distance detection device is longer than the distance from the light receiving means to the communication means.

12. The distance detection device according to claim 8, wherein the distance detection device is a distance sensor.

13. A heat dissipation member is disposed at a position opposite to the wiring board and across a central axis of the distance detection device.

13. The distance detection device according to claim 8, wherein the distance detection device is a distance measuring device.

14. the distance detection device has an attachment / detachment means for attaching / detaching the distance detection device to / from the lens device, The attachment / detachment means is an operating member biased from an optical axis of an imaging optical system of the lens device toward a radially outer side of the distance detection device; a locking member having a bent portion that fits into the notch of the operating member; a slide member that is biased in a direction parallel to the optical axis and has a step-shaped portion formed thereon; When the operating means is not operated, the locked member is locked by the slide member, and when the operating means is operated, the lock is released.

14. The distance detection device according to claim 1,

15. When the operating means is pressed down, the locking member is released, and the operating means becomes movable in a circumferential direction around the optical axis, When the operating means is not pressed, the locked member is locked, so that the operating means cannot move in the circumferential direction.

15. The distance detection device according to claim 14.

16. When the operating means is not pressed, the locked member abuts on a stepped portion formed on the slide member and is locked; When the operating means is pressed down, the stepped portion separates from the locked member, and the lock is released.

16. The distance detection device according to claim 14 or 15.

17. The locked member has an end portion formed of a flexible material.

17. The distance detection device according to claim 14,

18. The step portions of the slide member have different angles.

18. A distance detection device according to claim 14,

19. The optical axis is sandwiched between a plurality of the attachment / detachment means.

19. A distance detection device according to any one of claims 14 to 18.

20. The operation means is disposed so as to extend radially beyond the outer circumferential surface of the distance detection device.

20. A distance detection device according to claim 14,

21. The operation means is disposed in a region surrounded by an outer diameter arc from a first point to a second point on the outer circumference of the distance detection device, a first tangent to the first point, and a second tangent to the second point.

21. The distance detection device according to claim 20.

22. a wiring board provided with a first signal wiring for electrically connecting the light emitting means to the communication means and a second signal wiring for electrically connecting the light receiving means to the communication means; The first signal wiring and the second signal wiring are provided so as not to overlap each other in a stacking direction of the wiring board.

22. A distance detection device according to claim 1,

23. A scanning means for scanning the light emitted from the light emitting means 23. A distance detection device according to any one of claims 1 to 22.

24. a wiring board having a first signal wiring for electrically connecting the light emitting means to the communication means, a second signal wiring for electrically connecting the light receiving means to the communication means, and a third signal wiring for electrically connecting the scanning means to the communication means; The first signal wiring, the second signal wiring, and the third signal wiring are provided so as not to overlap each other in a stacking direction of the wiring substrate.

24. The distance detection device according to claim 23.

25. The light emitting means is disposed closer to the communication means than the scanning means and the light receiving means.

25. A distance detection device according to claim 24.

26. The light receiving means of the distance detection device and the imaging means of the imaging device are disposed at different positions in the optical axis direction.

26. A distance detection device according to claim 1,

27. The light receiving means of the distance detection device is disposed on the subject side in the optical axis direction relative to the imaging means of the imaging device.

27. A distance detection device according to any one of claims 1 to 26.

28. The imaging device includes a control unit that records distance information between the distance detection device and the imaging means, the distance information being calculated from protrusion amount information held by the lens device, as a correction value.

28. A distance detection device according to any one of claims 1 to 27.

29. The control unit adds the correction value to the distance information acquired by the distance detection device and records the result as distance information to the subject.

29. A distance detection device according to claim 28.

30. The control unit records the amount of movement of the lens device in the optical axis direction each time the lens device moves forward or backward.

30. The distance detection device according to claim 29.

31. The control unit adds the correction value to the distance information acquired by the distance detection device, and records the value obtained by adding or subtracting the amount of movement as distance information to the subject.

31. The distance detection device according to claim 30.

32. A distance detection device according to any one of claims 1 to 31, an imaging means for imaging a subject through the lens device; 1. An imaging device comprising:

33. A display means for displaying a captured image acquired by the imaging, The display means displays the attitude information of the distance detection device received from the distance detection device by superimposing it on the captured image.

33. The imaging device according to claim 32.

34. The display means displays an image indicating the distance information received from the distance detection device on the captured image.

34. The imaging device according to claim 33.

35. a correction unit that corrects the image showing the distance information so that an edge portion of the captured image coincides with an edge portion of the image showing the distance information received from the distance detection device; 35. The imaging device according to claim 34.

Images