Imaging system, imaging device, imaging method, and recording medium

Abstract

An imaging system (10) comprises: a first camera (110) having a first focal length; a second camera (120) having a second focal length; a first mirror (210) disposed so as to correspond to both of the first camera and the second camera; and a first adjustment means (310) that adjusts an optical positional relationship between the first camera or the second camera and the first mirror according to whether an image of an object is captured by the first camera or the second camera. This imaging system makes it possible to appropriately capture images of an object at different distances.

Description

[Technical Field]

[0001] The present disclosure relates to the technical fields of an imaging system, an imaging device, an imaging method, and a recording medium. [Background technology]

[0002] Known systems of this type capture images of living bodies using multiple cameras. For example, Patent Document 1 discloses a technology for capturing images of a subject's iris using three infrared cameras arranged at regular intervals in the vertical direction. Patent Document 2 discloses a technology for capturing images of a subject's face using cameras with different focal lengths.

[0003] As another related technique, Patent Document 3 discloses an imaging device equipped with a wide camera and a narrow camera, in which the imaging direction of the narrow camera is changed using a reflecting mirror. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] International Publication No. 2021 / 090366 [Patent Document 2] International Publication No. 2020 / 255244 [Patent Document 3] Japanese Patent Application Laid-Open No. 2009-104599 Summary of the Invention [Problem to be solved by the invention]

[0005] This disclosure aims to improve upon the techniques disclosed in the prior art documents. [Means for solving the problem]

[0006] One aspect of the imaging system of this disclosure comprises a first camera having a first focal length, a second camera having a second focal length, a first mirror positioned to correspond to both the first camera and the second camera, and a first adjustment means that adjusts the optical positional relationship between the first camera or the second camera and the first mirror depending on whether the first camera or the second camera is used to image the subject.

[0007] One aspect of the imaging device disclosed herein comprises a first camera having a first focal length, a second camera having a second focal length, a first mirror positioned to correspond to both the first camera and the second camera, and a first adjustment means that adjusts the optical positional relationship between the first camera or the second camera and the first mirror depending on whether the first camera or the second camera is used to image the subject.

[0008] One aspect of the imaging method of this disclosure is an imaging method in which at least one computer controls an imaging system including a first camera having a first focal length, a second camera having a second focal length, and a first mirror positioned to correspond to both the first camera and the second camera, and adjusts the optical positional relationship between the first camera or the second camera and the first mirror depending on whether the object is imaged with the first camera or the second camera.

[0009] One aspect of the recording medium of this disclosure is an imaging method for controlling an imaging system including a first camera having a first focal length, a second camera having a second focal length, and a first mirror positioned to correspond to both the first camera and the second camera, wherein a computer program for causing at least one computer to execute the imaging method is recorded, the imaging method adjusting the optical positional relationship between the first camera or the second camera and the first mirror depending on whether the first camera or the second camera is used to image the subject. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a hardware configuration of an imaging system according to a first embodiment. [Figure 2] 1 is a block diagram showing a functional configuration of an imaging system according to a first embodiment. [Figure 3] 4 is a flowchart showing the flow of an imaging operation of the imaging system according to the first embodiment. [Figure 4] FIG. 10 is a block diagram showing a functional configuration of an imaging system according to a modified example of the first embodiment. [Figure 5] 10 is a flowchart showing the flow of an imaging operation of the imaging system according to a modified example of the first embodiment. [Figure 6] FIG. 10 is a side view showing the origins of the viewing angles of the first and second cameras in the imaging system according to the second embodiment. [Figure 7] 10A and 10B are side views showing rotation drive control of the first mirror by the imaging system according to the third embodiment. [Figure 8] 10A to 10C are side views showing variations in the placement of the second camera. [Figure 9] 10A and 10B are front views showing an example of the operation of a drive unit that translates the first and second cameras. [Figure 10] 10 is a side view showing an example of the configuration of a drive unit that rotates and moves the first camera and the second camera. FIG. [Figure 11] 10 is a top view showing an example of the configuration of a drive unit that rotates and moves the first camera and the second camera. FIG. [Figure 12] FIG. 2 is a front view showing a first example of a combination of cameras. [Figure 13] FIG. 10 is a front view showing a second example of a combination of cameras. [Figure 14] FIG. 10 is a front view showing a third example of a combination of cameras. [Figure 15] FIG. 10 is a front view showing a fourth example of a combination of cameras. [Figure 16] FIG. 11 is a block diagram showing the functional configuration of an imaging system according to a fifth embodiment. [Figure 17] FIG. 11 is a conceptual diagram showing remote authentication and nearby authentication by an imaging system according to a fifth embodiment. [Figure 18] 13 is a flowchart showing the flow of authentication operation of the imaging system according to the fifth embodiment. [Figure 19] FIG. 13 is a conceptual diagram showing each phase and processing content in an imaging system according to a sixth embodiment. [Figure 20] FIG. 13 is a block diagram showing the functional configuration of an imaging system according to a seventh embodiment. [Figure 21] FIG. 13 is a front view showing an example of output of guidance information by the imaging system according to the seventh embodiment. [Figure 22] FIG. 13 is a front view showing an example of output of guide information corresponding to image capturing timing in the image capturing system according to the eighth embodiment. [Figure 23] FIG. 13 is a front view showing an example of output of guide information corresponding to timings other than image capture timings in the imaging system according to the eighth embodiment. [Figure 24] FIG. 13 is a block diagram showing the functional configuration of an imaging system according to a ninth embodiment. [Figure 25] FIG. 13 is a front view showing an example of the arrangement of an imaging system according to the ninth embodiment. [Figure 26] 13 is a flowchart showing the flow of an imaging operation of the imaging system according to the ninth embodiment. [Figure 27] FIG. 20 is a side view showing the origins of the viewing angles of the third and fourth cameras in the imaging system according to the tenth embodiment. [Figure 28] FIG. 22 is a front view showing the origin of the viewing angle of each camera in the imaging system according to the tenth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0011] Hereinafter, embodiments of an imaging system, an imaging device, an imaging method, and a recording medium will be described with reference to the drawings.

[0012] First Embodiment An imaging system according to a first embodiment will be described with reference to FIGS. 1 to 3. FIG.

[0013] (Hardware configuration) First, the hardware configuration of the imaging system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the imaging system according to the first embodiment.

[0014] 1, an imaging system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The imaging system 10 may further include an input device 15 and an output device 16. The imaging system 10 also includes an imaging unit 18. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, and imaging unit 18 are connected via a data bus 17.

[0015] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the imaging system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, functional blocks that execute processing for capturing an image of a target are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the imaging system 10.

[0016] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a demand-side platform (DSP), or an application-specific integrated circuit (ASIC). The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0017] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while the processor 11 is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (DRAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0018] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a P-ROM (Programmable Read Only Memory) or an EPROM (Erasable Read Only Memory). Alternatively, other types of non-volatile memory may be used instead of the ROM 13.

[0019] The storage device 14 stores data that is to be saved long-term by the imaging system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0020] The input device 15 is a device that receives input instructions from a user of the imaging system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0021] The output device 16 is a device that outputs information related to the imaging system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the imaging system 10. The output device 16 may also be a speaker or the like that can output information related to the imaging system 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet. The output device 16 may also be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the authentication system 10 as audio.

[0022] The imaging unit 18 is configured to be able to capture an image of a target. The imaging unit 18 is configured to include a first camera 110, a second camera 120, and a first mirror 210.

[0023] First camera 110 and second camera 120 are cameras installed in locations capable of capturing an image of a target. Note that the target here is not limited to humans, but may include animals such as dogs and snakes, robots, etc. First camera 110 and second camera 120 are cameras with different focal lengths. Specifically, first camera 110 has a first focal length, and second camera 120 has a second focal length. Furthermore, first camera 110 and second camera 120 have different viewing angles. First camera 110 and second camera 120 may capture an image of the entire target, or may capture an image of only a portion of the target. Furthermore, first camera 110 and second camera 120 may each capture an image of a different portion of the target. For example, first camera 110 may be configured to capture an image of the target's face (hereinafter referred to as a "face image" as appropriate), and second camera 120 may be configured to capture an image including the target's eyes (hereinafter referred to as an "eye image" as appropriate). The first camera 110 and the second camera 120 may be cameras that capture still images or cameras that capture video. The first camera 110 and the second camera 120 may be configured as visible light cameras or near-infrared cameras. The first camera 110 and the second camera 120 may be configured as the same type of camera. For example, both the first camera 110 and the second camera 120 may be configured as visible light cameras, or both the first camera 110 and the second camera 120 may be configured as near-infrared cameras. The first camera 110 and the second camera 120 may be configured as different types of cameras. For example, the first camera 110 may be configured as a visible light camera, and the second camera may be configured as a near-infrared camera. A plurality of first cameras 110 and a plurality of second cameras may be provided. The first camera 110 and the second camera 120 may have a function to automatically turn off when no images are being captured, for example. In this case, priority may be given to turning off the power of components with short life spans, such as liquid lenses and motors.

[0024] First mirror 210 is a mirror configured to be able to reflect light (specifically, light used by first camera 110 and second camera 120 when capturing images). First mirror 210 is arranged to correspond to both first camera 110 and second camera 120. That is, first camera 110 and second camera 120 are configured to be able to capture images of an object via first mirror 210. Specifically, first camera 110 captures images using light incident via first mirror 210, and second camera 120 also captures images using light incident via first mirror 210. Note that the optical positional relationship between first camera 110, second camera 120, and first mirror 210 is configured to be adjustable. Here, the "optical positional relationship" refers to a relative positional relationship that can affect the optical system including the first camera 110, the second camera 120, and the first mirror 210, and can be adjusted, for example, by moving (e.g., shifting or rotating) any one of the first camera 110, the second camera 120, and the first mirror 210. Also, rather than moving just one of the first camera 110, the second camera 120, and the first mirror 210, multiple may be moved simultaneously. For example, the first mirror 110 may be rotated while the first camera 110 is shifted. Adjustment of this optical positional relationship will be described in detail later.

[0025] 1 shows an example of an imaging system 10 including a plurality of devices, but all or some of the functions may be realized by a single device (imaging device). This imaging device may be configured to include only the above-mentioned processor 11, RAM 12, ROM 13, and imaging unit 18, and the other components (i.e., storage device 14, input device 15, output device 16) may be provided by an external device connected to the imaging device. Also, some of the calculation functions of the imaging device may be realized by an external device (e.g., an external server, cloud, etc.).

[0026] (Functional configuration) Next, the functional configuration of the imaging system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the imaging system according to the first embodiment.

[0027] The imaging system 10 according to the first embodiment is configured as a system that captures an image of a target. More specifically, the imaging system 10 is configured as a system that can capture an image of a moving target (e.g., a pedestrian, etc.). The use of the image captured by the imaging system 10 is not particularly limited, and the image may be used for biometric authentication, for example. For example, the imaging system 10 may be configured as part of an authentication system that performs walk-through authentication by capturing an image of a walking target and performing biometric authentication. Alternatively, the imaging system 10 may be configured as part of an authentication system that captures an image of a stationary target and performs biometric authentication.

[0028] 2, the imaging system 10 according to the first embodiment is configured to include, as components for realizing its functions, the imaging unit 18 already described and a first adjustment unit 310. The first adjustment unit 310 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0029] First adjustment unit 310 is configured to be able to adjust the optical positional relationship between first camera 110 or second camera 120 and first mirror 210. More specifically, when imaging with first camera 110, first adjustment unit 310 adjusts the optical positional relationship between first camera 110 and first mirror 210. This enables first camera 110 to image the target. Furthermore, when imaging with second camera 120, first adjustment unit 310 adjusts the optical positional relationship between second camera 120 and first mirror 210. This enables second camera 120 to image the target. First adjustment unit 310 may be configured to adjust the optical positional relationship between first camera 110, second camera 120, and first mirror 210 by driving at least one of them using a driving unit including, for example, an actuator.

[0030] (Operation flow) Next, the flow of the imaging operation of the imaging system 10 according to the first embodiment (i.e., the operation when capturing an image of a target) will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of the imaging operation of the imaging system according to the first embodiment.

[0031] As shown in FIG. 3 , when an imaging operation by the imaging system 10 according to the first embodiment is started, the first adjustment unit 310 first determines whether the first camera 110 or the second camera 120 will be used to image the target (step S101). The first adjustment unit 310 may determine whether the first camera 110 or the second camera 120 will be used to image the target, for example, based on the positional relationship between the first camera 110, the second camera 120, and the target. For example, when the target is located at a position corresponding to a first focal length, the first adjustment unit 310 may determine that the first camera 110 will be used to image the target. Similarly, when the target is located at a position corresponding to a second focal length, the first adjustment unit 310 may determine that the second camera 120 will be used to image the target. Alternatively, the first adjustment unit 310 may determine whether the first camera 110 or the second camera 120 will be used to image the target, based on information input by a user or the like.

[0032] If it is determined that first camera 110 is to capture an image (step S101: first camera), first adjustment unit 310 adjusts the optical positional relationship between first camera 110 and first mirror 210 (step S102). Then, with the optical positional relationship adjusted, first camera 110 captures an image (step S103).

[0033] On the other hand, if it is determined that imaging is to be performed by second camera 120 (step S101: second camera), first adjustment unit 310 adjusts the optical positional relationship between second camera 120 and first mirror 210 (step S104). Then, with the optical positional relationship adjusted, second camera 120 performs imaging (step S105).

[0034] (Variation) Next, a modified example of the imaging system 10 according to the first embodiment will be described with reference to Figs. 4 and 5. Fig. 4 is a block diagram showing the functional configuration of an imaging system according to the modified example of the first embodiment. Fig. 5 is a flowchart showing the flow of imaging operations of the imaging system according to the modified example of the first embodiment. In Figs. 4 and 5, the same reference numerals are used to denote the same elements or processes as those shown in Figs. 2 and 3.

[0035] 4, the imaging system 10 according to the modification of the first embodiment is configured to include, as components for realizing its functions, an imaging unit 18, a first adjustment unit 310, and an object detection unit 315. That is, the imaging system 10 according to the modification further includes the object detection unit 315 in addition to the configuration of the first embodiment described above (see FIG. 2). The object detection unit 310 may be a processing block realized by, for example, the processor 11 described above (see FIG. 1).

[0036] The object detection unit 315 is configured to be able to detect objects present in the vicinity of the first camera 110 and the second camera 120. More specifically, the object detection unit 315 is configured to be able to detect objects that may be captured by the first camera 110 and the second camera 120 (e.g., objects approaching the first camera 110 and the second camera 120, or objects within a predetermined distance from the first camera 110 and the second camera 120). The object detection unit 315 may detect the object based on the detection results of a position sensor or a distance sensor, for example. Alternatively, the object detection unit 315 may detect the object based on the image capture results of a camera different from the first camera 110 and the second camera 120 (e.g., an overhead camera with a wider image capture range than the first camera 110 and the second camera 120). Furthermore, the object detection unit 315 may be configured to be able to detect the positional relationship between the object and the first camera 110 and the second camera 120. This positional relationship may be used to determine whether to capture an image using first camera 110 or second camera 120. The detection result by object detection section 315 is configured to be output to first adjustment section 310.

[0037] 5, when imaging operation by imaging system 10 according to the modified example of the first embodiment is started, first, target detection unit 315 detects the presence of a target that can be an imaging target of first camera 110 and second camera 120 (step S110). Note that if target detection unit 315 does not detect a target (step S110: NO), the subsequent processes may be omitted.

[0038] On the other hand, if an object is detected by object detection unit 315 (step S110: YES), first adjustment unit 310 determines whether to use first camera 110 or second camera 120 to capture an image of the object (step S101). At this time, first adjustment unit 310 may determine whether to use first camera 110 or second camera 120 to capture an image of the object based on the detection result of object detection unit 315. For example, if it is detected that the object exists at a position corresponding to a first focal length, first adjustment unit 310 may determine that the object should be captured by first camera 110. Similarly, if it is detected that the object exists at a position corresponding to a second focal length, first adjustment unit 310 may determine that the object should be captured by second camera 120.

[0039] If it is determined that first camera 110 is to capture an image (step S101: first camera), first adjustment unit 310 adjusts the optical positional relationship between first camera 110 and first mirror 210 (step S102). Then, with the optical positional relationship adjusted, first camera 110 captures an image (step S103).

[0040] On the other hand, if it is determined that imaging is to be performed by second camera 120 (step S101: second camera), first adjustment unit 310 adjusts the optical positional relationship between second camera 120 and first mirror 210 (step S104). Then, with the optical positional relationship adjusted, second camera 120 performs imaging (step S105).

[0041] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the first embodiment will be described.

[0042] 1 to 3, in the imaging system 10 according to the first embodiment, the optical positional relationship between the first camera 110 and the second camera 120 and the first mirror 210 is adjusted depending on whether the object is imaged by the first camera 110 or the second camera 120. In this way, the first camera 110 and the second camera 120 can each capture an image via the first mirror 210. In other words, it is possible to capture images of objects located at different focal lengths via a common mirror.

[0043] Second Embodiment An imaging system 10 according to a second embodiment will be described with reference to Fig. 6. The second embodiment differs from the first embodiment described above only in some configurations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit a description of other overlapping parts as appropriate.

[0044] (Origin of viewing angle) First, the origin of the line of sight angle in the imaging system 10 according to the second embodiment will be described with reference to Fig. 6. Fig. 6 is a side view showing the origin of the viewing angle of the first camera and the second camera in the imaging system according to the second embodiment.

[0045] As shown in Fig. 6, in the imaging system 10 according to the second embodiment, a first mirror 210 is disposed between a first camera 110 and a second camera 120. When imaging with the first camera 110, the first mirror 210 faces the direction of the first camera 110, and light is incident on the first camera 110 via the first mirror 210 (see Fig. 6(a)). On the other hand, when imaging with the second camera 120, the first mirror 210 faces the direction of the second camera 120, and light is incident on the second camera 120 via the first mirror 210 (see Fig. 6(b)).

[0046] Here, whether capturing an image with first camera 110 or second camera 120, the intersection between the optical axis of each camera and the mirror surface of first mirror 210 is at a common position. In this embodiment, the above-mentioned intersection is referred to as the "gaze angle origin." For example, when first mirror 210 is rotated (the angle is changed) as shown in the figure, the position of the mirror surface that is the center of rotation becomes the common gaze angle origin. Note that, although it is ideal for the gaze angle origins of first camera 110 and second camera 120 to be common (matching), as described above, the technical effects of this embodiment, which will be described later, can be obtained even if there is some misalignment between the respective gaze angle origins.

[0047] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the second embodiment will be described.

[0048] 6, in the imaging system 10 according to the second embodiment, the first camera 110 and the second camera 120 capture images via a common gaze angle origin. This allows a common path for guiding light to the first camera 110 and the second camera 120, thereby simplifying the configuration of the imaging unit 18. Furthermore, for example, when it is required to guide the line of sight to capture an image of a subject's eyes, it is sufficient to guide the line of sight to a single common gaze angle origin regardless of whether the image is captured by the first camera 110 or the second camera 120.

[0049] <Third embodiment> An imaging system 10 according to a third embodiment will be described with reference to Figures 7 and 8. The third embodiment differs from the first and second embodiments described above only in part of the configuration and operation, and other parts may be the same as the first and second embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0050] (Configuration and operation of the imaging unit) First, the configuration and operation of the imaging unit 18 in the imaging system 10 according to the third embodiment will be described with reference to Fig. 7. Fig. 7 is a side view showing the rotation drive control of the first mirror by the imaging system according to the third embodiment.

[0051] As shown in FIG. 7 , in the imaging system 10 according to the third embodiment, the first camera 110 and the second camera 120 are arranged so as to sandwich the first mirror 210 between them. In other words, the first camera 110 and the second camera 120 are arranged so as to face each other directly with the mirror in between. More specifically, the first camera 110 is arranged so as to face the direction of the first mirror 210 from directly below (i.e., directly above). The second camera 120 is arranged so as to face the direction of the first mirror 210 from directly above (i.e., directly below). However, the first camera 110, the second camera 120, and the first mirror 210 according to this embodiment are not limited to this arrangement. For example, the first camera 110 and the second camera 120 may be arranged so as to sandwich the first mirror 210 from the side.

[0052] First adjustment unit 310 according to the third embodiment is configured to be able to control the rotational driving of first mirror 210. First mirror 210 is rotationally driven in accordance with instructions from first adjustment unit 310, thereby adjusting the optical positional relationship between first camera 110 and second camera 120 and first mirror 210. Note that first mirror 210 may be rotationally driven using, for example, a motor or the like.

[0053] For example, when first mirror 210 is rotationally driven so that the mirror surface faces first camera 110 (i.e., downward), light is incident on first camera 110 via first mirror 210. That is, first camera 110 is in a state where it can capture an image via first mirror 210. Also, when first mirror 210 is rotationally driven so that the mirror surface faces second camera 120 (i.e., upward), light is incident on second camera 120 via first mirror 210. That is, second camera 120 is in a state where it can capture an image via first mirror 210. Note that in this case, by performing rotational driving around the line-of-sight angle origin located on the surface of first mirror 210, first camera 110 and second camera 120 can capture images via a common line-of-sight angle origin.

[0054] (Camera placement variations) Next, variations in the placement of the cameras in the imaging system 10 according to the third embodiment will be described with reference to Fig. 8. Fig. 8 is a side view showing variations in the placement of the second camera.

[0055] As shown in FIG. 8 , in the imaging system 10 according to the third embodiment, the first camera 110 and the second camera 120 may be disposed at an angle. For example, when attempting to capture an image of a subject's eyes, if the second camera 120 is disposed so that it faces directly downward as shown in FIG. 8( a), the imaging range will be relatively low and the subject's eyes will not be included in the imaging range. On the other hand, if the second camera 120 is disposed so that it faces slightly diagonally as shown in FIG. 8( b), the imaging range will be relatively high and the subject's eyes will be included in the imaging range. In this way, it is possible to properly capture the subject's eyes, for example, when the subject is tall or nearby. Note that although the arrangement of the second camera 120 has been described here, the first camera 110 may also be disposed at an angle.

[0056] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the third embodiment will be described.

[0057] 7 and 8, in the imaging system 10 according to the third embodiment, the first mirror 210 disposed between the first camera 110 and the second camera 120 is rotationally driven to adjust the optical positional relationship between the first camera 110, the second camera 120, and the first mirror 210. In this way, the optical positional relationship between the first camera 110, the second camera 120, and the first mirror 210 can be adjusted by a relatively simple driving operation. Furthermore, the optical positional relationship can be adjusted by moving only the first mirror 210, without moving the first camera 110 and the second camera 120.

[0058] <Fourth embodiment> An imaging system 10 according to a fourth embodiment will be described with reference to Figures 9 to 11. The fourth embodiment differs only in part of the configuration and operation from the first to third embodiments described above, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0059] (translating camera) First, a translational camera, which is an example of the imaging unit 18 in the imaging system 10 according to the fourth embodiment, will be described with reference to Fig. 9. Fig. 9 is a front view showing an example of the operation of a drive unit that translates the first camera and the second camera.

[0060] 9, in imaging unit 18 equipped with a translational camera, first camera 110 and second camera 120 are arranged side by side. First camera 110 and second camera 120 are arranged so as to face downward. A first mirror 210 is arranged below first camera 110 and second camera 120.

[0061] First camera 110 and second camera 120 are configured to be movable in parallel by first drive unit 410. Note that first camera 110 and second camera 120 do not necessarily have to be movable in a completely parallel state. In other words, "parallel movement" here is a broad concept that refers to movement in the lateral direction (left and right direction) in FIG. 9. First adjustment unit 310 is configured to be able to control the operation of this first drive unit 410. In response to instructions from first adjustment unit 310, first drive unit 410 translates first camera 110 and second camera 120, thereby adjusting the optical positional relationship between first camera 110, second camera 120, and first mirror 210.

[0062] For example, in the state shown in FIG. 9(a), light is incident on the first camera 110 via the first mirror 210. That is, the first camera 110 is ready to capture an image. When the first camera 110 and the second camera 120 are translated from this state toward the right margin (i.e., translated to the right in the figure), the arrangement shown in FIG. 9(b) is achieved. In the state shown in FIG. 9(b), light is incident on the second camera 120 via the first mirror 210. That is, the second camera 120 is ready to capture an image. Note that when the first camera 110 and the second camera 120 are translated from this state again toward the left margin (i.e., translated to the left in the figure), the arrangement shown in FIG. 9(a) is achieved again, and the first camera 110 is ready to capture an image.

[0063] (revolver camera) Next, a revolver-type camera, which is an example of the imaging unit 18 in the imaging system 10 according to the fourth embodiment, will be described with reference to Fig. 10 and Fig. 11. Fig. 10 is a side view showing an example of the configuration of a drive unit that rotates the first camera and the second camera. Fig. 11 is a top view showing an example of the configuration of a drive unit that rotates the first camera and the second camera.

[0064] As shown in FIG. 10 , in the imaging unit 18 equipped with a revolver-type camera, a first camera 110 and a second camera 120 are arranged side by side. Note that here, cameras 130 and 140 are also arranged in addition to the first camera 110 and the second camera 120. The cameras 130 and 140 are configured as cameras having focal lengths different from those of the first camera 110 and the second camera 120, but the cameras 130 and 140 are not essential components. The first camera 110 and the second camera 120 are arranged so as to face downward. A first mirror 210 is arranged below the first camera 110 and the second camera 120.

[0065] As shown in FIG. 11 , the first camera 110, the second camera 120, and the other cameras 130 and 140 are arranged in a circular ring shape when viewed from above. A second driving unit 420 is arranged in a circular ring shape to connect these cameras. The second driving unit 420 is configured to be able to drive the first camera 110, the second camera 120, and the other cameras 130 and 140 in a revolver-like manner. Specifically, the cameras are configured to rotate in a circular motion, thereby exchanging positions with each other clockwise or counterclockwise. The first adjusting unit 310 is configured to be able to control the operation of the second driving unit 420. In response to instructions from the first adjusting unit 310, the second driving unit 420 moves the cameras in a revolver-like manner, thereby adjusting the optical positional relationship between the first camera 110, the second camera 120, and the first mirror 210.

[0066] 10 and 11, light is incident on first camera 110 via first mirror 210. That is, first camera 110 is ready to capture an image. When the cameras are moved clockwise from this state, second camera 120 is positioned above first mirror 210, and light is incident on second camera 120 via first mirror 210. That is, second camera 120 is ready to capture an image. Similarly, when cameras 130 and 140 are moved so that they are positioned above first mirror 210, cameras 130 and 140 are also ready to capture an image.

[0067] (Example of camera combination) Next, a configuration example in which the above-mentioned translational camera (see FIG. 9) and revolver-type camera (see FIGS. 10 and 11) are combined will be described with reference to Figures 12 to 15. Note that the following description will be given taking an example in which cameras are installed above and below first mirror 210.

[0068] (First combination example) First, the first combination example will be described with reference to Fig. 12. Fig. 12 is a front view showing the first combination example of the camera. In Fig. 12, the same components as those shown in Fig. 9 are denoted by the same reference numerals.

[0069] 12, in the first combination example, translational cameras are arranged above and below first mirror 210. Specifically, first camera 110, second camera 120, and first drive unit 410a are arranged above first mirror 210, and third camera 130, fourth camera 140, and first drive unit 410b are arranged below first mirror 210.

[0070] In the first combination example, for example, when a user approaches, images may be captured in the order of first camera 110, second camera 120, third camera 130, and fourth camera 140. Specifically, an image may be captured first by first camera 110, and then first drive unit 410a may be driven to capture an image by second camera 120. Next, first mirror 210 may be driven, and then third camera 130 may be captured, and then first drive unit 410b may be driven to capture an image by fourth camera 140.

[0071] (Second combination example) Next, a second combination example will be described with reference to Fig. 13. Fig. 13 is a front view showing the second combination example of the camera. In Fig. 13, the same components as those shown in Fig. 10 are denoted by the same reference numerals.

[0072] 13, in the second combination example, revolver-type cameras are arranged above and below first mirror 210. Specifically, first camera 110, second camera 120, third camera 130, and second drive unit 420a are arranged above first mirror 210, and fourth camera 140, fifth camera 150, sixth camera 160, and second drive unit 420b are arranged below first mirror 210.

[0073] In the second combination example, for example, when a user approaches, images may be captured in the order of first camera 110, second camera 120, third camera 130, fourth camera 140, fifth camera 150, and sixth camera 160. Specifically, an image may first be captured by first camera 110, then second driver 420a may be driven to capture an image by second camera 120, and second driver 420a may be driven again to capture an image by third camera 130. Next, first mirror 210 may be driven, and then fourth camera 140 may be captured, then second driver 420b may be driven to capture an image by fifth camera 150, and second driver 420b may be driven again to capture an image by sixth camera 160.

[0074] (Third combination example) Next, a third combination example will be described with reference to Fig. 14. Fig. 14 is a front view showing the third combination example of cameras. In Fig. 14, the same components as those shown in Fig. 9 are denoted by the same reference numerals.

[0075] As shown in FIG. 14 , in the third combination example, a translational camera is arranged above first mirror 210, and one regular camera is arranged below. Specifically, first camera 110, second camera 120, and first drive unit 410 are arranged above first mirror 210, and third camera 130 is arranged below the first mirror. Note that a regular camera may be arranged above first mirror 210, and a translational camera may be arranged below first mirror 210. Alternatively, a revolver-type camera may be arranged instead of the translational camera. That is, a revolver-type camera and a regular camera may be combined.

[0076] In the third combination example, for example, when a user approaches, images may be captured in the order of first camera 110, second camera 120, and third camera 130. Specifically, an image may be captured first by first camera 110, and then first drive unit 410 may be driven to capture an image by second camera 120. Next, first mirror 210 may be driven, and then an image may be captured by third camera 130.

[0077] (Fourth combination example) Next, a fourth combination example will be described with reference to Fig. 15. Fig. 15 is a front view showing the fourth combination example of the camera. In Fig. 15, the same elements as those shown in Figs. 9 and 10 are denoted by the same reference numerals.

[0078] 15 , in the fourth combination example, a translational camera is arranged above first mirror 210, and a revolver-type camera is arranged below first mirror 210. Specifically, first camera 110, second camera 120, and first drive unit 420 are arranged above first mirror 210, and fourth camera 140, fifth camera 150, sixth camera 160, and second drive unit 420 are arranged below first mirror 210. It is also possible that a revolver-type camera is arranged above first mirror 210, and a translational camera is arranged below first mirror 210.

[0079] In the fourth combination example, for example, when a user approaches, images may be captured in the order of first camera 110, second camera 120, fourth camera 140, fifth camera 150, and sixth camera 160. Specifically, an image may be captured first by first camera 110, and then first drive unit 420 may be driven to capture an image by second camera 120. Next, first mirror 210 may be driven, and then an image may be captured by fourth camera 140, and then second drive unit 420 may be driven to capture an image by fifth camera 150, and second drive unit 420 may be driven again to capture an image by sixth camera 160.

[0080] The combinations described with reference to FIGS. 12 to 15 are merely examples, and the technical effects of this embodiment can be obtained with other combinations.

[0081] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the fourth embodiment will be described.

[0082] 9 to 11 , in imaging system 10 according to the fourth embodiment, the optical positional relationship between first camera 110 and second camera 120 and first mirror 210 is adjusted by moving first camera 110 and second camera 120. In this way, the optical positional relationship between first camera 110 and second camera 120 and first mirror 210 can be adjusted by a relatively simple driving operation. Furthermore, the optical positional relationship can be adjusted by moving only first camera 110 and second camera 120 without moving first mirror 210.

[0083] Fifth Embodiment An imaging system 10 according to a fifth embodiment will be described with reference to Figures 16 to 18. The fifth embodiment differs only in part of the configuration and operation from the first to fourth embodiments described above, and other parts may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0084] (Functional configuration) First, the functional configuration of the imaging system 10 according to the fifth embodiment will be described with reference to Fig. 16. Fig. 16 is a block diagram showing the functional configuration of the imaging system according to the fifth embodiment. Note that in Fig. 16, the same components as those shown in Fig. 2 are denoted by the same reference numerals.

[0085] 16, the imaging system 10 according to the fifth embodiment is configured to include, as components for realizing its functions, an imaging unit 18, a first adjustment unit 310, a position acquisition unit 320, and an authentication unit 330. That is, the imaging system 10 according to the fifth embodiment further includes, in addition to the configuration of the first embodiment (see FIG. 2), a position acquisition unit 320 and an authentication unit 330. Note that each of the position acquisition unit 320 and the authentication unit 330 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).

[0086] Position acquisition unit 320 is configured to be able to acquire information regarding the position of the target imaged by first camera 110 and second camera 120. Position acquisition unit 320 may be configured to be able to acquire the position of the target using a wide-angle camera separate from first camera 110 and second camera 120. Position acquisition unit 320 may also be configured to be able to acquire the position of the target using a distance sensor, a passage sensor, a floor pressure sensor, or the like. Note that the information regarding the position of the target acquired by position acquisition unit 320 is used to determine whether first camera 110 or second camera 120 will be used to image the target, as will be described in detail later. Position acquisition unit 320 may be configured to have a function for making this determination.

[0087] Authentication unit 330 is configured to be able to perform authentication processing based on images of a target captured by first camera 110 and second camera 120. For example, authentication unit 330 may be configured to be able to perform face authentication using a facial image of the target. Alternatively, authentication unit 330 may be configured to be able to perform iris authentication using an eye image (iris image) of the target. Note that, as the specific method of authentication processing can be appropriately adopted from existing technologies, detailed description thereof will be omitted here.

[0088] (Remote and Nearby Authentication) Next, remote authentication and nearby authentication performed by the imaging system 10 according to the fifth embodiment will be described with reference to Fig. 17. Fig. 16 is a conceptual diagram showing remote authentication and nearby authentication by the imaging system according to the fifth embodiment.

[0089] As shown in FIG. 17 , the imaging system 10 according to the fifth embodiment performs "remote authentication," which captures an image of a target located relatively far from the imaging unit 18 and the gate 25 and performs authentication processing, and "proximal authentication," which captures an image of a target located relatively close to the imaging unit 18 and performs authentication processing. Note that the remote authentication and the distal authentication may be performed using a common modality. For example, both the remote authentication and the distal authentication may be performed as facial authentication, or both the remote authentication and the distal authentication may be performed as iris authentication. Furthermore, the remote authentication and the distal authentication may be performed using different modalities. For example, the remote authentication may be performed as facial authentication, and the distal authentication may be performed as iris authentication. Note that in the example shown in the figure, if the remote authentication or the distal authentication is successful, the gate 25 opens and the target is permitted to pass through.

[0090] Remote authentication is performed by capturing an image of the target with first camera 110 having a first focal length. In this case, first camera 110 may be configured as a camera with a large focal length and a small viewing angle. Remote authentication may be performed when the position of the target acquired by position acquisition unit 320 reaches the first focal length (i.e., the focal length of first camera 110). Remote authentication may be performed, for example, by capturing an image of the target walking toward imaging unit 18.

[0091] Proximity authentication is performed by capturing an image of the target with first camera 110 having a second focal length. In this case, second camera 120 may be configured as a camera with a small focal length and a medium viewing angle. Proximity authentication may be performed when the position of the target acquired by position acquisition unit 320 reaches the second focal length (i.e., the focal length of second camera 120). Remote authentication may be performed, for example, by capturing an image of a target standing near imaging unit 18 (i.e., in front of gate 25).

[0092] (Operation flow) Next, the flow of authentication operation (i.e., operation of performing biometric authentication using a captured image) by the imaging system 10 according to the fifth embodiment will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the flow of authentication operation by the imaging system according to the fifth embodiment.

[0093] 18, when the authentication operation by the imaging system 10 according to the fifth embodiment is started, the position acquisition unit 320 first acquires the position of the target (step S501). Then, the position acquisition unit 320 determines whether the acquired position of the target is a remote authentication position (i.e., a position where remote authentication should be performed) (step S502). The remote authentication position may be set according to the first focal length.

[0094] If the acquired position of the target is not the remote authentication position (step S502: NO), the process of step S501 is executed again. On the other hand, if the acquired position of the target is the remote authentication position (step S502: YES), first adjustment unit 310 adjusts the optical positional relationship so that first camera 110 can capture an image of the target, and first camera 110 captures an image of the target (step S503). Then, authentication unit 330 performs remote authentication using the image captured by first camera 110 (step S504).

[0095] Next, the authentication unit 330 determines whether the remote authentication is successful (step S505). If the remote authentication is successful (step S505: YES), the subsequent processes may be omitted. That is, the target may be allowed to pass without performing nearby authentication.

[0096] On the other hand, if the remote authentication fails (step S505: NO), the position acquisition unit 320 acquires the position of the target (step S506). Then, the position acquisition unit 320 determines whether the acquired position of the target is a nearby authentication position (i.e., a position where nearby authentication should be performed) (step S507). The remote authentication position may be set according to the second focal length.

[0097] If the acquired position of the target is not the nearby authentication position (step S507: NO), the process of step S506 is executed again. On the other hand, if the acquired position of the target is the remote authentication position (step S507: YES), first adjustment unit 310 adjusts the optical positional relationship so that second camera 120 can capture an image of the target, and second camera 120 captures an image of the target (step S508). Then, authentication unit 330 performs nearby authentication using the image captured by second camera 120 (step S509).

[0098] If the proximity authentication is successful, the target may be permitted to pass. On the other hand, if the proximity authentication is unsuccessful, the target may be prohibited from passing. Furthermore, the series of operations up to this point may be repeated each time a new target appears. For example, if the authentication of a first target is successful and the target is permitted to pass, the processing from step S501 may be executed for the subsequent second target. In this way, when processing is executed for different targets consecutively, after the series of operations is completed, processing may be executed to return the first camera 110 to a state where the first camera 110 can capture an image of the first target again. That is, processing may be executed to return the positional relationship adjusted so that the first camera 110 can capture an image of the subsequent second target immediately after the second camera 120 captures the image of the first target. Such positional relationship adjustment may be executed immediately after the first camera 120 captures an image of the first target, or after the subsequent second target is actually detected. When the positional relationship is adjusted by rotating first mirror 210, the rotation direction of first mirror 210 for adjusting the positional relationship to match first camera 110 and the rotation direction of first mirror 210 for adjusting the positional relationship to match first camera 110 may be configured to be the same. For example, suppose that after capturing an image with first camera 110, first mirror 210 is rotated counterclockwise when capturing an image with second camera 120. In this case, when capturing an image again with first camera 110 after capturing an image with second camera 120, first mirror 210 may be rotated one revolution counterclockwise without being rotated clockwise (i.e., without being rotated in the reverse direction). In this way, it is possible to reduce the load, etc., that occurs when changing the rotation direction of the mirror, and therefore to suppress deterioration of the motor, etc.

[0099] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the fifth embodiment will be described.

[0100] 16 to 18, in the imaging system 10 according to the fifth embodiment, remote authentication is first performed using the first camera 110, and if the remote authentication fails, proximity authentication is performed using the second camera 120. In this way, it is possible to appropriately perform authentication processing using the first camera 110 and the second camera 120 (specifically, authentication processing for targets at different distances).

[0101] Sixth Embodiment An imaging system 10 according to a sixth embodiment will be described with reference to Fig. 19. The sixth embodiment differs only in part of the configuration and operation from the first to fifth embodiments described above, and other parts may be the same as the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0102] (Processing for each phase) First, processing according to a plurality of phases executed by the imaging system 10 according to the sixth embodiment will be described with reference to Fig. 19. Fig. 19 is a conceptual diagram showing each phase and processing content in the imaging system according to the sixth embodiment.

[0103] In the imaging system 10 according to the sixth embodiment, imaging is performed by the first camera 110 and the second camera 120 according to a plurality of phases that are preset according to the position or situation of the target. The phase may be determined, for example, based on whether the target's position is within a preset distance. Alternatively, the phase may be determined based on whether the target is walking or standing still. The following description will be given using an example in which the phase is determined using distance, an image of the target's eyes is captured, and iris authentication is performed.

[0104] As shown in FIG. 19, when the target is located far from the imaging unit 18 and the gate 25 (specifically, at a position P=P1′ farther from the trigger T1 as viewed from the imaging unit 18), the remote authentication preparation phase is determined. In the remote authentication preparation phase, the control range of the first adjustment unit 310 is set to a value suitable for remote authentication. Specifically, the control range is set to a value suitable for capturing images using the first camera 110. Thereafter, when the target approaches the imaging unit 18 and the gate 25 slightly (specifically, when the target is located at a position P=P1 between triggers T1 and T2), the remote authentication phase is determined. In the remote authentication phase, the optical positional relationship between the first camera 110 and the first mirror 210 is adjusted to match the position of the target's eyes, and the first camera 110 captures an image. Then, iris authentication (remote authentication) is performed using the eye image captured by the first camera 110.

[0105] Subsequently, when the target approaches further to the imaging unit 18 and gate 25 (specifically, when the position P=P2′ between triggers T2 and T3), it is determined that the current phase is the proximity authentication preparation phase. In the proximity authentication preparation phase, the control range by the first adjustment unit 310 is set to match that for proximity authentication. Specifically, it is set to the control range when capturing an image with the second camera 120. Thereafter, when the target approaches further to the imaging unit 18 and gate 25 (specifically, when the position P=P2 between triggers T3 and T4), it is determined that the current phase is the proximity authentication phase. In the remote authentication phase, the optical positional relationship between the second camera 120 and the first mirror 210 is adjusted to match the position of the target's eyes, and imaging is performed by the second camera 120. Then, iris authentication (proximity authentication) is performed using the eye image captured by the second camera 120.

[0106] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the sixth embodiment will be described.

[0107] 19, in the imaging system 10 according to the sixth embodiment, imaging is performed by the first camera 110 and the second camera 120 according to the determined phase. In this way, the optical positional relationship between the first camera 110, the second camera 120, and the first mirror 210 can be adjusted at an appropriate timing. As a result, it becomes possible to capture an image of the target at an appropriate timing.

[0108] Seventh Embodiment An imaging system 10 according to the seventh embodiment will be described with reference to Figures 20 and 21. The seventh embodiment differs only in part of the configuration and operation from the first to sixth embodiments described above, and other parts may be the same as the first to sixth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0109] (Functional configuration) First, the functional configuration of the imaging system 10 according to the seventh embodiment will be described with reference to Fig. 20. Fig. 20 is a block diagram showing the functional configuration of the imaging system according to the seventh embodiment. Note that in Fig. 20, the same components as those shown in Fig. 2 are denoted by the same reference numerals.

[0110] 20, the imaging system 10 according to the seventh embodiment includes, as components for realizing its functions, an imaging unit 18, a first adjustment unit 310, and a guidance information output unit 340. That is, the imaging system 10 according to the seventh embodiment further includes the guidance information output unit 340 in addition to the configuration of the first embodiment (see FIG. 2). Note that the guidance information output unit 340 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).

[0111] The guidance information output unit 340 is configured to be able to output guidance information that guides the target's gaze to the common gaze angle origin of the first camera 110 and the second camera 120. The guidance information may be displayed, for example, using a display or projection. In this case, the guidance information may be displayed directly at the gaze angle origin (i.e., the intersection of the optical axes of the first camera 110 and the second camera 120 and the mirror surface of the first mirror 210), or may be displayed in a peripheral location thereof or in a location in the direction of the gaze angle origin as seen from the target. Alternatively, the guidance information may be output as audio information via a speaker or the like. In this case, the guidance information may be output so that the target hears the audio coming from the direction of the gaze angle origin.

[0112] (Example of guidance information output) Next, a specific example of guidance information output in the imaging system 10 according to the seventh embodiment will be described with reference to Fig. 21. Fig. 21 is a front view showing an example of output of guidance information by the imaging system according to the seventh embodiment.

[0113] As shown in FIG. 21, the imaging system 10 according to the seventh embodiment may display an arrow (i.e., a mark) indicating the position of the gaze angle origin. A message may also be displayed to guide the user to the gaze angle origin. That is, as shown in the figure, a message such as "Look here" may be displayed. These guidance displays may also be highlighted. For example, the guidance displays may flash or change color.

[0114] In the example shown in FIG. 21 , imaging using near-infrared light is assumed, and therefore a visible light cutoff panel is disposed on the surface of the imaging unit 18. The visible light cutoff panel is configured to be opaque to visible light but transparent to near-infrared light. In this case, guidance information may be displayed on the visible light cutoff panel. Note that when imaging using visible light, an opening is provided on the surface of the imaging unit 18 to allow visible light to pass through, for example. However, when near-infrared light is used, no opening is provided. By not providing an opening, imaging can be performed by guiding the subject's gaze without the subject being aware of the origin of the gaze angle, but it is difficult to determine the origin of the gaze angle just by appearance. The technical effects of this embodiment, described below, are particularly effective in such cases.

[0115] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the seventh embodiment will be described.

[0116] 20 and 21, the imaging system 10 according to the seventh embodiment outputs guidance information for guiding the subject's line of sight to the origin of the line-of-sight angle. In this way, the subject's line of sight can be guided to the origin of the line-of-sight angle, and an image of the subject's eye (iris) can be captured appropriately.

[0117] Eighth Embodiment An imaging system 10 according to the eighth embodiment will be described with reference to Fig. 22 and Fig. 23. The eighth embodiment differs from the seventh embodiment described above only in some of its operations, and other parts may be the same as the first to seventh embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0118] (Example of guidance information output) First, a specific example of guidance information output in the imaging system 10 according to the eighth embodiment will be described with reference to Fig. 22 and Fig. 23. Fig. 22 is a front view showing an example of output of guidance information corresponding to imaging timing in the imaging system according to the eighth embodiment. Fig. 23 is a front view showing an example of output of guidance information corresponding to timing other than imaging timing in the imaging system according to the eighth embodiment.

[0119] 22 and 23, in the imaging system 10 according to the seventh embodiment, an eye mark is displayed around the origin of the line of sight angle as guidance information. This mark is displayed with its eyes open when the target is located at the first focal length (i.e., the timing when the target should be imaged by the first camera 110) and when the target is located at the second focal length (i.e., the timing when the target should be imaged by the second camera 120) (see FIG. 22). This open-eye display mode is intended to prompt the target to look at the origin of the line of sight angle. Therefore, it is preferable that the open-eye mark be displayed in a relatively conspicuous manner.

[0120] On the other hand, when the target is not located at either the first or second focal length (i.e., when the target is not being imaged by the first camera 110 or the second camera 120), the target's eyes are displayed as closed (see FIG. 23). This closed-eye display mode informs the target that they do not need to look at the origin of the line-of-sight angle. Therefore, the closed-eye mark may be displayed in a less conspicuous manner than the open-eye mark.

[0121] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the eighth embodiment will be described.

[0122] 22 and 23, in the imaging system 10 according to the eighth embodiment, the eye mark is displayed to open or close depending on the situation. In this way, the gaze of the subject can be guided in accordance with the timing at which the first camera 110 and the second camera 120 capture images of the subject's eyes.

[0123] Ninth Embodiment An imaging system 10 according to the ninth embodiment will be described with reference to Fig. 24 to Fig. 26. The ninth embodiment differs only in part of the configuration and operation from the first to eighth embodiments described above, and other parts may be the same as the first to eighth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0124] (Functional configuration) First, the functional configuration of the imaging system 10 according to the ninth embodiment will be described with reference to Fig. 24. Fig. 24 is a block diagram showing the functional configuration of the imaging system according to the ninth embodiment. Note that in Fig. 24, the same components as those shown in Fig. 2 are denoted by the same reference numerals.

[0125] 24, the imaging system 10 according to the ninth embodiment is configured to include, as components for realizing its functions, an imaging unit 18, a first adjustment unit 310, and a second adjustment unit 350. That is, the imaging system 10 according to the ninth embodiment further includes the second adjustment unit 350 in addition to the configuration of the first embodiment (see FIG. 2). Note that the second adjustment unit 350 may be a processing block realized by, for example, the above-described processor 11 (see FIG. 1).

[0126] Furthermore, the imaging section 18 according to the ninth embodiment is configured to include a first camera 110, a second camera 120, a first mirror 210, a third camera 510, a fourth camera 520, and a second mirror 220. That is, the imaging section 18 according to the ninth embodiment further includes a third camera 510, a fourth camera 520, and a second mirror 220 in addition to the configuration of the first embodiment (see FIG. 2).

[0127] Third camera 510 is provided as a camera for identifying the eye position of a target when the target is imaged by first camera 110. Fourth camera 520 is provided as a camera for identifying the eye position of a target when the target is imaged by second camera 120. Specifically, when the target is imaged by first camera 110, the eye position of the target is identified from the image captured by third camera 510, and image capturing is performed based on the identified eye position of the target. Similarly, when the target is imaged by second camera 120, the eye position of the target is identified from the image captured by fourth camera 520, and image capturing is performed based on the identified eye position of the target. Note that a method for identifying the eye position of a target from an image can be appropriately adopted from existing technology, and therefore detailed description thereof will be omitted here.

[0128] Second mirror 220 is a mirror configured to reflect light used by third camera 510 and fourth camera 520 when capturing images. Second mirror 220 is arranged to correspond to both third camera 510 and fourth camera 520. That is, third camera 510 and fourth camera 520 are configured to be able to capture images of a target via second mirror 220. Specifically, third camera 510 captures images using light incident via second mirror 220, and fourth camera 520 also captures images using light incident via second mirror 220.

[0129] The second adjustment unit 350 is configured to be able to adjust the optical positional relationship between the third camera 510 or the fourth camera 520 and the second mirror 220. That is, the second adjustment unit 350 has the same function as the first adjustment unit 310 already described. More specifically, when capturing an image with the third camera 510, the second adjustment unit 350 adjusts the optical positional relationship between the third camera 510 and the second mirror 220. This enables the third camera 510 to capture an image of the target. Furthermore, when capturing an image with the fourth camera 520, the second adjustment unit 350 adjusts the optical positional relationship between the fourth camera 520 and the second mirror 220. This enables the fourth camera 520 to capture an image of the target. The second adjustment unit 350 may be configured to adjust the optical positional relationship between the third camera 510, the fourth camera 520, and the second mirror 220 by driving at least one of them using a driving unit including, for example, an actuator.

[0130] (Configuration and operation of the imaging unit) Next, the configuration and operation of the imaging section 18 in the imaging system 10 according to the ninth embodiment will be described with reference to Fig. 25. Fig. 25 is a front view showing an example of the arrangement of the imaging system according to the ninth embodiment.

[0131] As shown in FIG. 25 , in the imaging unit 18 according to the ninth embodiment, as described in the third embodiment (see FIG. 7 ), the first camera 110 and the second camera 120 are arranged to sandwich the first mirror 210 from above and below. A first adjustment unit 310 rotates the first mirror 210, thereby adjusting the optical positional relationship between the first camera 110, the second camera 120, and the first mirror 210. Furthermore, in the ninth embodiment, a third camera 510, a fourth camera 520, and the second mirror 220 are arranged next to the first camera 110, the second camera 120, and the first mirror 210. The first camera 110 and the second camera 120 are arranged to sandwich the second mirror 220 from above and below. The optical positional relationship between third camera 510 and fourth camera 520 and second mirror 220 is adjusted by the same operation as that of first camera 110, second camera 120, and first mirror 210 described above. Specifically, second adjustment unit 350 drives second mirror 220 to rotate, thereby adjusting the optical positional relationship between third camera 510 and fourth camera 520 and second mirror 220.

[0132] (Operation flow) Next, the flow of the imaging operation of the imaging system 10 according to the ninth embodiment will be described with reference to Fig. 26. Fig. 26 is a flowchart showing the flow of the imaging operation of the imaging system according to the ninth embodiment. Note that in Fig. 26, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0133] 26, when the imaging operation by the imaging system 10 according to the ninth embodiment is started, first, the first adjustment unit 310 determines whether the target is to be imaged by the first camera 110 or the second camera 120 (step S101). The result of the determination by the first adjustment unit 310 here is output to the second adjustment unit.

[0134] If it is determined that first camera 110 will capture an image (step S101: First Camera), second adjustment unit 350 adjusts the optical positional relationship between third camera 510 and second mirror 220 (step S901). Then, with the optical positional relationship adjusted, third camera 510 captures an image and identifies the eye position of the subject from the image (step S902). Thereafter, first adjustment unit 310 adjusts the optical positional relationship between first camera 110 and first mirror 210 (step S102). Then, with the optical positional relationship adjusted, first camera 110 captures an image (step S103).

[0135] On the other hand, if it is determined that the second camera 120 will capture an image (step S101: Second Camera), the second adjustment unit 350 adjusts the optical positional relationship between the fourth camera 520 and the second mirror 220 (step S903). Then, with the optical positional relationship adjusted, the fourth camera 520 captures an image and identifies the eye position of the subject from the image (step S902). Thereafter, the first adjustment unit 310 adjusts the optical positional relationship between the second camera 120 and the first mirror 210 (step S104). Then, with the optical positional relationship adjusted, the second camera 120 captures an image (step S105).

[0136] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the ninth embodiment will be described.

[0137] 24 to 26, in the imaging system 10 according to the ninth embodiment, the eye position of the subject is identified using the third camera 510 and the fourth camera 520. The optical positional relationship between the third camera 510 and the fourth camera 520 and the second mirror 220 is adjusted depending on which camera is used to capture the image. In this way, the third camera 510 and the fourth camera 520 can each capture an image via the second mirror 220. In other words, it is possible to capture an image for identifying the eye position of the subject via a common mirror.

[0138] Tenth Embodiment An imaging system 10 according to a tenth embodiment will be described with reference to Figures 27 and 28. The tenth embodiment differs from the above-described ninth embodiment only in some configurations and operations, and other parts may be the same as the first to ninth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0139] (Origin of viewing angle) First, the origin of the line of sight angle in the imaging system according to the tenth embodiment will be described with reference to Fig. 27 and Fig. 28. Fig. 27 is a side view showing the origin of the viewing angle of the third camera and the fourth camera in the imaging system according to the tenth embodiment. Fig. 28 is a front view showing the origin of the viewing angle of each camera in the imaging system according to the tenth embodiment.

[0140] 27, in the imaging system 10 according to the tenth embodiment, a second mirror 220 is disposed between a third camera 510 and a fourth camera 520. When imaging with the third camera 510, the second mirror 220 faces the direction of the third camera 510, and light is incident on the third camera 510 via the second mirror 220 (see FIG. 27(a)). On the other hand, when imaging with the fourth camera 520, the second mirror 220 faces the direction of the fourth camera 520, and light is incident on the fourth camera 520 via the second mirror 220 (see FIG. 27(b)).

[0141] Here, whether capturing an image with first camera 110 or second camera 120, the intersection point between the optical axis of each camera and the mirror surface of first mirror 210 is at a common position. For example, when second mirror 220 is rotated (the angle is changed) as shown in the figure, the position on the mirror surface that is the center of rotation becomes the common origin of the line of sight angle.

[0142] As already explained with reference to FIG. 25 , when the first camera 110, the second camera 120, and the first mirror 210, and the third camera 510, the fourth camera 520, and the second mirror 220 are arranged side by side when viewed from the front, the gaze angle origins of the cameras are also arranged side by side. That is, as shown in FIG. 28 , the common gaze angle origin of the first camera 110 and the second camera 120 and the common gaze angle origin of the third camera 510 and the fourth camera 520 are arranged side by side. Note that the third camera 510 and the fourth camera 520 are cameras that capture images for identifying eye positions, and therefore typically capture images using visible light. For this reason, openings are provided at the gaze angle origins of the third camera 510 and the fourth camera 520, unlike the gaze angle origins of the first camera 110 and the second camera 120.

[0143] (Technical Effects) Next, the technical effects obtained by the imaging system 10 according to the tenth embodiment will be described.

[0144] 27 and 28, in the imaging system 10 according to the tenth embodiment, the third camera 510 and the fourth camera 520 capture images via a common gaze angle origin. This allows a common path for guiding light to the third camera 510 and the fourth camera 520, thereby simplifying the configuration of the imaging unit 18. Furthermore, for example, when it is required to guide the line of sight to capture an image of a subject's eyes, it is sufficient to guide the line of sight to a single common gaze angle origin regardless of whether the image is captured by the third camera 510 or the fourth camera 520.

[0145] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0146] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processing by themselves, but also includes programs that execute processing by operating on an OS in cooperation with other software or functions of an expansion board. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal.

[0147] <Additional Notes> The above-described embodiment may be further described as follows, but is not limited to the following.

[0148] (Appendix 1) The imaging system described in Appendix 1 is an imaging system including a first camera having a first focal length, a second camera having a second focal length, a first mirror arranged to correspond to both the first camera and the second camera, and a first adjustment means that adjusts the optical positional relationship between the first camera or the second camera and the first mirror depending on whether the first camera or the second camera is used to image the target.

[0149] (Appendix 2) The imaging system described in Supplementary Note 2 is the imaging system described in Supplementary Note 1, in which the first camera and the second camera capture images via a common first line-of-sight angle origin.

[0150] (Appendix 3) The imaging system described in Appendix 3 is the imaging system described in Appendix 1 or 2, in which the first camera and the second camera are arranged facing each other across the first mirror, and the first adjustment means adjusts the optical positional relationship between the first camera or the second camera and the first mirror by rotating the first mirror.

[0151] (Appendix 4) The imaging system described in Appendix 4 is the imaging system described in Appendix 1 or 2, wherein the first adjustment means adjusts the optical positional relationship between the first camera or the second camera and the first mirror by moving the first camera and the second camera.

[0152] (Appendix 5) The imaging system described in Appendix 5 is the imaging system described in any one of Appendixes 1 to 4, further comprising: a position acquisition means for acquiring the position of the target; an authentication means for performing authentication processing using images of the target captured by the first camera and the second camera; a first control means for controlling the first camera to capture a first image and perform the authentication processing when the target is located at a position corresponding to the first focal length; and a second control means for controlling the second camera to capture a second image and perform the authentication processing when the authentication processing using the first image fails, after waiting for the target to be located at a position corresponding to the second focal length.

[0153] (Appendix 6) The imaging system described in Appendix 6 is the imaging system described in any one of Appendixes 1 to 5, wherein the first adjustment means adjusts the optical positional relationship between the first camera or the second camera and the first mirror according to a plurality of phases that are set in advance depending on the position or situation of the target.

[0154] (Appendix 7) The imaging system described in Appendix 7 is the imaging system described in any one of Appendixes 2 to 6, further comprising a guidance information output means for outputting information for guiding the line of sight of the target to the first line of sight angle origin when the target is imaged with the first camera and the second camera.

[0155] (Appendix 8) The imaging system described in Appendix 8 is the imaging system described in Appendix 7, wherein the guidance information output means displays an image of eyes around the first gaze angle origin, and controls the display so that the eyes are open when the target is located at the first focal length and the second focal length, and the eyes are closed when the target is not located at the first focal length and the second focal length.

[0156] (Appendix 9) The imaging system described in Appendix 9 is the imaging system described in any one of Appendixes 1 to 8, further comprising: a third camera that captures an image that identifies the eye position of the target when the target is imaged by the first camera; a fourth camera that captures an image that identifies the eye position of the target when the target is imaged by the second camera; a second mirror that is positioned to correspond to both the third camera and the fourth camera; and a second adjustment means that adjusts the optical positional relationship between the third camera or the fourth camera and the second mirror depending on whether the third camera or the fourth camera is used to image the target.

[0157] (Appendix 10) The imaging system described in Supplementary note 10 is the imaging system described in Supplementary note 9, wherein the third camera and the fourth camera capture images via a second line-of-sight angle origin that is common to each other.

[0158] (Appendix 11) The imaging device described in Appendix 11 is an imaging device comprising: a first camera having a first focal length; a second camera having a second focal length; a first mirror arranged to correspond to both the first camera and the second camera; and a first adjustment means for adjusting the optical positional relationship between the first camera or the second camera and the first mirror depending on whether the first camera or the second camera is used to image the subject.

[0159] (Appendix 12) The imaging method described in Appendix 12 is an imaging method in which at least one computer controls an imaging system including a first camera having a first focal length, a second camera having a second focal length, and a first mirror positioned to correspond to both the first camera and the second camera, and adjusts the optical positional relationship between the first camera or the second camera and the first mirror depending on whether the first camera or the second camera is used to image the subject.

[0160] (Appendix 13) The recording medium described in Appendix 13 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an imaging method for controlling an imaging system including a first camera having a first focal length, a second camera having a second focal length, and a first mirror positioned to correspond to both the first camera and the second camera, the imaging method adjusting the optical positional relationship between the first camera or the second camera and the first mirror depending on whether the first camera or the second camera is used to image an object.

[0161] (Appendix 14) The computer program described in Appendix 14 is a computer program that causes at least one computer to execute an imaging method for controlling an imaging system that includes a first camera having a first focal length, a second camera having a second focal length, and a first mirror positioned to correspond to both the first camera and the second camera, and that adjusts the optical positional relationship between the first camera or the second camera and the first mirror depending on whether the first camera or the second camera is used to image an object.

[0162] This disclosure may be modified as appropriate within the scope of the claims and the gist or idea of ​​the invention that can be read from the entire specification, and imaging systems, imaging devices, imaging methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure. [Explanation of symbols]

[0163] 10. Imaging System 11 processors 18 Imaging unit 25 Gates 110 Camera 1 120 Second Camera 210 1st Mirror 220 2nd mirror 310 1st adjustment section 315 Target detection unit 320 Position acquisition part 330 Authentication Department 340 Guidance information output unit 350 2nd adjustment section 410 First Drive Unit 420 Second Drive Unit 510 Third Camera 520 4th Camera

Claims

1. a first camera having a first focal length; a second camera having a second focal length different from the first focal length; a first mirror disposed to correspond to both the first camera and the second camera; a first adjustment means for adjusting an optical positional relationship between the first camera or the second camera and the first mirror by moving the first camera and the second camera depending on whether the first camera or the second camera is used to capture an image of the target; a position acquisition means for acquiring the position of the target; an authentication unit that performs authentication processing using images of the object captured by the first camera and the second camera; a first control means for controlling the first camera to capture a first image and perform the authentication process when the target position is at a position corresponding to the first focal length; a second control means for controlling the second camera to capture a second image and perform the authentication process when the authentication process using the first image fails, after waiting for the target position to reach a position corresponding to the second focal length; and An imaging system comprising:

2. the first camera and the second camera capture images via a common first line-of-sight angle origin; The imaging system according to claim 1 .

3. the first adjustment means adjusts the optical positional relationship between the first camera or the second camera and the first mirror in accordance with a plurality of phases that are set in advance depending on the position or situation of the target. The imaging system according to claim 1 or 2.

4. the first camera and the second camera capture images via a common first line-of-sight angle origin; a guidance information output unit configured to output information for guiding the line of sight of the target to the first line-of-sight angle origin when the target is imaged by the first camera and the second camera, The imaging system according to claim 1 or 3.

5. the guidance information output means displays an image of eyes around the first gaze angle origin, and controls the display so that the eyes are open when the target is located at the first focal length and the second focal length, and the eyes are closed when the target is not located at the first focal length and the second focal length. The imaging system according to claim 4 .

6. 1. An imaging method for controlling, by at least one computer, an imaging system including a first camera having a first focal length, a second camera having a second focal length different from the first focal length, and a first mirror positioned to correspond to both the first camera and the second camera, the method comprising: adjusting an optical positional relationship between the first camera or the second camera and the first mirror by moving the first camera and the second camera depending on whether the first camera or the second camera is used to capture an image of the target; obtaining a location of the object; performing an authentication process using images of the target captured by the first camera and the second camera; When the position of the target is a position corresponding to the first focal length, control is performed so that the first camera captures a first image and performs the authentication process; If the authentication process using the first image fails, control is performed so that the target position is at a position corresponding to the second focal length, and then the second camera captures a second image and performs the authentication process. Imaging method.

7. At least one computer 1. An imaging method for controlling an imaging system including a first camera having a first focal length, a second camera having a second focal length different from the first focal length, and a first mirror disposed to correspond to both the first camera and the second camera, the method comprising: adjusting an optical positional relationship between the first camera or the second camera and the first mirror by moving the first camera and the second camera depending on whether the first camera or the second camera is used to capture an image of the target; obtaining a location of the object; performing an authentication process using images of the target captured by the first camera and the second camera; When the position of the target is a position corresponding to the first focal length, control is performed so that the first camera captures a first image and performs the authentication process; If the authentication process using the first image fails, control is performed so that the target position is at a position corresponding to the second focal length, and then the second camera captures a second image and performs the authentication process. A computer program for executing the imaging method.

Images