Imaging system, imaging device, imaging method, and program

Abstract

To provide an imaging system, an imaging device, an imaging method, and a program capable of imaging an image focused on a plurality of subjects even when the plurality of subjects are at different distance.SOLUTION: An imaging system includes: a plurality of cameras having different focal length; a ranging sensor that measures distance of an imaging range by the plurality of cameras; a specification unit that specifies distance to a plurality of subjects included in the imaging range from ranging results of the ranging sensor; an imaging control unit that performs control to capture each image by the camera corresponding to distance to each subject among the plurality of cameras; and an integration unit that integrates each image captured by the camera corresponding to distance of each subject.SELECTED DRAWING: Figure 3

Description

[Technical Field]

[0001] The present disclosure relates to an imaging system, an imaging device, an imaging method, and a program. [Background technology]

[0002] In recent years, some portable information processing devices such as smartphones and tablet terminals are equipped with multiple cameras such as a wide-angle camera, a telephoto camera, etc. For example, Patent Document 1 discloses a technology that determines depth information from an image captured by a wide-angle camera and an image captured by a telephoto camera, and performs blurring processing on the image according to the depth information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Special Publication No. 2020-535764 Summary of the Invention [Problem to be solved by the invention]

[0004] However, with the above-mentioned conventional technology, when capturing images of multiple subjects at different distances, only one subject is in focus, and the other subjects are blurred in the captured image.

[0005] Therefore, the present disclosure proposes an imaging system, an imaging device, an imaging method, and a program that are capable of capturing an image in which multiple subjects are in focus even when the multiple subjects are at different distances. [Means for solving the problem]

[0006] In order to solve the above problems, one embodiment of an imaging system according to the present disclosure includes a plurality of cameras with different focal lengths, a ranging sensor that measures the imaging range of the plurality of cameras, an identification unit that determines the distance to a plurality of subjects included in the imaging range from the ranging results of the ranging sensor, an imaging control unit that controls each of the plurality of cameras to capture an image corresponding to the distance of each subject, and an integration unit that integrates the images captured by the cameras that correspond to the distance of each subject. [Brief explanation of the drawings]

[0007] [Figure 1] FIG. 1 is a schematic diagram of a smartphone according to an embodiment of the present disclosure. [Figure 2] FIG. 1 is a schematic diagram of a smartphone according to an embodiment of the present disclosure. [Figure 3] FIG. 1 is a block diagram illustrating a configuration example of a smartphone according to an embodiment of the present disclosure. [Figure 4A] FIG. 10 is an explanatory diagram illustrating an imaging technique according to a first comparative example. [Figure 4B] FIG. 10 is an explanatory diagram illustrating an imaging technique according to a second comparative example. [Figure 5] FIG. 1 is an explanatory diagram illustrating an imaging technique according to the present disclosure. [Figure 6] 10 is a flowchart illustrating a processing procedure of an imaging process executed by a smartphone according to an embodiment of the present disclosure. [Figure 7] FIG. 10 is a block diagram illustrating a configuration example of a smartphone according to a modified example of the present disclosure. [Figure 8] FIG. 10 is a block diagram illustrating a configuration example of a smartphone according to a modified example of the present disclosure. [Figure 9] FIG. 10 is a block diagram illustrating a configuration example of a smartphone according to a modified example of the present disclosure. [Figure 10] FIG. 10 is a block diagram illustrating a configuration example of a smartphone according to a modified example of the present disclosure. [Figure 11] FIG. 10 is a block diagram illustrating a configuration example of a smartphone according to a modified example of the present disclosure. [Figure 12A]FIG. 10 is a diagram illustrating an example of the arrangement of a plurality of cameras and distance measurement sensors according to a modified example of the present disclosure. [Figure 12B] FIG. 10 is a diagram illustrating an example of the arrangement of a plurality of cameras and distance measurement sensors according to a modified example of the present disclosure. [Figure 12C] FIG. 10 is a diagram illustrating an example of the arrangement of a plurality of cameras and distance measurement sensors according to a modified example of the present disclosure. [Figure 13] FIG. 10 is a block diagram illustrating a configuration example of a smartphone according to a modified example of the present disclosure. [Figure 14] FIG. 10 is an explanatory diagram illustrating an imaging technique according to a modified example of the present disclosure. [Figure 15] FIG. 1 is a hardware configuration diagram illustrating an example of a computer that realizes the functions of a smartphone. DETAILED DESCRIPTION OF THE INVENTION

[0008] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same components are designated by the same reference numerals, and redundant description will be omitted.

[0009] In the following, an example will be described in which the technology of the present disclosure is applied to a smartphone 10. In the following, an image capturing app that runs on the smartphone 10 may be referred to as a "camera app."

[0010] The present disclosure will be described in the following order. 1. Smartphone configuration 1-1. Smartphone configuration 1-2. Smartphone functional configuration 2. Specific examples of imaging 2-1. First comparative example 2-2. Second Comparative Example 2-3. Imaging method of the present disclosure 3. Processing Procedure 4. Variations 5. Hardware Configuration 6. Conclusion

[0011] <<1. Smartphone configuration>> <1-1. Overview of smartphone configuration> Fig. 1 is a schematic diagram of a smartphone 10 according to an embodiment of the present disclosure. Fig. 2 is a schematic diagram of the smartphone 10 according to an embodiment of the present disclosure. Fig. 1 shows the configuration of the front side of the smartphone 10. Fig. 2 shows the configuration of the back side of the smartphone 10.

[0012] The smartphone 10 is a portable information processing device with a camera function. In this embodiment, the smartphone 10 corresponds to the imaging system and imaging device of the present disclosure. As shown in FIG. 1 , a touch screen TS is provided on the front surface of the smartphone 10. The touch screen TS is a device that integrates a touch panel and a display. The touch screen TS detects touch operations by the user. The touch screen TS can use any of known detection methods such as a capacitance method, a resistive film method, a surface acoustic wave method (or an ultrasonic method), an infrared method, an electromagnetic induction method, and a load detection method.

[0013] The touch screen TS has a rectangular shape. At one end of the smartphone 10 in the longitudinal direction, for example, a camera 16 and an earpiece 15 are provided. The camera 16 has, for example, This is an inward-facing in-camera that is mainly used by the user to capture an image of the user himself / herself. A speaker is provided in the earpiece 15. Although not shown in the drawings, the other end of the smartphone 10 is provided with, for example, a mouthpiece having a microphone.

[0014] On the side of the smartphone 10 along the long side of the touch screen TS, for example, there are provided volume keys 11, a fingerprint sensor 12, a power key 13, and a camera key 14. The volume key 11 is a hardware key for adjusting the volume. The fingerprint sensor 12 is a device for reading fingerprints. The power key 13 is a hardware key for turning the power on and off. The camera key 14 is a hardware key for launching a camera application. The camera key 14 is used as a shutter when taking pictures. The camera key 14 is provided, for example, at a position closer to the mouthpiece (opposite the earpiece 15) than the center of the side of the smartphone 10.

[0015] As shown in FIG. 2, the smartphone 10 is provided with a plurality of cameras 17 and a distance measurement sensor 18 on its rear surface. In the example of FIG. 2, the plurality of cameras 17 include, for example, three cameras 17a-17c. The plurality of cameras 17 are outward-facing cameras that capture images of the user's surroundings, such as the user's line of sight. The plurality of cameras 17 each have a different focal length. For example, camera 17a is an ultra-wide-angle camera with a focal length of approximately 16 mm. Camera 17b is a standard wide-angle camera with a focal length of approximately 24 mm. Camera 17c is a telephoto camera with a focal length of approximately 85 mm to 125 mm.

[0016] The distance measurement sensor 18 is a sensor that employs a so-called active distance measurement method, which emits laser light and measures the distance to an object by observing the reflected light of the emitted laser light. The distance measurement sensor 18 is capable of measuring the distance to the imaging range of the multiple cameras 17. The distance measurement range of the distance measurement sensor 18 only needs to include the imaging range of the multiple cameras 17, and may be wider than the imaging range of the multiple cameras 17. In other words, the distance measurement sensor 18 may be capable of measuring the distance to a wider range than the range that can be captured by the multiple cameras 17.

[0017] A flashlight 19 and an RGBC-IR (Red Green Blue Clear-Infrared) sensor 20 are provided near the camera 17. The flashlight 19 is a device that turns on when capturing an image to brightly illuminate the subject. The RGBC-IR sensor 20 is a device that detects the light source components of the capturing environment when capturing an image. The RGBC-IR sensor 20 acquires, for example, infrared information about the surroundings of the smartphone 10 and identifies the light source environment, such as outdoors, incandescent light, or fluorescent light.

[0018] The smartphone 10 is equipped with a camera app and is capable of capturing images using multiple cameras 17. When the camera app is launched, the smartphone 10 captures video using one of the cameras 17a-17c and displays the captured video as a live view on the touch screen TS. The smartphone 10 accepts the designation of a subject within the live view image displayed on the touch screen TS. The subject may be a person, or may be a non-person object such as a flower or an object. The smartphone 10 is capable of designating multiple subjects. The smartphone 10 also accepts an instruction to capture an image on the touch screen TS.

[0019] When capturing an image with the smartphone 10, the user starts a camera application, specifies the position of a subject within a live view image displayed on the touch screen TS, and issues an instruction to capture the image. When the smartphone 10 receives an instruction to capture an image on the touch screen TS, it captures the image using the multiple cameras 17.

[0020] <1-2. Functional configuration of smartphone> Next, a functional configuration of the smartphone 10 will be described. Fig. 3 is a block diagram showing an example configuration of the smartphone 10 according to an embodiment of the present disclosure. Note that Fig. 3 shows only components necessary for explaining the features of the embodiment of the present disclosure, and omits descriptions of general components.

[0021] In other words, each component shown in Figure 3 is a functional concept and does not necessarily have to be physically configured as shown. For example, the specific form of distribution and integration of each block is not limited to that shown in the figure, and all or part of it can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0022] In addition, in the description using FIG. 3, the description of components that have already been described may be simplified or omitted.

[0023] As shown in FIG. 3, the smartphone 10 includes a camera group 30, a distance measurement sensor 18, a reception unit 31, and an AP (application processor) 32.

[0024] The camera group 30 is a plurality of cameras mounted on the smartphone 10, including the aforementioned plurality of cameras 17 (cameras 17a-17c). Each of the plurality of cameras 17 has an image sensor 40 and a lens 41. The image sensor 40 is, for example, an RGB sensor provided with a sensor unit in which a plurality of light-receiving pixels, each having a light-receiving element that detects red (R), green (G), or blue (B), are arranged in a two-dimensional matrix. Each of the plurality of cameras 17 has a predetermined distance range suitable for imaging. For example, the plurality of cameras 17 are configured so that the distance ranges in which the subject is in focus are different depending on at least one of the image sensor 40 and the lens 41.

[0025] The distance measurement sensor 18 has a light emitting section 18a and a light receiving section 18b.

[0026] The light-emitting unit 18a emits laser light. An example of such a light-emitting unit 18a is a VCSEL (Vertical Cavity Surface Emitting Laser) that emits laser light as a surface light source. Note that the light-emitting unit 18a is not limited to a VCSEL, and may be, for example, an edge-emitting laser. The light-emitting unit 18a is directed in the imaging direction of the multiple cameras 17, and emits laser light into the imaging range of the multiple cameras 17.

[0027] The light receiving unit 18b detects light emitted from the light emitting unit 18a and reflected by an object. The light receiving unit 18b includes a pixel array unit in which a plurality of light receiving pixels, each having a light receiving element that detects the reflected light, are arranged in a two-dimensional matrix. For example, a SPAD (Single Photon Avalanche Diode) can be used as the light receiving element. The light receiving unit 18b is oriented in the imaging direction of the multiple cameras 17, and detects reflected light from the imaging range of the multiple cameras 17.

[0028] Distance measurement sensor 18 is a dToF (direct Time of Flight) sensor that calculates the distance to an object based on the elapsed time from when light is emitted by light-emitting unit 18a to when reflected light is detected by light-receiving unit 18b. Distance measurement sensor 18 measures the distance to each object included in the imaging range by having light-emitting unit 18a emit laser light into the imaging range of multiple cameras 17 and having light-receiving unit 18b receive reflected light from the imaging range. Distance measurement sensor 18 generates and outputs distance data indicating the distance to the object. The distance data may be distance image data composed of the distance to the object, or point cloud data indicating the surface shape of the object using three-dimensional coordinates of multiple observation points on the surface.

[0029] The reception unit 31 receives various instructions from the user. The reception unit 31 may receive instructions through a physical operation by the user, may receive instructions by recognizing the user's voice, or may receive instructions by recognizing the user's gestures. For example, the reception unit 31 receives various inputs from the user via the touch screen TS. For example, when capturing an image, the reception unit 31 displays a live view image and receives designation of a subject within the live view image. The reception unit 31 also receives instructions to capture an image.

[0030] The AP 32 is an example of a processor such as a CPU (Central Processing Unit) or MPU (Micro Processing Unit) that executes the operating system (OS) and various application programs of the smartphone 10. The AP 32 includes a processor and a memory, and controls each unit of the smartphone 10. The AP 32 functions as various processing units and storage units when programs are executed. For example, the AP 32 includes a distance sensor control unit 50, a distance data storage unit 51, an identification unit 52, an imaging control unit 53, an imaging data storage unit 54, and an integration unit 55.

[0031] When the reception unit 31 receives the designation of a subject in a live view image, it stores the position of the designated subject in the image in the distance data storage unit 51. Furthermore, when the reception unit 31 receives an instruction to capture an image, it instructs the distance sensor control unit 50 to start capturing an image.

[0032] When the distance sensor control unit 50 is instructed to start imaging, it controls the distance measurement sensor 18 and performs distance measurement with the distance measurement sensor 18. Under the control of the distance sensor control unit 50, the distance measurement sensor 18 measures the distance to the imaging range of the multiple cameras 17 and outputs distance data.

[0033] The distance data storage unit 51 stores the distance data output from the distance measurement sensor 18. The distance data storage unit 51 also stores setting information. The setting information stores the conditions under which the distance was measured by the distance measurement sensor 18. The setting information also stores the position of a specified subject. When multiple subjects are specified, the setting information stores the position of each specified subject.

[0034] The determination unit 52 determines the distance to the subject included in the imaging range from the distance measurement result by the distance measurement sensor 18. For example, the determination unit 52 reads the distance of the part corresponding to the position of the subject stored in the setting information of the distance data storage unit 51 from the distance of each region within the imaging range stored in the distance data of the distance data storage unit 51, and determines the read distance as the distance to the subject. When multiple subjects are specified, the determination unit 52 reads the distance of the part corresponding to the position of the subject for each subject, and determines the read distance as the distance to the subject.

[0035] The imaging control unit 53 controls the multiple cameras 17 to capture images. For example, the imaging control unit 53 controls the cameras 17, among the multiple cameras 17, to capture images corresponding to the distances of each subject identified by the identification unit 52. The imaging control unit 53 simultaneously captures images using the cameras 17, among the multiple cameras 17, corresponding to the distances of each subject. For example, the imaging control unit 53 captures images by using cameras whose distances to each subject fall within their respective distance ranges, focusing on the subjects within the respective distance ranges. For example, the imaging control unit 53 captures images of subjects using cameras 17 with longer focal lengths as the subjects become more distant. Each camera 17 captures an image using its image sensor 40 under control of the imaging control unit 53, and outputs image data of the captured image.

[0036] The imaging data storage unit 54 stores image data output from each camera 17. The imaging data storage unit 54 also stores setting information. The setting information stores imaging conditions when an image is captured, such as the F-number and shutter speed of each camera 17.

[0037] The integrating unit 55 integrates the image data stored in the imaging data storage unit 54 to generate image data. For example, the integrating unit 55 determines an in-focus area of ​​the image of the image data for each image data. For example, in an in-focus area, the brightness changes significantly at the contour of an object. The integrating unit 55 evaluates the brightness change of the contour of the object depicted in the image of the image data and determines an in-focus area of ​​the image. Note that the integrating unit 55 may use any method for determining an in-focus area as long as it can determine an in-focus area.

[0038] The integrating unit 55 integrates in-focus areas of the images of each image data for the imaging ranges captured by the multiple cameras 17, and generates image data of the imaging ranges. For example, the integrating unit 55 uses an image of the imaging range of one of the image data as a base and integrates in-focus areas of the images of the other image data to generate image data. Note that any image integration method may be used as long as it can integrate in-focus areas. The image data generated by the integrating unit 55 is displayed as a captured image on the touch screen TS, and is also stored as a captured image.

[0039] <<2. Specific examples of imaging>> Next, the imaging method of the present disclosure and an imaging method of a comparative example will be described with reference to Figures 4A, 4B, and 5. In the following, an example in which the subject is a person will be described, but the subject may also be an object other than a person, such as a flower or an object.

[0040] <2-1. First Comparative Example> FIG. 4A is an explanatory diagram illustrating an imaging technique according to a first comparative example. In the first comparative example, an example in which imaging is performed using a smartphone 90 is described. The smartphone 90 is equipped with a wide-angle camera 91, a telephoto camera 92, and a distance sensor 93. In the first comparative example, three people, a child 80a, a man 80b, and a woman 80c, are included in the imaging ranges of the wide-angle camera 91 and the telephoto camera 92. In FIG. 4A, the child 80a is located at a closer distance to the smartphone 90 than the man 80b, followed by the woman 80c. The child 80a is located at an intermediate distance from the smartphone 90, farther from the smartphone 90 than the child 80a. The woman 80c is located at a farther distance from the smartphone 90 than the man 80b. When an image capture command is issued, the smartphone 90 captures the image using either the wide-angle camera 91 or the telephoto camera 92, whichever is more suitable for the distance to the subject. That is, the smartphone 90 captures the image using the wide-angle camera 91 or the telephoto camera 92 depending on the distance to the subject. FIG. 4A shows a case where smartphone 90 captures an image of child 80a as a subject. When an image capture command is issued, smartphone 90 acquires distance data using distance sensor 93 and identifies the distance to child 80a, who is the subject. Then, smartphone 90 captures an image using either wide-angle camera 91 or telephoto camera 92, whichever camera corresponds to the distance to the subject. For example, in the first comparative example, smartphone 90 captures an image using wide-angle camera 91, which corresponds to the distance to child 80a, of wide-angle camera 91 and telephoto camera 92. In this case, man 80b and woman 80c are out of focus, and an image of man 80b and woman 80c is captured in which they are blurred.

[0041] <2-2. Second Comparative Example> FIG. 4B is an explanatory diagram illustrating an imaging technique according to a second comparative example. In the second comparative example, a passive sensor is used as the distance sensor 93 in a smartphone 90. An example of a passive distance sensor 93 is a method of measuring the distance to an object based on parallax using a stereo camera. FIG. 4B shows a case in which the smartphone 90 captures an image of a child 80a as a subject against a dark background. When an image capture command is received, the smartphone 90 measures the distance using the distance sensor 93.

[0042] However, the passive distance sensor 93 cannot correctly determine the distance when the background is dark. As a result, the smartphone 90 cannot correctly determine the distance to the subject, the child 80a, and captures an image based on an incorrect distance. In this case, the man 80b and the woman 80c are not in focus, and the man 80b and the woman 80c are blurred in the captured image.

[0043] 2-3. Imaging Method of the Present Disclosure FIG. 5 is an explanatory diagram illustrating an imaging technique of the present disclosure. FIG. 5 illustrates an example of capturing images using cameras 17a-17c of a smartphone 10 according to an embodiment. In FIG. 5, three people, a child 80a, a man 80b, and a woman 80c, are included in the imaging range of cameras 17a-17c of the smartphone 10. In FIG. 5, the child 80a is located at a closer distance to the smartphone 10 than the man 80b, and the woman 80c is located at a farther distance from the smartphone 10 than the child 80a. The woman 80c is located at a farther distance from the smartphone 10 than the man 80b. The smartphone 10 accepts designation of subjects to be captured. In FIG. 5, the man 80b, the woman 80c, and the child 80a are each designated as subjects. When an image capture command is received, the smartphone 10 acquires distance data using the ranging sensor 18. Here, the smartphone 10 measures distances to objects by emitting laser light and observing the reflected light of the emitted laser light, using a so-called active distance measuring sensor 18. This allows the smartphone 10 to measure the distance to objects even when the background is dark, for example, and identify the distances to the subjects, namely, the man 80b, the woman 80c, and the child 80a.

[0044] The smartphone 10 captures an image using one of the cameras 17a-17c that corresponds to the distance of the subject. In FIG. 5, the distance to the child 80a is within the imaging distance range of the camera 17a, which is an ultra-wide-angle camera, and the camera 17a captures the image of the child 80a. The distance to the man 80b is within the imaging distance range of the camera 17b, which is a wide-angle camera, and the camera 17b captures the image of the man 80b. The distance to the woman 80c is within the imaging distance range of the camera 17c, which is a telephoto camera, and the camera 17c captures the image of the woman 80c. The smartphone 10 focuses the camera 17a on the child 80a, the camera 17b on the man 80b, and the camera 17c on the woman 80c, and simultaneously captures images using the cameras 17a-17c. The smartphone 10 combines the images captured by the cameras 17a-17c to generate image data. For example, the smartphone 10 may combine in-focus areas of the images in each image data set to generate image data of the imaging range. This allows the smartphone 10 to capture an image in which multiple subjects are in focus, even if the multiple subjects are at different distances. For example, the smartphone 10 may capture an image in which the man 80b, the woman 80c, and the child 80a are in focus.

[0045] <<3. Processing Procedure>> Next, a processing procedure of an imaging process executed by the smartphone 10 according to an embodiment of the present disclosure will be described with reference to Fig. 6. Fig. 6 is a flowchart showing the processing procedure of an imaging process executed by the smartphone 10 according to an embodiment of the present disclosure. When capturing an image with the smartphone 10, the user starts a camera app, specifies the position of a subject within a live view image displayed on the touch screen TS, and issues an instruction to capture an image. The imaging process shown in Fig. 6 is executed when an instruction to capture an image is accepted.

[0046] The distance sensor control unit 50 controls the distance measurement sensor 18, and the distance measurement sensor 18 measures distances (step S10). The distance measurement sensor 18 measures the distances within the imaging ranges of the multiple cameras 17 under the control of the distance sensor control unit 50, and outputs distance data. The distance data storage unit 51 stores the distance data output from the distance measurement sensor 18.

[0047] The identification unit 52 identifies the distance to the subject included in the imaging range from the distance measurement result by the distance measurement sensor 18 (step S11). For example, the identification unit 52 reads out the distance of the part corresponding to the position of the subject stored in the setting information of the distance data storage unit 51 from the distance of each area within the imaging range stored in the distance data of the distance data storage unit 51, and identifies the read distance as the distance to the subject. When multiple subjects are specified, the identification unit 52 reads out the distance of the part corresponding to the position of the subject for each subject, and identifies the read distance as the distance to the subject.

[0048] The imaging control unit 53 controls the multiple cameras 17 to capture images (step S12). For example, the imaging control unit 53 controls the cameras 17, among the multiple cameras 17, to capture images corresponding to the distances of each subject identified by the identification unit 52. The imaging control unit 53 simultaneously captures images using the cameras 17, among the multiple cameras 17, that correspond to the distances of each subject. Each camera 17 captures an image using the image sensor 40 under control of the imaging control unit 53, and outputs image data of the captured image. The imaging data storage unit 54 stores the image data output from each camera 17.

[0049] The integrating unit 55 integrates the image data stored in the imaging data storage unit 54 to generate image data (step S13), and ends the process. For example, the integrating unit 55 integrates in-focus areas of the images of each image data for the imaging range captured by the multiple cameras 17, and generates image data of the imaging range.

[0050] <<4. Modifications>> Incidentally, several modifications can be made to the above-described embodiment of the present disclosure.

[0051] In the above-described embodiment of the present disclosure, an example has been described in which a user specifies a subject to be captured. However, this is not limited to this. The smartphone 10 may select the subject. FIG. 7 is a block diagram illustrating an example configuration of a smartphone 10 according to a modified example of the present disclosure. The AP 32 further includes a selection unit 56. The selection unit 56 selects multiple subjects to be captured from multiple objects included in the imaging range of the multiple cameras 17. For example, the selection unit 56 performs image processing to recognize objects in an image captured by any of the multiple cameras 17, and selects a subject from the objects appearing in the image. For example, the selection unit 56 performs face recognition on a live view image and selects the recognized face as the subject. The selection unit 56 stores the position of the selected subject in the setting information of the distance data storage unit 51. The identification unit 52 identifies the distance from the subject stored in the setting information of the distance data storage unit 51 to multiple objects included in the imaging range. This allows the smartphone 10 to capture an image in which a person is the subject and is in focus, even if the user does not specify the person as the subject. Furthermore, the smartphone 10 can capture an image in which multiple subjects are in focus even when the multiple subjects are at different distances. For example, when capturing an image of a man 80b, a woman 80c, and a child 80a shown in FIG. 5, the smartphone 10 can capture an image in which the man 80b, the woman 80c, and the child 80a are in focus.

[0052] In the above-described embodiment of the present disclosure, the case where a user specifies a subject to be captured is described as an example. However, this is not limited thereto. The identification unit 52 may identify multiple subjects from multiple objects included in the imaging range of the multiple cameras 17 in a predetermined order and determine the distances to the identified multiple subjects. The predetermined order may be any order. For example, the predetermined order may be in ascending order of distance, descending order of distance, or the imaging range may be divided into multiple ranges, prioritized, and the ranges with the highest priority may be prioritized. The predetermined order may be determined in advance or may be specified by the user. The predetermined order may also be the order selected by the receiving unit 31. When capturing an image, subjects are often located close to each other. Therefore, the identification unit 52 may identify the distances to multiple objects included in the imaging range of the multiple cameras 17 as multiple subjects in descending order of distance. For example, the identification unit 52 may identify the distances to a predetermined number of areas in the imaging range stored in the distance data storage unit 51, in descending order of distance. The predetermined number may be a fixed value or a variable value. The predetermined number may be set by the user.

[0053] In the above-described embodiment of the present disclosure, an example has been described in which the multiple cameras 17 are configured to have different distance ranges in which they can focus on a subject. However, this is not limited to this. The multiple cameras 17 may each have a lens 41 that can adjust the focus. FIG. 8 is a block diagram showing an example configuration of a smartphone 10 according to a modified example of the present disclosure. For example, the multiple cameras 17 each have a lens 41 that can move along an optical axis, and the focus can be adjusted by the lens 41. The imaging control unit 53 captures images by adjusting the focus of the lens 41 of each of the multiple cameras 17 corresponding to the distance of each subject. This allows the smartphone 10 to capture images in which multiple subjects are in focus, even if the multiple subjects are at different distances. For example, when the smartphone 10 captures images of a man 80b, a woman 80c, and a child 80a shown in FIG. 5, the smartphone 10 can capture images in which the man 80b, the woman 80c, and the child 80a are in focus.

[0054] In the above-described embodiment of the present disclosure, the AP 32 functions as the distance sensor control unit 50, the distance data storage unit 51, the identification unit 52, the imaging control unit 53, the imaging data storage unit 54, and the integration unit 55. However, this is not limited to this. The distance sensor control unit 50, the distance data storage unit 51, the identification unit 52, the imaging control unit 53, the imaging data storage unit 54, and the integration unit 55 may be realized by multiple APs and a calculation unit. FIG. 9 is a block diagram showing an example configuration of a smartphone 10 according to a modified example of the present disclosure. The smartphone 10 further includes an AP 33 and a calculation unit 34. The AP 32, the AP 33, and the calculation unit 34 each include a processor and memory, and function as various processing units and storage units when programs are executed. The AP 32 is mainly responsible for processing related to the distance sensor 18 and has the functions of the distance sensor control unit 50 and the distance data storage unit 51. The AP 33 is mainly responsible for processing related to the multiple cameras 17 and has the functions of the identification unit 52, the imaging control unit 53, and the imaging data storage unit 54. The calculation unit 34 is mainly responsible for image processing and has the function of the integration unit 55. Even in this case, the smartphone 10 can capture an image in which multiple subjects are in focus, even if the multiple subjects are at different distances. For example, when the smartphone 10 captures an image of a man 80b, a woman 80c, and a child 80a shown in FIG. 5, the smartphone 10 can capture an image in which the man 80b, the woman 80c, and the child 80a are in focus.

[0055] In the above-described embodiment of the present disclosure, an example has been described in which images captured by multiple cameras 17 on the smartphone 10 are integrated. However, this is not limiting. For example, images may be integrated in a server device separate from the smartphone 10. That is, the disclosed technology may be realized in a system configuration including the smartphone 10 and a server device. FIG. 10 is a block diagram showing an example configuration of a smartphone 10 according to a modified example of the present disclosure. The smartphone 10 is capable of communicating with a server device 60 via a network such as a mobile phone network or the Internet. The server device 60 is realized, for example, as a cloud server. The smartphone 10 transmits image data captured by each camera 17 to the server device 60. For example, the AP 32 transmits image data and setting information stored in the image data storage unit 54 to the server device 60. The server device 60 has the function of an integration unit 55. The integration unit 55 integrates image data received from the smartphone 10 to generate image data. The server device 60 has higher processing power than the smartphone 10. Therefore, by performing image processing for integrating image data in the server device 60, a wide range of integration processing can be performed with high precision.

[0056] On the other hand, when images captured by the multiple cameras 17 are integrated in the smartphone 10 as in the above-described embodiment, the smartphone 10 does not require power for communication with the server device 60, and therefore power consumption can be reduced. Furthermore, since the smartphone 10 does not communicate with external devices, security can be ensured and communication costs can be reduced.

[0057] In the above-described embodiment of the present disclosure, the integrating unit 55 determines in-focus areas in each image captured by the multiple cameras 17 and integrates the in-focus areas of each image. However, this is not limited to this. The integrating unit 55 may integrate portions corresponding to the position of the subject in each image captured by the multiple cameras 17. Furthermore, the integrating unit 55 may integrate in-focus portions of each image as well as out-of-focus blurred portions other than the subject. For example, the integrating unit 55 may also integrate portions other than the subject, such as blurred backgrounds. FIG. 11 is a block diagram showing an example configuration of a smartphone 10 according to a modified example of the present disclosure. The integrating unit 55 acquires from the identifying unit 52 a portion corresponding to the position of the subject used to identify the distance to the subject. Note that the integrating unit 55 may also acquire a portion corresponding to the position of the subject from the setting information of the distance data storage unit 51. The integrating unit 55 integrates portions corresponding to the position of the subject in each image captured by the multiple cameras 17. For example, the integrating unit 55 generates image data by integrating portions of each image corresponding to the position of the subject, based on an image of the imaging range of one of the image data. The portions of each image corresponding to the position of the subject are captured with the focus on the subject. Therefore, by integrating the portions of each image corresponding to the position of the subject, the smartphone 10 can capture images in which multiple subjects are in focus, even if the multiple subjects are at different distances. For example, when the smartphone 10 captures images of a man 80b, a woman 80c, and a child 80a shown in FIG. 5, it can capture images in which the man 80b, the woman 80c, and the child 80a are in focus.

[0058] In the above-described embodiment of the present disclosure, an example has been described in which multiple cameras 17 are arranged in a line and the ranging sensor 18 is arranged outside the multiple cameras 17. However, this is not limited to this. Each camera 17 is preferably arranged adjacent to the ranging sensor 18. Furthermore, it is preferable to arrange the cameras 17 so that the distances between the cameras 17 and the ranging sensors 18 are equal. FIG. 12A is a diagram showing an example of the arrangement of multiple cameras 17 and ranging sensors 18 according to a modified example of the present disclosure. FIG. 12A shows an example of the arrangement of two cameras 17 and ranging sensors 18. The ranging sensor 18 is arranged between the two cameras 17 and adjacent to the two cameras 17. By arranging the ranging sensor 18 adjacent to the two cameras 17 in this way, the parallax between the ranging sensor 18 and each camera 17 can be reduced.

[0059] When multiple cameras 17 are arranged in a line and a ranging sensor 18 is arranged outside the multiple cameras 17, it is preferable that the ranging sensor 18 be arranged adjacent to the wide-angle camera. FIG. 12B is a diagram illustrating an example of an arrangement of multiple cameras 17 and ranging sensors 18 according to a modified example of the present disclosure. FIG. 12B illustrates an example of an arrangement of two cameras 17 and ranging sensors 18. In FIG. 12B, two cameras 17 are arranged adjacent to each other on the left and right. The camera 17x on the right is a wide-angle camera. The ranging sensor 18 is arranged adjacent to this right camera 17x. FIG. 12B illustrates a positional shift between an object located at the center of the angle of view of the camera 17x and the center of the ranging range of the ranging sensor 18 due to the parallax between the camera 17x and the ranging sensor 18. If there is no parallax between the camera 17x and the ranging sensor 18, there is no positional shift. If the ranging sensor 18 is not adjacent to the camera 17x and the parallax is large, the positional shift becomes large. When the distance measurement sensor 18 is adjacent to the camera 17x and the parallax is small, the positional deviation is small. FIG. 12C is a diagram showing an example of the arrangement of the multiple cameras 17 and the distance measurement sensor 18 according to a modified example of the present disclosure. In FIG. 12C, two cameras 17 are arranged adjacent to each other on the left and right. The camera 17y on the right side is a telephoto camera. The distance measurement sensor 18 is arranged adjacent to the right camera 17y. FIG. 12C shows an example of an image captured by the camera 17x due to the parallax between the camera 17x and the distance measurement sensor 18. The camera 17x can capture almost the same image both when there is no parallax with the distance measurement sensor 18 and when the camera 17x is not adjacent to the distance measurement sensor 18 and the parallax with the distance measurement sensor 18 is large. As such, the parallax between the telephoto camera and the distance measurement sensor 18 has little effect on the imaging results. Therefore, it is preferable to arrange the distance measurement sensor 18 adjacent to the wide-angle camera. This makes it possible to obtain an integrated result with less blur when integrating multiple images captured by multiple cameras 17.

[0060] In the above-described embodiment of the present disclosure, an example has been described in which multiple cameras 17 capture images of multiple subjects, respectively, and the captured images are integrated. However, this is not limited to this. Multiple subjects may be captured by a single camera 17 at different capture times, and the captured images may be integrated. FIG. 13 is a block diagram showing an example configuration of a smartphone 10 according to a modified example of the present disclosure. The smartphone 10 includes one camera 17. The camera 17 has a variable focal length lens 41, and is configured to capture images ranging from ultra-wide angle to telephoto by adjusting the focal length. The imaging control unit 53 controls the camera 17 to capture images. For example, the imaging control unit 53 adjusts the focus of the lens 41 and controls the sequential capture of images of each subject identified by the identification unit 52. This allows the smartphone 10 to capture images in which multiple subjects are in focus, even if the subjects are at different distances. The imaging data storage unit 54 stores each image data output from the camera 17. The integration unit 55 integrates the image data stored in the imaging data storage unit 54 to generate image data. FIG. 14 is an explanatory diagram illustrating an imaging method according to a modified example of the present disclosure. FIG. 14 illustrates an example of imaging using a single camera 17 of a smartphone 10 according to a modified example of the present disclosure. The camera 17 is configured to be able to capture images from an ultra-wide angle to a telephoto angle by adjusting the focal length. In FIG. 14, three people, a child 80a, a man 80b, and a woman 80c, are included in the imaging range of the camera 17 of the smartphone 10. In FIG. 14, the child 80a is located at a closer distance to the smartphone 90. The man 80b is located at an intermediate distance from the smartphone 90, farther away than the child 80a. The woman 80c is located at a farther distance from the smartphone 90 than the man 80b. The smartphone 10 accepts designation of subjects to be imaged. In FIG. 14, the man 80b, the woman 80c, and the child 80a are each designated as subjects. When an image capture command is received, the smartphone 10 acquires distance data using the ranging sensor 18. The smartphone 10 captures images of the man 80b, the woman 80c, and the child 80a with the camera 17 at different times.For example, the smartphone 10 adjusts the camera 17 to an ultra-wide angle by changing the focal length, and focuses the camera 17 on the child 80a to capture an image. Next, the smartphone 10 adjusts the camera 17 to a wide angle by changing the focal length, and focuses the camera 17 on the man 80b to capture an image. Next, the smartphone 10 adjusts the camera 17 to a telephoto angle by changing the focal length, and focuses the camera 17 on the woman 80c to capture an image. The smartphone 10 integrates the images of the image data captured by the camera 17 at different capture times to generate image data. This allows the smartphone 10 to capture an image in which multiple subjects are in focus, even if the multiple subjects are at different distances. Furthermore, when the subjects are stationary, the smartphone 10 can obtain optimal integration results because there is no parallax between the images of the image data captured by the camera 17 at different capture times. Furthermore, by using only one camera 17, the smartphone 10 can reduce the volume and surface area occupied by the camera 17. Furthermore, by using only one camera 17, the smartphone 10 can reduce manufacturing costs.

[0061] In the above-described embodiment of the present disclosure, the camera 17 is described as a camera that captures color images using RGB. However, this is not limited thereto. The camera 17 may be a camera that captures black-and-white images. The camera 17 may also be a camera that captures infrared images. The image sensor 40 of the camera 17 may be a stacked image sensor in which a sensor unit that detects light and a circuit unit that reads the charge accumulated in the sensor unit are stacked. The image sensor 40 may also be a flat image sensor in which the circuit unit is formed on the same layer as the sensor unit, such as around the sensor unit. A stacked image sensor can reduce the chip area. This allows the smartphone 10 to have multiple cameras 17 compatible with various focal lengths, thereby capturing images in focus of multiple subjects at various distances. Flat image sensors are cheaper than stacked types, thereby reducing the manufacturing cost of the camera 17. The light-emitting unit 18a and the light-receiving unit 18b of the ranging sensor 18 may be stacked or flat. If the ranging sensor 18 is a stacked type, the number of simultaneous ranging points can be increased and the number of pixels can be increased, allowing for ranging of many subjects. Also, if the ranging sensor 18 is a stacked type, it can achieve high-resolution ranging, allowing for more focus selection by the user. On the other hand, if the ranging sensor 18 is a flat type, it is cheaper than a stacked type, allowing for a reduction in the manufacturing cost of the ranging sensor 18.

[0062] In the above-described embodiment of the present disclosure, the camera 17 and the ranging sensor 18 are disposed separately. However, this is not limiting. The camera 17 and the ranging sensor 18 may be integrated. For example, the image sensor 40 of the camera 17 and the ranging sensor 18 may be stacked and configured as a single chip, and the camera 17 and the ranging sensor 18 may be integrated. In this case, there is no parallax between the ranging sensor 18 and the camera 17, so optimal integration results can be obtained. Furthermore, the camera 17 and the ranging sensor 18 can be realized by a single sensor, thereby improving area efficiency.

[0063] In the above-described embodiment of the present disclosure, the distance measurement sensor 18 performs distance measurement using the dToF method. However, this is not limiting. The distance measurement method of the distance measurement sensor 18 may be the iToF (Indirect Time of Flight) method, the Structured Light method, or the FMCW (Frequency Modulated Continuous Wave) method. The dToF method can measure the distance to a long-distance subject. The dToF method is also effective when the distance to the subject to be imaged is a mixture of short and long distances. The iToF method has high resolution, so it can acquire a large amount of distance information to the subject, thereby expanding the range of focus selection. The iToF method also has high distance measurement accuracy, so it can select the camera 17 that is optimal for the distance to the subject. The Structured Light method has high distance measurement accuracy at short distances, so it can select the camera 17 that is optimal for a close-distance subject. The FMCW method can measure the distance to the subject with higher accuracy than the ToF method, so it can calculate the optimal focal length.

[0064] Furthermore, among the processes described in the above-described embodiments of the present disclosure, all or part of the processes described as being performed automatically can be performed manually, or all or part of the processes described as being performed manually can be performed automatically using known methods. In addition, the information including the processing procedures, specific names, various data, and parameters shown in the above documents and drawings can be changed as desired unless otherwise specified. For example, the various information shown in each drawing is not limited to the information shown in the drawings.

[0065] Furthermore, the components of each device shown in the figure are conceptual functional components and do not necessarily have to be physically configured as shown in the figure. In other words, the specific form of distribution and integration of each device is not limited to that shown in the figure, and all or part of them can be functionally or physically distributed and integrated in any unit depending on various loads, usage conditions, etc.

[0066] The above-described embodiments of the present disclosure can be combined as appropriate within the scope of the present disclosure without causing any inconsistency in the processing content. The order of the steps shown in the sequence diagrams or flowcharts of the present embodiments can be changed as appropriate.

[0067] <<5. Hardware Configuration>> The smartphone 10 and server device 60 according to the above-described embodiments of the present disclosure are realized by, for example, a computer 1000 configured as shown in FIG. 15. The smartphone 10 will be described as an example. FIG. 15 is a hardware configuration diagram showing an example of the computer 1000 that realizes the functions of the smartphone 10. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM 1300, a secondary storage device 1400, a communication interface 1500, and an input / output interface 1600. The components of the computer 1000 are connected by a bus 1050.

[0068] The CPU 1100 operates and controls each unit based on programs stored in the ROM 1300 or the secondary storage device 1400. For example, the CPU 1100 loads the programs stored in the ROM 1300 or the secondary storage device 1400 into the RAM 1200 and executes processing corresponding to the various programs.

[0069] The ROM 1300 stores boot programs such as a Basic Input Output System (BIOS) executed by the CPU 1100 when the computer 1000 is started, and programs that depend on the hardware of the computer 1000 .

[0070] The secondary storage device 1400 is a computer-readable recording medium that non-temporarily records programs executed by the CPU 1100 and data used by such programs. Specifically, the secondary storage device 1400 is a recording medium that records an imaging processing program according to an embodiment of the present disclosure, which is an example of program data 1450.

[0071] The communication interface 1500 is an interface for connecting the computer 1000 to an external network 1550. For example, the CPU 1100 receives data from other devices and transmits data generated by the CPU 1100 to other devices via the communication interface 1500.

[0072] The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a microphone or a touch panel via the input / output interface 1600. The CPU 1100 also transmits data to an output device such as a display or a speaker via the input / output interface 1600. The input / output interface 1600 may also function as a media interface for reading programs and the like recorded on a predetermined recording medium. Examples of media include optical recording media such as a DVD (Digital Versatile Disc) or a PD (Phase Change Rewritable Disk), magneto-optical recording media such as an MO (Magneto-Optical disk), tape media, magnetic recording media, and semiconductor memories.

[0073] For example, when the computer 1000 functions as the smartphone 10 according to an embodiment of the present disclosure, the CPU 1100 of the computer 1000 executes a program loaded onto the RAM 1200 to implement the functions of the AP 32. The secondary storage device 1400 stores the program according to the present disclosure and data in the distance data storage unit 51 and the imaging data storage unit 54. The CPU 1100 reads and executes the program data 1450 from the secondary storage device 1400, but as another example, the CPU 1100 may obtain these programs from another device via an external network 1550.

[0074] <<6. Conclusion>> As described above, according to one embodiment of the present disclosure, the smartphone 10 (corresponding to an example of an "imaging system" or "imaging device") includes multiple cameras 17, a ranging sensor 18, an identification unit 52, an imaging control unit 53, and an integration unit 55. The multiple cameras 17 have different focal lengths. The ranging sensor 18 measures the distances to the imaging ranges of the multiple cameras 17. The identification unit 52 identifies the distances to multiple subjects included in the imaging range based on the distance measurement results from the ranging sensor 18. The imaging control unit 53 controls the cameras 17, among the multiple cameras 17, to capture images corresponding to the distances to each of the subjects. The integration unit 55 integrates the images captured by the cameras 17 corresponding to the distances to each of the subjects. This allows the smartphone 10 to capture images in which multiple subjects are in focus, even if the multiple subjects are at different distances.

[0075] Although the embodiments of the present disclosure have been described above, the technical scope of the present disclosure is not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of the present disclosure. Furthermore, components of different embodiments and modifications may be combined as appropriate.

[0076] Furthermore, the effects of each embodiment described in this specification are merely examples and are not intended to be limiting, and other effects may also be obtained.

[0077] The present technology can also be configured as follows. (1) Multiple cameras with different focal lengths a distance measurement sensor that measures the distance to the imaging range of the plurality of cameras; an identification unit that identifies distances to a plurality of subjects included in the imaging range based on the distance measurement results obtained by the distance measurement sensor; an imaging control unit that controls the cameras corresponding to the distances of the respective objects to capture images, among the plurality of cameras; an integration unit that integrates the images captured by the cameras corresponding to the distances of the respective subjects; An imaging system having: (2) The imaging control unit simultaneously captures images using cameras corresponding to the distances of the respective objects among the plurality of cameras. The imaging system according to (1) above. (3) a receiving unit that receives designation of a plurality of subjects to be imaged, The specifying unit specifies distances to a plurality of subjects designated by the accepting unit among a plurality of objects included in the imaging range. The imaging system according to (1) or (2). (4) a selection unit for selecting a plurality of subjects to be imaged from a plurality of objects included in the image capturing range, The specifying unit specifies distances to a plurality of subjects selected by the selecting unit from a plurality of objects included in the imaging range. The imaging system according to any one of (1) to (3) above. (5) The identification unit identifies a plurality of subjects from a plurality of objects included in the imaging range in a predetermined order, and identifies distances to the identified plurality of subjects. The imaging system according to any one of (1) to (3) above. (6) The plurality of cameras each have a predetermined imaging distance range, The imaging control unit controls the cameras to capture images of the respective objects within the respective distance ranges. The imaging system according to any one of (1) to (5) above. (7) Each of the plurality of cameras has a lens with adjustable focus, The imaging control unit controls the cameras corresponding to the distances of the respective objects to capture images by adjusting the focal points of the lenses of the cameras. The imaging system according to any one of (1) to (5) above. (8) The integration unit determines an in-focus area of ​​each image captured by the plurality of cameras, integrates the in-focus areas of each image, and generates image data of the captured image range. The imaging system according to any one of (1) to (7) above. (9) The integration unit integrates a portion of each image captured by the plurality of cameras that corresponds to a position of a subject. The imaging system according to any one of (1) to (7) above. (10) The distance measuring sensor emits a laser beam and measures the distance to an object by observing the reflected light of the emitted laser beam. The imaging system according to any one of (1) to (9) above. (11) The plurality of cameras, the distance measurement sensor, the identification unit, the imaging control unit, and the integration unit are provided in a portable information processing device. The imaging system according to any one of (1) to (10) above. (12) the plurality of cameras, the distance measuring sensor, the identification unit, and the imaging control unit are provided in a portable information processing device, The integration unit is provided in a server device that can communicate with the information processing device. The imaging system according to any one of (1) to (10) above. (13) Multiple cameras with different focal lengths a distance measurement sensor that measures the distance to the imaging range of the plurality of cameras; an identification unit that identifies distances to a plurality of subjects included in the imaging range based on the distance measurement results obtained by the distance measurement sensor; an imaging control unit that controls the cameras corresponding to the distances of the respective objects to capture images, among the plurality of cameras; an integration unit that integrates the images captured by the cameras corresponding to the distances of the respective subjects; An imaging device having the above configuration. (14) Identifying distances to a plurality of subjects included in an imaging range from distance measurement results obtained by a distance measurement sensor that measures distances to imaging ranges taken by a plurality of cameras with different focal lengths; among the plurality of cameras, an image is captured by a camera corresponding to the distance of each subject; The images taken by the cameras corresponding to the distance of each subject are integrated. Imaging method. (15) Identifying distances to a plurality of subjects included in an imaging range from distance measurement results obtained by a distance measurement sensor that measures distances to imaging ranges taken by a plurality of cameras with different focal lengths; among the plurality of cameras, an image is captured by a camera corresponding to the distance of each subject; The images taken by the cameras corresponding to the distance of each subject are integrated. A program that causes a computer to perform a process. [Explanation of symbols]

[0078] 10,90 Smartphone 16, 17, 17a-17c, 17x, 17y cameras 18 Distance measurement sensor 18a Light-emitting part 18b Light receiving section 19. Flashlight 20 RGBC-IR (Red Green Blue Clear-Infrared) sensors 30 cameras 31 Reception 32,33 AP 34 Arithmetic section 40 Image Sensor 41 Lens 50 Distance sensor control unit 51 Distance data storage unit 52 Specific part 53 Imaging control unit 54 Imaging data storage unit 55 Integration Department 56 Selection section 60 Server equipment 80a Children 80b male 80c women 91 Wide-angle camera 92 Telephoto Camera 93 Distance Sensor

Claims

1. Multiple cameras with different focal lengths a distance measurement sensor that measures the distance to the imaging range of the plurality of cameras; an identification unit that identifies distances to a plurality of subjects included in the imaging range based on the distance measurement results obtained by the distance measurement sensor; an imaging control unit that controls the cameras corresponding to the distances of the respective objects to capture images, among the plurality of cameras; an integration unit that integrates the images captured by the cameras corresponding to the distances of the respective subjects; An imaging system having:

2. The imaging control unit simultaneously captures images using cameras corresponding to the distances of the respective objects among the plurality of cameras. The imaging system according to claim 1 .

3. a receiving unit that receives designation of a plurality of subjects to be imaged, The specifying unit specifies distances to a plurality of subjects designated by the accepting unit among a plurality of objects included in the imaging range. The imaging system according to claim 1 .

4. a selection unit for selecting a plurality of subjects to be imaged from a plurality of objects included in the image capturing range, The specifying unit specifies distances to a plurality of subjects selected by the selecting unit from a plurality of objects included in the imaging range. The imaging system according to claim 1 .

5. The identification unit identifies a plurality of subjects from a plurality of objects included in the imaging range in a predetermined order, and identifies distances to the identified plurality of subjects. The imaging system according to claim 1 .

6. The plurality of cameras each have a predetermined imaging distance range, The imaging control unit controls the cameras to capture images of the respective objects within the respective distance ranges. The imaging system according to claim 1 .

7. Each of the plurality of cameras has a lens with adjustable focus, The imaging control unit controls the cameras corresponding to the distances of the respective objects to capture images by adjusting the focal points of the lenses of the cameras. The imaging system according to claim 1 .

8. The integration unit determines an in-focus area of ​​each image captured by the plurality of cameras, integrates the in-focus areas of each image, and generates image data of the captured image range. The imaging system according to claim 1 .

9. The integration unit integrates a portion of each image captured by the plurality of cameras that corresponds to a position of a subject. The imaging system according to claim 1 .

10. The distance measuring sensor emits a laser beam and measures the distance to an object by observing the reflected light of the emitted laser beam. The imaging system according to claim 1 .

11. The plurality of cameras, the distance measurement sensor, the identification unit, the imaging control unit, and the integration unit are provided in a portable information processing device. The imaging system according to claim 1 .

12. the plurality of cameras, the distance measuring sensor, the identification unit, and the imaging control unit are provided in a portable information processing device, The integration unit is provided in a server device that can communicate with the information processing device. The imaging system according to claim 1 .

13. Multiple cameras with different focal lengths a distance measurement sensor that measures the distance to the imaging range of the plurality of cameras; an identification unit that identifies distances to a plurality of subjects included in the imaging range based on the distance measurement results obtained by the distance measurement sensor; an imaging control unit that controls the cameras corresponding to the distances of the respective objects to capture images, among the plurality of cameras; an integration unit that integrates the images captured by the cameras corresponding to the distances of the respective subjects; An imaging device having the above configuration.

14. Identifying distances to a plurality of subjects included in an imaging range from distance measurement results obtained by a distance measurement sensor that measures distances to imaging ranges taken by a plurality of cameras with different focal lengths; among the plurality of cameras, an image is captured by a camera corresponding to the distance of each subject; The images taken by the cameras corresponding to the distance of each subject are integrated. Imaging method.

15. Identifying distances to a plurality of subjects included in an imaging range from distance measurement results obtained by a distance measurement sensor that measures distances to imaging ranges taken by a plurality of cameras with different focal lengths; among the plurality of cameras, an image is captured by a camera corresponding to the distance of each subject; The images taken by the cameras corresponding to the distance of each subject are integrated. A program that causes a computer to perform a process.

Images