Information processing system, information processing method, and recording medium

Abstract

An information processing system (10) comprises: a reference image acquisition means (110) for acquiring a reference image; a bracket photographing means (120) for controlling a camera to perform bracket photographing by using the reference image as a reference; a histogram acquisition means (130) for acquiring a histogram of the reference image; and an additional photographing means (140) for controlling, on the basis of the histogram of the reference image, the camera to perform additional photographing by using a setting value different from that for the bracket photographing. This information processing system can photograph an appropriate image regardless of the photographing environment.

Description

[Technical Field]

[0001] The present disclosure relates to the technical fields of an information processing system, an information processing method, and a recording medium. [Background technology]

[0002] When capturing an image, adjustments and corrections can be made according to the shooting environment to capture an image with appropriate brightness. For example, Patent Document 1 discloses backlight correction processing of an image signal by changing the gradation according to the spatial position on the image. Patent Document 2 discloses estimating control parameters based on the brightness within the photometric range and adjusting the input image of a camera based on these control parameters. Patent Document 3 discloses calculating the distribution of temporal changes in brightness information in local regions obtained by dividing an image and adjusting the input image of a shooting means.

[0003] As another related technique, Patent Document 4 discloses a technique for generating a luminance histogram of image data and determining whether or not the image is backlit based on the shape of the histogram. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2009-089357 [Patent Document 2] Japanese Patent Application Laid-Open No. 2009-059073 [Patent Document 3] Japanese Patent Application Laid-Open No. 2009-044526 [Patent Document 4] Japanese Patent Application Laid-Open No. 2009-230556 Summary of the Invention [Problem to be solved by the invention]

[0005] This disclosure aims to improve upon the techniques disclosed in the prior art documents. [Means for solving the problem]

[0006] One aspect of the information processing system disclosed herein comprises a reference image acquisition means for acquiring a reference image, a bracket shooting means for controlling a camera to perform bracket shooting based on the reference image, a histogram acquisition means for acquiring a histogram of the reference image, and an additional shooting means for controlling the camera to perform additional shooting with setting values ​​different from those used in the bracket shooting based on the histogram of the reference image.

[0007] One aspect of the information processing method of this disclosure involves using at least one computer to acquire a reference image, control a camera to perform bracket shooting based on the reference image, acquire a histogram of the reference image, and control the camera to perform additional shooting with settings different from those used in the bracket shooting based on the histogram of the reference image.

[0008] One aspect of the recording medium of this disclosure is a computer program recorded on at least one computer that causes the computer to execute an information processing method, which includes acquiring a reference image, controlling a camera to perform bracket shooting based on the reference image, acquiring a histogram of the reference image, and controlling the camera to perform additional shooting with settings different from those used for the bracket shooting based on the histogram of the reference image. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a block diagram showing a hardware configuration of an information processing system according to a first embodiment. [Figure 2] 1 is a block diagram showing a functional configuration of an information processing system according to a first embodiment. [Figure 3] 4 is a flowchart showing the flow of operations of the information processing system according to the first embodiment. [Figure 4] FIG. 10 is a block diagram showing the functional configuration of an information processing system according to a second embodiment. [Figure 5]10 is a flowchart showing the flow of operations of the information processing system according to the second embodiment. [Figure 6] FIG. 10 is a conceptual diagram showing a backlight determination method in an information processing system according to a third embodiment. [Figure 7] 10 is a flowchart showing the flow of operations of the information processing system according to the fourth embodiment. [Figure 8] 10 is a flowchart showing the flow of operations of the information processing system according to the fifth embodiment. [Figure 9] FIG. 13 is a block diagram showing the functional configuration of an information processing system according to a sixth embodiment. [Figure 10] 13 is a flowchart showing the flow of operations of the information processing system according to the sixth embodiment. [Figure 11] FIG. 13 is a block diagram showing a functional configuration of an information processing system according to a modified example of the sixth embodiment. [Figure 12] 13 is a flowchart showing the flow of operations of an information processing system according to a modified example of the sixth embodiment. [Figure 13] FIG. 13 is a block diagram showing the functional configuration of an information processing system according to a seventh embodiment. [Figure 14] 13 is a flowchart showing the flow of operations of the information processing system according to the seventh embodiment. [Figure 15] FIG. 13 is a block diagram showing the functional configuration of an information processing system according to an eighth embodiment. [Figure 16] 13 is a flowchart showing the flow of operations of the information processing system according to the eighth embodiment. [Figure 17] FIG. 13 is a block diagram showing the functional configuration of an information processing system according to a ninth embodiment. [Figure 18] 13 is a flowchart showing the flow of operations of the information processing system according to the ninth embodiment. [Figure 19] FIG. 20 is a block diagram showing the functional configuration of an information processing system according to a tenth embodiment. [Figure 20] 20 is a flowchart showing the flow of operations of the information processing system according to the tenth embodiment. [Figure 21] FIG. 22 is a block diagram showing the functional configuration of an information processing system according to an eleventh embodiment. [Figure 22] 22 is a flowchart showing the flow of operations of the information processing system according to the 11th embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments of an information processing system, an information processing method, and a recording medium will be described with reference to the drawings.

[0011] First Embodiment An information processing system according to a first embodiment will be described with reference to FIGS.

[0012] (Hardware configuration) First, the hardware configuration of the information processing system according to the first embodiment will be described with reference to Fig. 1. Fig. 1 is a block diagram showing the hardware configuration of the information processing system according to the first embodiment.

[0013] 1, an information processing system 10 according to the first embodiment includes a processor 11, a RAM (Random Access Memory) 12, a ROM (Read Only Memory) 13, and a storage device 14. The information processing system 10 may further include an input device 15 and an output device 16. The information processing system 10 also includes a camera 18. The processor 11, RAM 12, ROM 13, storage device 14, input device 15, output device 16, and camera 18 are connected via a data bus 17.

[0014] The processor 11 loads a computer program. For example, the processor 11 is configured to load a computer program stored in at least one of the RAM 12, the ROM 13, and the storage device 14. Alternatively, the processor 11 may load a computer program stored in a computer-readable storage medium using a storage medium reading device (not shown). The processor 11 may acquire (i.e., load) the computer program from a device (not shown) located outside the information processing system 10 via a network interface. The processor 11 controls the RAM 12, the storage device 14, the input device 15, and the output device 16 by executing the loaded computer program. In particular, in this embodiment, when the processor 11 executes the loaded computer program, functional blocks that execute processing for capturing an image of a target are realized within the processor 11. In other words, the processor 11 may function as a controller that executes each control in the information processing system 10.

[0015] The processor 11 may be configured as, for example, a central processing unit (CPU), a graphics processing unit (GPU), a field-programmable gate array (FPGA), a demand-side platform (DSP), or an application-specific integrated circuit (ASIC). The processor 11 may be configured as one of these, or may be configured to use multiple processors in parallel.

[0016] The RAM 12 temporarily stores computer programs executed by the processor 11. The RAM 12 temporarily stores data that the processor 11 temporarily uses while the processor 11 is executing the computer programs. The RAM 12 may be, for example, a dynamic random access memory (DRAM) or a static random access memory (SRAM). Alternatively, other types of volatile memory may be used instead of the RAM 12.

[0017] The ROM 13 stores computer programs executed by the processor 11. The ROM 13 may also store fixed data. The ROM 13 may be, for example, a programmable read-only memory (P-ROM) or an erasable read-only memory (EPROM). Alternatively, the ROM 13 may be replaced by another type of non-volatile memory.

[0018] The storage device 14 stores data that is to be saved long-term by the information processing system 10. The storage device 14 may operate as a temporary storage device for the processor 11. The storage device 14 may include, for example, at least one of a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device.

[0019] The input device 15 is a device that receives input instructions from a user of the information processing system 10. The input device 15 may include, for example, at least one of a keyboard, a mouse, and a touch panel. The input device 15 may be configured as a mobile terminal such as a smartphone or a tablet. The input device 15 may also be, for example, a device that includes a microphone and is capable of voice input.

[0020] The output device 16 is a device that outputs information related to the information processing system 10 to the outside. For example, the output device 16 may be a display device (e.g., a display) that can display information related to the information processing system 10. The output device 16 may also be a speaker or the like that can output information related to the information processing system 10 as audio. The output device 16 may be configured as a mobile terminal such as a smartphone or a tablet. The output device 16 may also be a device that outputs information in a format other than an image. For example, the output device 16 may be a speaker that outputs information related to the authentication system 10 as audio.

[0021] The camera 18 is configured to be able to capture an image of a target. Note that the target here is not limited to humans, but may include animals such as dogs, cats, snakes, and birds, as well as robots. The camera 18 may capture an image of the entire target, or may capture an image of only a portion of the target. For example, the camera 18 may capture an image of the target's face, or an image of the target's eyes (irises). The camera 18 may be configured as a visible light camera or a near-infrared camera. The camera 18 may be a camera that captures still images, or a camera that captures video. Furthermore, multiple cameras 18 may be provided. The camera 18 may have a function to automatically turn off the power when, for example, no images are being captured. In this case, priority may be given to turning off components with short lifespans, such as liquid lenses and motors.

[0022] 1 shows an example of information processing system 10 including a plurality of devices, but all or some of the functions may be realized by a single device (information processing device). This information processing device may be configured to include only the above-mentioned processor 11, RAM 12, ROM 13, and image capture unit 18, and the other components (i.e., storage device 14, input device 15, output device 16) may be provided by an external device connected to the information processing device. Furthermore, some of the calculation functions of the information processing device may be realized by an external device (e.g., an external server, a cloud, etc.).

[0023] (Functional configuration) Next, the functional configuration of the information processing system 10 according to the first embodiment will be described with reference to Fig. 2. Fig. 2 is a block diagram showing the functional configuration of the information processing system according to the first embodiment.

[0024] The information processing system 10 according to the first embodiment is configured as a system for capturing an image of a target. The use of the image captured by the information processing system 10 is not particularly limited, and the image may be used for biometric authentication, for example. For example, the information processing system 10 may be configured as part of an authentication system that captures an image of a target and performs biometric authentication.

[0025] 2, the information processing system 10 according to the first embodiment is configured to include, as components for realizing its functions, a reference image acquisition unit 110, a bracket photographing unit 120, a histogram acquisition unit 130, and an additional photographing unit 140. Each of the reference image acquisition unit 110, the bracket photographing unit 120, the histogram acquisition unit 130, and the additional photographing unit 140 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0026] The reference image acquisition unit 110 is configured to be able to acquire a reference image for bracket shooting. Note that "bracket shooting" here refers to a technique of capturing multiple images under different conditions while controlling (changing) camera parameters such as exposure. The reference image acquisition unit 110 may control the camera 18 to acquire a reference image before bracket shooting. The reference image may be captured with the camera settings (i.e., various camera parameters) set to preset values. For example, the reference image may be captured under conditions such that the average pixel brightness of a region of interest (ROI) becomes a specified value. Note that the shooting conditions for the reference image may be changed depending on, for example, the brightness of the location where the image is captured, the time of day, etc.

[0027] The bracket photographing unit 120 is configured to be able to control the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition unit 110 as a reference. Bracket photographing may be performed, for example, by using the reference image as a reference and gradually shifting the setting value of the camera 18 in a direction that makes the image brighter or darker. There is no particular limitation on the number of images taken in bracket photographing.

[0028] The histogram acquisition unit 130 is configured to be able to acquire the histogram of the reference image (i.e., the luminance distribution of the reference image) by analyzing the reference image. Note that, as a specific method for acquiring the histogram from the reference image can be appropriately adopted from existing technologies, detailed description thereof will be omitted here.

[0029] The additional photographing unit 140 is configured to be able to control the camera 18 to take additional photographs based on the histogram of the reference image acquired by the histogram acquisition unit 130. Specifically, the additional photographing unit 140 first sets the setting values ​​of the camera 18 to values ​​(hereinafter referred to as "additional photographing setting values") different from those used in bracket photographing based on the histogram of the reference image. Then, the additional photographing unit 140 takes additional photographs using the set additional photographing setting values. The additional photographing setting values ​​may be set to values ​​that enable capturing clearer images, taking into account the histogram of the reference image.

[0030] (Operation flow) Next, the flow of operations of the information processing system 10 according to the first embodiment will be described with reference to Fig. 3. Fig. 3 is a flowchart showing the flow of the photographing operation of the information processing system according to the first embodiment.

[0031] 3, when the operation of the information processing system 10 according to the first embodiment starts, first, the reference image acquisition unit 110 acquires a reference image (step S101). Note that the reference image acquisition unit 110 may acquire the reference image, for example, when the target reaches a predetermined trigger point. The reference image acquired by the reference image acquisition unit 110 is output to the bracket shooting unit 120 and the histogram acquisition unit 130.

[0032] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the additional photographing unit 140.

[0033] Next, the bracket photographing unit 140 controls the camera 18 to perform bracket photographing based on the reference image acquired by the reference image acquisition unit 110 (step S103). Then, the additional photographing unit 140 performs additional photographing based on the histogram of the reference image acquired by the histogram acquisition unit 130 (step S104). A plurality of images may be taken in the additional photographing.

[0034] The additional shooting in step S104 may be omitted as appropriate depending on the situation. For example, if it is determined that additional shooting is not necessary (in other words, bracket shooting is sufficient), additional shooting may not be performed. This configuration for omitting additional shooting as appropriate will be described in detail in another embodiment below.

[0035] Through the series of operations described above, images captured by bracket shooting (hereinafter referred to as "bracket shot images") and images captured by additional shooting (hereinafter referred to as "additional shot images") are acquired. These bracket shot images and additional shot images may be used for biometric authentication, for example. The information processing system 10 according to this embodiment may have a function to execute such biometric authentication processing. Furthermore, the information processing system 10 may have a function to execute various processes (for example, unlocking a gate) according to the results of the biometric authentication processing.

[0036] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the first embodiment will be described.

[0037] 1 to 3, in the information processing system 10 according to the first embodiment, bracket shooting is performed based on a reference image, and additional shooting is performed based on the histogram of the reference image. In this way, even if an appropriate image cannot be captured using bracket shooting alone (for example, if the image has blackout due to the shooting environment), an appropriate image can be captured by additional shooting.

[0038] Second Embodiment An information processing system 10 according to the second embodiment will be described with reference to Figures 4 and 5. The second embodiment differs from the first embodiment described above only in some configurations and operations, and other parts may be the same as the first embodiment. Therefore, the following will describe in detail the parts that differ from the first embodiment already described, and will omit explanations of other overlapping parts as appropriate.

[0039] (Functional configuration) First, the functional configuration of the information processing system 10 according to the second embodiment will be described with reference to Fig. 4. Fig. 4 is a block diagram showing the functional configuration of the information processing system according to the second embodiment. Note that in Fig. 4, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0040] As shown in Fig. 4, the information processing system 10 according to the second embodiment is configured to include, as components for realizing its functions, a reference image acquisition unit 110, a bracket shooting unit 120, a histogram acquisition unit 130, an additional shooting unit 140, and a backlight determination unit 150. That is, the information processing system 10 according to the second embodiment further includes a backlight determination unit 150 in addition to the configuration of the first embodiment already described (see Fig. 2). The backlight determination unit 150 may be a processing block realized by, for example, the above-mentioned processor 11 (see Fig. 1).

[0041] The backlight determination unit 150 is configured to be able to determine whether or not the shooting environment is backlit, based on the histogram of the reference image acquired by the histogram acquisition unit 130. Specific backlight determination methods using histograms will be described in detail in other embodiments below. The determination result of the backlight determination unit 150 is output to the additional shooting unit 140. Therefore, the additional shooting unit 140 according to the second embodiment takes additional shooting into consideration the determination result of the backlight determination unit 150.

[0042] (Operation flow) Next, the flow of operations of the information processing system 10 according to the second embodiment will be described with reference to Fig. 5. Fig. 5 is a flowchart showing the flow of the photographing operation of the information processing system according to the second embodiment. Note that in Fig. 5, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0043] 5, when the operation of the information processing system 10 according to the second embodiment starts, first, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket shooting unit 120 and the histogram acquisition unit 130.

[0044] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the backlight determination unit 150.

[0045] Next, the backlight determination unit 150 determines whether the shooting environment is backlit or not based on the histogram of the reference image acquired by the histogram acquisition unit 130 (step S201). The determination result of the backlight determination unit 150 is output to the additional shooting unit 140.

[0046] If it is determined that the shooting environment is not backlit (step S201: NO), the additional shooting unit 140 does not perform additional shooting. Therefore, in this case, the bracket shooting unit 120 controls the camera 18 to perform bracket shooting using the reference image acquired by the reference image acquisition unit 110 as a reference (step S103). Then, the series of processes ends.

[0047] On the other hand, if it is determined that the shooting environment is backlit (step S201: NO), the additional shooting unit 140 performs additional shooting. Therefore, in this case, first, the bracket shooting unit 120 controls the camera 18 to perform bracket shooting using the reference image acquired by the reference image acquisition unit 110 as a reference (step S103). Then, the additional shooting unit 140 performs additional shooting using backlit setting values ​​(step S202). Note that the "backlit setting values" here are additional shooting setting values ​​that are set so that an appropriate image can be captured even in a backlit shooting environment.

[0048] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the second embodiment will be described.

[0049] As described in Figures 4 and 5, in the information processing system 10 according to the second embodiment, additional shooting is performed when it is determined that the shooting environment is backlit. In this way, even in a situation where it is difficult to properly capture an image due to backlighting, it is possible to capture a proper image by additional shooting. Furthermore, because additional shooting is not performed when the environment is not backlit, it is possible to reduce the processing load compared to when additional shooting is always performed.

[0050] Third Embodiment An information processing system 10 according to a third embodiment will be described with reference to Fig. 6. The third embodiment specifically describes the backlight determination method of the second embodiment described above, and other aspects may be the same as those of the first and second embodiments. Therefore, the following will describe in detail only those aspects that differ from the embodiments already described, and will omit a description of other overlapping aspects as appropriate.

[0051] (Backlight judgment) First, backlight determination by the information processing system 10 according to the third embodiment will be specifically described with reference to Fig. 6. Fig. 6 is a conceptual diagram showing a backlight determination method in the information processing system according to the third embodiment. Note that the horizontal axis of the histogram shown in Fig. 6 represents brightness (Pixel Value) and the vertical axis represents the number of pixels.

[0052] In the information processing system 10 according to the third embodiment, the backlight determination unit 150 (see FIG. 4) determines whether the shooting environment is backlit based on the histogram of the reference image acquired by the histogram acquisition unit 130. Specifically, the backlight determination unit 150 determines whether the shooting environment is backlit based on whether the histogram of the reference image has two or more peaks that are equal to or greater than a predetermined value. The "predetermined value" here is a threshold value for determining peaks that appear in the histogram when the image is backlit, and an appropriate value may be determined in advance.

[0053] For example, suppose the histogram acquisition unit 130 acquires a histogram as shown in FIG. 6. This histogram has two large peaks (i.e., two peaks equal to or greater than a predetermined value) in areas darker than the first threshold (i.e., areas with a lower luminance value than the first threshold) and areas brighter than the second threshold (i.e., areas with a higher luminance value than the second threshold). Therefore, when such a histogram is acquired, the backlight determination unit 150 determines that the shooting environment is backlit. The first and second thresholds may be set to the same value. Alternatively, a single common threshold may be set instead of the first and second thresholds. In this case, it may be determined whether or not a peak exists in areas darker than the common threshold and areas brighter than the common threshold.

[0054] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the third embodiment will be described.

[0055] 6, in the information processing system 10 according to the third embodiment, backlight determination is performed by detecting peaks in the histogram. In this way, it is possible to appropriately determine whether the shooting environment is backlit or not using the histogram of the reference image.

[0056] <Fourth embodiment> An information processing system 10 according to a fourth embodiment will be described with reference to Fig. 7. Note that the fourth embodiment differs from the first to third embodiments described above only in some of its operations, and other parts may be the same as the first to third embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0057] (Operation flow) First, the flow of operations of the information processing system 10 according to the fourth embodiment will be described with reference to Fig. 7. Fig. 7 is a flowchart showing the flow of the photographing operation of the information processing system according to the fourth embodiment. Note that in Fig. 7, the same processes as those shown in Fig. 5 are denoted by the same reference numerals.

[0058] 7, when the operation of the information processing system 10 according to the fourth embodiment starts, first, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket shooting unit 120 and the histogram acquisition unit 130.

[0059] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the backlight determination unit 150.

[0060] Next, the backlight determination unit 150 determines whether the shooting environment is backlit or not based on the histogram of the reference image acquired by the histogram acquisition unit 130 (step S201). The determination result of the backlight determination unit 150 is output to the additional shooting unit 140.

[0061] If it is determined that the shooting environment is not backlit (step S201: NO), the additional shooting unit 140 does not perform additional shooting. Therefore, in this case, the bracket shooting unit 120 controls the camera 18 to perform bracket shooting using the reference image acquired by the reference image acquisition unit 110 as a reference (step S103). Then, the series of processes ends.

[0062] On the other hand, if the shooting environment is determined to be backlit (step S201: NO), the backlight determination unit 150 further determines the degree of backlight (step S301). The degree of backlight may be determined based on the histogram of the reference image. For example, it may be determined based on the height or width of the peak (see FIG. 6) described in the third embodiment, the difference between the peak and the rest of the image, or the like. Alternatively, the degree of backlight may be determined based on the time of day when the image is captured (the shooting environment for each time of day may be investigated in advance). The reference value for determining whether or not an image is backlit (e.g., a value compared with the peak) may be changed depending on the shooting environment and the time of day. For example, if the shooting environment is brighter than a predetermined value, the reference value for determining backlight may be increased (the height of the peak for determining backlight may be increased). Furthermore, if the shooting environment is darker than a predetermined value, the reference value for determining backlight may be decreased (the height of the peak for determining backlight may be decreased). The degree of backlight determined by the backlight determining unit 150 is output to the additional photographing unit 140 .

[0063] Thereafter, first, the bracket photographing unit 120 controls the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition unit 110 as a reference (step S103). Meanwhile, the additional photographing unit 140 changes the backlight setting values ​​according to the degree of backlight determined by the backlight determination unit 150 (step S302). For example, the additional photographing unit 140 changes the setting values ​​so that the image becomes brighter (to prevent crushed blacks) as the degree of backlight increases. Then, the additional photographing unit 140 performs additional photographing using the backlight setting values ​​changed according to the degree of backlight (step S202).

[0064] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the fourth embodiment will be described.

[0065] 7, in the information processing system 10 according to the fourth embodiment, the degree of backlighting is determined and the setting values ​​for additional shooting are changed based on the degree of backlighting. In this way, additional shooting is performed using setting values ​​according to the degree of backlighting, making it possible to capture more appropriate images than, for example, when additional shooting is always performed using the same setting values.

[0066] Fifth Embodiment An information processing system 10 according to the fifth embodiment will be described with reference to Fig. 8. The fifth embodiment differs only in part of the configuration and operation from the first to fourth embodiments described above, and other parts may be the same as the first to fourth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0067] (Operation flow) First, the flow of operations of the information processing system 10 according to the fifth embodiment will be described with reference to Fig. 8. Fig. 8 is a flowchart showing the flow of the photographing operation of the information processing system according to the fifth embodiment. Note that in Fig. 8, the same processes as those shown in Fig. 2 are denoted by the same reference numerals.

[0068] 8, when the operation of the information processing system 10 according to the fifth embodiment starts, first, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket shooting unit 120 and the histogram acquisition unit 130.

[0069] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the additional photographing unit 140.

[0070] Next, the bracket photographing section 140 controls the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition section 110 as a reference (step S103).

[0071] Next, particularly in the fifth embodiment, the additional photographing unit 140 determines a first setting value and a second setting value, which are additional photographing setting values, based on the histogram of the reference image acquired by the histogram acquisition unit 130 (step S501). The first setting value and the second setting value are different from each other. The first setting value and the second setting value may be determined as values ​​having a predetermined difference from each other. For example, the second setting value may be determined by adding a predetermined value to the first setting value. Alternatively, the second setting value may be determined by subtracting a predetermined value from the first setting value.

[0072] Then, the additional photographing unit 140 performs additional photographing with the first set value to acquire a first additional photographed image (step S502). The additional photographing unit 140 also performs additional photographing with the second set value to acquire a second additional photographed image (step S503). As a result, in the fifth embodiment, a first additional photographed image and a second additional photographed image are acquired as a result of additional photographing under different conditions.

[0073] Note that if the first additional captured image captured using the first set value is inappropriate, additional capture may be performed using the second set value. In other words, if the first additional captured image captured using the first set value is appropriate, additional capture using the second set value may not be performed. Also, although an example in which additional capture is performed twice has been given here, additional capture may be performed three or more times. Specifically, a third additional captured image may be acquired by additional capture using the third set value, and a fourth additional captured image may be acquired by additional capture using the fourth set value. Alternatively, if the first additional captured image is inappropriate, bracket capture may be performed again (i.e., a second bracket capture when step S103 is the first bracket capture). In the second bracket capture, the reference image may be changed based on the first set value (i.e., the value when the first additional captured image was captured), or the number of images to be captured, the correction width, etc. may be changed based on the first set value.

[0074] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the fifth embodiment will be described.

[0075] 8, in the information processing system 10 according to the fifth embodiment, additional shooting is performed multiple times with different setting values. In this way, even if a suitable image cannot be captured in one additional shooting, a suitable image can be captured by subsequent additional shooting.

[0076] Sixth Embodiment An information processing system 10 according to the sixth embodiment will be described with reference to Figures 9 and 10. The sixth embodiment differs only in part of the configuration and operation from the first to fifth embodiments described above, and other parts may be the same as the first to fifth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0077] (Functional configuration) First, the functional configuration of the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 9. Fig. 9 is a block diagram showing the functional configuration of the information processing system according to the sixth embodiment. Note that in Fig. 9, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0078] 9, the information processing system 10 according to the sixth embodiment is configured to include, as components for realizing its functions, a reference image acquisition unit 110, a bracket photographing unit 120, a histogram acquisition unit 130, an additional photographing unit 140, and a facial area identification unit 160. That is, the information processing system 10 according to the sixth embodiment further includes the facial area identification unit 160 in addition to the configuration of the first embodiment already described (see FIG. 2). The facial area identification unit 160 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0079] The facial area identification unit 160 is configured to be able to identify an area where the face of the subject photographed by the camera 18 exists (hereinafter referred to as "facial area" as appropriate). The facial area identification unit 160 may identify the facial area of ​​the subject in the reference image acquired by the reference image acquisition unit 110, for example. Note that the specific method for identifying the facial area is not particularly limited, and existing technology may be appropriately adopted. Information about the facial area identified by the facial area identification unit 160 (for example, information indicating the position of the facial area) is configured to be output to the histogram acquisition unit 130 and the additional photographing unit 140. Therefore, the additional photographing unit 140 according to the sixth embodiment performs additional photographing taking into account the facial area identified by the facial area identification unit 160.

[0080] (Operation flow) Next, the flow of operations of the information processing system 10 according to the sixth embodiment will be described with reference to Fig. 10. Fig. 10 is a flowchart showing the flow of the photographing operation of the information processing system according to the sixth embodiment. Note that in Fig. 10, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0081] 10, when the operation of the information processing system 10 according to the sixth embodiment starts, first, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket photographing unit 120 and the face area identification unit 160.

[0082] Next, the facial area specifying unit 160 specifies the facial area of ​​the target using the reference image (step S601). Information on the facial area specified by the facial area specifying unit 160 is output to the histogram acquisition unit 130 and the additional photographing unit 140.

[0083] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). At this time, the histogram acquisition unit 130 may acquire a histogram corresponding to only the face region. That is, it may acquire a histogram limited to the face region, rather than the entire reference image. The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the additional photographing unit 140.

[0084] Next, the bracket photographing section 140 controls the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition section 110 as a reference (step S103).

[0085] Next, the additional photographing unit 140 takes an additional photograph based on the histogram of the reference image acquired by the histogram acquisition unit 130. At this time, the additional photographing unit 140 takes an additional photograph so that the luminance value of the face region identified by the face region identification unit 160 falls within a predetermined range (step S602). Specifically, the additional photographing is performed with additional photographing setting values ​​that bring the luminance value of the face region into the predetermined range. Note that the "predetermined range" here is set in advance as an appropriate range for the luminance value of the face region. The predetermined range may be set as a range of luminance values ​​that will increase the authentication accuracy when used for face authentication, for example.

[0086] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the sixth embodiment will be described.

[0087] 9 and 10, in the information processing system 10 according to the sixth embodiment, the facial area of ​​the target is identified, and additional photographing is performed so that the brightness value of the facial area falls within a predetermined range. In this way, an image of the target's face can be appropriately photographed. Therefore, it is possible to photograph an image suitable for biometric authentication (i.e., face authentication) using the facial image of the target, for example.

[0088] <Modification of the Sixth Embodiment> An information processing system 10 according to a modification of the sixth embodiment will be described with reference to Figures 11 and 12. Note that the modification of the sixth embodiment differs only in part of the configuration and operation from the sixth embodiment described above, and other parts may be the same as the first to sixth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0089] (Functional configuration) First, the functional configuration of an information processing system 10 according to a modified example of the sixth embodiment will be described with reference to Fig. 11. Fig. 11 is a block diagram showing the functional configuration of an information processing system according to a modified example of the sixth embodiment. In Fig. 11, elements similar to those shown in Fig. 9 are denoted by the same reference numerals.

[0090] 11, the information processing system 10 according to the modification of the sixth embodiment is configured to include, as components for realizing its functions, a reference image acquisition unit 110, a bracket photographing unit 120, a histogram acquisition unit 130, an additional photographing unit 140, and an iris region identification unit 165. That is, the information processing system 10 according to the modification of the sixth embodiment is provided with an iris region identification unit 165 instead of the face region identification unit 160 in the configuration of the sixth embodiment already described (see FIG. 9). The iris region identification unit 165 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0091] The iris region identification unit 165 is configured to be able to identify a region where the iris of the subject photographed by the camera 18 exists (hereinafter referred to as "iris region" as appropriate). The iris region identification unit 165 may identify the iris region of the subject in the reference image acquired by the reference image acquisition unit 110, for example. Note that the specific method for identifying the iris region is not particularly limited, and existing technology may be appropriately adopted. Information about the iris region identified by the iris region identification unit 165 (for example, information indicating the position of the iris region) is configured to be output to the histogram acquisition unit 130 and the additional photographing unit 140. Therefore, the additional photographing unit 140 according to the modified example of the sixth embodiment performs additional photographing taking into account the iris region identified by the iris region identification unit 165.

[0092] (Operation flow) Next, the flow of operations of the information processing system 10 according to a modified example of the sixth embodiment will be described with reference to Fig. 12. Fig. 12 is a flowchart showing the flow of the photographing operation of the information processing system according to the modified example of the sixth embodiment. Note that in Fig. 12, the same processes as those shown in Fig. 10 are denoted by the same reference numerals.

[0093] 12, when the operation of the information processing system 10 according to the modified example of the sixth embodiment is started, first, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket photographing unit 120 and the face area identification unit 160.

[0094] Next, the iris region specifying unit 165 specifies the iris region of the target using the reference image (step S651). Information on the iris region specified by the iris region specifying unit 165 is output to the histogram acquisition unit 130 and the additional photographing unit 140.

[0095] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). At this time, the histogram acquisition unit 130 may acquire a histogram corresponding to only the iris region. That is, a histogram limited to the iris region may be acquired instead of the entire reference image. The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the additional photographing unit 140.

[0096] Next, the bracket photographing section 140 controls the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition section 110 as a reference (step S103).

[0097] Next, the additional photographing unit 140 takes an additional photograph based on the histogram of the reference image acquired by the histogram acquisition unit 130. At this time, the additional photographing unit 140 takes an additional photograph so that the brightness value of the iris region identified by the iris region identification unit 165 falls within a predetermined range (step S652). Specifically, the additional photographing is taken with additional photographing setting values ​​that bring the brightness value of the iris region into the predetermined range. Note that the "predetermined range" here is set in advance as an appropriate range of brightness values ​​for the iris region. The predetermined range may be set as a range of brightness values ​​that will increase authentication accuracy when used for iris authentication, for example.

[0098] (Technical Effects) Next, technical effects obtained by the information processing system 10 according to the modified example of the sixth embodiment will be described.

[0099] 11 and 12, in the information processing system 10 according to the modified example of the sixth embodiment, the iris region of the target is identified, and additional imaging is performed so that the brightness value of the iris region falls within a predetermined range. In this way, an image of the target iris can be appropriately captured. Therefore, it is possible to capture an image suitable for biometric authentication (i.e., iris authentication) using the iris image of the target, for example.

[0100] The sixth embodiment and the modified example of the sixth embodiment described above may be combined. Specifically, the information processing system 10 may be configured to include both the face region identification unit 160 and the iris region identification unit 165. In this case, the information processing system 10 may include a camera for capturing an image of the target's face and a camera for capturing an image of the target's iris separately. The information processing system 10 may be configured to be able to perform multimodal authentication using the target's face and iris.

[0101] In the sixth embodiment and the modified example of the sixth embodiment described above, a configuration for capturing an image of a target's face and iris has been described, but a similar configuration can be applied to capturing an image of other body parts. Specifically, a similar technical effect can be achieved by identifying an area of ​​the target body part to be captured and capturing an additional image so that the brightness value of that area falls within a predetermined range. In this way, the accuracy of authentication other than face authentication and iris authentication (for example, behavioral authentication, palm print authentication, etc.) can also be improved.

[0102] Seventh Embodiment An information processing system 10 according to the seventh embodiment will be described with reference to Figures 13 and 14. The seventh embodiment differs only in part of the configuration and operation from the first to sixth embodiments described above, and other parts may be the same as the first to sixth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0103] (Functional configuration) First, the functional configuration of the information processing system 10 according to the seventh embodiment will be described with reference to Fig. 13. Fig. 13 is a block diagram showing the functional configuration of the information processing system according to the seventh embodiment. In Fig. 13, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0104] 13, the information processing system 10 according to the seventh embodiment is configured to include, as components for realizing its functions, a reference image acquisition unit 110, a bracket photographing unit 120, a histogram acquisition unit 130, an additional photographing unit 140, and a first object identification unit 170. That is, the information processing system 10 according to the seventh embodiment further includes the first object identification unit 170 in addition to the configuration of the first embodiment already described (see FIG. 2). The first object identification unit 170 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0105] The first object identification unit 170 is configured to be able to identify a moving object. The first object identification unit 170 may identify an area in a reference image where the moving object exists. The first object identification unit 170 may identify an area where the moving object exists, for example, by using the difference between a plurality of time-series images including the reference image. Note that the specific method for identifying a moving object is not particularly limited, and existing technology can be appropriately adopted. Information about the object identified by the first object identification unit 170 (for example, information indicating the position of the area where the moving object exists) is configured to be output to the histogram acquisition unit 130 and the additional imaging unit 140. Therefore, the additional imaging unit 140 according to the seventh embodiment performs additional imaging taking into account the area identified by the first object identification unit 170.

[0106] (Operation flow) Next, the flow of operations of the information processing system 10 according to the seventh embodiment will be described with reference to Fig. 14. Fig. 14 is a flowchart showing the flow of the photographing operation of the information processing system according to the seventh embodiment. Note that in Fig. 14, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0107] 14, when the operation of the information processing system 10 according to the seventh embodiment is started, first, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket photographing unit 120 and the first object identification unit 170.

[0108] Next, the first object identification unit 170 identifies an area in the reference image where a moving object exists (step S701). Information about the area identified by the first object identification unit 170 is output to the histogram acquisition unit 130 and the additional photographing unit 140.

[0109] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). At this time, the histogram acquisition unit 130 may acquire a histogram corresponding to only the area where a moving object exists. In other words, a histogram may be acquired that is limited to the area where a moving object exists, rather than for the entire reference image. The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the additional imaging unit 140.

[0110] Next, the bracket photographing section 140 controls the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition section 110 as a reference (step S103).

[0111] Next, the additional photographing unit 140 performs additional photographing based on the histogram of the reference image acquired by the histogram acquisition unit 130. At this time, the additional photographing unit 140 performs additional photographing based on the histogram of the area where a moving object exists (step S702). For example, the additional photographing unit 140 may perform additional photographing so that the luminance value of the moving object falls within a predetermined range, as in the example using the face area described in the sixth embodiment (see FIG. 14). In other words, the additional photographing may be performed with additional photographing setting values ​​such that the area where the moving object exists has an appropriate luminance value.

[0112] After identifying the moving object, the area where the target's face is present may be identified as in the sixth embodiment. For example, the upper 25% of the area where the moving object is present may be identified as the face area where the target's face is present.

[0113] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the seventh embodiment will be described.

[0114] 13 and 14, in the information processing system 10 according to the seventh embodiment, a moving object is identified and additional shooting is performed based on the histogram of the area in which the object exists. In this way, by identifying the object in the image, it is possible to perform more appropriate additional shooting.

[0115] Eighth Embodiment An information processing system 10 according to the eighth embodiment will be described with reference to Figures 15 and 16. Note that the eighth embodiment differs only in some operations from the first to seventh embodiments described above, and other parts may be the same as the first to seventh embodiments. Therefore, hereinafter, only the parts that differ from the embodiments already described will be described in detail, and explanations of other overlapping parts will be omitted as appropriate.

[0116] (Functional configuration) First, the functional configuration of the information processing system 10 according to the eighth embodiment will be described with reference to Fig. 15. Fig. 15 is a block diagram showing the functional configuration of the information processing system according to the eighth embodiment. In Fig. 15, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0117] 15, the information processing system 10 according to the eighth embodiment is configured to include, as components for realizing its functions, a reference image acquisition unit 110, a bracket photographing unit 120, a histogram acquisition unit 130, an additional photographing unit 140, and a second object identification unit 180. That is, the information processing system 10 according to the eighth embodiment further includes the second object identification unit 180 in addition to the configuration of the first embodiment already described (see FIG. 2). The second object identification unit 180 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0118] The second object identification unit 180 is configured to be able to identify an object approaching the camera 18. The second object identification unit 180 may identify an area in the reference image where the object approaching the camera 18 exists. The second object identification unit 180 may identify the object approaching the camera using, for example, a plurality of time-series images including the reference image. For example, an object whose size in the images gradually increases may be identified as the object approaching the camera 18. Note that the specific method for identifying the object approaching the camera 18 is not particularly limited, and existing technology can be appropriately adopted. Information about the object identified by the second object identification unit 180 (for example, information indicating the position of the area where the object approaching the camera 18 exists) is configured to be output to the histogram acquisition unit 130 and the additional photographing unit 140. Therefore, the additional photographing unit 140 according to the eighth embodiment performs additional photographing taking into account the area identified by the second object identification unit 180.

[0119] (Operation flow) Next, the flow of operations of the information processing system 10 according to the eighth embodiment will be described with reference to Fig. 16. Fig. 16 is a flowchart showing the flow of the photographing operation of the information processing system according to the eighth embodiment. Note that in Fig. 16, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0120] 16, when the operation of the information processing system 10 according to the eighth embodiment is started, first, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket photographing unit 120 and the second object identification unit 180.

[0121] Next, the second object identification unit 180 identifies an area in the reference image where an object approaching the camera 18 exists (step S801). Information about the area identified by the second object identification unit 180 is output to the histogram acquisition unit 130 and the additional photographing unit 140.

[0122] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). At this time, the histogram acquisition unit 130 may acquire a histogram corresponding to only the area where an object approaching the camera 18 is present. In other words, the histogram acquired may be limited to the area where an object approaching the camera 18 is present, rather than the entire reference image. The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the additional photographing unit 140.

[0123] Next, the bracket photographing section 140 controls the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition section 110 as a reference (step S103).

[0124] Next, the additional photographing unit 140 performs additional photographing based on the histogram of the reference image acquired by the histogram acquisition unit 130. At this time, the additional photographing unit 140 performs additional photographing based on the histogram of the area where an object approaching the camera 18 exists (step S802). For example, the additional photographing unit 140 may perform additional photographing so that the brightness value of the object approaching the camera 18 falls within a predetermined range, as in the example using the face area described in the sixth embodiment (see FIG. 14). In other words, the additional photographing may be performed with additional photographing setting values ​​such that the area where the object approaching the camera 18 exists has an appropriate brightness value.

[0125] After identifying an object approaching camera 18, an area in which the target's face exists may be identified as in the sixth embodiment. For example, the upper 25% of the area in which the object approaching camera 18 exists may be identified as the face area in which the target's face exists.

[0126] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the eighth embodiment will be described.

[0127] 15 and 16, in the information processing system 10 according to the eighth embodiment, an object approaching the camera 18 is identified, and additional photography is performed based on the histogram of the area in which the object exists. In this way, by identifying the object in the image, it is possible to perform more appropriate additional photography.

[0128] Ninth Embodiment An information processing system 10 according to the ninth embodiment will be described with reference to Figures 17 and 18. The ninth embodiment differs only in part of the configuration and operation from the first to eighth embodiments described above, and other parts may be the same as the first to eighth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0129] (Functional configuration) First, the functional configuration of the information processing system 10 according to the ninth embodiment will be described with reference to Fig. 17. Fig. 17 is a block diagram showing the functional configuration of the information processing system according to the ninth embodiment. In Fig. 17, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0130] 17, the information processing system 10 according to the ninth embodiment is configured to include, as components for realizing its functions, a reference image acquisition unit 110, a bracket shooting unit 120, a histogram acquisition unit 130, an additional shooting unit 140, and a speed detection unit 190. That is, the information processing system 10 according to the ninth embodiment further includes the speed detection unit 190 in addition to the configuration of the first embodiment already described (see FIG. 2). The speed detection unit 190 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0131] The speed detection unit 190 is configured to be able to detect the moving speed of the object. The speed detection unit 190 may detect the moving speed of the object using, for example, various sensors, or may detect the moving speed of the object using images captured by the camera 18. For example, the moving speed of the object may be detected from the difference between a plurality of time-series images. The moving speed of the object detected by the speed detection unit 190 is configured to be output to the additional imaging unit 140. Therefore, the additional imaging unit 140 according to the ninth embodiment performs additional imaging taking into account the moving speed of the object.

[0132] (Operation flow) Next, the flow of operations of the information processing system 10 according to the ninth embodiment will be described with reference to Fig. 18. Fig. 18 is a flowchart showing the flow of the photographing operation of the information processing system according to the ninth embodiment. Note that in Fig. 18, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0133] 18, when the operation of the information processing system 10 according to the ninth embodiment is started, first the movement speed detection unit 190 detects the movement speed of the object (step S901). The movement speed of the object detected by the movement speed detection unit 190 is output to the additional photographing unit 140. Note that although the movement speed of the object is detected before the reference image is photographed here, the movement speed of the object may be detected after the reference image is photographed.

[0134] Next, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket photographing unit 120 and the histogram acquisition unit .

[0135] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the additional photographing unit 140.

[0136] Next, the bracket photographing section 140 controls the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition section 110 as a reference (step S103).

[0137] Next, the additional photographing unit 140 changes the additional photographing setting values ​​based on the histogram of the reference image acquired by the histogram acquisition unit 130 and the moving speed detected by the moving speed detection unit 190 (step S902). For example, the additional photographing unit 140 may set a shorter exposure time when the moving speed of the subject is fast compared to when the moving speed is slow. Thereafter, the additional photographing unit 140 performs additional photographing using the changed additional photographing setting values ​​(i.e., additional photographing setting values ​​that take the histogram and moving speed into consideration) (step S903).

[0138] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the ninth embodiment will be described.

[0139] 17 and 18, in the information processing system 10 according to the ninth embodiment, the moving speed of the object is detected, and additional image capturing is performed based on the moving speed of the object and the histogram of the reference image. In this way, appropriate additional image capturing can be performed according to the moving speed of the object. Therefore, it is possible to suppress blurring caused by, for example, the fast moving speed of the object.

[0140] Tenth Embodiment An information processing system 10 according to the tenth embodiment will be described with reference to Figures 19 and 20. The tenth embodiment differs from the above-described ninth embodiment only in some configurations and operations, and other parts may be the same as the first to ninth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit explanations of other overlapping parts as appropriate.

[0141] First, the functional configuration of the information processing system 10 according to the tenth embodiment will be described with reference to Fig. 19. Fig. 19 is a block diagram showing the functional configuration of the information processing system according to the tenth embodiment. In Fig. 19, the same elements as those shown in Fig. 17 are denoted by the same reference numerals.

[0142] 19, the information processing system 10 according to the tenth embodiment is configured to include, as components for realizing its functions, a reference image acquisition unit 110, a bracket shooting unit 120, a histogram acquisition unit 130, an additional shooting unit 140, a speed detection unit 190, and an illumination control unit 200. That is, the information processing system 10 according to the tenth embodiment further includes an illumination control unit 200 in addition to the configuration of the ninth embodiment already described (see FIG. 17). The illumination control unit 200 may be a processing block realized by, for example, the above-mentioned processor 11 (see FIG. 1).

[0143] The illumination control unit 200 is configured to control the intensity of the illumination light irradiated onto the object. For example, the illumination control unit 200 may control the intensity of the illumination light by changing the amount of light emitted from the illumination light. In this case, the illumination control unit 200 may control the illumination so as to increase the intensity of the illumination light already irradiated onto the object, or may control the illumination so as to increase the intensity of the illumination light by turning on the power of a light that is turned off. Alternatively, the illumination control unit 200 may control the intensity of the illumination light by changing the number of lights to be turned on in a lighting device having multiple lights. Alternatively, the illumination control unit 200 may control the intensity of the illumination light by changing the direction in which the illumination light is irradiated (e.g., directing the irradiated light toward or away from the object). The illumination control unit 200 may be configured to control, for example, a light built into the camera 18, a light attached to the camera 18, a light installed in a location other than the camera 18, etc. The illumination control unit 200 according to this embodiment controls the illumination light to be increased when the moving speed of the object is equal to or greater than a predetermined speed. The moving speed of the object may be detected by the speed detection unit 190. The "predetermined speed" here is a threshold value for determining whether the moving speed of the object is fast enough to require a shorter exposure time in order to suppress blurring in the image.

[0144] (Operation flow) Next, the flow of operations of the information processing system 10 according to the tenth embodiment will be described with reference to Fig. 20. Fig. 20 is a flowchart showing the flow of the photographing operation of the information processing system according to the tenth embodiment. Note that in Fig. 20, the same processes as those shown in Fig. 18 are denoted by the same reference numerals.

[0145] 20, when the operation of the information processing system 10 according to the tenth embodiment is started, first, the movement speed detection unit 190 detects the movement speed of the object (step S901). The movement speed of the object detected by the movement speed detection unit 190 is output to the additional shooting unit 140 and the illumination control unit 190.

[0146] Next, the illumination control unit 200 determines whether the moving speed of the object detected by the moving speed detection unit 190 is equal to or greater than a predetermined speed (step S1001). If the moving speed of the object is equal to or greater than the predetermined speed (step S1001: YES), the illumination control unit 200 controls the illumination so that the illumination light irradiated on the object becomes stronger (step S1002). On the other hand, if the moving speed of the object is not equal to or greater than the predetermined speed (step S1001: NO), the control of the above-mentioned step S1002 is omitted. That is, the illumination light irradiated on the object is not controlled to become stronger.

[0147] Next, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket photographing unit 120 and the histogram acquisition unit .

[0148] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the additional photographing unit 140.

[0149] Next, the bracket photographing section 140 controls the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition section 110 as a reference (step S103).

[0150] Next, the additional photographing unit 140 changes the additional photographing setting values ​​based on the histogram of the reference image acquired by the histogram acquisition unit 130 and the movement speed detected by the movement speed detection unit 190 (step S902). Then, the additional photographing unit 140 performs additional photographing using the changed additional photographing setting values ​​(i.e., additional photographing setting values ​​in consideration of the histogram and movement speed) (step S903).

[0151] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the tenth embodiment will be described.

[0152] 19 and 20, in the information processing system 10 according to the tenth embodiment, the illumination light is controlled to be stronger when the moving speed of the object is equal to or greater than a predetermined speed. In this way, the shooting environment becomes brighter according to the moving speed of the object, so that the exposure time when shooting can be relatively short. Therefore, it is possible to suppress blurring and the like even when the moving speed of the object is fast.

[0153] Eleventh Embodiment An information processing system 10 according to the eleventh embodiment will be described with reference to Figures 21 and 22. The eleventh embodiment differs only in part of the configuration and operation from the first to tenth embodiments described above, and other parts may be the same as the first to tenth embodiments. Therefore, the following will describe in detail the parts that differ from the embodiments already described, and will omit a description of other overlapping parts as appropriate.

[0154] (Functional configuration) First, the functional configuration of the information processing system 10 according to the 11th embodiment will be described with reference to Fig. 21. Fig. 21 is a block diagram showing the functional configuration of the information processing system according to the 11th embodiment. In Fig. 21, the same elements as those shown in Fig. 2 are denoted by the same reference numerals.

[0155] As shown in Fig. 21, the information processing system 10 according to the eleventh embodiment is configured to include, as components for realizing its functions, a reference image acquisition unit 110, a bracket photographing unit 120, a histogram acquisition unit 130, an additional photographing unit 140, and an instruction information output unit 210. That is, the information processing system 10 according to the eleventh embodiment further includes an instruction information output unit 210 in addition to the configuration of the first embodiment already described (see Fig. 2). The instruction information output unit 210 may be a processing block realized by, for example, the above-described processor 11 (see Fig. 1).

[0156] The instruction information output unit 210 is configured to be able to output instruction information for slowing down the moving speed of the target. The instruction information output unit 210 may output a message to the target using the above-mentioned output device 16 (see FIG. 1). The information output unit 210 may display a message such as "Please walk a little more slowly" on a display or output it as sound from a speaker.

[0157] The instruction information output unit 210 according to this embodiment particularly outputs instruction information when the exposure time for additional shooting exceeds a predetermined time. Note that the "predetermined time" here is a threshold value for determining whether the exposure time is long enough to increase the likelihood of blurring the image. Whether the exposure time exceeds the predetermined time can be determined, for example, from information about additional shooting setting values ​​set by the additional shooting unit 140. Alternatively, whether the exposure time will exceed the predetermined time can be predicted and determined from the current shooting environment (for example, the brightness of the location where shooting is performed) or the histogram of the reference image.

[0158] (Operation flow) Next, the flow of operations of the information processing system 10 according to the 11th embodiment will be described with reference to Fig. 22. Fig. 22 is a flowchart showing the flow of the photographing operation of the information processing system according to the 11th embodiment. Note that in Fig. 22, the same processes as those shown in Fig. 3 are denoted by the same reference numerals.

[0159] 22, when the operation of the information processing system 10 according to the eleventh embodiment is started, first, the reference image acquisition unit 110 acquires a reference image (step S101). The reference image acquired by the reference image acquisition unit 110 is output to the bracket shooting unit 120 and the histogram acquisition unit 130.

[0160] Next, the histogram acquisition unit 130 analyzes the reference image acquired by the reference image acquisition unit 110 and acquires a histogram of the reference image (step S102). The histogram of the reference image acquired by the histogram acquisition unit 130 is output to the additional photographing unit 140.

[0161] Next, the bracket photographing section 140 controls the camera 18 to perform bracket photographing using the reference image acquired by the reference image acquisition section 110 as a reference (step S103).

[0162] Next, the instruction information output unit 210 determines whether the exposure time in the additional shooting exceeds a predetermined time (step S1101). If the exposure time in the additional shooting exceeds the predetermined time (step S1101: YES), the instruction information output unit 210 outputs instruction information to slow down the speed of the target (step S1102). On the other hand, if the exposure time in the additional shooting does not exceed the predetermined time (step S1101: NO), the processing of step S1102 described above may be omitted. That is, the instruction information output unit 210 does not need to output instruction information to slow down the speed of the target.

[0163] Thereafter, the additional photographing unit 140 takes an additional photograph based on the histogram of the reference image acquired by the histogram acquisition unit 130 (step S104). Note that the additional photographing is preferably performed after it is confirmed that the moving speed of the subject has decreased, but the additional photographing may be performed without confirming that the moving speed of the subject has decreased.

[0164] (Technical Effects) Next, the technical effects obtained by the information processing system 10 according to the eleventh embodiment will be described.

[0165] 21 and 22, in the information processing system 10 according to the eleventh embodiment, if the exposure time for additional photography exceeds a predetermined time, instruction information is output to the subject to slow down the moving speed. In this way, it is considered that the moving speed of the subject is slowed down by outputting the instruction information. As a result, even if the exposure time exceeds a predetermined time, it is possible to suppress the occurrence of blurring and the like.

[0166] <Other embodiments> In the first to eleventh embodiments described above, examples have been given in which additional shooting is performed based on the histogram of the reference image, but bracket shooting may also be performed based on the histogram of the reference image. That is, the shooting conditions for bracket shooting may be changed as appropriate depending on the histogram of the reference image. For example, the correction width for each shot in bracket shooting may be changed depending on the histogram of the reference image. More specifically, if bracket shooting with a normal correction width results in blocked-up shadows, bracket shooting may be performed with a larger correction width (for example, doubled). In this way, by changing the shooting conditions for bracket shooting depending on the histogram of the reference image, it is possible to capture appropriate images even in bracket shooting.

[0167] The scope of each embodiment also includes a processing method in which a program that operates the configuration of each embodiment to realize the functions of the above-described embodiments is recorded on a recording medium, the program recorded on the recording medium is read as code, and the program is executed on a computer. In other words, a computer-readable recording medium is also included in the scope of each embodiment. Furthermore, each embodiment includes not only a recording medium on which the above-described program is recorded, but also the program itself.

[0168] Examples of recording media that can be used include floppy disks, hard disks, optical disks, magneto-optical disks, CD-ROMs, magnetic tapes, non-volatile memory cards, and ROMs. Furthermore, the scope of each embodiment is not limited to programs that execute processing by themselves, but also includes programs that execute processing by operating on an OS in cooperation with other software or functions of an expansion board. Furthermore, the program itself may be stored on a server, and part or all of the program may be downloadable from the server to a user terminal.

[0169] <Additional Notes> The above-described embodiment may be further described as follows, but is not limited to the following.

[0170] (Appendix 1) The information processing system described in Appendix 1 is an information processing system that includes a reference image acquisition means that acquires a reference image, a bracket shooting means that controls a camera to perform bracket shooting based on the reference image, a histogram acquisition means that acquires a histogram of the reference image, and an additional shooting means that controls the camera to perform additional shooting with setting values ​​different from those used in the bracket shooting, based on the histogram of the reference image.

[0171] (Appendix 2) The information processing system described in Appendix 2 is the information processing system described in Appendix 1, further comprising a backlight determination means for determining whether the shooting environment is backlit based on the histogram of the reference image, and the additional shooting means controls the camera to take the additional shot with the backlight setting value if it is determined that the shooting environment is backlit, and controls the camera not to take the additional shot if it is determined that the shooting environment is not backlit.

[0172] (Appendix 3) The information processing system described in Appendix 3 is the information processing system described in Appendix 2, in which the backlight determination means determines that backlight exists when there are two or more peaks above a predetermined value in the histogram of the reference image.

[0173] (Appendix 4) The information processing system described in Appendix 4 is the information processing system described in Appendix 2 or 3, in which, when the backlight determination means determines that backlight exists, it determines the degree of backlight based on the shape of the histogram of the reference image, and the additional shooting means changes the setting value for backlight based on the degree of backlight.

[0174] (Appendix 5) The information processing system described in Appendix 5 is an information processing system described in any one of Appendixes 1 to 4, wherein the additional photographing means controls the camera to photograph a first additional image with a first setting value and a second additional image with a second setting value different from the first setting value.

[0175] (Appendix 6) The information processing system described in Appendix 6 is the information processing system described in any one of Appendixes 1 to 5, further comprising a face area identification means for identifying a face area in which the face of a subject photographed by the camera is present, and the additional photographing means changes a setting value for the additional photographing so that the brightness value of the face area is within a predetermined range.

[0176] (Appendix 7) The information processing system described in Appendix 7 is the information processing system described in any one of Appendixes 1 to 6, further comprising a first object identification means for identifying a moving object, and the additional shooting means changes the setting value of the additional shooting based on a histogram of the area in the reference image where the moving object is present.

[0177] (Appendix 8) The information processing system described in Appendix 8 is the information processing system described in any one of Appendixes 1 to 7, further comprising a second object identification means for identifying an object approaching the camera, and the additional photographing means changes the setting value of the additional photographing based on a histogram of the area in which the object approaching the camera is located.

[0178] (Appendix 9) The information processing system described in Appendix 9 is an information processing system described in any one of Appendixes 1 to 8, further comprising a speed detection means for detecting the moving speed of an object photographed by the camera, and the additional photographing means changes the exposure time of the camera included in the setting value for the additional photographing based on the moving speed of the object.

[0179] (Appendix 10) The information processing system described in Appendix 10 is the information processing system described in Appendix 9, further comprising an illumination control means for increasing the intensity of illumination light irradiated onto the object when the moving speed of the object is greater than or equal to a predetermined speed.

[0180] (Appendix 11) The information processing system described in Appendix 11 is the information processing system described in Appendixes 1 to 10, further comprising an instruction information output means for outputting instruction information to slow down the movement speed of the object when the exposure time of the camera in the additional photographing exceeds a predetermined time.

[0181] (Appendix 12) The information processing method described in Appendix 12 is an information processing method in which at least one computer acquires a reference image, controls a camera to perform bracket shooting based on the reference image, acquires a histogram of the reference image, and controls the camera to perform additional shooting with setting values ​​different from those used in the bracket shooting based on the histogram of the reference image.

[0182] (Appendix 13) The recording medium described in Appendix 13 is a recording medium having recorded thereon a computer program for causing at least one computer to execute an information processing method, which includes acquiring a reference image, controlling a camera to perform bracket shooting based on the reference image, acquiring a histogram of the reference image, and controlling the camera to perform additional shooting with setting values ​​different from those used in the bracket shooting based on the histogram of the reference image.

[0183] (Appendix 14) The information processing device described in Appendix 11 is an information processing device that includes a reference image acquisition means that acquires a reference image, a bracket shooting means that controls a camera to perform bracket shooting based on the reference image, a histogram acquisition means that acquires a histogram of the reference image, and an additional shooting means that controls the camera to perform additional shooting with setting values ​​different from those used in the bracket shooting, based on the histogram of the reference image.

[0184] (Appendix 15) The computer program described in Appendix 15 is a computer program that causes at least one computer to execute an information processing method, which includes acquiring a reference image, controlling a camera to perform bracket shooting based on the reference image, acquiring a histogram of the reference image, and controlling the camera to perform additional shooting with setting values ​​different from those used in the bracket shooting based on the histogram of the reference image.

[0185] This disclosure may be modified as appropriate within the scope that does not contradict the gist or idea of ​​the invention that can be read from the claims and the entire specification, and information processing systems, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure. [Explanation of symbols]

[0186] 10 Information Processing Systems 11 processors 16 Output Devices 18 Camera 110 Reference image acquisition unit 120 Bracket shooting section 130 Histogram acquisition unit 140 Additional Photography Section 150 Backlight determination section 160 Face area identification unit 165 Iris area identification part 170 1st object identification section 180 2nd object identification section 190 Speed ​​detection unit 200 Lighting control unit 210 Instruction information output unit

Claims

1. a reference image acquisition means for acquiring a reference image; a bracket photographing means for controlling a camera to perform bracket photographing using the reference image as a reference; a histogram acquisition means for acquiring a histogram of the reference image; a backlight determination means for determining whether or not the photographing environment is backlit based on the histogram of the reference image; an additional photographing means for controlling the camera to take additional photographs with the setting values ​​for backlighting when it is determined that the subject is backlit, and for controlling the camera not to take additional photographs when it is determined that the subject is not backlit; An information processing system comprising:

2. the backlight determining means determines that the image is backlit when there are two or more peaks of a predetermined value or more in the histogram of the reference image; The information processing system according to claim 1 .

3. When it is determined that the image is backlit, the backlight determination means determines the degree of backlight based on the shape of the histogram of the reference image, the additional photographing means changes the backlight setting value based on the degree of backlight.

3. The information processing system according to claim 1 or 2.

4. the additional image capturing means controls the camera to capture a first additional image with a first set value and a second additional image with a second set value different from the first set value; The information processing system according to claim 1 .

5. a face area specifying means for specifying a face area in which a face of a subject photographed by the camera exists; the additional photographing means changes a setting value for the additional photographing so that the luminance value of the face area falls within a predetermined range. The information processing system according to any one of claims 1 to 4.

6. The system further includes a first object identification means for identifying a moving object, the additional photographing means changes a setting value for the additional photographing based on a histogram of an area in the reference image where the moving object is present. The information processing system according to any one of claims 1 to 5.

7. further comprising a second object identification means for identifying an object approaching the camera; the additional photographing means changes a setting value for the additional photographing based on a histogram of an area in which an object approaching the camera is present. The information processing system according to any one of claims 1 to 6.

8. The camera further includes a speed detection unit for detecting a moving speed of an object photographed by the camera, the additional photographing means changes an exposure time of the camera included in a setting value for the additional photographing based on a moving speed of the object. The information processing system according to any one of claims 1 to 5.

9. further comprising an illumination control means for increasing the intensity of illumination light irradiated onto the target when the moving speed of the target is equal to or greater than a predetermined speed; The information processing system according to claim 8 .

10. further comprising an instruction information output means for outputting instruction information to slow down the moving speed of the object photographed by the camera when the exposure time of the camera in the additional photographing exceeds a predetermined time; 10. An information processing system according to claim 1.

11. by at least one computer, Acquire a reference image; Controlling the camera to perform bracket photography using the reference image as a reference; obtaining a histogram of the reference image; determining whether the photographing environment is backlit based on the histogram of the reference image; When it is determined that the subject is backlit, the camera is controlled so as to take an additional photograph using the setting values ​​for backlit, and when it is determined that the subject is not backlit, the camera is controlled so as not to take the additional photograph. Information processing methods.

12. At least one computer Acquire a reference image; Controlling the camera to perform bracket photography using the reference image as a reference; obtaining a histogram of the reference image; determining whether the photographing environment is backlit based on the histogram of the reference image; When it is determined that the subject is backlit, the camera is controlled so as to take an additional photograph using the setting values ​​for backlit, and when it is determined that the subject is not backlit, the camera is controlled so as not to take the additional photograph. A computer program that executes an information processing method.

Images