Information processing system, information processing device, information processing method and program

Abstract

An information processing system (100) comprises a portion detection unit (111) and a focus control unit (112). The portion detection unit (111) acquires portion information about a prescribed portion of a subject on the basis of a portion image that includes the prescribed portion of the subject. The focus control unit (112) determines a reference control amount to be used for focus control in imaging the subject by using the portion information of the subject and history information (114a) that includes information that had been used for focus control in imaging in the past.

Description

Information processing system, information processing device, information processing method, and recording medium

[0001] The present disclosure relates to an information processing system, an information processing device, an information processing method, and a recording medium.

[0002] Japanese Patent Application Laid-Open No. 2011-126662 discloses a technology for quickly adjusting the focus when photographing a subject to be biometrically authenticated. The biometric authentication device described in Japanese Patent Application Laid-Open No. 2011-126662 includes a focus determination unit, a feature point extraction unit, a distance estimation unit, a correction unit, and a focus control unit.

[0003] The focus determination unit analyzes image information and performs focus determination, which is a determination of whether or not the image is in focus, by calculating a focus index that indicates whether or not a predetermined area of ​​the image is in focus.

[0004] The feature point extraction unit performs face or head detection on the input image and obtains facial landmarks, which are the positions of characteristic parts of the face or head. The distance estimation unit estimates the distance to the subject from the position information of the obtained landmarks.

[0005] The correction unit generates information on a correction distance for correcting the distance to the subject based on the estimated distance information and the focus information. The focus control unit generates control information for controlling the focus of the image capturing device based on the correction distance information.

[0006] The operation of the correction unit can be roughly divided into a focus distance search mode and a focus tracking mode. The focus distance search mode is a mode in which a focus difference distance is calculated. The focus tracking mode is a mode in which the distance is corrected using the calculated focus difference distance to maintain the focus state.

[0007] Patent Document 1 describes that the difference between the corrected distance and the estimated distance when focusing in focus distance search mode is a deviation in distance due to individual differences, etc. It also describes that because it is possible to focus quickly by taking individual differences into account, it is possible to focus quickly from the second time onwards when focusing and taking pictures.

[0008] International Publication No. 2021 / 166223

[0009] The present disclosure aims to improve upon the techniques described in the prior art documents mentioned above.

[0010] According to one aspect of the present invention, there is provided an information processing system comprising: a part detection means for determining part information relating to a specific part of an object based on a part image including the specific part of the object; and a focus control means for determining a reference control amount to be used for focus control in photographing the object, using the part information of the object and history information including information used for focus control in past photographing.

[0011] According to one aspect of the present invention, there is provided an information processing device comprising: a part detection means for determining part information relating to a specific part of an object based on a part image including the specific part of the object; and a focus control means for determining a reference control amount to be used for focus control in photographing the object, using the part information of the object and history information including information used for focus control in past photographing.

[0012] According to one aspect of the present invention, there is provided an information processing method in which one or more computers determine part information regarding a specific part of an object based on a part image including the specific part of the object, and determine a reference control amount to be used for focus control in photographing the object using the part information of the object and history information including information used for focus control in past photographing.

[0013] According to one aspect of the present invention, a recording medium having recorded thereon a program for causing one or more computers to perform the following operations: obtain part information regarding a specific part of an object based on a part image including the specific part of the object; and obtain a reference control amount to be used for focus control in photographing the object using the part information of the object and history information including information used for focus control in past photographing.

[0014] 1 is a diagram illustrating an overview of an information processing system according to embodiment 1. FIG. 1 is a diagram illustrating an overview of an information processing device according to embodiment 1. FIG. 2 is a flowchart illustrating an overview of an information processing method according to embodiment 1. FIG. 2 is a diagram illustrating an example of a configuration of an information processing system according to embodiment 1. FIG. 3 is a diagram illustrating an example of an iris image according to embodiment 1. FIG. 4 is a diagram illustrating an example of a binocular image that is a part image according to embodiment 1. FIG. 5 is a diagram illustrating an example of history information according to embodiment 1. FIG. 6 is a diagram illustrating an example of a physical configuration of an information processing device according to embodiment 1. FIG. 7 is a flowchart illustrating an example of information processing according to embodiment 1. FIG. 8 is a flowchart illustrating an example of detection processing according to embodiment 1. FIG. 9 is a diagram illustrating an example of a configuration of an information processing system according to embodiment 2. FIG. 10 is a diagram illustrating an example of history information according to embodiment 2. FIG. 11 is a diagram illustrating an example of a mechanical configuration of a focus control unit according to embodiment 2. FIG. 12 is a flowchart illustrating an example of information processing according to embodiment 2. FIG. 13 is a flowchart illustrating an example of reference control amount acquisition processing according to embodiment 2. FIG. 14 is a flowchart illustrating an example of information processing according to embodiment 3. FIG. 15 is a diagram illustrating an example of a configuration of an information processing system according to embodiment 4. FIG. 16 is a diagram illustrating an example of a mechanical configuration of a focus control unit according to embodiment 4. FIG. 17 is a flowchart illustrating an example of information processing according to embodiment 4. FIG. 18 is a flowchart illustrating an example of reference control amount acquisition processing according to embodiment 4. FIG. 19 is a diagram illustrating an example of a configuration of an information processing system according to embodiment 5. FIG. 19 is a flowchart illustrating an example of reference history change processing according to embodiment 5. 10 is a diagram illustrating an example of the configuration of an information processing system according to a sixth embodiment. FIG. 11 is a flowchart illustrating an example of information processing according to a sixth embodiment. FIG. 12 is a flowchart illustrating an example of detection processing according to the sixth embodiment.

[0015] Hereinafter, an embodiment of the present invention will be described with reference to the drawings. In all the drawings, like components are designated by like reference numerals, and the description thereof will be omitted as appropriate.

[0016] 1 is a diagram showing an overview of an information processing system 100 according to embodiment 1. The information processing system 100 includes a body part detection unit 111 and a focus control unit 112.

[0017] The part detection unit 111 obtains part information about a predetermined part of the target based on a part image including the predetermined part of the target. The focus control unit 112 obtains a reference control amount to be used for focus control when photographing the target, using the part information about the target and history information including information used for focus control in past photographs.

[0018] According to this information processing system 100, high speed focusing becomes possible.

[0019] 2 is a diagram showing an overview of the information processing device 103 according to embodiment 1. The information processing device 103 includes a body part detection unit 111 and a focus control unit 112.

[0020] The part detection unit 111 obtains part information about a predetermined part of the target based on a part image including the predetermined part of the target. The focus control unit 112 obtains a reference control amount to be used for focus control when photographing the target, using the part information about the target and history information including information used for focus control in past photographs.

[0021] This information processing device 103 enables high-speed focusing.

[0022] FIG. 3 is a flowchart showing an outline of the information processing method according to the first embodiment.

[0023] The part detection unit 111 obtains part information relating to a predetermined part of the target based on a part image including the predetermined part of the target (step S101a).

[0024] The focus control unit 112 uses information about the target body part and history information including information used for focus control in past imaging to determine a reference control amount to be used for focus control in imaging the target (step S102).

[0025] This information processing method allows for high speed focusing.

[0026] A detailed example of the information processing system 100 according to the first embodiment will be described below.

[0027] (detail)

[0028] Although Patent Document 1 discloses a technique for quickly adjusting the focus on the second and subsequent shots, it does not disclose a technique for quickly adjusting the focus on the first shot. Techniques for achieving even faster focusing are desired.

[0029] In view of the above circumstances, an example of a purpose of this disclosure is to provide an information processing system, an information processing device, an information processing method, a program, and the like that solve the problem of high-speed focusing.

[0030] (Configuration example of information processing system 100 according to the first embodiment)

[0031] 4 is a diagram illustrating an example of the configuration of an information processing system 100 according to the first embodiment. The information processing system 100 is a system for photographing an object. In this embodiment, the information processing system 100 also performs authentication using an object image obtained by photographing the object.

[0032] The target, target image, and authentication according to this embodiment are a person, a face image, and iris authentication, respectively. Therefore, the information processing system 100 according to this embodiment performs authentication using an iris image, which includes the iris, among face images. Here, the face image is an image that includes at least a part of a face and may further include a part or the entire head.

[0033] 5 is a diagram showing an example of an iris image according to embodiment 1. The iris image needs to include at least the iris, and may also include some or all of the pupil, white of the eye, eyelid, outer corner of the eye, inner corner of the eye, eyelashes, and surrounding area of ​​the eye. While the figure shows an example of a right iris image, the iris image may be a left iris image or an image including both the left and right irises.

[0034] The target is not limited to a person, but may be an animal, etc. The target image is not limited to a face image, but may be an image that includes at least a part of the target (for example, a part according to the purpose of authentication, etc.).

[0035] Furthermore, the authentication performed by the information processing system 100 is an example of the use of the target image, and the target image may be used for purposes other than authentication. When the target image is used for authentication, the authentication is not limited to iris authentication, and may be any authentication performed using an image. The authentication may be, for example, biometric authentication other than iris authentication, or may be other than biometric authentication.

[0036] Examples of biometric authentication other than iris authentication include face authentication, fingerprint authentication, eye authentication, and biometric authentication using images including palm prints and veins. Face authentication is biometric authentication using a face image. Eye authentication is biometric authentication using an eye image including one eye or both eyes in their entirety. Fingerprint authentication is biometric authentication using a fingerprint image including a fingerprint.

[0037] As shown in FIG. 4, the information processing system 100 includes an imaging device 101 , an object detection sensor 102 , and an information processing device 103 .

[0038] The image capturing device 101 captures an image of an object and generates an object image including at least a part of the object. The image capturing device 101 according to this embodiment captures an image of a person and generates a face image including the face and head of the person.

[0039] The imaging device 101 is, for example, a camera such as a near-infrared camera. The imaging device 101 according to this embodiment includes a liquid lens in its lens system. The liquid lens can adjust its focus in response to an applied voltage.

[0040] It should be noted that the imaging device 101 only needs to be able to adjust the focus of the lens system in accordance with the output control amount from the information processing device 103, and the lens system is not limited to a liquid lens. For example, the lens system may be composed of one or more solid lenses manufactured from materials such as resin or glass. In this case, the imaging device 101 may be provided with a drive mechanism that moves the solid lens along the optical axis, for example, to adjust the focus of the lens system. The drive mechanism may include a motor or the like that can control the rotation angle. The imaging device 101 may also be incorporated into the information processing device 103.

[0041] The information processing system 100 may also include an image capturing device (not shown) separate from the image capturing device 101. In this case, for example, the separate image capturing device may capture a face image, and the image capturing device 101 may capture an eye position estimated based on the face image. This also allows the image capturing device 101 to capture an eye image as a target image. In this case, the separate image capturing device may be a visible light camera.

[0042] The object detection sensor 102 is a sensor for detecting the presence of an object in a trigger area. The trigger area may be a predetermined linear, planar, or three-dimensional area, and the object detection sensor 102 may be, for example, an infrared sensor, an ultrasonic sensor, or an area sensor.

[0043] For example, when the object detection sensor 102 detects the presence of an object in a trigger area, it outputs a trigger signal to the image capturing device 101. For example, upon receiving this trigger signal, the image capturing device 101 may capture an image of a predetermined image capturing area. By appropriately setting the trigger area and the image capturing area, the image capturing device 101 can capture an image of the object detected by the object detection sensor 102 and generate an image of the object.

[0044] For example, when photographing an object stopped in the trigger area, the trigger area may be set to be part of the photographing area. For example, when photographing an object passing through the trigger area and moving in a predetermined direction, the trigger area may be set at a predetermined distance from the photographing area in the opposite direction to the predetermined direction.

[0045] The method for detecting the presence of an object in the trigger area is not limited to this. For example, the photographing device 101 may continuously photograph the photographing area, and the information processing device 103 may detect the presence of an object in the photographing area based on the images generated in each photographing. In this case, the information processing system 100 may not include the object detection sensor 102.

[0046] The object detection sensor 102 may also be a sensor that reads object identification information (hereinafter also referred to as "object ID") of an object from a card or the like that holds the object ID. When the object ID is read from a card, the object detection sensor 102 can be positioned so that the object is located in the trigger area, thereby detecting that the object is in the trigger area. Therefore, the object detection sensor 102 may output a detection signal to the imaging device 101 when it reads the object ID from the card.

[0047] (Example of functional configuration of information processing device 103 according to embodiment 1) The information processing device 103 is a device that causes the imaging device 101 to capture an image of an object. In this embodiment, the information processing device 103 also performs authentication using an object image generated by the imaging device 101. Note that authentication may be performed by a device other than the information processing system 100.

[0048] As shown in FIG. 4, the information processing device 103 functionally includes a body part detection unit 111, a focus control unit 112, a focus determination unit 113, a history storage unit 114, a storage control unit 115, and an authentication unit .

[0049] The part detection unit 111 acquires a target image from the imaging device 101. The part detection unit 111 detects a part image including a predetermined part of the target from the target image. The part detection unit 111 obtains part information based on the part image.

[0050] The predetermined region according to this embodiment is, for example, both eyes. Therefore, the region image is a binocular image. The binocular image needs to include at least both eyes, and may include some or all of the eyelids, outer corners of the eyes, inner corners of the eyes, eyelashes, and the periphery of the eyes in addition to the pupils, irises, and whites of the eyes. Fig. 6 is a diagram showing an example of a binocular image that is a region image according to the first embodiment.

[0051] The predetermined region is not limited to both eyes, but may be any region included in the target. If the target image is intended for authentication, the predetermined region may include a region used for the authentication. Therefore, for example, the region image may include at least a portion of an image including a region used for authentication (in this embodiment, an iris image), and the target image may include at least a portion of a region image.

[0052] The region information is information relating to a specific region of the object, and includes the dimensions of the specific region. However, the dimensions here represent the lengths on the image, not the lengths in real space.

[0053] The part information according to this embodiment includes, as dimensions of the predetermined part, the distance between characteristic points included in the predetermined part. The part information according to this embodiment further includes the positions of the characteristic points. The characteristic points may be determined as appropriate, and characteristic points that differ in terms of distance and position may be used.

[0054] The distance between characteristic locations according to this embodiment is, for example, the interocular distance, which is the distance between characteristic locations included in both eyes. For example, if the centers of the pupils are the characteristic locations, the interocular distance is the distance between the centers of the pupils. For example, if the inner corners of the eyes are the characteristic locations, the interocular distance is the distance between the inner corners of the eyes. For example, if the outer corners of the eyes are the characteristic locations, the interocular distance is the distance between the outer corners of the eyes.

[0055] The distance may be expressed as a distance in the target image, for example, based on the distance between pixels in the target image.

[0056] The position of the characteristic feature according to this embodiment is the eye position of the characteristic feature included in the eye. For example, if the pupil center is the characteristic feature, the eye position is the position of the pupil center. For example, if the iris is the characteristic feature, the eye position is the position of the iris. The eye position may be the position of the pupil center and the iris.

[0057] The location may be expressed as a location in the target image, for example, a pixel location in the target image.

[0058] The dimension of the predetermined part is not limited to the above example, and may be, for example, the outer diameter of the iris, etc. Furthermore, if the predetermined part is the face, the dimension of the predetermined part may be the distance between the eyebrows and the tip of the nose, the width of the mouth, etc.

[0059] Referring again to Fig. 4, the focus control unit 112 determines a reference control amount used for focus control when photographing an object. Focus control is control for focusing the image capturing device 101 on the object. The reference control amount is a control amount that serves as a reference for determining an output control amount, which is a control amount to be output to the image capturing device 101.

[0060] The focus control unit 112 determines a reference control amount to be used for focus control when photographing the target, for example, by using the target part information determined by the part detection unit 111 and history information 114a stored in the history storage unit 114, which will be described in detail later. Then, the photographing device 101 may photograph the target by adjusting the focus of the lens system in accordance with control using the reference control amount, for example.

[0061] In detail, for example, the focus control unit 112 may determine an output control amount based on the calculated reference control amount and output the determined output control amount to the image capturing apparatus 101. The output control amount may be the reference control amount itself, or may be determined by a predetermined method using the reference control amount.

[0062] The image capturing device 101 may then adjust the focus of the lens system in accordance with the output control amount from the focus control unit 112 to capture an image of the subject.

[0063] In this embodiment, since the lens system is a liquid lens as described above, each of the reference control amount and the output control amount may be expressed as an applied voltage value, which is the magnitude of the voltage applied to the liquid lens.

[0064] Each of the reference control amount and the output control amount is not limited to being expressed by an applied voltage value, but may be expressed by an estimated distance to the target, a rotation angle of the motor, etc. When the rotation angle of the motor is used, the rotation angle may be expressed as a change from a reference position.

[0065] The focus determination unit 113 determines whether the target image is a focused image.

[0066] A focused image is an image that is in focus to a predetermined degree or more.

[0067] A general technique may be adopted as a method for determining whether the target image is a focused image. For example, the focus determination unit 113 may calculate a focus score that indicates the degree of focus, and determine whether the target image is a focused image based on whether the focus score satisfies a predetermined focus condition.

[0068] In this case, the focus score is a value indicating the degree to which a predetermined region in the target image is in focus. The focus score may be expressed, for example, by the magnitude of high-frequency components contained in the target image, the sharpness of edge components in the target image, etc. A focus condition in which the focus score increases as the target is in focus is, for example, that the focus score is equal to or greater than a threshold value.

[0069] The focusing conditions may be determined according to the intended use of the target image. Since the intended use of the target image according to this embodiment is iris recognition, the focusing conditions may be any conditions that allow the image to be clear enough to perform iris recognition.

[0070] The history storage unit 114 is a storage unit for storing history information 114a, which includes information used for focus control in past photographing.

[0071] The storage control unit 115 generates history information 114 a and stores it in the history storage unit 114 .

[0072] 7 is a diagram illustrating an example of history information 114a according to embodiment 1. The history information 114a is information that associates a photographing time, a focusing voltage value, interocular distance as part of body part information, and a target ID. The focusing voltage value and interocular distance are examples of information used for focus control in past photographs.

[0073] The storage control unit 115 generates history information 114a illustrated in FIG. 7 by associating the photographing time, the focusing voltage value, the interocular distance, and the target ID.

[0074] The focus voltage value is the magnitude of the voltage applied to the liquid lens to capture a focused target image, in other words, a target image that the focus determination unit 113 determines to be a focused image.

[0075] The interocular distance included in the history information 114a is part information used to calculate the associated focusing voltage value.

[0076] The shooting time included in the history information 114a is information indicating the time when the focused target image was captured. The shooting time includes at least a part of the year, month, date, and time. The time is at least a part of the hour, minute, and second, and the second is not limited to one second, but may be an appropriate unit such as 1 / 10 second or 1 / 100 second.

[0077] The target ID included in the history information 114a is the target ID of the target included in the focused target image. The target ID may be acquired from the authentication unit 116, for example, when authentication by the authentication unit 116, which will be described later, is successful. Note that, when the target detection sensor 102 reads the target ID, the target ID may be acquired from the target detection sensor 102.

[0078] 7 includes, for example, a history of a target photographed at a photographing time T1 in which the focusing voltage value, interocular distance, and target ID are "V1," "DE1," and "P1," respectively. Here, the history information 114a may be stored in the history storage unit 114 in chronological order according to the photographing times T1 to Tn, as illustrated in FIG.

[0079] Referring again to Fig. 4, the authentication unit 116 performs authentication using a target image. For example, the authentication unit 116 performs authentication of the target using a body part image included in the target image. The authentication unit 116 according to this embodiment performs iris authentication of a person using an iris image included in a face image. Note that the body part image may be an image captured separately from the target image.

[0080] In more detail, for example, the authentication unit 116 acquires from the part detection unit 111 a part image detected based on a focused target image that the focus determination unit 113 has determined to be a focused image, and part information calculated based on the target image. The authentication unit 116 acquires an iris image based on the acquired part image and part information. The authentication unit 116 extracts features from the acquired iris image and compares the extracted features with features of a pre-registered iris image. The authentication unit 116 performs authentication based on the result of this comparison and outputs the authentication result.

[0081] For example, if the similarity of the compared feature amounts is equal to or greater than a threshold, the authentication unit 116 determines that the target is already registered (authentication successful), and if the similarity is less than the threshold, determines that the target is not registered (authentication failed). Alternatively, if there are multiple registrants, the registrant with the highest similarity is found, and if the similarity is equal to or greater than a threshold, the authentication unit 116 may determine that the target is the found registrant (authentication successful), or if not, determine that the target is none of the registrants (authentication failed).

[0082] Up to this point, the functional configuration example of the information processing system 100 according to the first embodiment has been mainly described. From here, a physical configuration example of the information processing system 100 according to the first embodiment will be described.

[0083] 8 is a diagram showing an example of the physical configuration of the information processing device 103 according to embodiment 1. The information processing device 103 physically includes, for example, a bus 1010, a processor 1020, a memory 1030, a storage device 1040, a communication interface 1050, an input interface 1060, and an output interface 1070.

[0084] The processor 1020 is implemented as a CPU (Central Processing Unit) or a GPU (Graphics Processing Unit).

[0085] The memory 1030 is a main storage device realized by a RAM (Random Access Memory) or the like.

[0086] The storage device 1040 is an auxiliary storage device realized by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores program modules for realizing each function of the information processing device 103. The processor 1020 reads each of these program modules into the memory 1030 and executes them to realize the function corresponding to that program module.

[0087] The communication interface 1050 is an interface for connecting the information processing device 103 to a communication line.

[0088] The input interface 1060 is an interface for the user to input information, and is configured from, for example, a touch panel, a keyboard, a mouse, and the like.

[0089] The output interface 1070 is an interface for presenting information to the user, and is configured, for example, by a liquid crystal panel, an organic EL (Electro-Luminescence) panel, or the like.

[0090] The information processing device 103 is preferably housed in a single housing and configured as an integrated unit. However, the physical configuration of the information processing device 103 is not limited to this. The information processing device 103 may be configured from multiple devices that are physically or logically divided. In this case, the functions provided by each device may be determined as appropriate.

[0091] So far, an example of the configuration of the information processing system 100 according to the first embodiment has been described. Next, an example of the operation of the information processing system 100 according to the first embodiment will be described.

[0092] (Operation of Information Processing System 100 According to First Embodiment) The information processing system 100 executes information processing for causing the imaging device 101 to capture an image of an object. The information processing according to this embodiment further includes authentication processing for authenticating the object.

[0093] FIG. 9 is a flowchart illustrating an example of information processing according to the first embodiment.

[0094] For example, when the photographing device 101 receives a trigger signal from the object detection sensor 102, it photographs the object and generates an object image. When the information processing device 103 receives the object image generated in response to the trigger signal, it starts photographing processing. Note that the method for starting the photographing processing is not limited to this.

[0095] The part detection unit 111 executes a detection process (step S101) based on a target image generated in response to a trigger signal, for example.

[0096] FIG. 10 is a flowchart showing an example of the detection process (step S101) according to the first embodiment.

[0097] The part detection unit 111 detects part images based on the target image (step S101a).

[0098] The technology used to detect the part image from the target image in step S101a may be a general technology such as pattern matching or a machine learning model. When a machine learning model is used, the part detection unit 111 may detect the part image using the detection model with the target image as input. The detection model is a machine learning model that has been trained to detect the part image from the target image. For example, the training of the detection model may be performed using supervised learning using training data in which a correct answer label indicating the position of the part image is attached to the target image. Such training may be performed by the information processing device 103 or another device.

[0099] The part detection unit 111 generates part information based on the part image detected in step S101a (step S101b), and returns to the imaging process.

[0100] In this embodiment, the target image and the part image are a face image and a binocular image, respectively, so the part detection unit 111 detects the binocular image from the face image. Then, the part detection unit 111 obtains, for example, the interocular distance and eye position in the detected binocular image, and generates part information including these.

[0101] Referring again to FIG.

[0102] The focus control unit 112 uses the part information generated in step S101b and the history information 114a stored in the history storage unit 114 to determine a reference control amount to be used for focus control in photographing the target (step S102).

[0103] In more detail, for example, the focus control unit 112 determines a reference control amount from the interocular distance included in the part information. In determining this reference control amount, the focus control unit 112 performs correction using the history information 114a. Here, the value before correction obtained from the part information using the history information 114a is called an intermediate control amount and is distinguished from the reference control amount. That is, first, the intermediate control amount is obtained using the history information 114a, and then the intermediate control amount is corrected to obtain the reference control amount.

[0104] There are various correction methods, the detailed examples of which will be described in other embodiments.

[0105] The focus control unit 112 determines an output control amount based on the reference control amount calculated in step S102 (step S103) and outputs the determined output control amount to the image capturing apparatus 101. When there are multiple output control amounts, the focus control unit 112 may output the multiple output control amounts one by one and output the next output control amount based on the result of the in-focus determination in step S106, or may output the multiple output control amounts sequentially in response to image capturing without waiting for the in-focus determination in step S106. First, the former case of outputting an output control amount based on the result of the in-focus determination will be described, and then the latter case of outputting an output control amount sequentially in response to image capturing will be described.

[0106] In detail, for example, the focus control unit 112 may determine the output control amount based on predetermined output pattern information.

[0107] The output pattern information is information that defines a method for determining an output control amount from a reference control amount.

[0108] The output pattern information determines, for example, that a plurality of output control variables are determined within a search range defined based on a reference control variable. More specifically, for example, the output pattern information determines that M output control variables are determined in increments of δ, with the reference control variable R as the median. M is an integer equal to or greater than 1. In this case, it determines that a plurality of output control variables are determined within a search range of δ×(M−1) in size, with the reference control variable R as the median. Note that when M is 1, the output control variables are the same as the reference control variable R.

[0109] In this output pattern information, focus control unit 112 may determine M output control amounts that differ by δ, with a search range of R-δ×((M-1) / 2) or more and R+δ×((M-1) / 2) or less. For example, focus control unit 112 first outputs the first output control amount within the search range. The output control amount determined in the initial step S103 may be, for example, the minimum value of the search range, R-δ×((M-1) / 2), or the maximum value of the search range, R+δ×((M-1) / 2). Note that, as will be described later, in determining the output control amount in subsequent step S103, output control amounts that have not yet been selected from the information included in the output pattern are sequentially output.

[0110] Note that the output pattern information is not limited to this, and the method of determining the output control amount based on the reference control amount may be changed as appropriate. For example, if a focused image cannot be obtained based on the output control amount determined within the search range defined by the output pattern information, the output pattern information may be redefined to include sections before and after the search range in the next search range, as described below. Then, the output control amount may be further output from within the redefined search range.

[0111] When the image capturing device 101 acquires the output control amount determined in step S103, it captures an image of the target in accordance with the acquired output control amount (step S104).

[0112] In this way, the image capturing device 101 generates an image of the target by capturing an image of the target using the output control amount. The image capturing device 101 may also generate image information including this image of the target.

[0113] In addition to the target image, the image information may include at least one of the following: an image ID of the target image, a shooting time of the target image, and an applied voltage value used in shooting to generate the target image. The image ID is information for identifying the target image.

[0114] When the target image generated in step S104 is acquired from the imaging device 101, the part detection unit 111 executes a detection process (step S105) based on the acquired target image. The details of the detection process (step S105) may be the same as those of the detection process (step S101), and therefore a detailed description thereof will be omitted here.

[0115] The focus determination unit 113 determines whether the target image generated in step S103 is a focused image (step S106).

[0116] In detail, for example, the focus determination unit 113 may acquire the part image generated in step S105 from the part detection unit 111 and calculate a focus score for the acquired part image. Then, the focus determination unit 113 may determine whether the target image is a focused image based on whether the calculated focus score satisfies the focus condition.

[0117] If it is determined that the image is not in focus (step S106; No), the focus control unit 112 determines an output control amount different from the output control amount determined immediately before, based on the output pattern information described above (step S103).

[0118] In more detail, for example, the focus control unit 112 may gradually change the output control amount from a small value to a large value. In this case, the focus control unit 112 may determine a value that is larger than the current value by δ as the output control amount. Alternatively, for example, the focus control unit 112 may gradually change the output control amount from a large value to a small value. In this case, the focus control unit 112 may determine a value that is smaller than the current value by δ as the output control amount.

[0119] If the output control amount determined in such an example falls outside the range indicated by the output pattern information, the focus control unit 112 may determine the next output pattern information by examining how the focus score has changed within the range indicated by the output pattern information. Then, the focus control unit 112 may determine the output control amount based on the next output pattern information in the same manner as described above.

[0120] If a smaller output control amount results in a larger focus score, the focus control unit 112 may, for example, define new output pattern information as values ​​that are greater than or equal to R-δ×N and less than or equal to R-δ×((M-1) / 2+1), where N is an integer greater than or equal to (M-1) / 2+1, and differ by δ, and determine one of these values ​​as the output control amount.

[0121] If a larger output control amount results in a larger focus score, the focus control unit 112 may define, for example, a value greater than or equal to R+δ×((M−1) / 2+1) and less than or equal to R+δ×N, which differs by δ, as new output pattern information, and determine one of the values ​​as the output control amount.

[0122] After acquiring the output control amount determined in step S103, the image capturing device 101 captures an image of the target again in accordance with the acquired output control amount (step S104), and steps S105 to S106 are then executed again.

[0123] As a result, the range of the output control amount is gradually widened while the object is repeatedly photographed until a focused image is obtained.

[0124] In step S103, the focus control unit 112 may sequentially output an output control amount in response to image capture. For example, if there are multiple output control amounts, the focus control unit 112 may sequentially output the multiple output control amounts in response to image capture. In this case, steps S103 to S105 may be repeated a number of times corresponding to the number of output control amounts. In step S106, the focus determination unit 113 may receive the detection result of step S105 and perform focus determination for each target image.

[0125] When a focused image is included among the plurality of target images captured according to the plurality of output control amounts, the focus determination unit 113 may determine that the target image is a focused image (step S106; Yes). In this case, the focus determination unit 113 may output not only the determination result of whether or not the image is focused, but also ID information identifying the focused image. On the other hand, when not all of the plurality of target images captured according to the plurality of output control amounts are focused images, the focus determination unit 113 may determine that the image is not a focused image (step S106; No).

[0126] Alternatively, the focus determination unit 113 may calculate focus scores for all of the target images captured according to the output control amounts, and then determine whether the target images are in focus. For example, if there is a peak in the focus scores for each output control amount and the peak satisfies a predetermined condition (e.g., if the peak is equal to or greater than a predetermined threshold), the focus determination unit 113 may determine that the target image corresponding to the peak is an in-focus image (step S106; Yes). In this case, the focus determination unit 113 may determine that the target image is not in focus if there is no peak (step S106; No). If it is determined that the target image is not in focus (step S106; No), the focus control unit 112 may redefine the output pattern information in step S103, as described above, and repeat the processes of steps S104 to S106.

[0127] If it is determined that the image is in focus (step S106; Yes), the storage control unit 115 generates history information 114a and stores it in the history storage unit 114 (step S108).

[0128] In more detail, for example, the storage control unit 115 associates the output control amount determined in step S103 and used to capture the focused target image, the interocular distance calculated in step S105, and the capture time included in the image information, thereby generating the history information 114a.

[0129] Here, the interocular distance included in the history information 114a is the interocular distance obtained in step S105 for the image determined to be an in-focus image. That is, here, the interocular distance when the image was actually in focus is calculated and stored as history information.

[0130] The authentication unit 116 authenticates the target (step S109) using the image contained in the part image detected in step S105 (i.e., the process equivalent to step S101a executed in step S105), and terminates the information control process.

[0131] If the authentication of the target is successful in step S109, the storage control unit 115 may, for example, acquire the target ID registered for the target from the authentication unit 116. Then, the storage control unit 115 may store the acquired target ID in association with the history information 114a stored in step S108.

[0132] Generally, when the control amount is determined based on the interocular distance, the difference between the determined control amount and the focusing control amount becomes large, which may result in a longer focusing time.

[0133] Here, the focus control amount is a control amount for generating an image that is actually in focus. The focus voltage described above is an example of the focus control amount. The focus time is the length of time required for an object to be brought into focus when photographing the object, in other words, for a focused image to be generated.

[0134] One of the factors that can cause a large discrepancy between the determined control amount and the focus control amount is due to the characteristics of the imaging device 101. For example, a liquid lens generally adjusts focus by changing its refractive index in response to an applied voltage, but the amount of change in refractive index relative to the applied voltage is easily affected by temperature. Therefore, when imaging an object at the same distance from the liquid lens, even if a focusing voltage value at a certain temperature is applied to the liquid lens, the image may not be able to be focused if the temperature changes. Furthermore, even when a solid lens is used, the lens may be affected by temperature and other factors due to the characteristics of the lens system, drive mechanism, etc.

[0135] In this embodiment, the correction is performed using the history information 114a, so the reference control amount, which is the corrected value, can be determined from the first image capture in step S104. Since the history information 114a is not limited to information related to a specific object, when the history of the IDs of multiple objects is used, the influence of differences in interocular distance between the objects is canceled out, and this correction can reduce deviations mainly caused by environmental factors such as the characteristics of the image capture device 101 and temperature. As a result, it is more likely that a control amount close to the focus control amount can be determined from the first image capture. Therefore, the focusing time can be reduced.

[0136] The history information 114a used for correction may be history information 114a related to multiple different objects among the history information 114a stored in the history storage unit 114, or history information 114a related to the same object as the object being photographed. The latter can be achieved, for example, by extracting the history information 114a using an object ID read from a card. In this case, it is possible to reduce deviations caused by individual differences in the dimensions of specific parts, such as interocular distance. This further reduces the focusing time.

[0137] (Operations and Effects) As described above, according to the first embodiment, the information processing system 100 includes the part detection unit 111 and the focus control unit 112 .

[0138] The part detection unit 111 obtains part information about a predetermined part of the target based on a part image including the predetermined part of the target. The focus control unit 112 obtains a reference control amount to be used for focus control in photographing the target, using the part information about the target and history information 114a including information used for focus control in past photographing.

[0139] This makes it possible to determine the reference control amount, which is a value corrected using the history information 114a, and therefore it is possible to reduce the discrepancy between the reference control amount and the focusing control amount, which is mainly caused by the characteristics of the imaging device 101, from the first imaging of the target. Therefore, it is more likely that a reference control amount close to the focusing control amount can be determined from the first imaging. Therefore, it becomes possible to focus quickly.

[0140] According to the first embodiment, the predetermined part is a part included in the object. The part information includes dimensions related to the predetermined part.

[0141] This allows the reference control amount to be calculated using the dimensions of the part included in the target, so that the reference control amount can be calculated by determining a predetermined part so that the target image can be easily focused on an area appropriate for the purpose of the target image, thereby enabling high-speed focusing.

[0142] According to the first embodiment, the information processing system 100 includes an image capturing device 101 and an authentication unit 116. The image capturing device 101 captures an image of an object to generate an object image including at least a portion of the object. The authentication unit 116 authenticates the object using an image included in the object image. The image capturing device 101 includes a liquid lens. The image capturing device 101 captures an image of the object by adjusting the focus of the liquid lens in accordance with control using a reference control amount.

[0143] This allows the target to be authenticated using the target image. By focusing quickly, a target image in focus on the target can be generated quickly, allowing authentication to be completed quickly. In addition, there is almost no decrease in the accuracy of focusing on the target. Therefore, high-speed authentication is possible while maintaining authentication accuracy.

[0144] Second Embodiment In this embodiment, as an example of a correction method, a correction amount is calculated based on a model defined based on history information, and a control amount determined from part information is corrected with the calculated correction amount.

[0145] In this embodiment, for the sake of simplicity, the description of matters common to the above-described embodiment will be omitted as appropriate.

[0146] 11 is a diagram showing an example of the configuration of an information processing system 200 according to the second embodiment. The information processing system 200 includes an information processing device 203 that replaces the information processing device 103. Except for this point, the information processing system 200 may be configured similarly to the information processing system 100 according to the first embodiment.

[0147] The information processing device 203 includes a focus control unit 212 and a history storage unit 214 instead of the focus control unit 112 and the history storage unit 114 according to the first embodiment. Except for these, the information processing device 203 may be configured similarly to the information processing device 103 according to the first embodiment.

[0148] The history storage unit 214 stores history information 214a that is different from the history information 114a according to the first embodiment. Except for this point, the history storage unit 214 may be similar to the history storage unit 114 according to the first embodiment.

[0149] 12 is a diagram showing an example of history information 214a according to the second embodiment. The history information 214a is similar to the history information 114a according to the first embodiment, except that it includes a "difference" instead of the focus voltage according to the first embodiment. That is, the history information 214a is information that associates the shooting time, the difference between the intermediate control amount (the control amount before correction; the value after correction becomes the reference control amount; details will be described later) and the actual focus voltage value, the interocular distance, which is part information, and the target ID. The difference and interocular distance are examples of information used for focus control in past shooting.

[0150] The storage control unit 115 generates history information 214a illustrated in FIG. 12 by associating the photographing time, the difference between the intermediate control amount and the actual focusing voltage value, the interocular distance, and the target ID.

[0151] 12 includes, for example, a history of a target photographed at a photographing time "T1" in which the difference, interocular distance, and target ID are "DF1," "DE1," and "P1," respectively. Here, the history information 214a may be stored in the history storage unit 214 in chronological order according to the photographing times T1 to Tn, as illustrated in FIG.

[0152] The history information 214a is not limited to this, and may further be associated with, for example, a focusing voltage.

[0153] 11 again, the focus control unit 212 is a detailed example of the focus control unit 112 according to the first embodiment. Therefore, the outline of the focus control unit 212 is similar to that of the focus control unit 112 according to the first embodiment.

[0154] FIG. 13 is a diagram showing an example of the mechanical configuration of the focus control unit 212 according to the second embodiment.

[0155] The focus control unit 212 includes a calculation unit 212a, a correction amount acquisition unit 212b, a correction parameter acquisition unit 212c, a correction unit 212d, and an output unit 213e.

[0156] The calculation unit 212a calculates an intermediate control amount for imaging the target based on the target's part information and a first model that receives the part information as an input and outputs an intermediate control amount. The first model receives the part information as an input and outputs an intermediate control amount, and is, for example, a model that indicates the relationship between the part information and the intermediate control amount.

[0157] Because the imaging device 101 includes a liquid lens, the intermediate control amount is expressed as a voltage value for controlling the focal length of the liquid lens. That is, the calculation unit 212a according to this embodiment calculates an intermediate voltage value, which is the intermediate control amount for imaging the target, based on the interocular distance, which is part information, and the first model. In detail, for example, the first model is a function that receives the interocular distance, which is part information, as input and outputs the intermediate voltage value, which is the intermediate control amount.

[0158] The first model is, for example, a function f expressed as MV=f(DE), where MV is the intermediate voltage value and DE is the interocular distance.

[0159] This function f is defined to show the relationship between the interocular distance DE and the focusing voltage value FV in an image when, for example, a person with a standard interocular distance in real space (e.g., approximately 63 mm) is photographed in a certain environment at different distances from the photographing device. This may be determined by actual measurement or may be determined arithmetically using information on lens characteristics, camera sensor information, etc. The function f represents a straight line, curve, etc. that approximates the interocular distance DE and the focusing voltage value FV.

[0160] The correction amount acquisition unit 212b calculates the correction amount for photographing the target based on the target part information and a second model that inputs the part information and outputs the correction amount. The second model is a model defined based on the relationship between the part information and the difference. Here, the difference is the difference between the intermediate control amount and the actual focusing voltage value. In other words, the second model calculates the difference between the intermediate control amount used for focus control in previous photographing and the actual focusing voltage value as the correction amount.

[0161] The correction amount acquisition unit 212b according to this embodiment calculates a correction voltage value, which is a correction amount for photographing a target, based on the interocular distance, which is part information, and the second model. In detail, for example, the second model is a function that receives the interocular distance, which is part information, as input and outputs a correction voltage value, which is a correction amount.

[0162] The second model is, for example, a function g expressed as CV=g(DE), where CV is the correction voltage and DE is the interocular distance.

[0163] This function g is determined using, for example, the interocular distance DE used for focus control in previous photographs and the difference between the intermediate control amount and the actual focusing voltage value. More specifically, for example, the function g represents a straight line, a curve, or the like that approximates the interocular distance DE and the focusing voltage value FV.

[0164] The correction parameter acquisition unit 212c obtains the values ​​of the parameters included in the second model based on the history information 214a. Therefore, the correction amount acquisition unit 212b obtains the correction amount using the second model to which the parameter values ​​obtained by the correction parameter acquisition unit 212c are applied.

[0165] For example, for a function g representing a straight line, CV = g(DE) = a DE + b. The "difference" included in the history information 214a corresponds to the correction voltage CV. Therefore, the correction parameter acquisition unit 212c determines the coefficients a and b of the function g by, for example, determining the "difference" included in the history information 214a as CV and the "interocular distance" included in the history information 214a as DE and finding a straight line that approximates the relationship between the difference and the interocular distance.

[0166] The correction unit 212d corrects the intermediate control amount in photographing the target using the correction amount calculated using the history information 214a, thereby calculating the reference control amount in photographing the target.

[0167] As described above, the second model is defined using the history information 214a, and the correction amount acquisition unit 212b calculates the correction amount using this second model. Therefore, the correction amount calculated using the history information 214a is the correction amount calculated by the correction amount acquisition unit 212b.

[0168] Since the imaging device 101 includes a liquid lens, the reference control amount is expressed as a voltage value for controlling the focal length of the liquid lens.

[0169] The correction unit 212d according to this embodiment calculates the reference voltage value for photographing the target by, for example, adding or subtracting the correction voltage value calculated by the correction amount acquisition unit 212b to or from the intermediate voltage value calculated by the calculation unit 212a.

[0170] The correction parameter acquisition unit 212c may determine the values ​​of the parameters included in the first model based on the history information 214a. Because the correction is applied to the first model, the intermediate control amount itself becomes a value that takes into account the correction, and the intermediate control amount can be used as the reference control amount. In this case, the correction amount acquisition unit 212b and the correction unit 212d may not be included.

[0171] The output unit 213e determines an output control amount that the imaging device 101 uses for focus control when imaging the target, based on a reference control amount when imaging the target, and outputs the determined output control amount to the imaging device 101. Because the imaging device 101 includes a liquid lens, the reference control amount is expressed as a voltage value for controlling the focal length of the liquid lens.

[0172] The method by which the output unit 213e determines the output control amount based on the reference control amount may be similar to that of the focus control unit 112 according to embodiment 1. That is, the output unit 213e may determine the output control amount by applying output pattern information similar to that of embodiment 1 to the reference control amount calculated by the correction unit 212d, for example.

[0173] The information processing system 200 according to this embodiment may be physically configured in the same manner as the information processing system 100 according to the first embodiment.

[0174] (Operation of the information processing system 200 according to the second embodiment) Fig. 14 is a flowchart showing an example of information processing according to the second embodiment. Fig. 14 shows differences from the information processing according to the first embodiment. That is, the information processing according to this embodiment includes steps S202 to S203 instead of steps S102 to S103 according to the first embodiment. Except for these, the information processing according to this embodiment may be similar to the information processing according to the first embodiment.

[0175] Following step S101, which is the same as in embodiment 1, the focus control unit 212 uses the part information generated in step S101b and the history information 214a stored in the history memory unit 214 to determine the reference control amount to be used for focus control when photographing the target (step S202).

[0176] FIG. 15 is a flowchart illustrating an example of the reference control amount acquisition process (step S202) according to the second embodiment.

[0177] The calculation unit 212a calculates an intermediate control amount for imaging the object based on the part information of the object and the first model (step S202a).

[0178] In detail, for example, the calculation unit 212a receives the interocular distance generated in step S101b as an input and calculates the intermediate voltage value in photographing the target using the first model.

[0179] The correction parameter acquisition unit 212c obtains the values ​​of the parameters included in the second model based on the history information 214a stored in the history storage unit 214 (step S202b).

[0180] More specifically, for example, if the second model is a linear equation (CV = g(DE) = a DE + b), a straight line DF = a DE + b that approximates the relationship between the difference DF included in the history information 214a and the interocular distance DE is obtained by linear regression. The obtained coefficients a and b are used as the values ​​of the parameters a and b to be applied to the second model.

[0181] The correction amount acquisition unit 212b obtains the correction amount for imaging the object based on the part information of the object and the second model (step S202c).

[0182] In detail, for example, the correction amount acquisition unit 212b inputs the interocular distance generated in step S101b into a second model to which the value obtained in step S202b is applied, and obtains a correction voltage value for photographing the subject.

[0183] The correction unit 212d corrects the intermediate control amount determined in step S202a using the correction amount determined in step S202c to determine the reference control amount for photographing the target (step S202d), and returns to information processing.

[0184] The output unit 213e determines an output control amount based on the reference control amount calculated in step S202d (step S203), and outputs the output control amount to the imaging device 101. The detailed processing in step S203 may be similar to that in step S103 according to the first embodiment.

[0185] Steps S104 to S106 are executed in the same manner as in the first embodiment.

[0186] If it is determined that the image is not in focus (step S106; No), the output unit 213e determines an output control amount different from the output control amount determined immediately before, based on the output pattern information described above (step S203).

[0187] According to this information processing, as in the first embodiment, correction is performed using the history information 214a, so that the corrected reference control amount can be calculated from the first shooting in step S104. Since the history information 214a is not limited to information relating to a specific object, when using the history of IDs of multiple objects, the influence of differences in interocular distance between objects is canceled out, and this correction can reduce deviations mainly caused by environmental factors such as the characteristics of the image capturing device 101 and temperature. As a result, it is more likely that a control amount close to the focus control amount can be calculated from the first shooting. Therefore, the focusing time can be reduced.

[0188] (Actions and Effects) As described above, according to the second embodiment, the focus control unit 212 includes a calculation unit 212a and a correction unit 212d. The calculation unit 212a calculates an intermediate control amount for imaging the object based on part information of the object and a first model that inputs the part information and outputs an intermediate control amount. The correction unit 212d calculates a reference control amount for imaging the object by correcting the intermediate control amount for imaging the object using a correction amount calculated using the history information 214a. Each of the intermediate control amount and the reference control amount is expressed as a voltage value for controlling the focal length of the liquid lens.

[0189] This makes it possible to determine the reference control amount, which is a value corrected using the history information 214a, and thus enables high-speed focusing, as in embodiment 1. Furthermore, since the focal length of the liquid lens can be controlled, it becomes possible to focus the liquid lens at high speed.

[0190] According to the second embodiment, the focus control unit 212 includes an output unit 213e that determines an output control amount used by the imaging device 101 for focus control when imaging the target based on a reference control amount when imaging the target, and outputs the determined output control amount to the imaging device 101. The output control amount is expressed as a voltage value for controlling the focal length of the liquid lens.

[0191] This allows the imaging device 101 to image an object according to an output control amount determined based on the reference control amount. Therefore, it is possible to image an object according to an appropriate output control amount. This makes it possible to focus the liquid lens at high speed. Furthermore, since the focal length of the liquid lens can be controlled, it is possible to focus the liquid lens at high speed.

[0192] According to the second embodiment, the output unit 213e determines the output control amount by applying output pattern information that specifies determining a plurality of output control amounts within a search range defined based on a reference control amount.

[0193] This allows the imaging device 101 to image the target in accordance with the output control amount determined based on the reference control amount, thereby enabling the target to be imaged in accordance with the output control amount within an appropriate search range, thereby enabling the liquid lens to be focused at high speed.

[0194] According to the second embodiment, the history information 214a is information that associates part information used for focus control in past imaging with the difference between the intermediate control amount and the actual focusing voltage value. The focus control unit 212 further includes a correction amount acquisition unit 212b that calculates the correction amount for imaging the target based on the part information of the target and a second model that inputs the part information and outputs the correction amount. The second model is defined based on the history information 214a.

[0195] This allows the correction amount to be calculated using the history information 214a, eliminating the need for an additional sensor, etc. Therefore, it is possible to prevent the configuration from becoming complicated or large in size in order to focus the liquid lens at high speed.

[0196] According to the second embodiment, the second model is a model defined based on the relationship between the part information and the difference. The focus control unit 212 further includes a correction parameter acquisition unit 212c that determines the values ​​of parameters included in the second model based on the history information 214a. The correction amount acquisition unit 212b uses the second model to which the determined parameter values ​​are applied.

[0197] This allows the second model for calculating the correction amount to be appropriately determined using the history information 214a, eliminating the need for additional sensors, etc. This makes it possible to prevent the configuration from becoming complicated or large in size in order to focus the liquid lens at high speed.

[0198] Third Embodiment Generally, shooting may continue even after a target image in which the target is focused is obtained. In shooting after focusing, the correction amount used when the target is focused may be applied. In this embodiment, an example will be described in which such shooting after focusing is applied to the information processing system 200 according to the second embodiment.

[0199] In this embodiment, for the sake of simplicity, the description of matters common to the above-described embodiment will be omitted as appropriate.

[0200] The information processing system according to the third embodiment may be configured functionally in the same manner as the information processing system according to the second embodiment (see FIG. 11 ), except that the correction unit 212d further includes a function for capturing an image after a target image in focus on the target has been obtained.

[0201] The correction unit 212d corrects the intermediate control amount in photographing the object after the object image in focus has been obtained, using the correction amount in photographing that generated the object image in focus. In this way, the correction unit 212d calculates the reference control amount in photographing the object after the object image in focus has been obtained.

[0202] The correction amount used in capturing an image of the object in focus is the correction amount applied by the correction unit 212d to calculate the previous reference control amount. Therefore, it is preferable that the correction unit 212d store the correction amount applied immediately before.

[0203] The information processing system according to this embodiment may be physically configured in the same manner as the information processing system 100 according to the first embodiment.

[0204] (Operation of Information Processing System According to Third Embodiment) Fig. 16 is a flowchart showing an example of information processing according to the third embodiment. Fig. 16 shows differences from the information processing according to the first embodiment. That is, the information processing according to this embodiment further includes steps S310 to S314 in addition to the processing in the information processing according to the second embodiment (see Fig. 14). Except for these, the information processing according to this embodiment may be similar to the information processing according to the second embodiment.

[0205] If it is determined to be an in-focus image (step S106; Yes), the part detection unit 111 acquires the target image determined to be an in-focus image from the imaging device 101 and then executes a detection process (step S310) based on the acquired target image. The immediately preceding image capture refers to the image capture performed in step S105 or S313. The details of the detection process (step S310) may be the same as those of the detection process (step S101), and therefore a detailed description thereof will be omitted here.

[0206] The focus control unit 212 uses the part information generated in step S101b and the correction amount used in the shooting that generated the target image in focus on the target to determine the reference control amount to be used for focus control in the shooting of the target (step S311).

[0207] FIG. 17 is a flowchart illustrating an example of the reference control amount acquisition process (step S311) according to the third embodiment.

[0208] The calculation unit 212a calculates intermediate control amounts for imaging the target based on the target region information and the first model, similarly to step S202a in the second embodiment (step S311a).

[0209] However, in step S311a, the interocular distance generated in step S105 (that is, the process corresponding to step S101b in step S105) is used as an input to determine the intermediate voltage value in photographing the target using the first model.

[0210] The correction unit 212d corrects the intermediate control amount calculated in step S311a using the correction amount used in the shooting that generated the target image in focus on the target, thereby calculating the reference control amount used in the shooting of the target (step S311d), and returns to information processing.

[0211] 16 again, the output unit 213e determines an output control amount based on the reference control amount calculated in step S311d (step S312), and outputs the determined output control amount to the image capturing apparatus 101. The detailed processing in step S312 may be similar to that in step S103 according to the first embodiment.

[0212] When the image capturing apparatus 101 acquires the output control amount determined in step S312, it captures an image of the target again in accordance with the acquired output control amount (step S313).

[0213] The correction unit 212d determines whether the termination condition is satisfied (step S314).

[0214] The termination condition is a condition for terminating the photographing after the target image in focus is obtained, and is preferably determined in advance.

[0215] The termination condition may be, for example, that the number of times the target has been photographed after a target image in focus on the target has been obtained has reached a predetermined number, that the time the target has been photographed after a target image in focus on the target has been obtained has reached a predetermined time, or that an instruction to terminate has been received from the user. Furthermore, the termination condition may be that a local area image cannot be detected in step S310 (i.e., processing equivalent to step S101a in step S310). The termination condition is not limited to these.

[0216] By performing such information processing, it is possible to continue photographing the target even after a target image in focus on the target is obtained. When multiple target images in focus on the target are obtained, for example, the clearest image (e.g., the image with the highest focus score), the image with the largest iris area (e.g., the image with the largest iris area, the image with an iris area equal to or larger than a predetermined value), etc. may be used for authentication.

[0217] According to the third embodiment, the information processing system further includes the focus determination unit 113 that determines whether the target image is an in-focus image. In photographing the target after the target image in focus on the target has been obtained, the correction unit 212d corrects the intermediate control amount in photographing the target using the correction amount used in photographing the target that generated the target image in focus on the target.

[0218] This allows for capturing an image using a control amount that is likely to bring the object into focus, even after an image of the object in focus has been obtained, making it possible to quickly adjust the focus even after an image of the object in focus has been obtained.

[0219] Fourth Embodiment In this embodiment, an example will be described in which the average value of the differences included in the history information 214a is used as the correction amount.

[0220] In this embodiment, for the sake of simplicity, the description of matters common to the above-described embodiment will be omitted as appropriate.

[0221] 18 is a diagram showing an example of the configuration of an information processing system 400 according to the fourth embodiment. The information processing system 400 includes an information processing device 403 that replaces the information processing device 103. Except for this point, the information processing system 400 may be configured similarly to the information processing system 100 according to the first embodiment.

[0222] The information processing device 403 includes a focus control unit 412 and a history storage unit 214 instead of the focus control unit 112 and the history storage unit 114 according to the first embodiment. Except for these, the information processing device 203 may be configured similarly to the information processing device 103 according to the first embodiment.

[0223] The history storage unit 214 may be generally similar to that in the second embodiment, and therefore a description thereof will be omitted here.

[0224] The focus control unit 412 is a detailed example of the focus control unit 112 according to the first embodiment. Therefore, the focus control unit 212 has the same outline as the focus control unit 112 according to the first embodiment.

[0225] FIG. 19 is a diagram showing an example of the mechanical configuration of the focus control unit 412 according to the fourth embodiment.

[0226] The focus control unit 412 includes a calculation unit 212a, a correction unit 212d, and an output unit 213e similar to those in the second embodiment, and a correction amount acquisition unit 412b instead of the correction amount acquisition unit 212b according to the second embodiment.

[0227] The correction amount acquisition unit 412b obtains the average value of the differences included in the history information 214a as the correction amount for photographing the target.

[0228] In detail, for example, the correction amount acquisition unit 412b may change the method for determining the correction amount depending on whether the number of past photographs taken, i.e., the number of histories included in the history information 214a, satisfies a predetermined lower limit condition.

[0229] The lower limit condition is, for example, being equal to or greater than a predetermined threshold, exceeding a predetermined threshold, etc. However, the lower limit condition is not limited to these.

[0230] The correction amount acquisition unit 412b according to this embodiment calculates the average value of the differences included in the history information 214a as the correction amount for the target image capture when the number of past image captures satisfies a lower limit condition. Also, when the number of past image captures does not satisfy a predetermined lower limit condition, the correction amount acquisition unit 412b calculates the correction amount for the target image capture using a value obtained by dividing the sum of the differences in the past image captures by a predetermined value.

[0231] The information processing system 400 according to this embodiment may be physically configured in the same manner as the information processing system 100 according to the first embodiment.

[0232] (Operation of Information Processing System 400 According to Fourth Embodiment) Fig. 20 is a flowchart showing an example of information processing according to the fourth embodiment. Fig. 20 shows differences from the information processing according to the first embodiment. That is, the information processing according to this embodiment includes step S402 instead of step S202 in the information processing according to the second embodiment (see Fig. 14). Except for this, the information processing according to this embodiment may be similar to the information processing according to the second embodiment.

[0233] Following step S101, which is the same as in embodiment 1, the focus control unit 212 uses the part information generated in step S101b and the history information 214a stored in the history memory unit 214 to determine the reference control amount to be used for focus control when photographing the target (step S402).

[0234] FIG. 21 is a flowchart illustrating an example of the reference control amount acquisition process (step S402) according to the fourth embodiment.

[0235] Following step S202a, which is the same as in the second embodiment, the correction amount acquisition unit 412b obtains the correction amount for photographing the target (step S402c).

[0236] In more detail, for example, as described above, when the number of past photographing operations satisfies the lower limit condition, the correction amount acquisition unit 412b calculates the average value of the differences included in the history information 214a as the correction amount for photographing the target. Also, when the number of past photographing operations does not satisfy the predetermined lower limit condition, the correction amount acquisition unit 412b calculates the correction amount for photographing the target using a value obtained by dividing the sum of the differences in the past photographing operations by a predetermined value.

[0237] As a result, if the number of past photographs taken is small, the influence of the characteristics of each individual photograph history, such as the individuality of the subject, becomes greater.If the number of past photographs taken does not satisfy a predetermined lower limit condition, the total number of photographs taken is divided by a predetermined value as the correction amount, thereby reducing the influence of the characteristics of each individual photograph history.

[0238] A trial was conducted using the voltage applied to the liquid lens, with the value by which the total was divided set to 10. As a result, it was found that a correction amount was obtained in which the reference control amount was close to the focus control amount when the number of images taken reached approximately 10. Therefore, for example, it is preferable that the threshold included in the lower limit condition and the threshold by which the total was divided be 10.

[0239] The threshold value included in the lower limit condition and the value by which the total is divided are not limited to 10 and may be changed as appropriate. The threshold value included in the lower limit condition and the value by which the total is divided may be the same or different.

[0240] The correction unit 212d executes step S202d similar to that in the second embodiment, and then returns to information processing.

[0241] According to this information processing, as in the second embodiment, correction is performed using the history information 214a, so that the corrected reference control amount can be obtained from the first shooting in step S104. Because the history information 214a is not limited to information relating to a specific target, this correction can reduce deviations that are mainly caused by the characteristics of the image capturing device 101. As a result, there is a high possibility that a control amount close to the focus control amount can be calculated from the first shooting. Therefore, the focusing time can be reduced.

[0242] (Actions and Effects) As described above, according to the fourth embodiment, the focus control unit 412 includes a correction amount acquisition unit 412b. When the number of past image captures satisfies a predetermined lower limit condition, the correction amount acquisition unit 412b calculates the average value of the differences included in the history information 214a as the correction amount for the target image capture. When the number of past image captures does not satisfy the predetermined lower limit condition, the correction amount acquisition unit 412b calculates the correction amount for the target image capture using a value obtained by dividing the sum of the differences in the past image captures by a predetermined value.

[0243] This allows the reference control amount to be corrected using the history information 214a, making it possible to achieve high-speed focusing, as in the second embodiment.

[0244] Furthermore, when the number of past photographs taken is small, the total sum divided by a predetermined value is used as the correction amount, thereby reducing the influence of the characteristics of each history. Therefore, even when the number of past photographs taken is small, it is more likely that a reference control amount close to the focus control amount can be determined. Therefore, even when the number of past photographs taken is small, high-speed focusing is possible.

[0245] Fifth Embodiment When the deviation between the reference control amount and the focusing control amount becomes large, it is desirable to change the correction amount. Examples of cases in which the deviation between the reference control amount and the focusing control amount becomes large include when the characteristics of the liquid lens change due to a change in temperature, or when the time required to focus on the target increases. By changing the history information 214a referenced to determine the correction amount, it is possible to reduce the deviation between the reference control amount and the focusing control amount.

[0246] In this embodiment, an example will be described in which the change of the history information 214a to be referred to in order to obtain the correction amount is applied to the second embodiment.

[0247] In this embodiment, for the sake of simplicity, the description of matters common to the above-described embodiment will be omitted as appropriate.

[0248] 22 is a diagram showing an example of the configuration of an information processing system 500 according to the fifth embodiment. The information processing system 500 includes an information processing device 503 that replaces the information processing device 203. Except for this point, the information processing system 500 may be configured similarly to the information processing system 100 according to the second embodiment.

[0249] The information processing device 503 further includes a history selection unit 521. Except for this point, the information processing system 500 may be configured similarly to the information processing system 200 according to the second embodiment.

[0250] When at least one condition included in the predetermined change conditions is satisfied, the history selection unit 521 selects the history information 214a to be referenced to determine the correction amount from the history information 214a stored in the history storage unit 214. This selection makes it possible to change part or all of the history information 214a to be referenced to determine the correction amount.

[0251] The change condition includes, for example, at least one of (1) a temperature condition, (2) a focusing time condition, and (3) a frequency condition.

[0252] (1) The temperature condition is a predetermined condition regarding a change in at least one of the environmental temperature and the temperature of the image capturing device 101. For example, the temperature condition is that a change in at least one of the environmental temperature and the temperature of the image capturing device 101 is equal to or greater than a predetermined temperature threshold. To determine the temperature condition, the information processing system 500 may further include a temperature sensor.

[0253] (2) The focusing time condition is a predetermined condition regarding the focusing time. The focusing time is the length of time required to generate a focused image when photographing a target. For example, the focusing time condition is that the focusing time is equal to or greater than a predetermined time threshold.

[0254] (3) The frequency condition is a predetermined condition regarding the number of times photographs are taken within a predetermined time. For example, the frequency condition is that the number of times photographs are taken within a predetermined time is equal to or greater than a predetermined frequency threshold.

[0255] The focus control unit 212 may determine a reference control amount to be used for focus control in photographing the target, for example, by using the target part information determined by the part detection unit 111 and the history information 114a selected by the history selection unit 521. In detail, for example, the correction parameter acquisition unit 212c may determine the values ​​of the parameters included in the second model based on the history information 214a selected by the history selection unit 521.

[0256] The information processing system 500 according to this embodiment may be physically configured in the same manner as the information processing system 100 according to the first embodiment.

[0257] (Operation of the Information Processing System 500 According to the Fifth Embodiment) The information processing executed by the information processing system 500 according to the fifth embodiment further includes a reference history change process. The reference history change process is a process for changing the history information 214a that is referenced to calculate the correction amount. The information processing device 503 may repeatedly execute the reference history change process during operation.

[0258] FIG. 23 is a flowchart illustrating an example of a reference history change process according to the fifth embodiment.

[0259] The history selection unit 521 determines whether or not a change condition is satisfied (step S501).

[0260] If it is determined that the change condition is not satisfied (step S501; No), the history selection unit 521 repeatedly executes step S501.

[0261] If it is determined that the change conditions are met (step S501; Yes), the history selection unit 521 selects history information 214a to be referenced to determine the correction amount from the history information 214a stored in the history memory unit 214 (step S502).

[0262] In more detail, for example, it is desirable that the history selection unit 521 selects history information 214a that satisfies the elements used in the determination change condition that has been determined to be satisfied. In the example of the change condition described above, the elements used in the change condition are the ambient temperature, the temperature of the image capturing device, the focusing time, and the frequency.

[0263] For example, if the environmental temperature exceeds the temperature threshold and the temperature condition is satisfied, the history selection unit 521 may select the history information 214a for a predetermined time period when the temperature is relatively high, such as when the image was captured between 12:00 and 14:00.

[0264] The history information 214a may further include elements used in the change conditions to facilitate selection by the history selection unit 521. In this case, the history selection unit 521 may select history information 214a in which the value of the element used in the determination change condition that is determined to be satisfied is within a predetermined range from the current state.

[0265] By performing such a reference history change process, the history information 214a referenced to determine the correction amount can be changed to a more appropriate one, thereby reducing the discrepancy between the reference control amount and the focus control amount.

[0266] In this embodiment, the example of changing the history information 214a referenced to obtain the correction amount has been described as being applied to the second embodiment, but it can also be applied to other embodiments. For example, when applied to the fourth embodiment, the correction amount acquisition unit 412b may refer to the history information 214a selected by the history selection unit 521.

[0267] (Operations and Effects) According to the fifth embodiment, the information processing system 500 further includes the history storage unit 214 for storing the history information 214 a and the history selection unit 521 .

[0268] When at least one of the conditions including the temperature condition, the focusing time condition, and the frequency condition is satisfied, the history selection unit 521 selects the history information 214a stored in the history memory unit 214 that is to be referenced to determine the correction amount.

[0269] The temperature condition is a predetermined condition regarding at least one temperature change of the ambient temperature and the temperature of the image capturing device 101. The focusing time condition is a predetermined condition regarding the focusing time, which is the length of time required to generate a focused image when capturing an object. The frequency condition is a predetermined condition regarding the number of times capturing an image within a predetermined period of time.

[0270] As mentioned above, the characteristics of a liquid lens are generally susceptible to change due to changes in temperature. By using temperature conditions, the history information 214a referenced to determine the correction amount can be changed to more appropriate information that corresponds to the characteristics of the liquid lens, thereby reducing the discrepancy between the reference control amount and the focusing control amount. This makes it possible to achieve high-speed focusing.

[0271] If the focusing time is long, the history information 214a referenced to calculate the correction amount may be inappropriate. By changing this history information 214a to more appropriate information, it is possible to reduce the discrepancy between the reference control amount and the focusing control amount. Therefore, it becomes possible to focus quickly.

[0272] Generally, if the number of times images are captured within a given period of time increases, the temperature of the image capture device 101 may rise due to heat generated during processing, which may cause changes in the characteristics of the liquid lens. In such cases, by changing the history information 214a to more appropriate information, it is possible to reduce the discrepancy between the reference control amount and the focus control amount. This makes it possible to focus quickly.

[0273] Sixth Embodiment Generally, for example, the interocular distance in a binocular image may change depending on whether or not the subject is wearing an accessory. For example, if the subject is wearing glasses, distortion caused by the lenses may result in an interocular distance that differs from the interocular distance corresponding to the distance between the subject and the image capturing device 101.

[0274] Furthermore, for example, the interocular distance in a binocular image may change depending on the orientation of the subject's face. For example, even if the subject is at the same distance from the image capturing device 101, the interocular distance in a binocular image usually differs depending on whether the subject is facing the image capturing device 101 directly or at an angle.

[0275] In this embodiment, an example will be described in which correction is performed using at least one of the attachment and the face direction of the target to obtain the part information of the target.

[0276] In this embodiment, for the sake of simplicity, the description of matters common to the above-described embodiment will be omitted as appropriate.

[0277] 24 is a diagram showing an example of the configuration of an information processing system 600 according to the sixth embodiment. The information processing system 600 includes an information processing device 603 that replaces the information processing device 103. Except for this point, the information processing system 600 may be configured similarly to the information processing system 100 according to the first embodiment.

[0278] The information processing device 603 includes a part detection unit 611 that replaces the part detection unit 111 according to the first embodiment. The information processing device 603 further includes an analysis unit 617. Except for these components, the information processing device 603 may be configured similarly to the information processing device 103 according to the first embodiment.

[0279] The analysis unit 617 acquires a target image from the image capturing device 101. The analysis unit 617 analyzes the target image to acquire at least one of the presence or absence of an attachment and the facial orientation of the target.

[0280] Examples of the article of wear include glasses, sunglasses, an eye patch, goggles, a mask, and a niqab.

[0281] Common techniques such as pattern matching and machine learning models may be used to analyze the target image.

[0282] For example, when a machine learning model is used, the analysis unit 617 may use an analysis model with a target image as input to acquire at least one of the presence or absence of an article of clothing of the target and the facial direction. The analysis model is a machine learning model that has been trained to analyze the target image and output at least one of the presence or absence of an article of clothing of the target and the facial direction. In training the analysis model, supervised learning may be performed using training data in which correct labels for at least one of the presence or absence of an article of clothing of the target and the facial direction are attached to the target image.

[0283] Similar to the part detection unit 111 according to the first embodiment, when a target image is acquired from the image capturing device 101, the part detection unit 611 detects part images including predetermined parts of the target from the target image. The part detection unit 611 according to this embodiment acquires the analysis results of the analysis unit 617. Then, the part detection unit 611 obtains part information based on the detected part images and at least one of the presence or absence of an attachment on the target and the facial orientation.

[0284] In detail, for example, the part detection unit 611 corrects the dimensions obtained from the part image (i.e., the dimensions related to a specific part in the part image) using at least one of the presence or absence of an attachment on the subject and the facial orientation, and obtains part information including the corrected dimensions.

[0285] The information processing system according to this embodiment may be physically configured in the same manner as the information processing system 100 according to the first embodiment.

[0286] (Operation of Information Processing System 600 According to Sixth Embodiment) Fig. 25 is a flowchart showing an example of information processing according to the sixth embodiment. Fig. 25 shows a difference from the information processing according to the first embodiment. That is, the information processing according to this embodiment includes step S601 instead of step S101 according to the first embodiment. Except for this, the information processing according to this embodiment may be similar to the information processing according to the first embodiment.

[0287] The analysis unit 617 and the part detection unit 611 perform a detection process (step S601) based on a target image generated in response to a trigger signal, for example.

[0288] FIG. 26 is a flowchart showing an example of the detection process (step S601) according to the sixth embodiment.

[0289] The analysis unit 617 analyzes the target image (step S601c) after acquiring the target image from the image capturing device 101. As a result, the analysis unit 617 acquires at least one of the presence or absence of an attachment and the facial orientation of the target as an analysis result.

[0290] The part detection unit 611 executes step S101a similar to that in the first embodiment.

[0291] The part detection unit 611 generates part information based on the analysis result acquired in step S601c and the part image detected in step S101a (step S601b), and returns to the imaging process.

[0292] In more detail, for example, it is assumed that the part detection unit 611 obtains an analysis result indicating that eyeglasses are worn from the analysis unit 617. Furthermore, it is assumed that the part detection unit 611 obtains the interocular distance. In this case, for example, the part detection unit 611 obtains the corrected interocular distance by multiplying the interocular distance in the part image by a predetermined value for wearing eyeglasses.

[0293] For example, suppose that the part detection unit 611 obtains an analysis result from the analysis unit 617 indicating that the subject is facing obliquely at an angle of θ degrees with respect to the image capturing device 101. Furthermore, suppose that the part detection unit 611 obtains the interocular distance. In this case, for example, the part detection unit 611 obtains the corrected interocular distance by dividing the interocular distance in the part image by cos θ.

[0294] However, the correction method is not limited to these.

[0295] By performing such information processing, the dimensions of a predetermined region in a region image can be corrected to values ​​closer to the actual dimensions, thereby improving the accuracy of the reference control amount calculated using the dimensions.

[0296] According to the sixth embodiment, the information processing system 600 further includes an analysis unit 617 that acquires, based on a target image, at least one of whether or not the target is wearing an item and the facial orientation of the target. The body part detection unit 611 obtains body part information related to a specific body part of the target based on a body part image including the specific body part of the target and at least one of the target's wearing an item and the facial orientation of the target.

[0297] This allows the dimensions of a specific region in a region image to be corrected to values ​​close to the actual dimensions, improving the accuracy of the reference control amount calculated using the dimensions and reducing the discrepancy between the reference control amount and the focus control amount, thereby enabling high-speed focusing.

[0298] Although the embodiments and modifications of the present invention have been described above with reference to the drawings, these are merely examples of the present invention, and various configurations other than those described above can also be adopted.

[0299] In addition, although the flowcharts used in the above description show multiple steps (processes) in a sequential order, the order of steps performed in each embodiment is not limited to the order shown. In each embodiment, the order of steps shown in the drawings can be changed as long as it does not cause any problems in terms of content. Furthermore, the above-described embodiments and variations can be combined as long as the content is not contradictory.

[0300] Some or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0301] 1. An information processing system comprising: part detection means for determining part information relating to a predetermined part of an object based on a part image including the predetermined part of the object; and focus control means for determining a reference control amount to be used for focus control when photographing the object, using the part information of the object and history information including information used for focus control in past photographs. 2. The information processing system described in 1., wherein the predetermined part is a part included in the object, and the part information includes dimensions related to the predetermined part. 3. The information processing system described in 1. or 2., further comprising: an imaging device that photographs the object and generates an object image including at least a part of the object; and authentication means that authenticates the object using an image included in the object image, wherein the imaging device includes a liquid lens, and photographs the object by adjusting the focus of the liquid lens in accordance with control using the reference control amount. 4. The information processing system described in 3., wherein the focus control means includes: a calculation means for calculating an intermediate control amount for photographing the object based on part information of the object and a first model that inputs the part information and outputs an intermediate control amount; and a correction means for calculating a reference control amount for photographing the object by correcting the intermediate control amount for photographing the object using a correction amount calculated using the history information, wherein the intermediate control amount and the reference control amount are each expressed as a voltage value for controlling the focal length of the liquid lens. 5. The information processing system described in 4., wherein the focus control means further includes an output means for determining an output control amount used by the photographing device for focus control when photographing the object based on a reference control amount for photographing the object, and outputting the determined output control amount to the photographing device, wherein the output control amount is expressed as a voltage value for controlling the focal length of the liquid lens. 6. The information processing system described in 5., wherein the output means determines the output control amount by applying output pattern information that specifies determining a plurality of output control amounts within a search range defined based on the reference control amount.7. The information processing system described in any one of 4. to 6., wherein the history information is information relating part information used for focus control in past imaging with the difference between an intermediate control amount and an actual focusing voltage value, and the focus control means further includes correction amount acquisition means for determining a correction amount for imaging the object based on part information of the object and a second model that inputs part information and outputs a correction amount, and the second model is defined based on the history information. 8. The information processing system described in 7., wherein the second model is a model defined based on the relationship between the part information and the difference, and the focus control means further includes correction parameter acquisition means for determining parameter values ​​included in the second model based on the history information, and the correction amount acquisition means uses a second model to which the determined parameter values ​​are applied. 9. The information processing system of any one of 4. to 8., further comprising focus determination means for determining whether the target image is a focused image, and wherein the correction means, in photographing the target after the target image in focus on the target has been obtained, corrects an intermediate control amount in photographing the target by using the correction amount used in photographing that generated the target image in focus on the target. 10. The information processing system of any one of 4. to 6., further comprising correction amount acquisition means for, if the number of past photographings satisfies a predetermined lower limit condition, calculating an average value of the differences included in the history information as the correction amount in photographing of the target, and, if the number of past photographings does not satisfy the predetermined lower limit condition, calculating an average value of the differences in the past photographings by a predetermined value as the correction amount in photographing of the target.11. The information processing system described in any one of 4. to 10., further comprising: a history storage means for storing the history information; and a history selection means for selecting, from the history information stored in the history storage means, history information 214a to be referenced for determining the correction amount when at least one of the following conditions is satisfied: (1) a predetermined temperature condition regarding a change in at least one of the ambient temperature and the temperature of the photographing device; (2) a predetermined focusing time condition regarding a focusing time which is the length of time required for generating a focused image in photographing the object; and (3) a predetermined frequency condition regarding the number of times photographing is performed within a predetermined time. 12. The information processing system described in any one of 1. to 11., further comprising: an analysis means for acquiring, based on a target image, at least one of the presence or absence of an attachment on the target and a facial orientation, wherein the body part detection means determines body part information regarding a predetermined body part of the target based on a body part image including the predetermined body part of the target and at least one of the attachment and the facial orientation of the target. 13. 14. An information processing device comprising: a part detection means for determining part information about a predetermined part of an object based on a part image including the predetermined part of the object; and a focus control means for determining a reference control amount to be used for focus control when photographing the object, using the part information about the object and history information including information used for focus control in past photographs. 14. An information processing method in which one or more computers determine part information about a predetermined part of an object based on a part image including the predetermined part of the object, and determine a reference control amount to be used for focus control when photographing the object, using the part information about the object and history information including information used for focus control in past photographs. 15. The information processing method described in 14., in which the predetermined part is a part included in the object, and the part information includes dimensions related to the predetermined part. 16. The information processing method described in 14 or 15, further comprising photographing the object using an imaging device to generate an object image including at least a portion of the object, and authenticating the object using an image included in the object image, wherein the imaging device includes a liquid lens, and photographing the object by adjusting the focus of the liquid lens in accordance with control using the reference control amount.17. The information processing method described in 16., wherein determining a reference control amount to be used for focus control includes: determining an intermediate control amount for photographing the object based on part information of the object and a first model that inputs part information and outputs an intermediate control amount; and determining a reference control amount for photographing the object by correcting the intermediate control amount for photographing the object using a correction amount determined using the history information, wherein each of the intermediate control amount and the reference control amount is expressed as a voltage value for controlling the focal length of the liquid lens. 18. The information processing method described in 17., wherein determining a reference control amount to be used for focus control further includes determining an output control amount to be used by the photographing device for focus control when photographing the object based on a reference control amount for photographing the object, and outputting the determined output control amount to the photographing device, wherein the output control amount is expressed as a voltage value for controlling the focal length of the liquid lens. 19. The information processing method described in 18., wherein outputting the output control amount includes determining the output control amount by applying output pattern information that specifies determining multiple output control amounts within a search range defined based on the reference control amount. 20. The information processing method described in any one of 17. to 19., wherein the history information is information correlating part information used for focus control in past imaging with a difference between an intermediate control amount and an actual focusing voltage value, and determining a reference control amount to be used for focus control further includes determining a correction amount for imaging the object based on part information of the object and a second model that inputs part information and outputs a correction amount, and the second model is defined based on the history information. 21. The information processing method described in 20., wherein the second model is a model defined based on a relationship between the part information and the difference, and determining a reference control amount to be used for focus control further includes determining a value of a parameter included in the second model based on the history information, and determining a correction amount for imaging the object uses a second model to which the determined parameter value is applied.22. The information processing method according to any one of 17. to 21., further comprising determining whether the target image is a focused image, wherein determining a reference control amount for photographing the target includes correcting an intermediate control amount for photographing the target using the correction amount used in photographing the target that generated the target image in focus on the target, when photographing the target after the target image in focus on the target has been obtained. 23. The information processing method according to any one of 17. to 19., further comprising determining an average value of the differences included in the history information as the correction amount for photographing the target when the number of past photographs satisfies a predetermined lower limit condition, and using a value obtained by dividing the sum of the differences in the past photographs by a predetermined value as the correction amount for photographing the target when the number of past photographs does not satisfy the predetermined lower limit condition. 26. The information processing method described in any one of 17. to 23., further comprising selecting, from the history information, history information to be referenced for determining the correction amount when at least one of the following conditions is satisfied: (1) a predetermined temperature condition regarding at least one temperature change of the ambient temperature and the temperature of the photographing device; (2) a predetermined focusing time condition regarding the focusing time, which is the length of time required for generating a focused image in photographing the object; and (3) a predetermined frequency condition regarding the number of times photographing is performed within a predetermined time. 27. The information processing method described in any one of 14. to 26., further comprising acquiring, based on the object image, at least one of the presence or absence of an attachment on the object and a facial direction, wherein determining the body part information determines body part information related to a predetermined body part of the object based on a body part image including the predetermined body part of the object and at least one of the attachment on the object and the facial direction. 28. A recording medium having recorded thereon a program for causing one or more computers to execute the following: determining part information regarding a predetermined part of a target based on a part image including the predetermined part of the target; and determining a reference control amount to be used for focus control in photographing the target using the part information of the target and history information including information used for focus control in past photographing.29. The recording medium described in 28., wherein the predetermined part is a part included in the object, and the part information includes dimensions related to the predetermined part. 30. The recording medium described in 28 or 29, wherein the program further causes the program to photograph the object using an imaging device to generate an object image including at least a part of the object, and authenticate the object using an image included in the object image, wherein the imaging device includes a liquid lens, and photographs the object by adjusting the focus of the liquid lens in accordance with control using the reference control amount. 31. The recording medium described in 30., wherein determining the reference control amount to be used for focus control includes determining an intermediate control amount for photographing the object based on part information of the object and a first model that inputs part information and outputs an intermediate control amount, and determining a reference control amount for photographing the object by correcting the intermediate control amount for photographing the object using a correction amount determined using the history information, wherein each of the intermediate control amount and the reference control amount is expressed as a voltage value for controlling the focal length of the liquid lens. 32. 31. The recording medium described in 31., wherein the program further causes the program to determine an output control amount used by the imaging device for focus control when imaging the object based on a reference control amount for imaging the object, and output the determined output control amount to the imaging device, wherein the output control amount is expressed as a voltage value for controlling the focal length of the liquid lens. 33. The recording medium described in 32., wherein outputting the output control amount determines the output control amount by applying output pattern information that specifies determining multiple output control amounts within a search range defined based on the reference control amount. 34. The recording medium described in any one of 31. to 33., wherein the history information is information that associates part information used for focus control in past imaging with a difference between an intermediate control amount and an actual focusing voltage value, and wherein determining the reference control amount for focus control further includes determining a correction amount for imaging the object based on part information of the object and a second model that receives part information as input and outputs a correction amount, wherein the second model is defined based on the history information.35. The recording medium described in 34., wherein the second model is a model defined based on the relationship between the part information and the difference, and determining a reference control amount to be used for focus control further includes determining a value of a parameter included in the second model based on the history information, and determining a correction amount for photographing the object uses the second model to which the determined parameter value is applied. 36. The recording medium described in any one of 31. to 35., wherein the program further causes the program to determine whether the object image is an in-focus image, and determining a reference control amount for photographing the object includes correcting an intermediate control amount for photographing the object using the correction amount used in photographing that generated the object image in focus on the object, in photographing the object after the object image in focus on the object has been obtained. 37. The recording medium described in any one of 31. to 33., wherein calculating the reference control amount used for focus control further includes: calculating an average value of the differences included in the history information as a correction amount for photographing the object when the number of past photographings satisfies a predetermined lower limit condition; and, when the number of past photographings does not satisfy the predetermined lower limit condition, using a value obtained by dividing the sum of the differences in the past photographings by a predetermined value as a correction amount for photographing the object. 38. The recording medium described in any one of 31. to 37., wherein the program further executes selecting, from the history information, history information to be referenced for calculating the correction amount when at least one condition is satisfied, including: (1) a predetermined temperature condition regarding at least one temperature change of an ambient temperature and a temperature of the photographing device; (2) a predetermined focusing time condition regarding a focusing time which is the length of time required for generating a focused image when photographing the object; and (3) a predetermined frequency condition regarding the number of times photographing is performed within a predetermined time.39. The recording medium described in any one of 28. to 38., wherein the program further executes acquiring at least one of the presence or absence of an attachment of the target and a facial orientation based on the target image, and obtaining the body part information obtains body part information related to a predetermined body part of the target based on a body part image including the predetermined body part of the target and at least one of the attachment of the target and a facial orientation of the target.

[0302] 100, 200, 400, 500, 600 Information processing system 101 Imaging device 102 Object detection sensor 103, 203, 403, 503, 603 Information processing device 103 Information processing device 111, 611 Part detection unit 112, 212, 412 Focus control unit 113 Focus determination unit 114, 214 History storage unit 114a, 214a History information 115 Storage control unit 116 Authentication unit 212a Calculation unit 212b, 412b Correction amount acquisition unit 212c Correction parameter acquisition unit 212d Correction unit 213e Output unit 521 History selection unit 617 Analysis unit

Claims

1. a region detection means for determining region information relating to a predetermined region of the object based on a region image including the predetermined region of the object; and a focus control unit that calculates a reference control amount to be used for focus control in photographing the object using the part information of the object and history information including information used for focus control in past photographing. Information processing system.

2. the predetermined site is a site included in the target, The part information includes dimensions of the predetermined part. The information processing system according to claim 1 .

3. an imaging device that captures an image of the object and generates an object image including at least a portion of the object; and an authentication means for authenticating the target using an image included in the target image, The imaging device includes a liquid lens, and adjusts the focus of the liquid lens according to control using the reference control amount to image the object.

3. The information processing system according to claim 1 or 2.

4. The focus control means a calculation means for calculating an intermediate control amount for imaging the object based on part information of the object and a first model that receives the part information as an input and outputs an intermediate control amount; a correction unit that calculates a reference control amount for photographing the object by correcting an intermediate control amount for photographing the object using a correction amount calculated using the history information, Each of the intermediate control amount and the reference control amount is expressed as a voltage value for controlling the focal length of the liquid lens. The information processing system according to claim 3 .

5. the focus control means further includes output means for determining an output control amount to be used by the photographing device for focus control when photographing the object based on a reference control amount when photographing the object, and outputting the determined output control amount to the photographing device; The output control amount is expressed as a voltage value for controlling the focal length of the liquid lens. The information processing system according to claim 4 .

6. The output means determines the output control amount by applying output pattern information that determines a plurality of output control amounts within a search range defined based on the reference control amount. The information processing system according to claim 5 .

7. The image processing device further includes an analysis unit for acquiring at least one of the presence or absence of an attachment and the facial orientation of the subject based on the target image, The part detection means obtains part information about the predetermined part of the target based on a part image including the predetermined part of the target and at least one of an attachment and a facial orientation of the target.

3. The information processing system according to claim 1 or 2.

8. a region detection means for determining region information relating to a predetermined region of the object based on a region image including the predetermined region of the object; and a focus control unit that calculates a reference control amount to be used for focus control in photographing the object using the part information of the object and history information including information used for focus control in past photographing. Information processing device.

9. One or more computers determining region information relating to the predetermined region of the subject based on a region image including the predetermined region of the subject; Using the part information of the object and history information including information used for focus control in past imaging, a reference control amount to be used for focus control in imaging of the object is calculated. Information processing methods.

10. On one or more computers, determining region information relating to the predetermined region of the subject based on a region image including the predetermined region of the subject; Using the part information of the object and history information including information used for focus control in past imaging, a reference control amount to be used for focus control in imaging the object is calculated. A program to execute.