Information processing device, information processing method, and computer program

Abstract

An information processing device 1 comprises: a distance acquisition unit 11 that acquires the results of measuring the distance to an object; and a switching unit 12 that switches the method for modifying the orientation of an imaging means for imaging the object.

Description

Information processing device, information processing method, and recording medium

[0001] The present disclosure relates to the technical fields of an information processing device, an information processing method, and a recording medium.

[0002] Patent Document 1 describes a technology that measures the distance to a person, calculates the eye height from the captured image, calculates the direction in which the camera should be pointed using the distance to the person and the eye height, and tilts the camera to point it in the calculated direction to capture an image of the eyes.

[0003] Japanese Patent Application Laid-Open No. 2006-163683

[0004] An object of the present disclosure is to provide an information processing device, an information processing method, and a recording medium that aim to quickly orient a photographing unit in an appropriate direction.

[0005] One aspect of the information processing device includes a distance acquisition means for acquiring a measurement result of the distance to an object, and a switching means for switching a method of changing the orientation of an imaging means for imaging the object according to the measurement result.

[0006] One aspect of the information processing method includes obtaining a measurement result of a distance to an object, and switching a method of changing the orientation of an image capturing means for capturing an image of the object in accordance with the measurement result.

[0007] One aspect of the recording medium has a computer program recorded thereon to cause a computer to execute an information processing method that acquires measurement results of the distance to an object and switches the method of changing the orientation of a photographing means that photographs the object depending on the measurement results.

[0008] The information processing device, information processing method, and recording medium according to the present disclosure can quickly orient the image capture means in an appropriate direction.

[0009] FIG. 1 is a block diagram showing an example of a configuration of an information processing device according to the present disclosure. FIG. 2 is a cross-sectional view showing an example of a configuration of an information processing device according to the present disclosure. FIG. 3 is a block diagram showing an example of a configuration of an information processing device according to the present disclosure. FIG. 4 is a cross-sectional view showing an example of a configuration of an information processing device according to the present disclosure. FIG. 5 is a cross-sectional view showing an example of a configuration of an information processing device according to the present disclosure. FIG. 6 is a block diagram showing an example of a configuration of an information processing device according to the present disclosure. FIG. 7 is a cross-sectional view showing an example of a configuration of an information processing device according to the present disclosure. FIG. 8 is a block diagram showing an example of a configuration of an information processing device according to the present disclosure. FIG. 9 is a cross-sectional view showing an example of a configuration of an information processing device according to the present disclosure.

[0010] Hereinafter, embodiments of an information processing device, an information processing method, and a recording medium will be described with reference to the drawings. [1: First Embodiment]

[0011] A first embodiment of an information processing device, an information processing method, and a recording medium will be described. Hereinafter, the first embodiment of the information processing device, the information processing method, and the recording medium will be described using an information processing device 1 according to the present disclosure. [1-1: Configuration of Information Processing Device 1]

[0012] Fig. 1 is a block diagram showing the configuration of an information processing device 1 according to the present disclosure. As shown in Fig. 1, the information processing device 1 includes a distance acquisition unit 11 and a switching unit 12. The distance acquisition unit 11 acquires a measurement result of the distance to an object. The switching unit 12 switches the method of changing the orientation of the imaging means that captures the object, depending on the measurement result. [1-2: Technical Effects of the Information Processing Device 1]

[0013] The information processing device 1 according to the present disclosure switches the method for changing the orientation of the image capturing device depending on the measurement result, and therefore can quickly orient the image capturing device in an appropriate direction. [2: Second embodiment]

[0014] A second embodiment of an information processing device, an information processing method, and a recording medium will be described below. The second embodiment of the information processing device, the information processing method, and the recording medium will be described below using an information processing device 2 according to the present disclosure. The information processing device 2 may be used for user authentication performed by an entrance / exit gate, an automated teller machine, etc. [2-1: Appearance of the information processing device 2]

[0015] FIG. 2 is a cross-sectional view showing an example of the configuration of the information processing device 2. FIG. 2( a) is an example of a front view of the information processing device 2, and FIG. 2( b) is an example of a side view of the information processing device 2. As shown in FIG. 2( a), the information processing device 2 includes a face camera FC, an iris camera IC, and a distance measurement sensor DS. The information processing device 2 may also include an interface I. The side on which the face camera FC, the iris camera IC, and the distance measurement sensor DS are provided may also be referred to as the front of the information processing device 2. Hereinafter, the forward direction from the front of the information processing device 2 may be referred to as the Z-axis direction. The up-down direction in the drawing may also be referred to as the Y-axis direction. The direction perpendicular to the Z-axis direction and the Y-axis direction may also be referred to as the X-axis direction.

[0016] The face camera FC is a specific example of a "face photographing means" described in the appendix below. The face camera FC photographs a face image including the face of the person O. The face camera FC may be a wide-angle camera. The face camera FC photographs a wide-angle image including at least both eyes of the person O.

[0017] The iris camera IC is a specific example of the "iris photographing means" described in the appendix below. The iris camera IC photographs an eye image including the area around the eye of person O. The iris camera IC may be a telephoto camera. The iris camera IC may be an infrared camera.

[0018] The ranging sensor DS measures the distance to the person O. The ranging sensor DS may be configured so that its detection range is limited to a specific range in the Z-axis direction. The ranging sensor DS is a specific example of the "distance measuring means" described in the appendix below. For example, as shown in FIG. 2B, the ranging sensor DS may include a sensor S and a convex lens L. The sensor S may measure distance using a pyroelectric sensor. The sensor S is capable of detecting the person O in all directions. The convex lens L may be provided on the detection surface of the sensor S. The convex lens L may limit the area in which the sensor S can detect the person O. The sensor S detects the person O within a limited predetermined range by providing the convex lens L. The half-dotted line in FIG. 2B illustrates the limited predetermined range. In other words, the convex lens L allows the ranging sensor DS to measure the distance to the person O within a specified range and output the measurement result. The ranging sensor DS may measure the distance to the person O within a specified angle from the Z-axis direction and output the measurement result. The distance measurement sensor DS may detect an object within a limited range in the Z-axis direction. For example, the distance measurement sensor DS may detect an object within a range of ±20° of an axis parallel to the Z-axis direction.

[0019] Alternatively, the distance measurement sensor DS may measure distance using an ultrasonic sensor. The detection range of the distance measurement sensor DS may be limited by the directionality of the ultrasonic sensor.

[0020] A camera equipped with a telephoto lens has a relatively narrow range in terms of the angle of view, focus, etc. Therefore, in order for the iris camera IC to capture an iris image that can be used for iris authentication, it is necessary to change the orientation of the iris camera IC to match the eye height of person O. Therefore, as shown in FIG. 2(b), the iris camera IC is mounted on a tilt mechanism T. The tilt mechanism T may be cylindrical. The tilt mechanism T is equipped with a motor and is configured to change the orientation of the iris camera IC by rotating in the direction of arrow t in FIG. 2(b). The iris camera IC is configured so that the imaging range in the Y-axis direction can be changed by rotating the tilt mechanism T.

[0021] The face camera FC may also be provided so that its orientation can be changed. The face camera FC may also be mounted on a mechanism such as a tilt mechanism T, similar to the iris camera IC.

[0022] The interface I may display an image captured by at least one of the face camera FC and the iris camera IC. The information processing device 2 performs at least one of face authentication using a face image captured by the face camera FC and iris authentication using an iris image captured by the iris camera IC. The interface I may display information guiding the position, posture, etc. of the person O so that an appropriate face image or an appropriate iris image can be captured. The interface I may also display the authentication result by the information processing device 2. [2-2: Configuration of the information processing device 2]

[0023] 3 is a block diagram showing the configuration of the information processing device 2. As shown in FIG. 3, the information processing device 2 includes a calculation device 21 and a storage device 22. The information processing device 2 may further include a communication device 23, an input device 24, and an output device 25. However, the information processing device 2 does not necessarily have to include at least one of the communication device 23, the input device 24, and the output device 25. The calculation device 21, the storage device 22, the communication device 23, the input device 24, and the output device 25 may be connected via a data bus 26.

[0024] The arithmetic device 21 includes, for example, at least one of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and an FPGA (Field Programmable Gate Array). The arithmetic device 21 reads a computer program. For example, the arithmetic device 21 may read a computer program stored in the storage device 22. For example, the arithmetic device 21 may read a computer program stored in a computer-readable, non-transitory recording medium using a recording medium reading device (e.g., an input device 24 described later) not shown in the drawings that is included in the information processing device 2. The arithmetic device 21 may acquire (i.e., download or read) the computer program from a device (not shown) located outside the information processing device 2 via the communication device 23 (or another communication device). The arithmetic device 21 executes the read computer program. As a result, logical functional blocks for executing the operations to be performed by the information processing device 2 are realized within the arithmetic device 21. In other words, the arithmetic device 21 can function as a controller for realizing logical functional blocks for executing the operations (in other words, processing) to be performed by the information processing device 2.

[0025] 3 shows an example of logical functional blocks implemented within the computing device 21 to execute information processing operations. As shown in FIG. 3 , the computing device 21 includes a distance acquisition unit 211, which is a specific example of a "distance acquisition means" described in the appendix below, a determination unit 212, a face camera control unit 213, an iris camera control unit 214, a tilt mechanism control unit 215, which is a specific example of a "changing means" described in the appendix below, and an authentication unit 216. The determination unit 212 may include a distance determination unit 2121, a switching unit 2122, which is a specific example of a "switching means" described in the appendix below, an eye position detection unit 2123, and a tilt amount calculation unit 2124. The authentication unit 216 may include a face authentication unit 2161 and an iris authentication unit 2162. The operations of the distance acquisition unit 211, the determination unit 212, the face camera control unit 213, the iris camera control unit 214, and the tilt mechanism control unit 215 will be described in detail later with reference to FIGS.

[0026] The storage device 22 can store desired data. For example, the storage device 22 may temporarily store a computer program executed by the arithmetic device 21. The storage device 22 may temporarily store data that the arithmetic device 21 temporarily uses when the arithmetic device 21 is executing a computer program. The storage device 22 may store data that the information processing device 2 stores long-term. The storage device 22 may include at least one of a RAM (Random Access Memory), a ROM (Read Only Memory), a hard disk device, a magneto-optical disk device, an SSD (Solid State Drive), and a disk array device. In other words, the storage device 22 may include a non-temporary recording medium.

[0027] The communication device 23 is capable of communicating with devices external to the information processing device 2 via a communication network (not shown). The communication device 23 may be a communication interface based on standards such as Ethernet (registered trademark), Wi-Fi (registered trademark), Bluetooth (registered trademark), or USB (Universal Serial Bus).

[0028] The input device 24 is a device that accepts information input to the information processing device 2 from outside the information processing device 2. For example, the input device 24 may include an operation device (e.g., at least one of a keyboard, a mouse, and a touch panel) that can be operated by an operator of the information processing device 2. For example, the input device 24 may include a reading device that can read information recorded as data on a recording medium that can be externally attached to the information processing device 2.

[0029] The output device 25 is a device that outputs information to the outside of the information processing device 2. For example, the output device 25 may output information as an image. That is, the output device 25 may include a display device (a so-called display) that can display an image showing the information to be output. For example, the output device 25 may output information as sound. That is, the output device 25 may include an audio device (a so-called speaker) that can output sound. For example, the output device 25 may output information on paper. That is, the output device 25 may include a printing device (a so-called printer) that can print desired information on paper. [2-3: Information Processing Operation Performed by the Information Processing Device 2]

[0030] An example of the information processing operation performed by the information processing device 2 will be described with reference to Fig. 4 to Fig. 6. Fig. 4 and Fig. 6 are flowcharts showing an example of the flow of the information processing operation performed by the information processing device 2.

[0031] 4, the distance acquisition unit 211 acquires the measurement result of the distance to the person O. The distance acquisition unit 211 acquires the distance to the person O located within a predetermined range measured by the distance measurement sensor DS (step S20).

[0032] The determination unit 212 determines whether or not the photographing condition is satisfied (step S21). If the photographing condition is satisfied, it may be that the period during which the distance to the person O is within a first distance L1 exceeds a predetermined period. The first distance L1 may be, for example, a distance at which it can be estimated that the person O is likely to use the information processing device 2. Furthermore, the predetermined period may be, for example, a period during which it can be estimated that the person O is likely to use the information processing device 2. The determination unit 212 may determine that the person O wishes to use the information processing device 2 when the period during which the distance to the person O is within the first distance L1 exceeds the predetermined period.

[0033] If the photographing conditions are met (step S21: Yes), the face camera control unit 213 turns on the power of the face camera FC, making the face camera FC ready to take photographs at any time (step S22). The face camera control unit 213 may start photographing using the face camera FC. On the other hand, if the photographing conditions are not met (step S21: No), the process returns to step S20. In other words, the face camera control unit 213 does not turn on the power of the face camera FC until the photographing conditions are met.

[0034] The distance determination unit 2121 determines whether the distance to the person O is less than a second distance L2 (step S23). The second distance L2 may be, for example, a distance to the person O that is suitable for the iris camera IC to capture an image of the iris. In this case, if the distance to the person O is less than the second distance L2, the iris camera IC may immediately capture an image of the iris of the person O. On the other hand, if the distance to the person O is equal to or greater than the second distance L2, the iris camera IC may wait without capturing an image of the iris of the person O until the distance to the person O becomes less than the second distance L2.

[0035] 5A illustrates an example of a first person O1 when the shooting conditions are satisfied. The person O1 is moving as indicated by the arrow A1. That is, the person O1 is approaching the information processing device 2 from approximately in front of the information processing device 2. In other words, the person O1 is approaching the information processing device 2 from approximately the Z-axis direction. In such a case, the distance to the person O1 when the shooting conditions are satisfied is often equal to or greater than the second distance L2.

[0036] 5B illustrates an example of a second person O2 when the shooting conditions are satisfied. The person O2 is moving as indicated by the arrow A2. That is, the person O2 is approaching the information processing device 2 from the side of the information processing device 2. In other words, the person O2 is approaching the information processing device 2 from a direction different from the Z-axis direction. In such a case, the distance to the person O2 when the shooting conditions are satisfied is often less than the second distance L2.

[0037] If the distance to person O is equal to or greater than second distance L2 (step S23: No), switching unit 2122 switches the method of changing the orientation of the iris camera IC to a first change method that changes the orientation of the iris camera IC depending on the height of the eyes included in the facial image and the distance to person O. The method of changing the orientation of the iris camera IC is switched to the first change method, and information processing device 2 performs authentication (step S24). Details of step S24 will be described with reference to FIG. 6(a).

[0038] If the distance to the person O is less than the second distance L2 (step S23: Yes), the switching unit 2122 switches the method of changing the orientation of the iris camera IC to a second change method that changes the orientation of the iris camera IC according to the height of the eyes included in the face image. The method of changing the orientation of the iris camera IC is switched to the second change method, and the information processing device 2 performs authentication (step S25). Details of step S25 will be described with reference to FIG. 6(b). [When switching to the first change method]

[0039] The case where the first change method is used may be, for example, when the photographing conditions are satisfied and the person O is relatively far from the information processing device 2, as shown in Fig. 5A. The first change method may be used when the person O approaches from approximately the Z-axis direction. In other words, the first change method may be used when it is determined that the person O is approaching from approximately the front.

[0040] As shown in FIG. 6A , the face camera control unit 213 controls the face camera FC to capture a target face and acquire a face image (step S241). The eye position detection unit 2123 identifies the position of the person O's eyes in the face image (step S242). The eye position detection unit 2123 identifies at least the height of the person O's eyes in the face image. The eye position detection unit 2123 may identify the position of the person O's eyes based on feature points extracted from the face image. The feature points extracted from the face image may be information used for face authentication. At this time, the face authentication unit 2161 may perform face authentication using the face image. The face authentication unit 2161 may perform face authentication using the feature points extracted from the face image. Specifically, the face authentication unit 2161 may perform face authentication by extracting a face region from the face image, extracting feature amounts from the extracted face region, and matching the feature amounts with feature amounts registered in a feature database.

[0041] If the identification of the eye positions of person O in the face image generated in step S241 fails, the face camera control unit 213 may control the face camera FC again to acquire a face image. Also, if the face authentication of person O using the face image generated in step S241 fails, the face camera control unit 213 may control the face camera FC again to generate a face image.

[0042] Alternatively, the determination unit 212 may determine, from the state of the person O appearing in the facial image, whether or not the person O wants to use the information processing device 2. For example, the determination unit 212 may determine, from the direction of the gaze of the person O appearing in the facial image, whether or not the person O wants to use the information processing device 2. If the determination unit 212 determines that the person O does not want to use the information processing device 2, the process may return to step S20 in FIG. 4.

[0043] The tilt amount calculation unit 2124 calculates the tilt amount based on the distance to person O and the height of person O's eyes in the face image (step S243). The tilt amount calculation unit 2124 predicts the direction in which the iris camera IC should be pointed so as to be suitable for capturing an image of person O's eyes when person O reaches a location suitable for capturing an iris image. In other words, since person O has not yet reached a location suitable for capturing an iris image, the tilt amount calculation unit 2124 estimates the future eye position when person O reaches a location suitable for capturing an iris image from the current distance and current eye position, and calculates the tilt amount so as to be suitable for capturing an image of the future eye position.

[0044] Note that the tilt amount calculation unit 2124 may calculate the tilt amount using a distance calculated from a face image captured by the face camera FC in addition to or instead of the measurement result output by the distance measurement sensor DS as the distance to the person O. For example, the distance acquisition unit 211 may detect the positions of both eyes of the person O in the face image and calculate the distance to the person O based on the distance between the eyes in the face image.

[0045] The tilt amount calculation unit 2124 calculates the tilt amount indicating the angle by which the tilt mechanism T equipped with the iris camera IC should be rotated. The tilt amount calculation unit 2124 sends the tilt amount to the tilt mechanism control unit 215.

[0046] The tilt mechanism control unit 215 controls the motor mounted on the tilt mechanism T according to the tilt amount (step S244). The tilt mechanism control unit 215 rotates the tilt mechanism T at least in the tilt direction (the direction of the arrow t in FIG. 2). The tilt mechanism control unit 215 changes the orientation of the iris camera IC so that the iris camera IC can appropriately photograph the iris of person O.

[0047] When person O arrives at a location suitable for capturing an iris image, iris camera control unit 214 controls the iris camera IC to capture an image of person O's eyes and acquire an iris image. iris authentication unit 2162 performs iris authentication using the iris image. Specifically, iris authentication unit 2162 may perform iris authentication by extracting an iris region from the iris image, extracting feature amounts from the extracted iris region, and matching the feature amounts with feature amounts registered in a feature database.

[0048] Also, at this timing, the face authentication unit 2161 may perform face authentication using a face image. That is, in this flow, the timing of performing face authentication may be arbitrary. Iris authentication may be performed after the timing of performing face authentication. Iris authentication may be an operation that is performed when face authentication is successful. A case where face authentication is successful may be a case where the matching score by the face authentication unit 2161 is equal to or greater than a predetermined value. Also, a case where iris authentication is successful may be a case where the matching score by the iris authentication unit 2162 is equal to or greater than a predetermined value.

[0049] The authentication unit 216 determines whether to complete authentication of person O based on the results of face authentication and iris authentication (step S245). The authentication unit 216 may determine whether authentication of person O has been successful based on the results of face authentication and iris authentication. That is, the information processing device 2 may perform multimodal authentication including face authentication and iris authentication.

[0050] The authentication unit 216 may determine that authentication of person O is successful if both face authentication and iris authentication are successful. In this case, authentication can be performed with higher accuracy compared to when only face authentication or iris authentication is performed. The authentication unit 216 may determine that authentication of person O is successful if only one of face authentication and iris authentication is successful. For example, person O may be in a state that is not suitable for face authentication but is suitable for iris authentication. Conversely, person O may be in a state that is not suitable for iris authentication but is suitable for face authentication. In such cases, authentication can be performed reliably. The determination method by the authentication unit 216 may be set according to the scene, needs, etc. in which the information processing device 2 is used.

[0051] If the authentication of person O is not to be completed (step S245: No), the process may return to step S241. The authentication unit 216 may determine the operation to be performed when the authentication of person O is not to be completed based on the results of face authentication and iris authentication. If the authentication unit 216 determines that the authentication operation may be completed (step S245: Yes), the operation of step S24 ends. [When switching to the second change method]

[0052] The case where the second change method is used may be, for example, when the photographing condition is satisfied when the person O is relatively close to the information processing device 2, as shown in Fig. 5(b). Since the distance measurement sensor DS limits the detection range to a predetermined range, for example, when the person O approaches from a direction significantly deviated from the Z-axis direction, for example, approximately from the X-axis direction, the photographing condition is satisfied when the person O is relatively close. The second change method may be used when it is determined that the person O is approaching from a direction other than the front, such as from the side.

[0053] 6B, the face camera control unit 213 controls the face camera FC to capture a face image of the target and acquire a face image (step S241). The eye position detection unit 2123 identifies the positions of the eyes of person O in the face image (step S242).

[0054] The tilt amount calculation unit 2124 calculates the tilt amount based on the eye height of the person O in the face image (step S253). Because the person O has reached a location suitable for capturing an iris image, the tilt amount calculation unit 2124 may calculate the tilt amount so as to capture an image at the current eye height.

[0055] The tilt mechanism control unit 215 controls the motor mounted on the tilt mechanism T according to the tilt amount (step S254). Once the orientation of the iris camera IC has been changed and the iris camera IC is in a state where it can properly photograph the eyes, the iris camera control unit 214 controls the iris camera IC to photograph the eyes of person O and acquire an iris image. The iris authentication unit 2162 performs iris authentication using the iris image. Furthermore, the face authentication unit 2161 performs face authentication using a face image at any timing.

[0056] The authentication unit 216 determines whether to complete authentication of person O based on the results of face authentication and iris authentication (step S255). If the authentication unit 216 determines that the authentication operation may be completed (step S255: Yes), the operation of step S25 ends.

[0057] After the authentication unit 216 determines that the authentication of the target O has been successful, for example, if the information processing device 2 is used at an entrance / exit gate, the information processing device 2 may control the gate to open and allow the target O to enter or exit. Alternatively, if the information processing device 2 is used at an automated teller machine, the information processing device 2 may allow the target O to deposit or withdraw money. [2-4: Technical Effects of the Information Processing Device 2]

[0058] As described above, a camera equipped with a telephoto lens has a relatively narrow range in terms of the angle of view, focus, etc., and therefore it is necessary to tilt the iris camera IC to match the eye height of person O. The tilting operation of the iris camera IC often takes several hundred milliseconds to about one second. In order not to keep person O using the information processing device 2 waiting, it is preferable to complete the tilting operation of the iris camera IC before person O starts using the information processing device 2.

[0059] The information processing device 2 switches the method for changing the orientation of the iris camera IC depending on the distance to the person O, and completes the tilt operation of the iris camera IC before the person O starts using the information processing device 2. The information processing device 2 switches the method for changing the orientation of the iris camera IC depending on whether the distance to the person O when the shooting conditions are met is less than the second distance L2, so that the tilt operation of the iris camera IC can be completed before the person O starts using the information processing device 2. When the distance to the person O is less than the second distance L2, the information processing device 2 adopts the second change method, which is simpler than the first change method adopted when the distance to the person O is equal to or greater than the second distance L2, so that the tilt operation of the iris camera IC can be completed before the person O starts using the information processing device 2. That is, the information processing device 2 determines whether the person O approached from the front or the side depending on the output of the ranging sensor DS, and changes the tilt operation of the camera depending on the approach method. The information processing device 2 changes the tilt operation depending on the output of the ranging sensor DS, so that the iris camera IC can be quickly tilted to an appropriate position.

[0060] Furthermore, when a person O who is likely to use the information processing device 2 appears, the information processing device 2 performs an image capture using the face camera FC and a tilt operation of the iris camera IC, thereby avoiding unnecessary operation of the face camera FC and the iris camera IC for people who will not use the information processing device 2 and reducing unnecessary energy consumption. For example, when entrance / exit equipment is installed at an aisle door or when an automated teller machine is installed in the aisle of a convenience store, many people pass by the equipment without using it. Operation of the face camera FC and the iris camera IC for such many people who will not use the equipment is unnecessary.

[0061] When using the information processing device 2, the person O often faces the front of the information processing device 2. Therefore, the information processing device 2 measures the distance to the person O who is within a predetermined range in front of the information processing device 2, and avoids unnecessary operations related to the face camera FC and iris camera IC for people who are not using the information processing device 2. Furthermore, in order to exclude people who pass in front of the information processing device 2 from people O who are likely to use the information processing device 2, the information processing device 2 determines that the person O is likely to use the information processing device 2 when the period during which the distance to the person O is within a first distance L1 exceeds a predetermined period, and performs operations related to the face camera FC and iris camera IC. The information processing device 2 is particularly suitable for use in devices where people who are not using the device often approach. [3: Third Embodiment]

[0062] A third embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the third embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 3 according to the present disclosure. [3-1: Appearance of the information processing device 3]

[0063] 7 is a front view of the information processing device 3, showing an example of the configuration of the information processing device 3. As shown in Fig. 7, the information processing device 3 includes a face camera FC, an iris camera IC, and a distance measurement sensor DS, as well as a second distance measurement sensor DS2. The second distance measurement sensor DS2 may be provided on a side surface of the information processing device 3.

[0064] The second distance measuring sensor DS2 measures the distance to the person O. The second distance measuring sensor DS2 may be configured so that the detection range is not limited. The second distance measuring sensor DS2 may measure the distance to the person O in all directions. [3-2: Configuration of the information processing device 3]

[0065] An example of the configuration of the information processing device 3 will be described with reference to Fig. 8. Fig. 8 is a block diagram showing an example of the configuration of the information processing device 3.

[0066] As shown in FIG. 8, the information processing device 3 includes a calculation device 21 and a storage device 22, similar to the information processing device 2. Furthermore, the information processing device 3 may include a communication device 23, an input device 24, and an output device 25, similar to the information processing device 2. However, the information processing device 3 does not need to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 3 differs from the information processing device 2 in that the determination unit 312 includes a speed calculation unit 3125. Other features of the information processing device 3 may be the same as other features of the information processing device 2. Therefore, hereinafter, differences from the embodiments already described will be described in detail, and descriptions of other overlapping parts will be omitted as appropriate. [3-3: Information Processing Operation Performed by Information Processing Device 3]

[0067] An example of the information processing operation performed by the information processing device 3 will be described with reference to Fig. 9. Fig. 9 is a flowchart showing an example of the flow of the information processing operation performed by the information processing device 3.

[0068] 9, the distance acquisition unit 311 acquires the measurement result of the distance to the person O measured by the second distance measurement sensor DS2 (step S30). The speed calculation unit 3125 calculates the movement speed of the person O based on the measurement result of the second distance measurement sensor DS2 (step S31).

[0069] The determination unit 312 determines whether or not the photographing conditions are satisfied based on the movement speed of the person O (step S32). In the third embodiment, the photographing conditions are satisfied when the movement speed of the person O is tending to slow down. When the movement speed of the person O is tending to slow down, the determination unit 312 may estimate that the person O is about to stop. When the movement speed of the person O is tending to slow down, the determination unit 312 may determine that the person O wants to use the information processing device 3.

[0070] If the photographing conditions are met (step S32: Yes), the face camera control unit 313 turns on the power of the face camera FC, making the face camera FC ready to photograph at any time (step S22). The face camera control unit 313 photographs the face of the person O according to the calculation result of the speed calculation unit 3125. The distance determination unit 2121 determines whether the distance to the person O is less than the second distance L2 (step S23). If the distance to the person O is equal to or greater than the second distance L2 (step S23: No), the method of changing the orientation of the iris camera IC is switched to the first change method, and the information processing device 3 performs authentication (step S24). If the distance to the person O is less than the second distance L2 (step S23: Yes), the method of changing the orientation of the iris camera IC is switched to the second change method, and the information processing device 3 performs authentication (step S25). [3-4: Technical Effects of the Information Processing Device 3]

[0071] The information processing device 3 can accurately determine whether or not the person O is likely to use the information processing device 3. [4: Fourth Embodiment]

[0072] Fourth Embodiment of Information Processing Apparatus, Information Processing Method, and Recording Medium Will Be Described Hereinafter, a fourth embodiment of an information processing apparatus, an information processing method, and a recording medium will be described using an information processing apparatus 4 according to the present disclosure.

[0073] The fourth embodiment differs from the second and third embodiments in the switching operation by the switching unit 4122. In the fourth embodiment, a case where the third change method is adopted will be described. [4-1: Information Processing Operation Performed by the Information Processing Device 4]

[0074] An example of the information processing operation performed by the information processing device 4 will be described with reference to Fig. 11. Fig. 11 is a flowchart showing an example of the flow of the information processing operation performed by the information processing device 4.

[0075] 11 , the distance acquisition unit 211 acquires the measurement result of the distance to the person O (step S20). The determination unit 412 determines whether the photographing conditions are met (step S21). If the photographing conditions are met (step S21: Yes), the face camera control unit 213 turns on the power of the face camera FC, making the face camera FC ready to photograph at any time (step S22).

[0076] The determination unit 412 determines whether the distance to the person O is less than the third distance L3 (step S40). The third distance L3 may be, for example, a distance to the person O that is suitable for the iris camera IC to capture an iris image. The third distance L3 may be shorter than the second distance L2. The third distance L3 may be the same as the second distance L2 or longer than the second distance L2.

[0077] If the distance to the person O is equal to or greater than the third distance L3 (step S40: No), the method of changing the orientation of the iris camera IC is switched to the first change method, and the information processing device 4 performs authentication (step S24).

[0078] If the distance to person O is less than the third distance L3 (step S40: Yes), the switching unit 4122 switches the method of changing the orientation of the iris camera IC that captures the image of person O to the third change method. The method of changing the orientation of the iris camera IC is switched to the third change method, and the information processing device 4 performs authentication (step S41). The third change method is a method of changing the orientation of the iris camera IC that performs a predetermined tilt operation regardless of the height of the eyes of person O. In other words, if the distance to person O is less than the third distance L3, the eye position detection operation by the eye position detection unit 2123 and the tilt amount calculation operation by the tilt amount calculation unit 2124 are skipped.

[0079] The determination unit 412 may calculate in advance the amount of tilt when the distance to the person O is less than the third distance L3, based on the height of each person O using the information processing device 4 and assuming a typical eye height of the person O. For example, the determination unit 412 may calculate in advance the amount of tilt when the distance to the person O is less than the third distance L3, based on the height of each person O using the information processing device 4. Furthermore, the determination unit 412 may calculate in advance the amount of tilt when the distance to the person O is less than the third distance L3, based on the height with the greatest distribution of each person O using the information processing device 4. Furthermore, the determination unit 412 may calculate in advance the amount of tilt when the distance to the person O is less than the third distance L3, based on the average height of each person O using the information processing device 4. [4-2: Modification]

[0080] When the third distance L3 is shorter than the second distance L2, in the operation of determining the distance to the person O in step S40, if the distance to the person O is equal to or greater than the third distance L3 and less than the second distance L2, the switching unit 4122 may switch to the second change method. [4-3: Technical Effects of the Information Processing Device 4]

[0081] The information processing device 4 can achieve high-speed tilting and energy saving. [5: Fifth Embodiment]

[0082] A fifth embodiment of an information processing device, an information processing method, and a recording medium will be described below. Hereinafter, the fifth embodiment of an information processing device, an information processing method, and a recording medium will be described using an information processing device 5 according to the present disclosure. [5-1: Configuration of Information Processing Device 5]

[0083] An example of the configuration of the information processing device 5 will be described with reference to Fig. 12 and Fig. 13. Fig. 12 is a block diagram showing an example of the configuration of the information processing device 5.

[0084] As shown in FIG. 12 , the information processing device 5 includes a calculation device 21 and a storage device 22, similar to the information processing devices 2 to 4. Furthermore, the information processing device 5 may include a communication device 23, an input device 24, and an output device 25, similar to the information processing devices 2 to 4. However, the information processing device 5 does not have to include at least one of the communication device 23, the input device 24, and the output device 25. The information processing device 5 differs from the information processing devices 2 to 4 in that it includes a sensor group SG and the calculation device 21 further implements a sensor information acquisition unit 517. Other features of the information processing device 5 may be the same as at least one other feature of the information processing devices 2 to 4. Therefore, the following will describe in detail the differences from the already-described embodiments, and will omit descriptions of other overlapping features as appropriate.

[0085] FIG. 13 is a cross-sectional view showing an example of the configuration of the sensor group SG. As shown in FIG. 13 , the sensor group SG includes multiple sensors S. Each of the multiple sensors S is provided at a different height. Each of the multiple sensors S may be a directional motion sensor. That is, each of the multiple sensors S can detect a person O of a different height. FIG. 13 illustrates a case where the sensor group SG includes five sensors S. In this case, the sensor group SG can detect which of six height ranges a person belongs to. For example, if a person corresponding to the shortest height range among the six height ranges appears, none of the sensors S detects the person. If a person corresponding to the second shortest height range appears, only sensor S5 detects the person. If a person corresponding to the third shortest height range appears, sensors S5 and S4 detect the person. If a person corresponding to the fourth shortest height range appears, sensors S5, S4, and S3 detect the person. FIG. 13 illustrates a case where a person corresponding to the fourth shortest height range appears. Furthermore, when a person corresponding to the second tallest height range appears, the sensors S5, S4, S3, and S2 detect the person. Furthermore, when a person corresponding to the first tallest height range appears, all of the sensors S, namely, the sensors S5, S4, S3, S2, and S1, detect the person. [5-2: Information Processing Operation Performed by Information Processing Device 5]

[0086] The sensor information acquisition unit 517 acquires the detection results of the sensor group SG. That is, it acquires each of the detection results of the multiple sensors S. The height determination unit 5126 determines the height of the person O based on the detection results of the sensor group SG. The tilt amount calculation unit 5124 calculates the tilt amount according to the determined height. The tilt mechanism control unit 515 uses the tilt amount to change the orientation of the iris camera IC.

[0087] The tilt amount calculation operation described in the fifth embodiment may be performed in addition to or instead of the tilt amount calculation operation described in the second to fourth embodiments. For example, if eye position detection fails, the tilt amount calculation unit 5124 may calculate the tilt amount based on the detection results of the sensor group SG. The height determination unit 5126 may determine the height of the person O based on the detection results obtained when capturing a face image, for example. Alternatively, the switching unit 5122 may switch the method of changing the orientation of the iris camera IC depending on the distance to the person O when the capturing conditions are met so as to perform the tilt amount calculation operation described in the fifth embodiment. That is, in the fifth embodiment, if the distance to the person O when the capturing conditions are met is less than a predetermined distance, the eye height determination operation based on the face image may be skipped. This may achieve faster tilt operation and energy saving. [5-3: Technical Effects of the Information Processing Device 5]

[0088] The information processing device 5 can achieve high-speed tilting and energy saving. [6: Supplementary Note]

[0089] The following supplementary notes are further disclosed with respect to the above-described embodiments. [Supplementary Note 1] An information processing device comprising: a distance acquisition means for acquiring a measurement result of the distance to an object; and a switching means for switching a method of changing the orientation of an image capture means for capturing an image of the object in accordance with the measurement result. [Supplementary Note 2] The information processing device according to Supplementary Note 1, comprising: a distance measurement means for measuring the distance to the object within a predetermined range and outputting the measurement result; an image capture means for capturing an image of the object in accordance with the measurement result; and a changing means for changing the orientation of the image capture means. [Supplementary Note 3] The information processing device according to Supplementary Note 2, wherein the image capture means includes a face image capture means and an iris image capture means, wherein the face image capture means captures the face of the object to generate a face image when an image capture condition is satisfied, and the switching means switches a method of changing the orientation of the iris image capture means in accordance with the measurement result when the image capture condition is satisfied, and wherein the image capture condition is satisfied when the period during which the distance to the object is within a first distance exceeds a predetermined period. [Supplementary Note 4] The information processing device according to Supplementary Note 3, wherein the switching means switches the change method depending on whether the distance to the target is less than a second distance when the shooting conditions are met. [Supplementary Note 5] The information processing device according to Supplementary Note 4, wherein the switching means switches to a change method of changing the orientation depending on the height of eyes included in the facial image when the distance to the target is less than the second distance, and the switching means switches to a change method of changing the orientation depending on the height of eyes included in the facial image and the distance to the target when the distance to the target is equal to or greater than the second distance. [Supplementary Note 6] The information processing device according to Supplementary Note 3, wherein the information processing device includes calculation means for calculating a moving speed of the target based on the measurement result, and the face photographing means photographs the face of the target depending on the calculation result of the calculation means. [Supplementary Note 7] The information processing device according to Supplementary Note 2, wherein the change means changes the orientation to a predetermined orientation when the distance to the target is within a third distance when the shooting conditions are met.[Supplementary Note 8] An information processing device according to Supplementary Note 2, having a plurality of detection means that each detects objects at different heights, the information processing device including detection result acquisition means that acquires detection results from the detection means, and the change means that changes the orientation in accordance with the detection results. [Supplementary Note 9] An information processing method that acquires measurement results of a distance to an object, and switches a method of changing the orientation of an image capture means that captures an image of the object in accordance with the measurement results. [Supplementary Note 10] A recording medium having recorded thereon a computer program for causing a computer to execute an information processing method that acquires measurement results of a distance to an object, and switches a method of changing the orientation of an image capture means that captures an image of the object in accordance with the measurement results.

[0090] This disclosure may be modified as appropriate within the scope of the claims and the technical idea that can be read from the entire specification. Information processing devices, information processing methods, and recording media that involve such modifications are also included in the technical idea of ​​this disclosure.

[0091] O Person FC Face camera IC Iris camera DS Distance measurement sensor S Sensor L Convex lens T Tilt mechanism DS2 Second distance measurement sensor SG Sensor group 1, 2, 3, 4, 5 Information processing device 11, 211, 311 Distance acquisition unit 12, 2122, 4122, 5122 Switching unit 212, 312, 412, 512 Determination unit 2121 Distance determination unit 2123 Eye position detection unit 2124, 5124 Tilt amount calculation unit 213, 313 Face camera control unit 214 Iris camera control unit 215, 515 Tilt mechanism control unit 216 Authentication unit 2161 Face authentication unit 2162 Iris authentication unit 3125 Speed ​​calculation unit 5126 Height determination unit 517 Sensor information acquisition unit

Claims

1. distance acquisition means for acquiring a measurement result of the distance to the object; a switching means for switching a method for changing the orientation of the photographing means for photographing the object according to the measurement result; An information processing device comprising:

2. a distance measuring means for measuring the distance to the object within a predetermined range and outputting the measurement result; an imaging means for imaging the object in accordance with the measurement result; a change means for changing the orientation of the photographing means; The information processing device according to claim 1 , comprising:

3. The photographing means includes a face photographing means and an iris photographing means, the face photographing means photographs the face of the subject and generates a face image when a photographing condition is satisfied; the switching means switches a method of changing the orientation of the iris photographing means in accordance with the measurement result when the photographing condition is satisfied, The photographing condition is satisfied when the period during which the distance to the object is within a first distance exceeds a predetermined period. The information processing device according to claim 2 .

4. The switching means switches the change method depending on whether the distance to the object is less than a second distance when the photographing condition is satisfied. The information processing device according to claim 3 .

5. the switching means switches to a change method in which the orientation is changed in accordance with a height of eyes included in the face image when the distance to the target is less than a second distance; When the distance to the target is equal to or greater than a second distance, the switching means switches to a change method in which the direction is changed depending on the height of the eyes included in the face image and the distance to the target. The information processing device according to claim 4 .

6. the information processing device includes a calculation means for calculating a moving speed of the object based on the measurement result, The face photographing means photographs the face of the subject in accordance with the calculation result of the calculation means. The information processing device according to claim 3 .

7. The change means changes the orientation to a predetermined orientation when the photographing condition is satisfied and the distance to the object is within a third distance. The information processing device according to claim 3 .

8. a plurality of detection means each detecting an object at a different height; the information processing device includes a detection result acquisition means for acquiring a detection result of the detection means, The change means changes the orientation in accordance with the detection result. The information processing device according to claim 2 .

9. Obtain a measurement of the distance to the target, and switching a method for changing the orientation of the imaging means for imaging the object according to the measurement result. A computer-implemented information processing method.

10. On the computer, Obtain a measurement of the distance to the target, A method for changing the orientation of the imaging means for imaging the object is switched according to the measurement result. A computer program for executing an information processing method.