Information processing device, information processing system, information processing method, and program

Abstract

This invention can provide an information processing device and the like that prompts an authentication operation in a manner that is easily understandable to a user. An information processing device (10) includes a projection image acquisition unit (110), a determination unit (120), and a control signal output unit (130). For the projection image acquisition unit (110), a computer acquires a projection image obtained by projecting a prescribed guide image on the hand of a user presented to a biometric information reading device that reads prescribed biometric information from the hand of the user. The determination unit (120) determines whether the guide image included in the projection image and the hand image correspond to a prescribed condition. The control signal output unit (130) outputs a prescribed control signal to the biometric information reading device on the basis of the determination.

Description

Information processing device, information processing system, information processing method, and non-transitory computer-readable medium storing a program

[0001] The present disclosure relates to an information processing device, an information processing system, an information processing method, and a program.

[0002] Various techniques have been disclosed for reading a user's fingerprint at immigration and other times.

[0003] For example, a technique has been disclosed in which an arched trajectory image is displayed on a screen as a guide image, encouraging a user to keep their fingertip along the arched trajectory without touching the screen (Patent Document 1).

[0004] In addition, a technology has been disclosed that calculates the difference in the relative position of a living body relative to an imaging device when the biometric image and the registered image are acquired, based on a biometric image generated by capturing an image of the living body that is the object to be authenticated and a registered image stored in a registered image storage unit (Patent Document 2).

[0005] Furthermore, a technology has been disclosed in which images of at least two or more body parts of a user are captured, the optimal posture of the user is estimated, and a first posture image representing the estimated posture is superimposed on a second posture image representing the posture of the body parts captured by a capturing unit (Patent Document 3).

[0006] Furthermore, a technology has been disclosed in which multiple marks are displayed on a touch panel to indicate the position where the user should touch with their finger, and when it is detected that the user has touched the multiple marks with their finger, a biometric sensor captures biometric information of the user's hand (Patent Document 4).

[0007] Japanese Patent Application Laid-Open No. 2020-003873 International Publication No. 2010 / 086993 Japanese Patent Application Laid-Open No. 2013-205931 Japanese Patent Application Laid-Open No. 2018-128785

[0008] However, there is a demand for a technique for more appropriately prompting the user to perform an authentication operation.

[0009] In view of the above-mentioned problems, an object of this disclosure is to provide an information processing device or the like that prompts a user to perform authentication in a manner that is easy for the user to understand.

[0010] An information processing device according to one aspect of the present disclosure includes a projection image acquisition unit, a determination unit, and a control signal output unit. The projection image acquisition unit acquires a projection image in which a predetermined guidance image is projected onto a user's hand presented to a biometric information reading device that reads predetermined biometric information from the user's hand. The determination unit determines whether the guidance image included in the projection image and the image of the hand meet predetermined conditions. The control signal output unit outputs a predetermined control signal to the biometric information reading device based on the determination.

[0011] In an information processing method according to one aspect of the present disclosure, a computer executes the following processes. The computer acquires a projection image in which a predetermined guidance image is projected onto a user's hand presented to a biometric information reading device that reads predetermined biometric information from the user's hand. The computer determines whether the guidance image included in the projection image and the image of the hand meet predetermined conditions. The computer outputs a predetermined control signal to the biometric information reading device based on the determination.

[0012] A program according to one aspect of the present disclosure causes a computer to execute the following process. The computer acquires a projection image in which a predetermined guidance image is projected onto a user's hand presented to a biometric information reading device that reads predetermined biometric information from the user's hand. The computer determines whether the guidance image included in the projection image and the image of the hand meet predetermined conditions. The computer outputs a predetermined control signal to the biometric information reading device based on the determination.

[0013] 1 is a block diagram showing the configuration of an information processing device according to a first embodiment. 2 is a flowchart showing an information processing method according to the first embodiment. 3 is a block diagram showing the configuration of an information processing system according to a second embodiment. 4 is a block diagram showing the configuration of an information processing device according to the second embodiment. 5 is a flowchart showing an information processing method according to the second embodiment. 6 is a block diagram showing the configuration of an information processing system according to a second embodiment. 7 is a block diagram showing the configuration of an authentication device. 8 is a flowchart showing an information processing method according to the second embodiment. 9 is a first diagram showing an example of use of an information processing device according to the second embodiment. 10 is a diagram showing a guidance image. 11 is a second diagram showing an example of use of an information processing device according to the second embodiment. 12 is a third diagram showing an example of use of an information processing device according to the second embodiment. 13 is a fourth diagram showing an example of use of an information processing device according to a third embodiment. 14 is a flowchart showing an information processing method according to a fourth embodiment. 15 is a flowchart showing an information processing method according to a fifth embodiment. 16 is a first diagram showing an example of use of an information processing device according to the fifth embodiment. 17 is a second diagram showing an example of use of an information processing device according to the fifth embodiment. 18 is a block diagram showing the configuration of an information processing device according to a sixth embodiment. 19 is a flowchart showing an information processing method according to the sixth embodiment. 20 is a diagram showing the configuration of an information processing device according to a seventh embodiment. 21 is a block diagram showing an example of the hardware configuration of a computer.

[0014] This disclosure will be described below through embodiments of the invention, but the invention according to the claims is not limited to the following embodiments. Furthermore, not all of the configurations described in the embodiments are necessarily essential means for solving the problems. For clarity of explanation, the following description and drawings have been omitted and simplified as appropriate. In each drawing, the same elements are designated by the same reference numerals, and repeated explanations are omitted as necessary.

[0015] First Embodiment First, a first embodiment of the present disclosure will be described. Fig. 1 is a block diagram showing the configuration of an information processing device according to the first embodiment. The information processing device 10 shown in Fig. 1 is used to acquire predetermined biometric information from a user's hand. The predetermined biometric information may be, for example, a fingerprint shape pattern, a vein shape pattern, or a combination thereof.

[0016] The information processing device 10 acquires biometric information of a user, who is a user of the information processing device 10, by, for example, cooperating with a biometric information reading device that reads biometric information of the user. The information processing device 10 is communicably connected to, for example, an imaging device that generates image data by capturing a predetermined image, and receives the image data from the imaging device. The information processing device 10 also processes the received image data to generate a predetermined control signal and supplies the generated control signal to the biometric information reading device.

[0017] The information processing device 10 may be configured, for example, by a computer, server, or dedicated device with a communication function. In the following description, the term "computer" may encompass a server device, a blade, and a cloud computing system. The information processing device 10 mainly includes a projection image acquisition unit 110, a determination unit 120, and a control signal output unit 130.

[0018] The projection image acquisition unit 110 acquires a projection image. The projection image is an image in which a predetermined guidance image is projected onto a user's hand presented to the biometric information reading device. That is, the projection image includes an image of the user's hand and a guidance image projected onto the user's hand. The guidance image at least guides the user, who is bringing his or her hand close to the biometric information reading device, as to the position of the hand. The guidance image is set to be projected onto the user's hand when the user brings his or her hand close to the biometric information reading device.

[0019] In this disclosure, the term "image" also refers to image data, which is data on the image. That is, the above-mentioned projected image also refers to "image data of the projected image." For example, the projected image acquisition unit 110 acquires image data related to the projected image.

[0020] The determination unit 120 determines whether the guidance image and the hand image included in the projected image correspond to a predetermined condition. The predetermined condition corresponds to, for example, a situation in which the biometric information of the user can be read by the biometric information reading device. Specifically, for example, when the hand is in a predetermined posture, if a guidance image indicating that biometric information can be read is projected at a predetermined position on the hand, the determination unit 120 may determine that the predetermined condition is met. Alternatively, if a guidance image indicating that biometric information can be read is not projected at a predetermined position on the hand, the determination unit 120 may determine that the predetermined condition is not met.

[0021] The control signal output unit 130 outputs a predetermined control signal to the biometric information reading device in response to the above determination. For example, when the determination unit 120 determines that the projected image meets the above-mentioned predetermined condition, the control signal output unit 130 may output a control signal to the biometric information reading device indicating that it is possible to read biometric information. Alternatively, in this case, the control signal output unit 130 may output a control signal to the biometric information reading device instructing it to read biometric information.

[0022] Furthermore, for example, when the determination unit 120 determines that the projection image does not meet the above-described predetermined conditions, the control signal output unit 130 may output a control signal to the biometric information reading device indicating that the biometric information cannot be read. Alternatively, in this case, the control signal output unit 130 may output a control signal to the biometric information reading device instructing the biometric information reading device not to read the biometric information.

[0023] Next, processing executed by the information processing device 10 will be described with reference to Fig. 2. Fig. 2 is a flowchart showing an information processing method according to the first embodiment. The flowchart shown in Fig. 2 starts, for example, when the information processing device 10 receives a projection image.

[0024] First, the projection image acquisition unit 110 acquires a projection image in which a predetermined guidance image is projected onto the user's hand presented to the biometric information reading device (step S11). After acquiring the projection image, the projection image acquisition unit 110 supplies the acquired projection image to the determination unit 120.

[0025] Next, the determination unit 120 determines whether the guidance image and the hand image included in the received projected image meet predetermined conditions (step S12). The determination unit 120 supplies information about the determination result to the control signal output unit 130.

[0026] Next, the control signal output unit 130 outputs a predetermined control signal to the biometric information reader based on the above determination (step S13). When the control signal output unit 130 outputs the control signal to the biometric information reader, the information processing device 10 ends the series of processes.

[0027] The above describes the information processing method executed by the information processing device 10. With the above-described configuration, the information processing device 10 can project a guidance image onto the user's hand that is intuitively understandable to the user, and guide the user's hand to a predetermined position. Furthermore, the information processing device 10 can instruct the biometric information reader to read biometric information when the user's hand is in the predetermined position.

[0028] The information processing device according to the first embodiment has been described above. The information processing device 10 includes a processor and a storage device (not shown). The storage device of the information processing device 10 includes a storage device including a nonvolatile memory such as a flash memory or an SSD (Solid State Drive). In this case, the storage device of the information processing device 10 stores a computer program (hereinafter simply referred to as a program) for executing the image processing method described above. The processor loads the computer program from the storage device into a buffer memory such as a DRAM (Dynamic Random Access Memory) and executes the program.

[0029] Each component of the information processing device 10 may be implemented using dedicated hardware. Furthermore, some or all of the components may be implemented using general-purpose or dedicated circuits, processors, or a combination thereof. These may be implemented using a single chip or multiple chips connected via a bus. Some or all of the components of each device may be implemented using a combination of the above-mentioned circuits and programs. Furthermore, a CPU (Central Processing Unit), GPU (Graphics Processing Unit), FPGA (Field-Programmable Gate Array), or the like may be used as the processor. The description of the components described herein may also be applied to other devices or systems described below in this disclosure.

[0030] Furthermore, when some or all of the components of the information processing device 10 are realized by multiple information processing devices, circuits, etc., the multiple information processing devices, circuits, etc. may be centrally or distributed. For example, the information processing devices, circuits, etc. may be realized as a client-server system, a cloud computing system, or the like, in which each is connected via a communication network. Furthermore, the functions of the information processing device 10 may be provided in a software as a service (SaaS) format. Furthermore, the above-described method may be stored on a computer-readable medium to cause a computer to execute the above-described method.

[0031] According to this embodiment, it is possible to provide an information processing device or the like that prompts the user to perform authentication in a manner that is easy for the user to understand.

[0032] Second Embodiment Next, an information processing system will be described with reference to Fig. 3. Fig. 3 is a diagram showing the overall configuration of an information processing system 1 according to the second embodiment. The information processing system 1 is a system that performs biometric authentication of users who use, for example, an airport or a port. The information processing system 1 mainly includes an information processing device 20 and an authentication device 400. The information processing device 20 and the authentication device 400 are connected to each other via a network N1 so as to be able to communicate with each other. Note that the network N1 may be a telephone line, a wide area network, or a local area network.

[0033] The information processing device 20 is installed, for example, at a predetermined airport L20, and acquires biometric information of a user P1, who is a passenger. After acquiring the biometric information of the user P1, the information processing device 20 supplies the acquired biometric information to the authentication device 400. Upon receiving the biometric information from the information processing device 20, the authentication device 400 authenticates the received biometric information. After performing the authentication, the authentication device 400 supplies information regarding the result of the authentication to the information processing device 20. Upon receiving information regarding the result of the authentication from the authentication device 400, the information processing device 20 executes processing such as permitting passage for the user P1 in accordance with this information.

[0034] Next, the information processing device 20 will be further described with reference to Fig. 4. Fig. 4 is a block diagram showing the configuration of the information processing device 20 according to the second embodiment. The information processing device 20 mainly includes a projection image acquisition unit 110, a determination unit 120, a control signal output unit 130, a storage unit 200, a display device 300, a camera 310, a guidance image projection device 320, and a biometric information reading device 330. These components of the information processing device 20 are communicably connected as appropriate so that the information processing device 20 can perform the functions described in this disclosure.

[0035] The projection image acquisition unit 110 according to this embodiment acquires image data relating to the projection image captured and generated by the camera 310 .

[0036] The determination unit 120 according to the present embodiment determines whether the guidance image and the hand image included in the projected image meet a predetermined condition, for example, whether a trigger image indicating the start of biometric information reading in the guidance image is projected onto the hand of the user P1.

[0037] Furthermore, the determination unit 120 according to this embodiment determines whether the projection image includes an image of a hand. If it determines that the projection image includes an image of a hand, the determination unit 120 supplies information indicating the determination result to the control signal output unit 130.

[0038] When the projected image satisfies the above-described predetermined conditions, the control signal output unit 130 according to this embodiment outputs a control signal to the biometric information reader 330 to start reading the biometric information.

[0039] Furthermore, the control signal output unit 130 outputs a control signal to the guidance image projection device 320 to instruct the device to project a guidance image under a predetermined condition. The predetermined condition is, for example, when the device receives information from the determination unit 120 indicating that the projection image includes an image of a hand before the device 320 projects the guidance image. This enables the information processing device 20 to start projecting a guidance image when the user P1 brings his / her hand close to the biometric information reading device 330.

[0040] The storage unit 200 is a storage device including a nonvolatile memory such as a flash memory. The storage unit 200 stores at least image data of the guidance image projected by the guidance image projection device 320. The storage unit 200 may also store a program for an information processing method executed by the information processing device 20.

[0041] The display device 300 is an information display device including a liquid crystal display, an organic electroluminescence display, or the like, and notifies the user P1 of the authentication result, for example. The display device 300 may also notify the user P1 of information such as presenting his or her hand.

[0042] The camera 310 is an imaging device that captures the hand of the user P1 to be presented to the biometric information reading device 330 and the guidance image to be projected onto the hand of the user P1. The camera 310 includes an objective lens, an imaging element, an image processing device, etc. The camera 310 may have zoom, tilt, and pan functions.

[0043] Guidance image projection device 320 projects a predetermined guidance image onto user P1's hand with the aim of guiding user P1's hand to a predetermined position. Guidance image projection device 320 includes a light source such as an LED (light-emitting diode) or a lamp, an image generation unit including a liquid crystal panel or a galvanic mirror that receives the light source and generates a guidance image, and a projection unit including a lens that projects the image generated by the image generation unit. Guidance image projection device 320 receives a control signal including a predetermined instruction from control signal output unit 130, for example, and projects a guidance image in accordance with the received control signal.

[0044] The biometric information reader 330 performs a biometric information reading operation in response to a control signal received from the control signal output unit 130, and reads predetermined biometric information. The biometric information reader 330 is provided in a position where it can read biometric information from a hand that meets predetermined conditions. The biometric information reader 330 includes, for example, an image sensor such as an imaging element for reading the predetermined biometric information.

[0045] The configuration of the authentication device 400 will be described with reference to Fig. 5. Fig. 5 is a block diagram of the authentication device 400. The authentication device 400 is a computer having an authentication function, which will be described later. The authentication device 400 receives an image related to biometric information of the user P1 from the information processing device 20, and authenticates the person by extracting a predetermined feature image from the received image. The feature image is, for example, a fingerprint pattern image. The authentication device 400 mainly includes an authentication storage unit 410, a feature image extraction unit 420, a feature point extraction unit 430, a registration unit 440, and an authentication unit 450.

[0046] The authentication storage unit 410 stores person IDs of pre-registered people in association with feature data of these people. The feature image extraction unit 420 detects feature areas included in an image related to the biometric information of user P1 and outputs the detected feature areas to the feature point extraction unit 430. The feature point extraction unit 430 extracts feature points from the detected feature areas and outputs data related to the feature points to the registration unit 440. The data related to the feature points is a collection of the extracted feature points.

[0047] The registration unit 440 issues a new person ID when registering the feature data. The registration unit 440 associates the issued person ID with feature data extracted from the registration image and registers the associated person ID in the authentication storage unit 410. The authentication unit 450 compares the feature data extracted from the image related to the biometric information of user P1 with the feature data in the authentication storage unit 410. The authentication unit 450 determines that authentication is successful if feature data matching the biometric information of user P1 is present. On the other hand, the authentication unit 450 determines that authentication is unsuccessful if feature data matching the biometric information of user P1 is not present. The authentication unit 450 provides information regarding the success or failure of authentication to the information processing device 20. Furthermore, if the authentication is successful, the authentication unit 450 identifies the person ID associated with the successful feature data and notifies the information processing device 20 of the authentication result including the identified person ID.

[0048] Next, processing executed by the information processing device 20 will be described with reference to Fig. 6. Fig. 6 is a flowchart showing an information processing method according to embodiment 2. The flowchart shown in Fig. 6 starts, for example, when the camera 310 of the information processing device 20 starts capturing an image.

[0049] First, the projection image acquisition unit 110 acquires a captured image from the camera 310 (step S21). When the projection image acquisition unit 110 acquires the captured image, the projection image acquisition unit 110 supplies the acquired captured image to the determination unit 120.

[0050] Next, the determination unit 120 determines whether the received captured image includes an image of the user P1's hand, in other words, whether the hand has been detected (step S22). If it is determined that the hand has not been detected (step S22: NO), the information processing device 20 returns to step S21. On the other hand, if it is determined that the hand has been detected (step S22: YES), the information processing device 20 proceeds to step S23.

[0051] Next, in step S23, control signal output unit 130 supplies a control signal to guidance image projection device 320 instructing it to project a guidance image, and guidance image projection device 320 starts projecting the guidance image in response to this (step S23).

[0052] Next, the projection image acquisition unit 110 acquires the projection image captured by the camera 310 (step S24). The projection image acquisition unit 110 supplies the acquired projection image to the determination unit 120.

[0053] Next, the determination unit 120 determines whether the guidance image and the hand image included in the received projection image meet predetermined conditions. More specifically, the determination unit 120 determines whether biometric information can be read from the received projection image (step S25). If the determination unit 120 does not determine that biometric information can be read from the received projection image (step S25: NO), the determination unit 120 returns to step S24 and acquires a projection image again. That is, while the determination unit 120 repeats steps S24 and S25, the user P1 attempts to move his or her hand to a position where the biometric information reading device can read the biometric information, following the projected guidance image. Then, if the determination unit 120 determines that biometric information can be read from the received projection image (step S25: YES), the determination unit 120 proceeds to step S26. At this time, the determination unit 120 supplies information regarding the determination result to the control signal output unit 130.

[0054] Next, the control signal output unit 130 outputs a control signal to the biometric information reading device based on the above determination, instructing the biometric information reading device to read the biometric information (step S26). When the control signal output unit 130 outputs the control signal to the biometric information reading device, the information processing device 20 ends the series of processes.

[0055] The above has described the processing executed by the information processing device 20, but the processing executed by the information processing device 20 is not limited to the above. For example, when repeating step S24 and step S25, the information processing device 20 may set a time limit, and if it is not determined that the predetermined condition is met within the set time limit, execute processing to output an error message to the display device 300. Furthermore, when repeating step S24 and step S25, the information processing device 20 may set an upper limit on the number of times the processing is repeated, and if it is not determined that the predetermined condition is met the set upper limit, execute processing to output an error message to the display device 300.

[0056] Next, a usage example of the information processing device 20 will be described with reference to Fig. 7. Fig. 7 is a first diagram illustrating a usage example of the information processing device 20 according to the second embodiment. The information processing device 20 illustrated in Fig. 7 further includes a guide unit 340 in addition to the above-described configuration. The information processing device 20 illustrated here reads the fingerprint pattern of the index finger of the left hand of a user P1 as biometric information.

[0057] For convenience of explaining the positional relationships of the components, a right-handed Cartesian coordinate system is used in Fig. 7. Furthermore, in subsequent figures where Cartesian coordinate systems are used, the X-, Y-, and Z-axis directions in Fig. 7 coincide with the X-, Y-, and Z-axis directions of these Cartesian coordinate systems, respectively.

[0058] The guide portion 340 has a horizontal main surface. The information processing device 20 guides, for example, the user P1 to place his or her left hand with the back of the hand facing up above the guide portion 340. The guide portion 340 has a readable area A10.

[0059] Below the readable area A10, a biometric information reader 330 is placed. That is, when the user's hand or fingers are positioned in the readable area A10, the biometric information reader 330 can read the biometric information of P1.

[0060] The guide unit 340 is, for example, a transparent plate-like member made of glass, acrylic, polycarbonate, or the like. The area of ​​the guide unit 340 excluding the readable area A10 does not have to be transparent. For example, the readable area A10 of the guide unit 340 may be transparent, and the other parts may be black, white, or the like. For example, if the other parts are black, the guide unit 340 can absorb the light of the guidance image projected by the guidance image projection device 320. On the other hand, if the other parts are white, the guide unit 340 can reflect the light of the guidance image projected by the guidance image projection device 320.

[0061] Camera 310 and guidance image projection device 320 are disposed above guide unit 340. Camera 310 is installed so as to be able to photograph guide unit 340, including readable area A10, from above guide unit 340. Guidance image projection device 320 projects a predetermined guidance image from above guide unit 340 downward.

[0062] The display device 300 is provided in a position where the information to be displayed can be viewed by the user P1. For example, the display device 300 is provided near the guide unit 340. This allows the information processing device 20 to notify the user P1 who presents his or her hand of predetermined information. Furthermore, for example, the display device 300 may present predetermined information to the user P1 when a guidance image is not projected onto the hand of the user P1.

[0063] Furthermore, the display device 300 may be realized by a guidance image projection device 320 projecting predetermined information onto the surface of the guide unit 340. Alternatively, the guide unit 340 may include the display device 300. That is, for example, the guide unit 340 may include a liquid crystal panel or the like in at least a portion thereof.

[0064] With the above-described configuration, the information processing device 20 can appropriately project a guidance image onto the hand presented by the user P1 and guide the hand of the user P1 into the readable area A10. Note that in the above-described configuration, the information processing device 20 may guide the hand of the user P1 by having the guide unit 340 come into contact with the hand of the user P1. Furthermore, the information processing device 20 may be configured to leave a predetermined distance between the guide unit 340 and the hand of the user P1. Furthermore, the information processing device 20 may not have a configuration that includes the guide unit 340.

[0065] Next, an example of a guidance image will be described with reference to Fig. 8. Fig. 8 is a diagram showing a guidance image G10 that the guidance image projection device 320 projects onto the guide unit 340. The guidance image G10 projected by the guidance image projection device 320 includes a first guidance image G11 and a second guidance image G12.

[0066] The first guidance image G11 includes a first message to be projected onto a hand that is located at a biometric information readable position of the biometric information reader 330. The biometric information readable position refers to a position on the hand of the user P1 where a part of the hand that is to be read by the biometric information reader 330 is located in the readable area A10. The first guidance image G11 shown in FIG. 8 includes the characters "OK" as the first message. When the first guidance image G11 is projected onto the hand, the user P1 can recognize that the position of the hand is a biometric information readable position.

[0067] The second guidance image G12 includes a second message different from the first message projected onto the hand located away from the biometric information readable position. The second guidance image G12 shown in FIG. 8 includes an arrow symbol as the second message. The arrow points toward the first image. That is, when the second guidance image G12 is projected onto the hand, the user P1 is prompted to move his / her hand toward the first guidance image G11.

[0068] 8 may be constantly projected onto the guide unit 340, or may change depending on the position and posture of the hand. In this case, the guide unit 340 is preferably black or the like to suppress light reflection from the guidance image G10. With this configuration, the user P1 can view only the image projected onto his or her hand and focus on the message projected on the hand.

[0069] Next, an example of the usage of the information processing device 20 will be described with reference to Fig. 9. Fig. 9 is a second diagram showing an example of the usage of the information processing device according to the second embodiment. Fig. 9 is a diagram in which the guide part 340 and an object present on the guide part 340 are observed from above the guide part 340.

[0070] 9, user P1 holds out his / her hand to the information processing device 20 to attempt biometric authentication. However, the user P1's hand is located away from the readable area A10. A second guidance image G12, which is a guidance image, is projected onto the user P1's hand. The second guidance image G12 projected onto the user P1's hand is an image of an arrow with its tip pointing to the right, to prompt the user P1 to move his / her hand to the right (positive direction of the X axis). Therefore, the user P1 moves his / her hand to the right.

[0071] Next, the usage status of the information processing device 20 will be further described with reference to Fig. 10. Fig. 10 is a third diagram illustrating an example of usage of the information processing device according to the second embodiment. Fig. 10 illustrates a situation in which the hand of the user P1 has moved at a time later than the situation illustrated in Fig. 9, for example.

[0072] In FIG. 10 , the index finger of the user P1's left hand is in the readable area A10, allowing the biometric information reader 330 to read the biometric information. At this time, a first guidance image G11 is projected onto the back of the user P1's hand. Therefore, the user P1 stops moving his / her hand. The camera 310 installed above the guide unit 340 captures the situation shown in FIG. 10 . The determination unit 120, which acquires the projection image captured by the camera 310 from the projection image acquisition unit 110, determines that the biometric information can be read from the received projection image. The control signal output unit 130 outputs a control signal to the biometric information reader 330 to instruct the biometric information reader 330 to read the biometric information. As a result, the biometric information reader 330 installed below the guide unit 340 reads the biometric information.

[0073] Although the second embodiment has been described above, the information processing system 1 and the information processing device 20 according to the second embodiment are not limited to the above-described configuration. For example, the information processing device 20 and the authentication device 400 may communicate directly without going through a network. Furthermore, the information processing system 1 may have multiple information processing devices 20, and multiple information processing devices 20 may be connected to one authentication device 400.

[0074] In the information processing device 20, the biometric information reading device 330 may have a function of extracting features of an image read by the biometric information reading device 330. In this case, the information processing device 20 may supply the extracted features of the image to the authentication device 400.

[0075] The information processing system 1 described above projects a guidance image onto the hand of the user P1. As a result, the information processing system 1 can smoothly acquire biometric information by having the user pay attention to their hand. Therefore, the information processing system 1 can smoothly perform authentication. That is, according to the second embodiment, it is possible to provide an information processing device or the like that prompts the user to perform authentication in a manner that is easy for the user to understand. <Embodiment 3>

[0076] Next, the third embodiment will be further described with reference to Fig. 11. In the third embodiment, further functions are added to the determination unit 120 of the second embodiment. Fig. 11 shows an example in which the hand of the user P1 is guided to a position away from the guide unit 340.

[0077] 11 , the guidance image projection device 320 projects a guidance image onto the back of the hand of a user P1. The guidance image projection device 320 is configured to project a clear guidance image onto the back of the hand when the distance between the guidance image projection device 320 and the back of the hand is D320. That is, when the back of the hand moves downward and is located farther than the distance D320, the guidance image becomes unclear (blurred). Similarly, when the back of the hand moves upward and is located closer than the distance D320, the guidance image also becomes unclear. Therefore, the user P1 intuitively moves his or her hand to a position where the guidance image projected onto the back of the hand is clearly projected.

[0078] 11, the biometric information reader 330 is configured to be able to suitably read the biometric information of the user P1 when the finger of the user P1 is at a distance D330 from a position along the optical axis 331 of the biometric information reader 330. That is, in this case, the depth of field of the biometric information reader 330 includes at least the distance D330.

[0079] In the above-described configuration, the guidance image projector 320 projects the first guidance image G11 on the back of the hand within the range of the depth of field of the biometric information reader 330. In other words, the guidance image projector 320 projects the first guidance image G11 so that the image is not formed outside the range of the depth of field of the biometric information reader 330. With this configuration, the information processing device 20 can intuitively prompt the user P1 to move his or her hand within the range of the depth of field of the biometric information reader 330.

[0080] In the above-described configuration, the determination unit 120 determines, as a predetermined condition, a state in which the guidance image is formed on the back of the hand of the user P1. With this configuration, the information processing device 20 guides the hand of the user P1 in an easily understandable manner along the optical axis of the biometric information reading device 330. Furthermore, the information processing device 20 can instruct the biometric information reading device 330 to read biometric information when the guidance image is formed on the hand of the user P1.

[0081] Although the third embodiment has been described above, the information processing system 1 and the information processing device 20 according to the third embodiment are not limited to the above-described configuration. For example, the information processing device 20 and the authentication device 400 may communicate directly without going through a network. Furthermore, the information processing system 1 may have multiple information processing devices 20, and multiple information processing devices 20 may be connected to one authentication device 400.

[0082] In the information processing device 20, the biometric information reading device 330 may have a function of extracting features of an image read by the biometric information reading device 330. In this case, the information processing device 20 may supply the extracted features of the image to the authentication device 400.

[0083] The above-described information processing system 1 projects a guidance image onto the hand of the user P1. As a result, the information processing system 1 smoothly acquires biometric information by having the user pay attention to his or her hand. Therefore, the information processing system 1 can smoothly perform authentication. That is, according to the third embodiment, it is possible to provide an information processing device or the like that prompts the user to perform authentication in a manner that is easy for the user to understand.

[0084] Fourth Embodiment Next, a fourth embodiment will be described with reference to Fig. 12. The fourth embodiment differs from the second or third embodiment in the functions of the determination section 120 and the control signal output section 130.

[0085] The determination unit 120 according to this embodiment detects whether the hand posture in the projected image is in a state in which biometric information can be read from the hand image included in the projected image. The determination unit 120 also determines that the hand posture in the projected image is in a state in which biometric information can be read, as a predetermined condition. In this case, if the hand posture does not meet the predetermined condition, the control signal output unit 130 outputs a control signal to, for example, the display device 300 to prompt the user to adjust the hand posture. This causes the display device 300 to display a message prompting the user to adjust the hand posture.

[0086] The processing according to this embodiment will be further described with reference to Fig. 12. Fig. 12 is a flowchart showing an information processing method according to the fourth embodiment. The processing between step S24 and step S25 in the flowchart shown in Fig. 12 is different from that in the flowchart shown in Fig. 6.

[0087] 12, the projection image acquisition unit 110 acquires the projection image captured by the camera 310 (step S24). The projection image acquisition unit 110 supplies the acquired projection image to the determination unit 120.

[0088] Next, the determination unit 120 detects the hand posture from the received projection image and determines whether the hand posture does not require adjustment (step S31). If the hand posture included in the projection image is in a state where biometric information can be read, the determination unit 120 determines that the hand posture does not require adjustment. In this case (step S31: YES), the information processing device 20 proceeds to step S25. On the other hand, if the hand posture included in the projection image is not in a state where biometric information can be read, the determination unit 120 does not determine that the hand posture does not require adjustment. In this case (step S31: NO), the information processing device 20 proceeds to step S32.

[0089] In step S32, the control signal output unit 130 outputs a control signal that prompts the user to adjust the hand posture (step S32). For example, the control signal output unit 130 causes the display device 300 to display a predetermined attention message. The attention message may include, for example, content that instructs the user on the hand posture. After the control signal output unit 130 outputs the control signal that prompts the user to adjust the hand posture, the information processing device 20 returns to step S24 and acquires the projection image again.

[0090] In step S25, the determination unit 120 determines whether biometric information can be read from the received projection image (step S25). If the determination unit 120 determines that biometric information can be read from the received projection image (step S25: NO), the determination unit 120 returns to step S24. If the determination unit 120 determines that biometric information can be read from the received projection image (step S25: YES), the determination unit 120 proceeds to step S26.

[0091] The information processing method according to this embodiment has been described above, but the processing performed by the information processing device 20 according to this embodiment is not limited to the above. For example, the determination unit 120 may detect whether the hand included in the projected image is a right hand or a left hand. Furthermore, the determination unit 120 may make the above-described determination based on the predetermined condition that either a pre-defined right hand or a pre-defined left hand has been detected. In this case, if the hand image does not meet the predetermined condition, the control signal output unit 130 outputs a control signal to, for example, the display device 300 to prompt the user to present the opposite hand.

[0092] More specifically, for example, suppose that the condition for reading biometric information in the information processing device 20 is to read biometric information from the index finger of the left hand, and the hand detected by the determination unit 120 is the right hand. In this case, the determination unit 120 supplies a signal indicating that the detected hand does not meet the predetermined condition to the control signal output unit 130 as the determination result. Upon receiving the signal from the determination unit 120, the control signal output unit 130 outputs a control signal to the display device 300 to output a message prompting the user to present the opposite hand.

[0093] In this way, the information processing device 20 according to the present embodiment prompts the user P1 to correct or adjust the hand when the hand presented by the user P1 does not meet the conditions for reading biometric information. Therefore, the fourth embodiment can provide an information processing device or the like that prompts the user to perform authentication in a manner that is easy for the user to understand and that suitably prompts the user to correct or adjust the hand.

[0094] <Fifth Embodiment> Next, a fifth embodiment will be described. The fifth embodiment differs from the above-described embodiments in that the guidance image is changeable.

[0095] In this embodiment, the determination unit 120 calculates the size ratio between the hand included in the projection image and the projection image projected onto the hand. The determination unit 120 then determines whether the calculated size ratio is within a predetermined range as a predetermined condition. In this case, if the size ratio does not meet the predetermined condition, the control signal output unit 130 outputs a control signal to the guidance image projection device 320 to change the size of the projection image.

[0096] Furthermore, the guidance image projection device 320 according to this embodiment may include a tracking mechanism that tracks the user's hand and projects a guidance image. In this case, the guidance image projection device 320 may be configured to project a guidance image at the position of the hand detected by the determination unit 120. The tracking mechanism may include a drive mechanism that changes the orientation of the guidance image projection device 320 itself. Alternatively, instead of the drive mechanism, the tracking mechanism may project a guidance image at a pixel position corresponding to the hand position within a predetermined image projection range of the guidance image projection device 320. In this case, the control signal output unit 130 receives the determination from the determination unit 120 and, depending on the result of the received determination, outputs a control signal to the guidance image projection device 320 to cause it to output a guidance image.

[0097] Fig. 13 is a flowchart showing an information processing method according to embodiment 5. The flowchart shown in Fig. 13 differs from the flowchart shown in Fig. 6 in that steps S41 and S42 are provided between steps S24 and S25.

[0098] After acquiring the projection image in step S24 according to the present embodiment, the determination unit 120 determines whether or not the guidance image needs to be changed based on the received projection image. For example, the determination unit 120 measures the size of the image of the hand included in the projection image and the size of the guidance image projected on the hand, and calculates the size ratio between them. If the calculated size ratio is within a predetermined range, the determination unit 120 determines that the guidance image does not need to be changed. In this case (step S41: YES), the information processing device 20 proceeds to step S24 without changing the guidance image. On the other hand, if the calculated size ratio is outside the predetermined range, the determination unit 120 does not determine that the guidance image does not need to be changed. In this case (step S41: NO), the information processing device 20 proceeds to step S42.

[0099] In step S42, the control signal output unit 130 generates and outputs a control signal instructing the guidance image projection device 320 to change the guidance image according to the determination result. Here, for example, the control signal output unit 130 calculates or selects the size of the guidance image according to the size ratio calculated by the determination unit 120 so that the size ratio falls within a predetermined range, and generates and outputs a control signal for projecting the calculated or selected guidance image. Through this process, the information processing device 20 changes the guidance image (step S42). After changing the guidance image, the information processing device 20 proceeds to step S25.

[0100] Fig. 14 is a first diagram illustrating a usage example of the information processing device according to the fifth embodiment. Fig. 14 is a projection image captured by the camera 310, and includes the hand of a user P1 and a second guide image G12 projected on the hand of the user P1. Upon receiving the image of Fig. 14 from the projection image acquisition unit 110, the determination unit 120 according to the present embodiment measures the size of the hand and the image of the second guide image G12 projected on the hand.

[0101] When measuring the size of a hand, the determination unit 120 first recognizes an image of the hand. A common object detection technique can be applied as the method by which the determination unit 120 recognizes the hand image. That is, the determination unit 120 recognizes the hand image contained in the projected image using, for example, histograms of oriented gradient (HOG), a support vector machine, or a neural network involving convolution processing. Next, the length of the diagonal line from the recognized hand image is measured. In the example shown in FIG. 14 , the diagonal line of the hand has a length D41.

[0102] Next, the determination unit 120 recognizes the guidance image projected on the hand and measures the size of the recognized guidance image. In the example shown in FIG. 14 , the diagonal of the second guidance image G12 has a length D42.

[0103] Next, the determination unit 120 calculates the size ratio between the diagonal of the hand and the diagonal of the guidance image. Specifically, for example, the determination unit 120 sets the value obtained by dividing the length D41 of the diagonal of the hand by the length D42 of the diagonal of the guidance image as the size ratio. Then, the determination unit 120 compares this size ratio with a predetermined numerical range stored in advance. Based on this, the determination unit 120 determines whether or not the size ratio is within the predetermined numerical range.

[0104] Next, an example in which the guidance image projected by the guidance image projection device 320 changes will be described with reference to Fig. 15. Fig. 15 is a second diagram illustrating an example of use of the information processing device according to the fourth embodiment.

[0105] FIG. 15 shows the hands of user P1 in multiple different locations. Among the hands of user P1 shown in FIG. 15, three hands indicated by dotted lines are positioned differently in both the X and Y directions. Also in FIG. 15, guidance images are projected onto the backs of each hand. The guidance images projected onto the hands located away from the readable area A10 are all arrows, with their tips pointing toward the readable area A10. In this way, the guidance image projection device 320 according to this embodiment can project guidance images onto the hands of user P1 within the image projection range A20 to guide the hands of user P1 toward the readable area A10.

[0106] In this way, the information processing device 20 according to the present embodiment can flexibly display a guidance image according to the size and position of the hand of the user P1. Therefore, the fourth embodiment can provide an information processing device or the like that flexibly prompts the user to perform authentication in a manner that is easy for the user to understand.

[0107] Sixth Embodiment Next, a sixth embodiment will be described with reference to Fig. 16. Fig. 16 is a block diagram showing the configuration of an information processing device 30 according to the sixth embodiment. The information processing device 30 according to this embodiment differs from the above-described embodiments in that it includes an attribute information acquisition unit 140 and a passport reading device 350.

[0108] The attribute information acquisition unit 140 included in the information processing device 30 acquires attribute information of the user P1 whose biometric information is read. The attribute information includes at least one of the nationality, address, residence, travel history, age, and gender of the user P1. The attribute information acquisition unit 140 acquires the attribute information from the passport information read by the passport reading device 350.

[0109] The control signal output unit 130 according to this embodiment outputs a control signal to the guidance image projection device 320 to cause the device 320 to output a guidance image corresponding to the attribute information acquired by the attribute information acquisition unit 140. At this time, the control signal output unit 130 compares the attribute information acquired by the attribute information acquisition unit 140 with the attribute information stored in the storage unit 200. The control signal output unit 130 then reads, from the storage unit 200, a guidance image corresponding to the attribute information acquired by the attribute information acquisition unit 140, and outputs a control signal to cause the device 320 to project the read guidance image.

[0110] The storage unit 200 according to the present embodiment stores a plurality of guidance images and attribute information corresponding to each of the guidance images in association with each other. The guidance images according to the present embodiment, for example, display different languages ​​depending on the attribute information. This allows the guidance images to be displayed in languages ​​that are familiar to each user. Similarly, the symbols and the like displayed in the guidance images according to the present embodiment can also be set depending on the attribute information. Therefore, the information processing device 30 can display guidance images that are easy for each user to understand.

[0111] The passport reading device 350 according to this embodiment reads predetermined information written on the passport of user P1. The passport reading device 350 is, for example, a scanner including an image sensor. In this case, the passport reading device 350 photographs the passport presented by user P1, identifies characters from the photographed image, and supplies the identified character information to the attribute information acquisition unit 140. Note that if attribute information is written on user P1's passport using a method other than text, the passport reading device 350 may have a means for reading the attribute information instead of a scanner. Specifically, the passport reading device 350 may be, for example, a barcode reader, a magnetic information reader, a near-field wireless communication device, or the like.

[0112] Next, processing by the information processing device 30 will be described with reference to Fig. 17. Fig. 17 is a flowchart showing an information processing method according to embodiment 6. The flowchart shown in Fig. 17 differs from the flowchart shown in Fig. 6 in that it includes step S50 before step S21 and step S51 instead of step S23.

[0113] The information processing device 30 first acquires attribute information of the user (step S50). More specifically, the attribute information acquisition unit 140 of the information processing device 30 extracts predetermined attribute information from the passport information read by the passport reading device 350.

[0114] Next, the information processing device 30 executes steps S21 and S22 to attempt to detect the hand of the user P1. If the hand of the user P1 is detected in step S22 (step S22: YES), the information processing device 30 projects a guidance image corresponding to the attribute information (step S51). More specifically, the control signal output unit 130 compares the attribute information acquired by the attribute information acquisition unit 140 with the attribute information and the guidance image associated therewith stored in the storage unit 200. Then, the control signal output unit 130 selects a guidance image corresponding to the acquired attribute information. Furthermore, the control signal output unit 130 outputs a control signal to the guidance image projection device 320 to instruct the projection of the selected guidance image. The subsequent processing is similar to that shown in FIG. 6 , and therefore will not be described here.

[0115] The sixth embodiment has been described above. In the above flowchart, step S50 may be performed before step S51. That is, step S50 may be performed after step S21 or step S22, or may be performed in parallel. Furthermore, the information processing device 30 may use the attribute information acquired by the attribute information acquisition unit 140 for messages to be displayed on the display device. This allows the information processing device 30 to display various messages, etc., in a manner that is easy for the user to understand. Furthermore, the above-described embodiments can be combined as appropriate.

[0116] With the above-described configuration, the information processing system including the information processing device 30 can smoothly perform authentication. That is, according to the sixth embodiment, it is possible to provide an information processing device or the like that prompts the authentication operation in a manner that is easy for the user to understand.

[0117] Seventh Embodiment Next, a seventh embodiment will be described. Fig. 18 is a diagram showing the configuration of an information processing device 40 according to the seventh embodiment. This embodiment differs from the above-described embodiments in that it includes a tactile stimulation means corresponding to a guidance image.

[0118] The information processing device 40 includes a tactile stimulation device 360. The tactile stimulation device 360 ​​stimulates the tactile sense of the hand on which the guidance image is projected. The tactile stimulation device 360 ​​is set so that the stimulation to the tactile sense of the hand becomes weaker the closer the distance to the biometric information reading device, and becomes stronger the farther the distance from the biometric information reading device.

[0119] The tactile stimulation device 360 ​​shown in FIG. 18 has multiple air outlets provided on the guide unit 340 as a specific means for stimulating the tactile sense of the hand. The air outlets spray air toward the user's presented hand. The flow rate of the air emitted from each air outlet is set according to its location. For example, the air flow rate of each air outlet is set to be slower the closer the air outlet is to the biometric information reading device 330, and faster the farther the air outlet is from the biometric information reading device 330. In FIG. 18, the arrows extending upward from each air outlet of the tactile stimulation device 360 ​​schematically represent the flow rate F360 of the air emitted from each air outlet. As shown in the figure, the flow rate F360 is shorter the closer the air outlet is to the readable area A10. Furthermore, the flow rate F360 is longer the farther the air outlet is from the readable area A10.

[0120] The tactile stimulation device 360 ​​also associates the flow speed and air blowing direction with the readable area A10. Specifically, the tactile stimulation device 360 ​​shown in Fig. 18 is set so that the air blown out by the tactile stimulation device 360 ​​does not hit the hand when the hand is positioned in the readable area A10.

[0121] With the above-described configuration, the information processing device 40 according to this embodiment can guide the hand to a position where biometric information can be read not only for users who can see the guidance image, but also for users who have difficulty seeing the guidance image or who cannot see the guidance image.

[0122] Although the seventh embodiment has been described above, the information processing device 40 according to the seventh embodiment is not limited to the above-described configuration. For example, instead of the linear nozzle as shown in FIG. 18 , the tactile stimulation device 360 ​​may be arranged at any position on a plane, or may be arranged three-dimensionally. The tactile stimulation device 360 ​​may have an object that touches the hand of the user P instead of air. The object that touches the hand may be made of metal, resin, wood, organic matter, or the like. The object that touches the hand may stimulate the hand by vibration. The object that touches the hand may stimulate the hand by texture.

[0123] As described above, according to this embodiment, it is possible to provide an information processing device or the like that prompts various users to perform authentication operations in a manner that is easy to understand.

[0124] <Example of Hardware Configuration> Hereinafter, a case will be described in which each functional configuration of the determination device in this disclosure is realized by a combination of hardware and software.

[0125] FIG. 19 is a block diagram illustrating an example of a hardware configuration of a computer. The management device in this disclosure can realize the above-described functions by a computer 500 including the hardware configuration shown in the figure. The computer 500 may be a portable computer such as a smartphone or tablet terminal, or a stationary computer such as a PC. The computer 500 may be a dedicated computer designed to realize each device, or may be a general-purpose computer. The computer 500 can realize the corresponding function by installing a predetermined program.

[0126] The computer 500 has a bus 502, a processor 504, a memory 506, a storage device 508, an input / output interface 510 (an interface is also called an I / F (Interface)), and a network interface 512. The bus 502 is a data transmission path through which the processor 504, the memory 506, the storage device 508, the input / output interface 510, and the network interface 512 transmit and receive data to and from each other. However, the method of connecting the processor 504 and other components to each other is not limited to a bus connection.

[0127] The processor 504 is a processor such as a CPU, a GPU, an FPGA, etc. The memory 506 is a main storage device realized using a RAM (Random Access Memory) or the like.

[0128] The storage device 508 is an auxiliary storage device realized using a hard disk, an SSD, a memory card, a ROM (Read Only Memory), etc. The storage device 508 stores programs for realizing predetermined functions. The processor 504 reads the programs into the memory 506 and executes them to realize the respective functional components of each device.

[0129] The input / output interface 510 is an interface for connecting the computer 500 with input / output devices. For example, the input / output interface 510 is connected to an input device such as a keyboard and an output device such as a display device.

[0130] The network interface 512 is an interface for connecting the computer 500 to a network.

[0131] Although an example of a hardware configuration has been described above in this disclosure, the above-described embodiment is not limited to this. Any processing in this disclosure can also be realized by causing a processor to execute a computer program.

[0132] In the above examples, the program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable medium or tangible storage medium includes random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technology, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable medium or communication medium includes electrical, optical, acoustic, or other forms of propagated signals.

[0133] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.

[0134] Some or all of the above embodiments can be described as, but are not limited to, the following supplementary notes. (Supplementary Note 1) An information processing device comprising: a projection image acquisition unit that acquires a projection image in which a predetermined guidance image is projected onto a user's hand presented to a biometric information reading device that reads predetermined biometric information from the user's hand; a determination unit that determines whether the guidance image and an image of the hand included in the projection image correspond to a predetermined condition; and a control signal output unit that outputs a predetermined control signal to the biometric information reading device based on the determination. (Supplementary Note 2) The information processing device according to Supplementary Note 1, wherein the determination unit makes the determination based on the predetermined condition that a trigger image in the guidance image that indicates the start of biometric information reading is projected onto the hand, and the control signal output unit outputs the control signal to the biometric information reading device to start reading if the projection image corresponds to the predetermined condition. (Supplementary Note 3) The information processing device according to Supplementary Note 1, wherein the determination unit makes the determination, using as the predetermined condition that the posture of the hand included in the projection image is in a state in which biometric information can be read, and the control signal output unit outputs the control signal to prompt the user to adjust the posture of the hand if the posture of the hand does not meet the predetermined condition. (Supplementary Note 4) The information processing device according to Supplementary Note 1, wherein the determination unit detects whether the hand included in the projection image is a right hand or a left hand, and makes the determination, using as the predetermined condition that either the pre-set right hand or the pre-set left hand has been detected, and the control signal output unit outputs the control signal to prompt the user to present the opposite hand if the image of the hand does not meet the predetermined condition. (Supplementary Note 5) The information processing device according to any one of Supplements 2 to 4, further comprising the biometric information reading device, which is provided in a position where biometric information can be read from fingers of the hand that meets the predetermined condition, and which performs a biometric information reading operation in response to the control signal. (Supplementary Note 6) An information processing system further comprising: the information processing device according to Supplementary Note 5; and an authentication device that acquires biometric information read by the biometric information reading device, authenticates the acquired biometric information, and supplies a result of the authentication to the information processing device.(Supplementary Note 7) The information processing device according to Supplementary Note 1, further comprising a guidance image projection device capable of projecting a first guidance image including a first message to be projected onto the hand present at a biometric information readable position of the biometric information reading device, and a second guidance image including a second message different from the first message to be projected onto the hand present at a position away from the biometric information readable position. (Supplementary Note 8) The information processing device according to Supplementary Note 7, wherein the guidance image projection device projects the first guidance image so as to form an image on the hand within a range of a depth of field of the biometric information reading device and not to form an image outside the range of the depth of field. (Supplementary Note 9) The information processing device according to Supplementary Note 8, wherein the determination unit makes the determination using the predetermined condition that the first guidance image has been formed on the hand. (Supplementary Note 10) The information processing device according to Supplementary Note 7, wherein the determination unit calculates a size ratio between the hand included in the projection image and the projection image, and makes the determination using the size ratio being within a predetermined range as the predetermined condition, and the control signal output unit outputs the control signal to the guidance image projection device to change the size of the projection image if the size ratio does not correspond to the predetermined condition. (Supplementary Note 11) The information processing device according to Supplementary Note 7, wherein the guidance image projection device includes a tracking mechanism that tracks the hand of the user to project the guidance image, and the control signal output unit outputs a control signal to the guidance image projection device to output the guidance image corresponding to the position of the hand based on the determination. (Supplementary Note 12) The information processing device according to any one of Supplements 7 to 11, further comprising an attribute information acquisition unit that acquires attribute information of the user, and the control signal output unit outputs the control signal to the guidance image projection device to output the guidance image corresponding to the acquired attribute information. (Supplementary Note 13) The information processing device according to Supplementary Note 12, further comprising: the biometric information reading device, which is provided at a position where biometric information can be read from a finger of the hand that meets the predetermined condition, and which performs a biometric information reading operation in response to the control signal.(Supplementary Note 14) An information processing system further comprising: the information processing device according to Supplementary Note 12; and an authentication device that acquires biometric information read by the biometric information reading device, authenticates the acquired biometric information, and supplies the authentication result to the information processing device. (Supplementary Note 15) An information processing method in which a computer acquires a projection image in which a predetermined guidance image is projected onto a user's hand presented to the biometric information reading device, determines whether the guidance image and the image of the hand included in the projection image meet predetermined conditions, and outputs a predetermined control signal to the biometric information reading device based on the determination. (Supplementary Note 16) A program that causes a computer to execute an information processing method in which a projection image in which a predetermined guidance image is projected onto a user's hand presented to the biometric information reading device, determines whether the guidance image and the image of the hand included in the projection image meet predetermined conditions, and outputs a predetermined control signal to the biometric information reading device based on the determination. (Appendix 17) The information processing system described in Appendix 14 further comprises a tactile stimulation device that stimulates the tactile sense of the hand on which the guidance image is projected, and the stimulation to the tactile sense of the hand is set to be weaker the closer the distance to the biometric information reading device and stronger the farther the distance to the biometric information reading device.

[0135] Although the present invention has been described above with reference to the embodiments, the present invention is not limited to the above. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present invention within the scope of the invention.

[0136] This application claims priority based on Japanese Patent Application No. 2022-085696, filed May 26, 2022, the disclosure of which is incorporated herein in its entirety.

[0137] The present disclosure can be used, for example, as a system for performing biometric authentication of users who use airports, ports, etc.

[0138] REFERENCE SIGNS LIST 1 Information processing system 10 Information processing device 20 Information processing device 30 Information processing device 40 Information processing device 110 Projected image acquisition unit 120 Determination unit 130 Control signal output unit 140 Attribute information acquisition unit 200 Storage unit 300 Display device 310 Camera 320 Guidance image projection device 330 Biometric information reading device 340 Guide unit 350 Passport reading device 360 ​​Tactile stimulation device 400 Authentication device 410 Authentication storage unit 420 Feature image extraction unit 430 Feature point extraction unit 440 Registration unit 450 Authentication unit 500 Computer 504 Processor 506 Memory 508 Storage device 510 Input / output interface 512 Network interface A10 Readable area G10 Guidance image G11 First guidance image G12 Second guidance image N1 Network P1 User

Claims

1. a projection image acquiring means for acquiring a projection image in which a predetermined guidance image is projected onto a user's hand presented to a biometric information reading device that reads predetermined biometric information from the user's hand; a determination means for determining whether the guidance image and the hand image included in the projection image correspond to a predetermined condition; and a control signal output unit that outputs a predetermined control signal to the biometric information reader based on the determination. Information processing device.

2. the determination means makes the determination based on the predetermined condition that a trigger image, which indicates a start of biometric information reading, among the guidance images, is projected onto the hand; and when the projection image satisfies the predetermined condition, the control signal output means outputs the control signal to the biometric information reading device to start reading. The information processing device according to claim 1 .

3. the determining means determines that the posture of the hand included in the projection image is in a state in which biometric information can be read, as the predetermined condition; the control signal output means outputs the control signal for prompting adjustment of the hand posture when the hand posture does not correspond to the predetermined condition. The information processing device according to claim 1 .

4. the determining means detects whether the hand included in the projection image is a right hand or a left hand, and makes the determination based on the predetermined condition that either the right hand or the left hand set in advance has been detected; the control signal output means outputs the control signal for prompting the user to present an opposite hand when the image of the hand does not correspond to the predetermined condition. The information processing device according to claim 1 .

5. a finger sensor that detects the predetermined condition and is provided at a position where biometric information can be read from the finger of the hand; The biometric information reading device further performs a biometric information reading operation in response to the control signal. The information processing device according to any one of claims 2 to 4.

6. The information processing device according to claim 5 ; The biometric information reading device further includes an authentication device that obtains the biometric information read by the biometric information reading device, authenticates the obtained biometric information, and supplies a result of the authentication to the information processing device. Information processing system.

7. The present invention further includes a tactile stimulation device that stimulates the tactile sense of the hand on which the guidance image is projected, the stimulation to the tactile sense of the hand is set to be weaker as the distance to the biometric information reader is relatively closer, and to be stronger as the distance to the biometric information reader is relatively farther; 7. The information processing system according to claim 6.

8. The biometric information reading device further includes a guidance image projecting device capable of projecting a first guidance image including a first message to be projected onto the hand present at a biometric information readable position of the biometric information reading device, and a second guidance image including a second message different from the first message to be projected onto the hand present at a position away from the biometric information readable position. The information processing device according to claim 1 .

9. The computer A predetermined guidance image is projected onto the user's hand presented to the biometric information reading device, and a projection image is acquired. determining whether the guidance image and the hand image included in the projection image correspond to a predetermined condition; outputting a predetermined control signal to the biometric information reader based on the determination; Information processing methods.

10. A predetermined guidance image is projected onto the user's hand presented to the biometric information reading device, and a projection image is acquired. determining whether the guidance image and the hand image included in the projection image correspond to a predetermined condition; outputting a predetermined control signal to the biometric information reader based on the determination; Making a computer execute an information processing method program.