Information processing device, information processing method, program, and information processing system

Abstract

Provided is an information processing device having: an acquisition unit that acquires information indicating the position of a user; and a control unit that moves a displayed object by a display device from the position corresponding to the user and in the direction of an imaging device which captures an authentication image based on the eyes of the user.

Description

Information processing device, information processing method, program, and information processing system

[0001] The present disclosure relates to an information processing device, an information processing method, a program, and an information processing system.

[0002] Patent Document 1 discloses a walk-through authentication technique that performs iris authentication on a user who is moving.

[0003] Japanese Patent Application Laid-Open No. 2020-194599

[0004] However, with the technology described in Patent Document 1, for example, the accuracy of authentication may be affected depending on whether the user faces the direction of the image capturing device (camera).

[0005] In view of the above-mentioned problems, an object of the present disclosure is to provide a technology that can appropriately perform user authentication.

[0006] In a first aspect of the present disclosure, an information processing device is provided that has an acquisition unit that acquires information indicating a user's position, and a control unit that moves an object displayed by a display device from a position corresponding to the user toward a photographing device that photographs an image for authentication based on the user's eyes.

[0007] In addition, a second aspect of the present disclosure provides an information processing method that acquires information indicating a user's position, and moves an object displayed by a display device from a position corresponding to the user toward a photographing device that photographs an image for authentication based on the user's eyes.

[0008] In addition, in a third aspect of the present disclosure, a program is provided that causes a computer to execute a process of acquiring information indicating a user's position, and moving an object displayed by a display device from a position corresponding to the user toward a photographing device that photographs an image for authentication based on the user's eyes.

[0009] In addition, in a fourth aspect of the present disclosure, there is provided an information processing system having an information processing device, a photographing device, and a display device, wherein the information processing device has an acquisition unit that acquires information indicating a user's position, and a control unit that moves an object displayed by the display device from a position corresponding to the user toward the photographing device that photographs an image for authentication based on the user's eyes.

[0010] According to one aspect, user authentication can be properly performed.

[0011] FIG. 1 is a diagram showing an example of the configuration of an information processing device according to an embodiment; FIG. 2 is a diagram showing an example of the configuration of an information processing system according to an embodiment; FIG. 3 is a diagram showing an example of the arrangement of each imaging device according to an embodiment; FIG. 4 is a diagram showing an example of the hardware configuration of an information processing device according to an embodiment; FIG. 5 is a flowchart showing an example of processing of an information processing device according to an embodiment; and FIG. 6 is a diagram showing an example of movement of a display object according to an embodiment.

[0012] The principles of the present disclosure will be described with reference to some exemplary embodiments. It should be understood that these embodiments are set forth for illustrative purposes only, to aid those skilled in the art in understanding and practicing the present disclosure, without implying any limitation on the scope of the disclosure. The disclosure described herein may be implemented in various ways other than those described below.

[0013] In the following description and claims, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs.

[0014] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each drawing is merely an example for describing one or more embodiments. Each drawing is not related to only one particular embodiment, but may also be related to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessarily required to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0015] (First Embodiment) <Configuration> The configuration of an information processing device 10 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of the information processing device 10 according to an embodiment. The information processing device 10 has an acquisition unit 11 and a control unit 12. These units may be realized by cooperation between one or more programs installed in the information processing device 10 and hardware such as a processor and memory of the information processing device 10.

[0016] The acquisition unit 11 acquires information indicating the user's position. The control unit 12 moves the display object displayed on the display device from a position corresponding to the user toward a photographing device that photographs an image for authentication based on the user's eyes. This allows for proper user authentication.

[0017] (Embodiment 2) Next, with reference to FIG. 2, the configuration of an information processing system 1 according to an embodiment will be described. <System Configuration> FIG. 2 is a diagram showing an example of the configuration of the information processing system 1 according to an embodiment. In the example of FIG. 2, the information processing system 1 includes an information processing device 10, an image capture device 20A, an image capture device 20B, an image capture device 20C, a display device 30A, a display device 30B, and a display device 30C. Hereinafter, when there is no need to distinguish between the image capture devices 20A to 20C, they will also be simply referred to as "image capture device 20." Furthermore, when there is no need to distinguish between the display devices 30A to 30C, they will also be simply referred to as "display device 30." In the example of FIG. 2, the information processing device 10, the image capture device 20, and the display device 30 are connected so as to be able to communicate via a network N. Note that the number of information processing devices 10, the image capture devices 20, and the display devices 30 is not limited to that of the example of FIG. 2.

[0018] Examples of the network N include the Internet, a mobile communication system, a wireless local area network (LAN), a LAN, a bus, etc. Examples of the mobile communication system include a fifth generation mobile communication system (5G), a sixth generation mobile communication system (6G, Beyond 5G), a fourth generation mobile communication system (4G), a third generation mobile communication system (3G), etc.

[0019] The information processing device 10 is, for example, a device such as a server, a cloud, or a personal computer. The information processing device 10 may perform user authentication for, for example, immigration, office entrance / exit management, facility entrance / exit management, etc., using images captured by the image capture device 20. The information processing device 10 also controls the display device 30 to guide the user's line of sight (gaze) so that the user's eyes are directed toward the image capture device 20.

[0020] The image capturing device 20 is an image capturing device that captures an image of the eyes of a user walking through a passageway, etc. The display device 30, in response to control from the information processing device 10, displays an object to guide the user's line of sight toward the image capturing device 20. The display device 30 may be, for example, a spotlight or a projector.

[0021] FIG. 3 is a diagram showing an example of the arrangement of each image capture device 20 according to the embodiment. In the example of FIG. 3, users YA-C are traveling from entrance 311 toward exit 312 of a passageway having walls 301 and 302. Furthermore, when facing from entrance 311 toward exit 312, image capture device 20A is installed on the right side near the middle of the passageway, and image capture device 20B is installed on the left side. Furthermore, image capture device 20C is installed further back in the passageway (near the exit) than image capture devices 20A and 20B. Note that display devices 30A-C may be installed in association with each of image capture devices 20A-C. In this case, for example, display devices 30A-C may be installed on the ceiling or the like in front of each of image capture devices 20A-C.

[0022] <Hardware Configuration> Fig. 4 is a diagram showing an example of the hardware configuration of the information processing device 10 according to the embodiment. In the example of Fig. 4, the information processing device 10 (computer 100) includes a processor 101, a memory 102, and a communication interface 103. These components may be connected via a bus or the like. The memory 102 stores at least a part of a program 104. The communication interface 103 includes an interface required for communication with other network elements.

[0023] When the program 104 is executed by the processor 101, memory 102, and other components in cooperation with each other, the computer 100 performs at least some of the processing of the embodiments of the present disclosure. The memory 102 may be of any type. As a non-limiting example, the memory 102 may be a non-transitory computer-readable storage medium. The memory 102 may also be implemented using any suitable data storage technology, such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory, and removable memory. Although only one memory 102 is shown in the computer 100, several physically different memory modules may be present in the computer 100. The processor 101 may be of any type. The processor 101 may include one or more of a general-purpose computer, a special-purpose computer, a microprocessor, a digital signal processor (DSP), and, as a non-limiting example, a processor based on a multi-core processor architecture. The computer 100 may have multiple processors, such as application-specific integrated circuit chips that are time-slaved to a clock that synchronizes the main processor.

[0024] Embodiments of the present disclosure may be implemented in hardware or special purpose circuits, software, logic, or any combination thereof. Some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device.

[0025] The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. The computer program product includes computer-executable instructions, such as instructions included in program modules, that execute on a target real or virtual processor or device to perform the processes or methods of the present disclosure. Program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or divided among program modules as desired in various embodiments. The machine-executable instructions of the program modules may be executed in local or distributed devices. In a distributed device, the program modules may be located in both local and remote storage media.

[0026] The program code for executing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus. When the program code is executed by the processor or controller, the functions / acts in the flowcharts and / or implementing block diagrams are performed. The program code may be executed entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine, or entirely on a remote machine or server.

[0027] The program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0028] <Processing> Next, an example of processing of the information processing device 10 according to the embodiment will be described with reference to Fig. 5 and Fig. 6. Fig. 5 is a flowchart showing an example of processing of the information processing device 10 according to the embodiment. Fig. 6 is a diagram showing an example of movement of a display object according to the embodiment. Note that the processing of Fig. 5 may be executed, for example, when a human presence sensor or the like detects a user passing through a passageway.

[0029] In step S101, the acquisition unit 11 acquires information indicating the user's location. Here, the acquisition unit 11 may acquire the information indicating the user's location based on, for example, a motion sensor installed in a passageway or the like. Alternatively, the acquisition unit 11 may acquire the information indicating the user's location based on, for example, an image captured by the imaging device 20.

[0030] Next, the control unit 12 causes the display device 30 to display the displayed object at a position corresponding to the user (step S102). The position corresponding to the user may be, for example, a position corresponding to at least one of the user's feet, the user's eyes, or the direction of the user's line of sight. When displaying at the user's feet, the control unit 12 may, for example, display the displayed object near the user's feet in the direction of travel of the user (toward the exit of the passage). When displaying at the user's eyes, the control unit 12 may, for example, illuminate a light near the user's face.

[0031] When displaying an object in the user's line of sight, the control unit 12 may, for example, display the object near the intersection of the line of sight detected based on an image captured by the image capture device 20 and a wall of the passageway or the like. In this case, the control unit 12 may calculate the three-dimensional position of the intersection based on the line of sight and three-dimensional position information of the wall of the passageway or the like. Note that the three-dimensional position information of the wall of the passageway or the like may be registered in advance in the information processing device 10 by an operator (administrator) or the like, or may be calculated based on an image captured by the image capture device 20.

[0032] The display object may be, for example, a display object including a message such as "Please face the camera" projected by a projector. The display object may also be, for example, a ray of light emitted by a spotlight.

[0033] The display object may be, for example, a display object according to the attributes of the user. In this case, the control unit 12 may, for example, display a display object including a text message, a symbol, or a figure for an adult. The control unit 12 may, for example, display a display object including a character such as an animal for a child. This, for example, increases the user's interest in the display object, and can more appropriately guide the user's gaze toward the camera.

[0034] Next, the control unit 12 moves the display object toward the image capturing device 20, which captures an image for authentication based on the user's eyes (step S103). This allows the user's line of sight to be guided toward the image capturing device 20. Here, the control unit 12 may display the display object so that it gradually moves from a position corresponding to the user to the position of the image capturing device 20. In this case, the display device 30 may, for example, control an actuator or the like based on a command received from the control unit 12 to change the direction of light irradiation. Note that the three-dimensional position information of the image capturing device 20 may be registered in advance in the information processing device 10 by an operator (administrator) or the like.

[0035] An example of movement of a display object according to the embodiment is shown in Fig. 6. In the example of Fig. 6, the display device 30 emits light toward an area including the eyes of the user Y, and then moves the illumination range of the light toward the image capturing device 20.

[0036] (Example of Simultaneous Guidance of Multiple Users) The control unit 12 may assign each image capture device 20 and each display device 30 to each user, and guide each user's line of sight toward each image capture device 20 using each display device 30. This allows each user to be properly authenticated, for example, even in a passage where multiple users are walking side by side (a gate that can accommodate multiple users). Furthermore, each user can be properly authenticated even when one user is walking directly behind another user.

[0037] In this case, the control unit 12 may, for example, move the display object displayed by the display device 30A from a position corresponding to the first user toward the image capturing device 20A that captures an image for authentication based on the eyes of the first user, and the control unit 12 may, for example, move the display object displayed by the display device 30B from a position corresponding to the second user toward the image capturing device 20B that captures an image for authentication based on the eyes of the second user.

[0038] In this case, the control unit 12 may, for example, guide the gaze of each user to the camera 20 corresponding to the user's position. This allows, for example, a person passing relatively to the right of a multi-person gate to be guided to the camera installed on the right. This allows the user's eyes to be photographed from a more frontal perspective. In this case, the control unit 12 may, for example, assign the camera 20A to the first user and the camera 20B to the second user based on the positions of the first user and the second user.

[0039] Next, the control unit 12 authenticates the user based on the image of the user's eyes captured by the imaging device 20 (step S104). Here, the control unit 12 may authenticate the user by, for example, iris authentication. Note that iris authentication may be authentication using, for example, the wrinkle pattern in the black part of the eyeball, the circular part outside the pupil. The control unit 12 may also authenticate the user by, for example, face authentication, which performs matching based on the positions of facial feature points such as the eyes, nose, and mouth, or the position and size of the facial area.

[0040] (Example of Processing When Authentication Fails) When authentication based on the user's eyes fails, the control unit 12 may cause the user to display a specific message at a position appropriate to the user. This allows the user to, for example, go back down the hallway, look toward the image capture device 20, and be authenticated again. In this case, the control unit 12 may cause the display device 30, such as a projector, to project a display object containing a message such as "Please try again to be authenticated by the camera," onto the user's feet, for example.

[0041] If authentication based on an image captured by the camera device 20 installed near the front of the passage fails, the control unit 12 may move the display object from a position corresponding to the user toward the camera device 20 installed near the rear of the passage. As a result, for example, if user authentication fails because the user does not look at the camera while proceeding near the front of the passage, authentication can be performed again using a camera near the rear of the passage.

[0042] In this case, for example, if authentication based on an image captured by image capture device 20A or 20B installed near the front of the passage fails, control unit 12 may move the display object displayed by display device 30C from the current position corresponding to the user toward image capture device 20C. In this case, control unit 12 may, for example, display the display object in a different display mode from that used during the initial authentication (e.g., when the user is traveling near the front of the passage). This allows, for example, a user who did not notice a display object during the initial authentication to notice the display object during a second authentication attempt using a highlighted display object. Examples of highlighting may include, for example, at least one of illuminating a light with a higher intensity, displaying a larger display object, illuminating a light of a more noticeable color (e.g., red), etc.

[0043] <Modifications> The information processing device 10 may be a device contained in a single housing, but the information processing device 10 of the present disclosure is not limited to this. Each unit of the information processing device 10 may be realized, for example, by cloud computing configured with one or more computers. Furthermore, the information processing device 10 and at least one of the image capture device 20 and the display device 30 may be housed in the same housing and configured as an integrated information processing device. Furthermore, at least some of the processing of each functional unit of the information processing device 10 may be performed by at least one of the image capture device 20 and the display device 30. Such information processing devices 10 are also included in examples of the "information processing device" of the present disclosure.

[0044] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0045] The present invention is not limited to the above-described embodiment, and can be modified as appropriate within the scope of the invention.

[0046] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. Note that some or all of the elements (e.g., configurations and functions) described in each supplementary note subordinate to supplementary note 1 may also be subordinate to independent supplementary notes in other categories in a similar subordinate relationship. Some or all of the elements described in any supplementary note may be applied to various hardware, software, recording means for recording software, systems, and methods. (Supplementary note 1) An information processing device having: an acquisition unit that acquires information indicating a user's position; and a control unit that moves a display object displayed by a display device from a position corresponding to the user toward a capture device that captures an image for authentication based on the user's eyes. (Supplementary note 2) The information processing device described in supplementary note 1, wherein the position corresponding to the user is a position corresponding to at least one of the user's feet, the user's eyes, or the line of sight of the user. (Supplementary Note 3) The information processing device according to Supplementary Note 1 or 2, wherein the users include a first user and a second user, the photographing device includes a first photographing device and a second photographing device, and the display device includes a first display device and a second display device, and the control unit moves an object displayed by the first display device from a position corresponding to the first user toward the first photographing device that photographs an image for authentication based on the eyes of the first user, and moves an object displayed by the second display device from a position corresponding to the second user toward the second photographing device that photographs an image for authentication based on the eyes of the second user. (Supplementary Note 4) The information processing device according to Supplementary Note 3, wherein the control unit assigns the first photographing device to the first user and the second photographing device to the second user based on the position of the first user and the position of the second user. (Supplementary Note 5) The information processing device according to Supplementary Note 1 or 2, wherein the control unit, when the eye-based authentication of the user fails, displays a specific message for the user at a position corresponding to the user.(Supplementary Note 6) The information processing device according to Supplementary Note 1 or 2, wherein the photographing devices include a first photographing device and a third photographing device installed behind the first photographing device, and wherein the control unit, if authentication based on an image photographed by the first photographing device fails, moves a display object from a position corresponding to the user toward the third photographing device. (Supplementary Note 7) The information processing device according to Supplementary Note 6, wherein the control unit moves a first display object from a position corresponding to the user toward the first photographing device, and, if authentication based on the image photographed by the first photographing device fails, moves a second display object having a display mode different from that of the first display object from a position corresponding to the user toward the third photographing device. (Supplementary Note 8) The information processing device according to Supplementary Note 1 or 2, wherein the control unit causes the display object according to an attribute of the user to be displayed by the display device. (Supplementary Note 9) An information processing method, comprising: acquiring information indicating a user's position; and moving an object displayed by a display device from a position corresponding to the user toward a photographing device that photographs an image for authentication based on the user's eyes. (Supplementary Note 10) A program that causes a computer to execute a process of acquiring information indicating a user's position, and moving an object displayed by a display device from a position corresponding to the user in a direction of a photographing device that photographs an image for authentication based on the user's eyes. (Supplementary Note 11) An information processing system having an information processing device, a photographing device, and a display device, wherein the information processing device has: an acquisition unit that acquires information indicating the user's position, and a control unit that moves an object displayed by the display device from a position corresponding to the user in a direction of the photographing device that photographs an image for authentication based on the user's eyes.

[0047] This application claims priority based on Japanese Patent Application No. 2024-022700, filed February 19, 2024, the disclosure of which is incorporated herein in its entirety by reference.

[0048] REFERENCE SIGNS LIST 1 Information processing system 10 Information processing device 11 Acquisition unit 12 Control unit 20 Imaging device 30 Display device

Claims

1. An information processing device having: an acquisition unit that acquires information indicating a user's position; and a control unit that moves an object displayed by a display device from a position corresponding to the user toward a photographing device that photographs an image for authentication based on the user's eyes.

2. The information processing device according to claim 1, wherein the position according to the user is a position according to at least one of the user's feet, the user's eyes, or a position ahead of the user's line of sight.

3. The information processing device of claim 1 or 2, wherein the users include a first user and a second user, the photographing device includes a first photographing device and a second photographing device, the display device includes a first display device and a second display device, and the control unit moves an object displayed by the first display device from a position corresponding to the first user toward the first photographing device that photographs an image for authentication based on the eyes of the first user, and moves an object displayed by the second display device from a position corresponding to the second user toward the second photographing device that photographs an image for authentication based on the eyes of the second user.

4. The information processing device according to claim 3, wherein the control unit assigns the first image capturing device to the first user and the second image capturing device to the second user based on the position of the first user and the position of the second user.

5. The information processing device according to claim 1 or 2, wherein the control unit, if authentication based on the user's eyes fails, displays a specific message to the user at a position corresponding to the user.

6. The information processing device according to claim 1 or 2, wherein the photographing device includes a first photographing device and a third photographing device installed behind the first photographing device, and the control unit, if authentication based on an image photographed by the first photographing device fails, moves a display object from a position corresponding to the user toward the third photographing device.

7. The information processing device according to claim 6, wherein the control unit moves a first display object from a position corresponding to the user toward the first photographing device, and if authentication based on the image photographed by the first photographing device fails, moves a second display object having a display mode different from that of the first display object from a position corresponding to the user toward the third photographing device.

8. The information processing device according to claim 1 or 2, wherein the control unit causes the display device to display the display object according to the attributes of the user.

9. An information processing method comprising: acquiring information indicating a user's position; and moving an object displayed on a display device from a position corresponding to the user toward a photographing device that photographs an image for authentication based on the user's eyes.

10. A program that causes a computer to execute the following process: acquire information indicating a user's position; and move an object displayed on a display device from a position corresponding to the user toward a photographing device that photographs an image for authentication based on the user's eyes.

11. An information processing system having an information processing device, an imaging device, and a display device, wherein the information processing device has an acquisition unit that acquires information indicating a user's position, and a control unit that moves an object displayed by the display device from a position corresponding to the user toward the imaging device that captures an image for authentication based on the user's eyes.

Images