Information processing device, information processing method, and program

The information processing device guides users to appropriate destinations based on authentication results using display and mobile objects, addressing the issue of unclear post-authentication directions.

WO2025177754A1PCT designated stage Publication Date: 2025-08-28NEC CORP
View PDF 6 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2025/001849
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2024-02-19
Filing Date
2025-01-22
Publication Date
2025-08-28

AI Technical Summary

Technical Problem

Existing technologies fail to provide users with a clear understanding of their destination based on authentication results, leading to potential confusion or misdirection.

Method used

An information processing device and method that acquires user location information and moves a guide object from a corresponding position to a destination aligned with the authentication result, utilizing display and mobile objects to guide users appropriately.

Benefits of technology

Enables users to accurately understand and follow the correct path based on authentication outcomes, enhancing security and efficiency in environments like immigration or facility access.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2025001849_28082025_PF_FP_ABST
    Figure JP2025001849_28082025_PF_FP_ABST
Patent Text Reader

Abstract

Provided is an information processing device comprising: an acquisition unit that acquires information indicating the position of a user for whom authentication processing has been performed; and a control unit that moves a guidance object from a position corresponding to the user to a movement destination corresponding to the result of the authentication processing.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing device, information processing method, and program

[0001] The present disclosure relates to an information processing device, an information processing method, and a program.

[0002] Patent Literature 1 discloses a technology for providing information on the authentication result to an authenticated person. Patent Literature 1 discloses that the notification content may be determined to encourage authenticated notification recipients to continue passing through, and that the notification content may be determined to instruct unauthenticated recipients to move to a predetermined area.

[0003] International Publication No. 2020 / 105142

[0004] However, with the technology described in Patent Document 1, for example, there may be cases where the user is unable to properly grasp the destination according to the authentication result.

[0005] In view of the above-described problems, an object of the present disclosure is to provide a technology that allows a user to appropriately know a destination based on an authentication result.

[0006] In a first aspect of the present disclosure, an information processing device is provided that has an acquisition unit that acquires information indicating the location of a user for whom authentication processing has been performed, and a control unit that moves a guide object from a location corresponding to the user to a destination corresponding to the result of the authentication processing.

[0007] In addition, a second aspect of the present disclosure provides an information processing method that acquires information indicating the location of a user for whom authentication processing has been performed, and moves a guide object from a location corresponding to the user to a destination corresponding to the result of the authentication processing.

[0008] In addition, in a third aspect of the present disclosure, a program is provided that causes a computer to execute a process of acquiring information indicating the location of a user for whom authentication processing has been performed, and moving a guide object from a location corresponding to the user to a destination corresponding to the result of the authentication processing.

[0009] According to one aspect, the user can appropriately know the destination according to the authentication result.

[0010] Fig. 1 is a diagram showing an example of the configuration of an information processing device according to an embodiment; Fig. 2 is a diagram showing an example of the configuration of an information processing system according to an embodiment; Fig. 3 is a diagram showing an example of the hardware configuration of an information processing device according to an embodiment; Fig. 4 is a flowchart showing an example of processing of an information processing device according to an embodiment; Fig. 5 is a diagram showing an example of movement of a guide object according to an embodiment;

[0011] The principles of the present disclosure will be described with reference to some exemplary embodiments. It should be understood that these embodiments are set forth for illustrative purposes only, to aid those skilled in the art in understanding and practicing the present disclosure, without implying any limitation on the scope of the disclosure. The disclosure described herein may be implemented in various ways other than those described below.

[0012] In the following description and claims, unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs.

[0013] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that each drawing is merely an example for describing one or more embodiments. Each drawing is not related to only one particular embodiment, but may also be related to one or more other embodiments. As will be understood by those skilled in the art, various features or steps described with reference to any one drawing can be combined with features or steps shown in one or more other drawings to create, for example, an embodiment not explicitly shown or described. Not all features or steps shown in any one drawing are necessarily required to describe an exemplary embodiment, and some features or steps may be omitted. The order of steps described in any drawing may be changed as appropriate.

[0014] (First Embodiment) <Configuration> The configuration of an information processing device 10 according to an embodiment will be described with reference to Fig. 1. Fig. 1 is a diagram showing an example of the configuration of the information processing device 10 according to an embodiment. The information processing device 10 has an acquisition unit 11 and a control unit 12. These units may be realized by cooperation between one or more programs installed in the information processing device 10 and hardware such as a processor and memory of the information processing device 10.

[0015] The acquisition unit 11 acquires information indicating the location of the user for whom authentication processing has been performed. The control unit 12 moves the guide object from the location corresponding to the user to a destination corresponding to the result of the authentication processing. This allows the user to properly understand the destination corresponding to the authentication result.

[0016] (Embodiment 2) Next, the configuration of an information processing system 1 according to an embodiment will be described with reference to Fig. 2. <System Configuration> Fig. 2 is a diagram showing an example of the configuration of an information processing system 1 according to an embodiment. In the example of Fig. 2, the information processing system 1 includes an information processing device 10, an image capturing device 20A, an image capturing device 20B, an image capturing device 20C, a display device 30A, a display device 30B, and a display device 30C. The information processing system 1 also includes a moving object 40A, a moving object 40B, and a moving object 40C.

[0017] Hereinafter, when there is no need to distinguish between the image capture devices 20A to 20C, they will also be simply referred to as "image capture device 20." Furthermore, when there is no need to distinguish between the display devices 30A to 30C, they will also be simply referred to as "display device 30." Furthermore, when there is no need to distinguish between the mobile objects 40A to 40C, they will also be simply referred to as "mobile object 40." In the example of FIG. 2, the information processing device 10, image capture device 20, display device 30, and mobile object 40 are connected so as to be able to communicate via network N. Note that the number of information processing devices 10, image capture devices 20, display devices 30, and mobile objects 40 is not limited to the example of FIG. 2.

[0018] Examples of the network N include the Internet, a mobile communication system, a wireless local area network (LAN), a LAN, a bus, etc. Examples of the mobile communication system include a fifth generation mobile communication system (5G), a sixth generation mobile communication system (6G, Beyond 5G), a fourth generation mobile communication system (4G), a third generation mobile communication system (3G), etc.

[0019] The information processing device 10 is, for example, a device such as a server, a cloud, or a personal computer. The information processing device 10 may perform user authentication for, for example, immigration, office entry / exit management, facility entry / exit management, etc., using an image captured by the image capturing device 20. The information processing device 10 also guides the user to a destination according to the result of the authentication process using a guide including at least one of a display object on the display device 30 and a mobile object 40.

[0020] The image capturing device 20 is an image capturing device that captures an image of the eyes of a user walking through a passageway, etc. The display device 30, in response to control from the information processing device 10, displays an object to guide the user's line of sight toward the image capturing device 20. The display device 30 may be, for example, a spotlight or a projector.

[0021] The mobile body 40 may be, for example, a robot capable of moving using legs or wheels, an electrically driven wheelchair, an electric transport device (electric cart), a drone (unmanned aerial vehicle), or the like. The mobile body 40 may also be, for example, a device that can autonomously move from a departure point to a destination specified by the information processing device 10. Furthermore, the mobile body 40 may also be, for example, a device that can autonomously move ahead of a person specified by the information processing device 10 to a destination specified by the information processing device 10 based on an image captured by a camera mounted on the mobile body 40.

[0022] <Hardware Configuration> Fig. 3 is a diagram showing an example of the hardware configuration of the information processing device 10 according to the embodiment. In the example of Fig. 3, the information processing device 10 (computer 100) includes a processor 101, a memory 102, and a communication interface 103. These components may be connected via a bus or the like. The memory 102 stores at least a part of a program 104. The communication interface 103 includes an interface required for communication with other network elements.

[0023] When the program 104 is executed by the processor 101, memory 102, and other components in cooperation with each other, the computer 100 performs at least some of the processing of the embodiments of the present disclosure. The memory 102 may be of any type. As a non-limiting example, the memory 102 may be a non-transitory computer-readable storage medium. The memory 102 may also be implemented using any suitable data storage technology, such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory, and removable memory. Although only one memory 102 is shown in the computer 100, several physically different memory modules may be present in the computer 100. The processor 101 may be of any type. The processor 101 may include one or more of a general-purpose computer, a special-purpose computer, a microprocessor, a digital signal processor (DSP), and, as a non-limiting example, a processor based on a multi-core processor architecture. The computer 100 may have multiple processors, such as application-specific integrated circuit chips that are time-slaved to a clock that synchronizes the main processor.

[0024] Embodiments of the present disclosure may be implemented in hardware or special purpose circuits, software, logic, or any combination thereof. Some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software that may be executed by a controller, microprocessor, or other computing device.

[0025] The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. The computer program product includes computer-executable instructions, such as instructions included in program modules, that execute on a target real or virtual processor or device to perform the processes or methods of the present disclosure. Program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The functionality of the program modules may be combined or divided among program modules as desired in various embodiments. The machine-executable instructions of the program modules may be executed in local or distributed devices. In a distributed device, the program modules may be located in both local and remote storage media.

[0026] The program code for executing the methods of the present disclosure may be written in any combination of one or more programming languages. These program codes may be provided to a processor or controller of a general-purpose computer, a special-purpose computer, or other programmable data processing apparatus. When the program code is executed by the processor or controller, the functions / acts in the flowcharts and / or implementing block diagrams are performed. The program code may be executed entirely on the machine, partly on the machine, as a stand-alone software package, partly on the machine and partly on a remote machine, or entirely on a remote machine or server.

[0027] The program includes instructions (or software code) that, when loaded into a computer, cause the computer to perform one or more functions described in the embodiments. The program may be stored on a non-transitory computer-readable medium or a tangible storage medium. By way of example and not limitation, computer-readable media or tangible storage media include random-access memory (RAM), read-only memory (ROM), flash memory, solid-state drive (SSD) or other memory technologies, CD-ROM, digital versatile disc (DVD), Blu-ray disc or other optical disk storage, magnetic cassette, magnetic tape, magnetic disk storage or other magnetic storage device. The program may also be transmitted on a transitory computer-readable medium or communication medium. By way of example and not limitation, transitory computer-readable media or communication media include electrical, optical, acoustic, or other forms of propagated signals.

[0028] <Processing> Next, an example of processing of the information processing device 10 according to the embodiment will be described with reference to Fig. 4 and Fig. 5. Fig. 4 is a flowchart showing an example of processing of the information processing device 10 according to the embodiment. Fig. 5 is a diagram showing an example of movement of a guide object according to the embodiment. Note that the processing of Fig. 4 may be executed, for example, when a human presence sensor or the like detects a user passing through a passage.

[0029] In step S101, the control unit 12 authenticates the user based on an image of the user's eyes captured by the image capturing device 20. Here, the control unit 12 may authenticate the user by, for example, iris authentication. Note that iris authentication may be authentication using, for example, the wrinkle pattern in the black part of the eyeball, the circular part outside the pupil. The control unit 12 may also authenticate the user by, for example, face authentication, which performs matching based on the positions of facial feature points such as the eyes, nose, and mouth, or the position and size of the facial area.

[0030] Next, the acquisition unit 11 acquires information indicating the location of the user for whom authentication processing has been performed by the control unit 12 (step S102). Here, the acquisition unit 11 may acquire the information indicating the user's location based on, for example, a motion sensor installed in a passageway or the like. Alternatively, the acquisition unit 11 may acquire the information indicating the user's location based on, for example, an image captured by the imaging device 20.

[0031] Next, the control unit 12 sets a guiding object including at least one of a display object by the display device 30 and the moving object 40 at a position corresponding to the user (step S103). The position corresponding to the user may be, for example, a position corresponding to at least one of a position in front of the user, a position at the user's eyes, or a position ahead of the user's line of sight. When displaying a display object by the display device 30 in front of the user, the control unit 12 may, for example, display the display object near the user's feet in the direction of travel of the user (toward the exit of the passage). When displaying to the user's eyes, the control unit 12 may, for example, illuminate a light near the user's face.

[0032] When displaying an object in the user's line of sight, the control unit 12 may, for example, display the object near the intersection of the line of sight detected based on an image captured by the image capture device 20 and a wall of the passageway or the like. In this case, the control unit 12 may calculate the three-dimensional position of the intersection based on the line of sight and three-dimensional position information of the wall of the passageway or the like. Note that the three-dimensional position information of the wall of the passageway or the like may be registered in advance in the information processing device 10 by an operator (administrator) or the like, or may be calculated based on an image captured by the image capture device 20.

[0033] The display object may be, for example, a display object including a message such as "Please proceed to the inspection lane" projected by a projector. The display object may also be, for example, a beam of light emitted by a spotlight.

[0034] The control unit 12 may determine the guide object based on at least one of the result of the authentication process for the user and the user's attributes. This allows, for example, more appropriate guidance of the user. When determining the guide object based on the result of the authentication process for the user, the control unit 12 may set a specific guide object for the user only if the user is registered on a blacklist. This allows, for example, only users who fall into special cases to be guided to a special destination. The specific guide object may be, for example, a moving object 40 that automatically follows the user, or a display object with a specific display mode (for example, highlighted display).

[0035] Furthermore, the control unit 12 may set a different guide object for each user depending on the result of the authentication process for that user. In this case, the control unit 12 may, for example, set the mobile object 40 as the guide object for a user registered on a blacklist (a person requiring screening), and may determine the display object on the display device 30 as the guide object for a user (a person who has failed authentication) who is not registered on the list (blacklist or whitelist) (a person who has failed to be identified). The control unit 12 may also, for example, not set a guide object for a user registered on a whitelist (a person who has successfully been authenticated), and may not provide guidance. This allows, for example, only users who fall into special cases to be guided to a special destination.

[0036] When determining the guide object according to the user's attributes, the control unit 12 may, for example, cause the display device 30 to display a display object including a text message, symbol, or figure for an adult. Furthermore, the control unit 12 may, for example, cause the display device 30 to display a display object including a character such as an animal for a child. Furthermore, the control unit 12 may, for example, assign a moving object 40 in the form of a character such as an animal to a child. This, for example, increases the user's interest in the guide object, thereby more appropriately guiding the user's gaze toward the camera.

[0037] Next, the control unit 12 moves the guide object to a destination corresponding to the result of the authentication process (step S104). This allows the user to properly understand the destination corresponding to the authentication result. Here, the control unit 12 may gradually move the guide object from a position corresponding to the user to the destination. In this case, the display device 30 may, for example, control an actuator or the like based on a command received from the control unit 12 to change the direction of light irradiation. Note that the three-dimensional position information of the image capture device 20 may be registered in advance in the information processing device 10 by an operator (administrator) or the like. Furthermore, the moving object 40 may, for example, autonomously move to a destination specified by the information processing device 10 based on a command received from the control unit 12.

[0038] Fig. 5 shows an example of the movement of a guide object according to the embodiment. In the example of Fig. 5, user Y is shown moving along a passageway that allows access to a lane 501 for successful authentication persons, a lane 502 for persons requiring screening, and a lane 503 for unsuccessful authentication persons. In addition, in the example of Fig. 5, a message 511 saying "Please proceed to the lane for successful authentication persons" and an arrow 512 indicating the direction of the lane 501 for successful authentication persons are displayed as guide objects by the display device 30 ahead in the moving direction 510 of user Y, who is successful in authentication.

[0039] The control unit 12 may move the guide object by at least one of the travel time and travel distance depending on the result of the authentication process. This allows for more appropriate guidance for a specific user, for example, by guiding the user until the user reaches the destination lane. In this case, the control unit 12 may move the guide object for a relatively short time and a short distance for a person who has been successfully authenticated. Furthermore, the control unit 12 may move the guide object for a relatively long time and a long distance for a person who is subject to screening. This reduces the likelihood of terrorists or people who are subject to screening and are subject to deportation proceeding to a lane for successful authentication, for example.

[0040] Furthermore, the control unit 12 may move the guide object for at least one of the travel time and travel distance according to the attributes of the user. As a result, for example, for users with specific attributes, more appropriate guidance can be provided by guiding the user until the user reaches the destination lane. In this case, the control unit 12 may move the guide object for a relatively short time and a short distance for, for example, adults. Furthermore, the control unit 12 may move the guide object for a relatively long time and a long distance for, for example, children and elderly people. As a result, for example, it is possible to reduce the number of children and elderly people proceeding to a lane requiring screening where staff members or the like are available to assist the user.

[0041] Furthermore, if the result of the authentication process is authentication failure, the control unit 12 may move a guide from a position corresponding to the user toward the photographing device 20, which captures an image for authentication based on the user's eyes. As a result, if iris authentication or the like fails because the user does not face the photographing device 20, for example, the authentication process can be performed again by having the photographing device 20 face the user. Note that if the user faces the photographing device 20, an image of the user's eyes from the front can be captured, thereby improving the accuracy of iris authentication.

[0042] The control unit 12 may also display the guide in a display mode that corresponds to the user's movement direction and the direction from the user's location to the destination according to the result of the authentication process. This allows, for example, when a person requiring screening is moving toward a lane for successful authentication, the person requiring screening and nearby staff members to be notified of an abnormality. In this case, the control unit 12 may, for example, cause the display device 30 to highlight the displayed object or the moving object 40 more, the greater the deviation (e.g., the angle between the two directions) between the user's movement direction and the direction from the user's location to the destination according to the result of the authentication process. Examples of highlighting may include, for example, at least one of illuminating with a light of higher intensity, displaying a larger display object, illuminating with a light of a more conspicuous color (e.g., red), and outputting a warning sound.

[0043] Furthermore, the control unit 12 may issue a warning using a guide object, for example, when the user's movement direction is a movement direction corresponding to an authentication result that differs from the result of the authentication process. This allows the control unit 12 to notify the person requiring screening and nearby staff members of an abnormality, for example, when the person requiring screening is proceeding toward a lane for successful authentication, etc. In this case, the control unit 12 may, for example, cause the display device 30 to highlight the displayed object or the moving object 40 more, the smaller the deviation (e.g., the angle between the two directions) between the user's movement direction and the direction from the user's position to the destination corresponding to the result that differs from the result of the authentication process.

[0044] <Modifications> The information processing device 10 may be a device contained in a single housing, but the information processing device 10 of the present disclosure is not limited to this. Each unit of the information processing device 10 may be realized, for example, by cloud computing configured with one or more computers. Furthermore, the information processing device 10 and at least one of the image capture device 20, the display device 30, and the mobile object 40 may be housed in the same housing and configured as an integrated information processing device. Furthermore, at least some of the processing of each functional unit of the information processing device 10 may be performed by at least one of the image capture device 20, the display device 30, and the mobile object 40. Such information processing devices 10 are also included in examples of the "information processing device" of the present disclosure.

[0045] Although the present disclosure has been described above with reference to the embodiments, the present disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0046] The present invention is not limited to the above-described embodiment, and can be modified as appropriate within the scope of the invention.

[0047] Some or all of the above embodiments may be described as, but are not limited to, the following supplementary notes. Note that some or all of the elements (e.g., configurations and functions) described in each supplementary note subordinate to supplementary note 1 may also be subordinate to independent supplementary notes in other categories in a similar subordinate relationship. Some or all of the elements described in any supplementary note may be applied to various hardware, software, recording means for recording software, systems, and methods. (Supplementary note 1) An information processing device comprising: an acquisition unit that acquires information indicating the position of a user who has undergone authentication processing; and a control unit that moves a guide object from a position corresponding to the user to a destination corresponding to the result of the authentication processing. (Supplementary note 2) The information processing device described in supplementary note 1, wherein the position corresponding to the user is a position corresponding to at least one of a position in front of the user, the user's eyes, or a position ahead of the user's line of sight. (Supplementary note 3) The information processing device described in supplementary note 1 or 2, wherein the control unit determines the guide object according to at least one of a result of the authentication processing and an attribute of the user, and the guide object includes at least one of an object displayed by a display device and a moving object. (Supplementary Note 4) The information processing device according to Supplementary Note 1 or 2, wherein the control unit moves the guide by at least one of a travel time and a travel distance according to a result of the authentication process. (Supplementary Note 5) The information processing device according to Supplementary Note 1 or 2, wherein the control unit moves the guide by at least one of a travel time and a travel distance according to an attribute of the user. (Supplementary Note 6) The information processing device according to Supplementary Note 1 or 2, wherein the control unit moves the guide from a position according to the user toward a photographing device that photographs an image for authentication based on the user's eyes when the result of the authentication process is authentication failure. (Supplementary Note 7) The information processing device according to Supplementary Note 1 or 2, wherein the control unit displays the guide in a display mode according to the movement direction of the user and the direction from the position of the user to a destination according to the result of the authentication process. (Supplementary Note 8) The information processing device according to Supplementary Note 1 or 2, wherein the control unit issues a warning by the guide when the movement direction of the user is a movement direction according to an authentication result that differs from the result of the authentication process.(Supplementary Note 9) An information processing method, which acquires information indicating the location of a user who has undergone authentication processing, and moves a guide object from a location corresponding to the user to a destination corresponding to the result of the authentication processing. (Supplementary Note 10) A program that causes a computer to execute processing, which acquires information indicating the location of a user who has undergone authentication processing, and moves a guide object from a location corresponding to the user to a destination corresponding to the result of the authentication processing.

[0048] This application claims priority based on Japanese Patent Application No. 2024-022701, filed February 19, 2024, the disclosure of which is incorporated herein in its entirety by reference.

[0049] REFERENCE SIGNS LIST 1 Information processing system 10 Information processing device 11 Acquisition unit 12 Control unit 20 Imaging device 30 Display device 40 Mobile object

Claims

1. An information processing device having: an acquisition unit that acquires information indicating the location of a user who has undergone authentication processing; and a control unit that moves a guide object from a location corresponding to the user to a destination corresponding to the result of the authentication processing.

2. The information processing device according to claim 1, wherein the position according to the user is a position according to at least one of a position in front of the user, a position at the user's eyes, or a position ahead of the user's line of sight.

3. The information processing device according to claim 1 or 2, wherein the control unit determines the guide object according to at least one of the result of the authentication process and the attributes of the user, and the guide object includes at least one of a display object on a display device and a moving object.

4. The information processing device according to claim 1 or 2, wherein the control unit moves the guide object by at least one of a moving time and a moving distance according to a result of the authentication process.

5. The information processing device according to claim 1 or 2, wherein the control unit moves the guide object according to at least one of a travel time and a travel distance that correspond to the attributes of the user.

6. The information processing device according to claim 1 or 2, wherein, if the result of the authentication process is authentication failure, the control unit moves a guide object from a position corresponding to the user toward a photographing device that photographs an image for authentication based on the user's eyes.

7. The information processing device according to claim 1 or 2, wherein the control unit displays the guide object in a display mode that corresponds to the direction of movement of the user and the direction from the user's position to a destination that corresponds to the result of the authentication process.

8. The information processing device according to claim 1 or 2, wherein the control unit issues a warning using the guiding object when the user's movement direction is a movement direction corresponding to an authentication result that differs from the result of the authentication process.

9. An information processing method, comprising: acquiring information indicating the location of a user who has undergone authentication processing; and moving a guide object from a location corresponding to the user to a destination corresponding to the result of the authentication processing.

10. A program that causes a computer to execute the following process: acquire information indicating the location of a user who has undergone authentication processing; and move a guide object from a location corresponding to the user to a destination corresponding to the result of the authentication processing.

Citation Information

Patent Citations

  • Guide robot

    JP2007276080A

  • Program, video processing apparatus, and authentication method

    JP2021060691A

  • Mobile body control device, mobile body control method, program, and storage medium

    JP2023151134A

  • CONTROL APPARATUS, CONTROL METHOD, AND BIO-ATTACHED DEVICE

    JP7422961B1

  • Light emission guidance

    US8423431B1