Information processing devices, computer-readable media and computer program products

Abstract

An information processing apparatus and a computer-readable medium are provided. The information processing apparatus has a processor that controls changes to the image formed in the air, whereby information is read from the location of an object used for authentication in a non-contact manner, based on the conditions of the authentication site.

Description

Technical Field

[0001] This disclosure relates to information processing apparatus and computer-readable media. Background Technology

[0002] Currently, various methods exist as technologies for authenticating individuals. For example, methods that scan patterns of the retina or veins perform authentication by having the user bring their eyes or hands close to a specific location on a pre-set reading device (see, for example, Japanese Patent Application Publication No. 2019-40463). Summary of the Invention

[0003] However, there are technologies that authenticate individuals by reading liveness information without physically contacting the body with the reading device. For example, there are technologies that authenticate individuals by having the person being authenticated superimpose their hand onto an image of their hand formed in the air. However, in contactless authentication technologies, the intended reading position is fixed.

[0004] The purpose of this disclosure is to make it easier to respond to changes in the conditions of the authentication site compared to reading the object used for authentication in a non-contact manner, regardless of the conditions of the authentication site.

[0005] According to a first aspect of this disclosure, an information processing apparatus is provided, wherein the information processing apparatus has a processor that controls changes to the image formed in the air, whereby the image represents the location from which information is read from an object for authentication in a non-contact manner, based on the conditions of the authentication site.

[0006] According to the second aspect of this disclosure, the conditions of the authentication site are characteristics related to the physical condition of the person being authenticated.

[0007] According to the third aspect of this disclosure, the height of the position forming the image is changed to match the height of the person being authenticated.

[0008] According to the fourth aspect of this disclosure, the height of the position forming the image is changed in accordance with the age division of the person being authenticated.

[0009] According to the fifth aspect of this disclosure, the position of the image is changed in accordance with the orientation of the body of the person being authenticated.

[0010] According to the sixth aspect of this disclosure, the status of the authentication site is the environment on the site side.

[0011] According to the seventh aspect of this disclosure, the position where the image is formed is changed to a position that avoids situations that would hinder the acquisition of the information.

[0012] According to the eighth embodiment of this disclosure, the on-site conditions for certification are the required security strength.

[0013] According to the ninth aspect of this disclosure, the position of the image is changed frequently while maintaining a high required level of security.

[0014] According to the 10th embodiment of this disclosure, the position of the image is randomly changed when a high level of security is required.

[0015] According to the 11th scheme of this disclosure, the image is not formed before authentication begins.

[0016] According to the 12th scheme of this disclosure, the image is removed from the air upon successful authentication.

[0017] According to the 13th aspect of this disclosure, in the event of successful authentication, an image of an open door is formed in the air in front of the person being authenticated.

[0018] According to the 14th aspect of this disclosure, when multiple people are present at the scene where the authentication is being performed, the image is formed in a manner suitable for the multiple people.

[0019] According to the 15th embodiment of this disclosure, in the event of authentication failure, the image indicating the authentication failure is formed in the air.

[0020] According to the 16th aspect of this disclosure, as an image indicating authentication failure, an image of a closed door is formed in front of the person being authenticated.

[0021] According to the 17th aspect of this disclosure, in the event of successful authentication, the processor causes an audio notification of successful authentication to be output.

[0022] According to the 18th embodiment of this disclosure, in the event of authentication failure, the processor causes an audio notification of authentication failure to be output.

[0023] According to a 19th aspect of this disclosure, a computer-readable medium is provided that stores a program for causing a computer to perform processing, wherein, in said processing, when an image formed in the air represents the location from which information is read from an object used for authentication in a non-contact manner, changes to the image are controlled according to the conditions of the authentication site.

[0024] (Effect)

[0025] According to the first scheme, compared to the case where the object used for authentication can be read in a non-contact manner regardless of the conditions of the authentication site, it is easier to respond to changes in the conditions of the authentication site.

[0026] According to the second scheme, the location of the area from which information is read from the object used for authentication can be changed in a non-contact manner in accordance with the person being authenticated.

[0027] According to the third scheme, the position of the area from which information is read from the object used for authentication can be changed in a non-contact manner to match the height of the person being authenticated.

[0028] According to the fourth scheme, the location of the area from which information is read from the object used for authentication can be changed in a non-contact manner in accordance with the object being authenticated.

[0029] According to the fifth scheme, the location of the area from which information is read from the object used for authentication can be changed in a non-contact manner in accordance with the object being authenticated.

[0030] According to the sixth scheme, the location of the area where information is read from the object used for authentication in a contactless manner can be changed to a location where information reading is unobstructed.

[0031] According to the seventh scheme, the location of the area for reading information from an object used for authentication in a contactless manner can be changed to a location that avoids obstructing the reading of information.

[0032] According to the eighth scheme, the location of the area where information is read from the object used for authentication in a contactless manner can be changed according to the security level.

[0033] According to the ninth scheme, since the location of the area where information is read from the object used for authentication in a non-contact manner is not fixed, the security strength can be improved.

[0034] According to the 10th scheme, since the location of the area where information is read from the object used for authentication in a non-contact manner is not fixed, the security strength can be improved.

[0035] According to the 11th scheme, security can be improved by concealing the location of the area from which information is read from the object used for authentication until authentication is imminent.

[0036] According to the 12th scheme, the success of authentication can be visually confirmed.

[0037] According to the 13th scheme, the success of authentication can be visually confirmed.

[0038] According to the 14th scheme, it is also possible to handle authentication for multiple people.

[0039] According to the 15th scheme, authentication failure can be visually confirmed.

[0040] According to the 16th scheme, authentication failure can be visually confirmed.

[0041] According to the 17th scheme, the success of authentication can be audibly confirmed.

[0042] According to the 18th scheme, the failure of authentication can be audibly confirmed.

[0043] According to the 19th scheme, compared to reading the object used for authentication in a non-contact manner regardless of the conditions at the authentication site, it is easier to respond to changes in the conditions at the authentication site. Attached Figure Description

[0044] Figure 1 This is a diagram illustrating an example of the structure of the information processing system used in Embodiment 1.

[0045] Figure 2 This is a flowchart illustrating the steps of the authentication process performed in Implementation Method 1.

[0046] Figure 3 This is a diagram illustrating the different formation of aerial images when the subject of authentication is an adult and when the subject is a child.

[0047] Figure 4 It is a diagram illustrating the different formation of aerial images of the person being authenticated when they are in a wheelchair and when they are standing.

[0048] Figure 5 This diagram illustrates an example of using the information terminal held by the user to perform authentication.

[0049] Figure 6 This diagram illustrates an example of changing the position of an aerial image based on the orientation of the subject's body. (A) shows the case where the subject's line of sight is along the Y-axis, and (B) shows the case where the subject's line of sight is along the X-axis.

[0050] Figure 7 This is a diagram illustrating the progress of authentication using aerial images and an example of successful authentication notification. (A) shows the situation at time point T1 before authentication begins, (B) shows the situation at time point T2 when aerial image formation begins, and (C) shows the situation at time point T3 when authentication ends.

[0051] Figure 8 This is another example illustrating the progress of authentication using aerial images and the notification of successful authentication. (A) shows the situation at time point T1 before authentication begins, (B) shows the situation at time point T2 when aerial image formation begins, and (C) shows the situation at time point T3 when authentication ends.

[0052] Figure 9This is another example illustrating the progress of authentication using aerial images and the notification of successful authentication. (A) shows the situation at time point T1 before authentication begins, (B) shows the situation at time point T2 when aerial image formation begins, and (C) shows the situation at time point T3 when authentication ends.

[0053] Figure 10 This is a diagram illustrating the progress of authentication using aerial images and examples of authentication failure notifications. (A) shows the case where aerial image formation begins at time point T2, and (B) shows the case where authentication ends at time point T3.

[0054] Figure 11 This is another example illustrating the progress of authentication using aerial images and notification of authentication failure. (A) shows the case where aerial image formation begins at time point T2, and (B) shows the case where authentication ends at time point T3.

[0055] Figure 12 This is another example illustrating the progress of authentication using aerial images and notification of authentication failure. (A) shows the case where aerial image formation begins at time point T2, and (B) shows the case where authentication ends at time point T3.

[0056] Figure 13 This is a flowchart illustrating the steps of the authentication process performed in Implementation Method 2.

[0057] Figure 14 This diagram illustrates the formation of an aerial image in the presence of obstacles at the authentication site. (A) is a top view of the site, showing the positional relationship between the person being authenticated and the authentication sensor device. (B) shows an example of an aerial image formed considering obstacles.

[0058] Figure 15 This is another example illustrating the formation of an aerial image in the presence of obstacles at the authentication site. (A) is a top view of the site, showing the positional relationship between the person being authenticated and the authentication sensor device, and (B) shows an example of an aerial image formed taking obstacles into account.

[0059] Figure 16 This is a flowchart illustrating the steps of the authentication process performed in Implementation Method 3.

[0060] Figure 17 This is a diagram illustrating the formation of an aerial image corresponding to the security strength of the certified site. (A) shows the position of the aerial image formed in the Nth execution, (B) shows the position of the aerial image formed in the N+1th execution, and (C) shows the position of the aerial image formed in the N+2th execution.

[0061] Figure 18 This is a flowchart illustrating the steps of the authentication process performed in Implementation Method 4.

[0062] Figure 19 This is a diagram showing an example of the structure of the information processing system 1A used in Embodiment 5. Detailed Implementation

[0063] Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings.

[0064] <Implementation Method 1>

[0065] <System Architecture>

[0066] Figure 1 This is a diagram illustrating a structural example of the information processing system 1 used in Embodiment 1.

[0067] Figure 1 The information processing system 1 shown includes: an aerial image forming device 10, which forms an image (hereinafter also referred to as "aerial image") in a manner that floats in the air; a control device 20, which controls the aerial image forming device 10, etc.; a camera 30, which is used to acquire information related to the physical characteristics of the person being authenticated and the environment of the scene where authentication is performed; a communication device 40, which is used to acquire authentication information with an information terminal maintained by the person being authenticated through directional communication; a speaker 50, which is used to notify the results of authentication, etc.; and an authentication sensor device 60, which acquires authentication information from a part of the body of the person being authenticated.

[0068] Furthermore, if the information used for authentication is not obtained from the information terminal, the communication device 40 is not required. Similarly, if the information used for authentication is not obtained from a part of the body of the person being authenticated, the authentication sensor device 60 is not required.

[0069] The information processing system 1 used in Embodiment 1 has a communication device 40 and an authentication sensor device 60 to cope with the acquisition of any information.

[0070] Furthermore, when only images captured by camera 30 are used to obtain information for authentication, both communication device 40 and authentication sensor device 60 are not required.

[0071] In this implementation, the information used for authentication is not limited to individuals, but can also include whether or not someone has permission to enter a room, or permission to use a specific service.

[0072] In this embodiment, the purpose of using the aerial image is to position the object to be authenticated at a specific location, height, orientation, and tilt (hereinafter also referred to as "position, etc.") used in reading the information used for authentication. The position is given, for example, in coordinates in the horizontal plane, and the height is given, for example, in coordinates above the vertical. Furthermore, the orientation is given, for example, in rotation angle with a reference direction in the horizontal plane, and the tilt is given, for example, in rotation angle relative to the vertical direction.

[0073] In other words, the aerial image is used as a marker to locate the object being authenticated. The object being authenticated contains an information terminal, in addition to a part of the body of the person being authenticated.

[0074] For the content of the aerial image in this embodiment, an image corresponding to the object used for authentication is selected. The location where the aerial image is formed is an example of the location of an area from which information is read non-contactly from the object used for authentication.

[0075] exist Figure 1 In the example, the vein on the right hand is used for authentication. Therefore, in Figure 1 In the example shown, an aerial image is formed with the right palm facing the authentication sensor device 60. Furthermore, the aerial image serves as a marker for the person being authenticated; therefore, an image of the back of the right hand is formed in the air. This aerial image formation serves to indicate a specific height and orientation, enabling the acquisition of information for authentication.

[0076] Furthermore, when the face is used for authentication, an aerial image is formed by orienting the head towards a specific height. However, for the person being viewed, aligning the face with the same technique as observing a mirror might be easier to understand. In this case, the aerial image is formed by visually viewing the face rather than the back of the head.

[0077] Since the image in the air is a symbol, it does not necessarily have to be an image of an object used for authentication.

[0078] In this embodiment, the position for forming the aerial image is set based on the position where the authentication sensor device 60 can accurately obtain information for authentication.

[0079] In this embodiment, when the person being authenticated positions themselves by overlapping a part of their body or information terminal with an aerial image, authentication information is obtained via the authentication sensor device 60 or the communication device 40. In this embodiment, the aerial image shows the location from which information is read non-contactly from the object being authenticated.

[0080] The shape of the aerial image used in this embodiment is arbitrary; it can be either a three-dimensional or a two-dimensional shape. Examples of three-dimensional shapes include the shape of a part of a human body, the shape of an information terminal, etc. The same applies to two-dimensional shapes.

[0081] Furthermore, the aerial image formed in the air is not limited to an image of a defined three-dimensional surface; it can also be composed of both an image of a defined three-dimensional surface and an image corresponding to its interior. In other words, for example, it can be said that the aerial image is represented not only by three-dimensional surface data such as voxel data, but also by data that assigns image attributes to the internal structure. The aerial image in this embodiment can be a static image or a dynamic image.

[0082] Furthermore, the aerial image in this embodiment can also be formed for the purpose of visually notifying the target of successful or failed authentication. For example, an aerial image of an open door can be formed in the direction of travel of a successfully authenticated target. On the other hand, an aerial image of a closed door can be formed in the direction of travel of a failed authentication target.

[0083] The aerial image forming apparatus 10 in this embodiment is an apparatus for directly forming aerial images in the air. Various methods have been proposed, and some of them have been put into practical use.

[0084] For example, in the formation of aerial images, there are methods using semi-reflective mirrors, beam splitters, micromirror arrays, microlens arrays, plasma emission, holograms, etc. It is possible to see aerial images generated using these methods.

[0085] The control device 20 includes: a processor 21 that controls the formation of an aerial image based on the aerial image forming apparatus 10 by executing a program; a storage device 22 that stores programs and various data; a network interface (InterFace) 23 that enables communication with the outside world; and a bus and other signal lines 24 that connect the above components. The control device 20 is an example of an information processing device.

[0086] The processor 21 is, for example, a CPU. The storage device 22 is, for example, a ROM (Read Only Memory) storing the BIOS (Basic Input Output System), a RAM (Random Access Memory) used as the working area, and a hard disk device storing basic programs, application programs, etc.

[0087] However, this does not preclude ROM and RAM from being included as part of processor 21. Processor 21 and storage device 22 constitute a computer.

[0088] Camera 30 is used to photograph people surrounding the aerial image. In this embodiment, camera 30 is used to acquire information related to the environment, such as the person's height, age group classification, body orientation, whether they are using a wheelchair, and whether there are obstacles in the space where the aerial image can be formed. The physical characteristics of the person being authenticated and the information related to the environment are examples of the status of the authentication site. Furthermore, the determination of the status of the authentication site is performed in processor 21.

[0089] The communication device 40 is used to obtain authentication information registered and associated with the account information of a person's information terminal through communication with the terminal. The authentication information includes the subject's name, employee number, membership number, fingerprint pattern image, vein pattern image, and other information that identifies the individual. In the case of the communication device 40 in this embodiment, highly directional communication is used for authentication communication. The communication device 40 in this embodiment corresponds to, for example, visible light communication and infrared communication. Furthermore, if the information terminal is equipped with a highly directional antenna, radio wave-based communication is also possible.

[0090] The speaker 50 is used to notify the recipient of the authentication result using sound.

[0091] The authentication sensor device 60 is a device that acquires information for authentication from a part of the subject's body. The information used for authentication varies depending on the environment in which the information processing system 1 is used. In this embodiment, the authentication sensor device 60 uses, for example, information such as veins, fingerprints, palm prints, facial features, irises, and auricles as authentication information. Regarding the authentication sensor device 60, a device corresponding to the information used for authentication is used.

[0092] For example, when a vein pattern is used for authentication, the authentication sensor device 60 consists of an LED (Light Emitting Diode) that illuminates near-infrared light toward the location to be authenticated and a camera that captures an image of the near-infrared light transmitted through or reflected from the object.

[0093] <Authentication Processing>

[0094] Figure 2 This is a flowchart illustrating the steps of the authentication process performed in Implementation Method 1. Figure 2 The processing shown is performed by processor 21 (refer to...) Figure 1 This is achieved by executing the program.

[0095] First, processor 21 determines whether a person exists within a predetermined space (step 1). This space is defined to distinguish the person being authenticated from other people. In the determination in step 1, a camera 30 (see reference...) is used... Figure 1 Images captured, output from a human sensor (not shown), etc. For example, when using images, if a person is detected within a specific area of ​​the captured image, it is determined that an authenticator exists within a predetermined space. Furthermore, in this embodiment, the processor 21 processes the image to determine whether the subject is a human. For example, if the subject is an animal, the processor 21 obtains a negative result in step 1. In this embodiment, a person confirmed to have intruded into the predetermined space is considered an authenticator.

[0096] During the period when a negative result is obtained in step 1, processor 21 repeats the determination in step 1.

[0097] If a positive result is obtained in step 1, the processor 21 acquires information about the physical characteristics of the subject (step 2). In this embodiment, physical characteristics of the subject include, for example, the subject's height, body orientation, age group, whether they use a wheelchair, and whether they wear a cast. Of course, this information is just one example of physical characteristics.

[0098] In this embodiment, one or more of this information are obtained as needed. This information is obtained, for example, through parsing processing by the processor 21, which deals with images captured by the camera 30.

[0099] Furthermore, the method for obtaining information is not limited to image analysis and processing. For example, regarding height, detection involves identifying the position with the highest transverse infrared height among multiple infrared sensors at different heights. In this embodiment, the subject's height is used to set the height of the aerial image formed as the target during authentication; therefore, it is not necessary to obtain a height in a strict sense.

[0100] Furthermore, when setting the orientation and tilt of the aerial image formed in the air based on the orientation of the subject's body, the orientation of the body is taken into account.

[0101] In this embodiment, the age group is used to distinguish between adults and children. Similar to height, it is used to set the position at which the aerial image is formed. However, in a method where the body part used for authentication is switched according to the age group, the obtained age group information is used to change the content of the aerial image to be formed.

[0102] Whether or not a wheelchair is used to set the height of the aerial image. This is because, when a person is using a wheelchair, the height of the aerial image needs to be determined based on their seated position in the wheelchair.

[0103] Furthermore, the question of whether or not a body part is in a cast is relevant because in most cases it is difficult to use a body part in a cast for authentication. For example, if the right hand is in a cast, the movement of the right hand is mostly restricted, and using the right hand to perform authentication may become a burden for the person being authenticated.

[0104] In this embodiment, the feature information is any information that can be determined through image analysis. Furthermore, the image used for analysis is not limited to static images; it can also be a dynamic image. For example, a dynamic image capturing the process of moving into a predetermined space, or an image capturing the actions of a person after entering the predetermined space, can also be used for analysis.

[0105] After obtaining information about the physical characteristics of the subject, the processor 21 sets the position of the aerial image of the subject for performance authentication, etc., based on the obtained characteristics (step 3).

[0106] In this embodiment, the object of authentication is, for example, a specific part of the user's body. For example, the pattern of veins on the user's face, hands, fingers, and palms can be used as the object of authentication. However, as described above, the object of authentication also includes an information terminal. Information identifying the user is transmitted by the communication device 40 via directional communication (see reference). Figure 1 Thus, authentication is achieved using an information terminal. Examples of information terminals include smartphones, tablets, and wearable devices.

[0107] Regarding position, this includes not only horizontal coordinates but also vertical coordinates. For example, the vertical coordinates are set based on the subject's height and wheelchair. For instance, when the subject is an adult, the coordinates are set using the height and horizontal coordinates for locating the adult's face, and the height and horizontal coordinates accessible by the subject's hands. Furthermore, the position of the aerial image can vary each time authentication is performed. For example, even if the subject is the same, a different position can be set each time. Additionally, the orientation and tilt of the aerial image are also set. The orientation and tilt of the aerial image are set to be adjustable by the authentication sensor device 60 (see reference 60). Figure 1 The location of the information is within the range of direction and tilt. This location is also constrained by the authentication sensor device 60 used for authentication.

[0108] In addition, the size of the aerial image is also set. The size of the aerial image is set according to the physique of the subject. This is because, for example, the size of the head and the size of the hands are different for adults and children.

[0109] Once the positions for forming the aerial image are set, the processor 21 sets the aerial image forming apparatus 10 (refer to...). Figure 1 The processor 21 then outputs the data required for the aerial image forming apparatus 10 to form the aerial image (step 4). Figure 1 In the image, as an example of an aerial image, there is an image of the back of a right hand with the fingers spread out.

[0110] Then, processor 21 communicates via communication device 40 (see reference). Figure 1 ), Authentication sensor device 60 (reference) Figure 1 (e.g., to obtain authentication information for the target user and determine whether the authentication was successful (step 5)).

[0111] For example, when authentication uses a part of the body, the successful authentication is considered to be based on the accurate positioning of the part used for authentication by overlapping with the aerial image. Furthermore, for example, when authentication is performed using an information terminal, the successful communication is considered to be based on the accurate positioning of the information terminal by overlapping with the aerial image, and the authentication information is sent from the information terminal to the communication device 40.

[0112] If successful authentication is confirmed in step 5, processor 21 receives a positive result in step 5. Then, processor 21 saves the authentication result to storage device 22 (see reference). Figure 1 (Step 6).

[0113] Furthermore, the processor 21 notifies the recipient of the successful authentication (step 7). In this embodiment, the processor 21 uses aerial images and sounds for the notification.

[0114] In this embodiment, after the notification in step 7, the processor 21 instructs the aerial image forming apparatus 10 that the formation of the aerial image is complete (step 8). When authentication ends, the aerial image disappears from the air, thus concealing the location and orientation used for authentication from the target until authentication begins. By forming an aerial image in the air during each authentication and erasing it from the air after authentication, an improvement in security is expected.

[0115] On the other hand, if authentication failure is confirmed in step 5, the processor 21 obtains a negative result in step 5. In this case, the processor 21 also saves the authentication result to the storage device 22 (step 9).

[0116] In addition, processor 21 notifies the target of the authentication failure (step 10). Similar to the successful authentication case, processor 21 uses an aerial image and sound for notification.

[0117] Following the notification in step 10, the processor 21 instructs the aerial image forming apparatus 10 that the formation of the aerial image is complete (step 8).

[0118] Alternatively, an aerial image can be formed without matching the start and end of the authentication process (the formation of the aerial image does not need to be coordinated with the start and end of the authentication process). That is, an aerial image with a marker indicating the authentication position can always be formed in the air. In this case, steps 4 and 8 are unnecessary.

[0119] <Example of the formation of aerial images>

[0120] The following is a specific example of controlling the position of the aerial image based on the physical characteristics of the person being authenticated.

[0121] <Example 1>

[0122] Figure 3 This is a diagram illustrating the different formation of aerial images when the subject of authentication is an adult and when the subject is a child.

[0123] Furthermore, it is possible to estimate whether the person being authenticated is an adult or a child by analyzing the image captured by camera 30. However, since it is used to determine the location where the aerial image is formed, there is no need to strictly determine the age.

[0124] exist Figure 3 In this system, relatively tall people are denoted as adults, and relatively short people are denoted as children. However, there is significant individual variation in height; some children are taller than adults, while others are shorter than children. Furthermore, even among adults, there is considerable individual variation in height.

[0125] therefore, Figure 3 The relationship between height and age shown is merely one example to illustrate the processing related to the formation of aerial images. Furthermore, through the camera 30 (reference...) Figure 1 The analysis of the captured images is used to estimate whether the subject is an adult or a child.

[0126] In this embodiment, height refers to the height of the top of the head from the ground when wearing shoes. However, it does not need to be the exact top of the head; it can be the approximate height of the head. In this sense, height in this embodiment includes the approximate height of the head.

[0127] exist Figure 3In this case, consider the use of a vein pattern of the hand in authentication. Therefore, as an aerial image, an image of the right hand as observed by the subject is formed. That is, as an aerial image, an image of the back of the right hand is formed so that the subject can observe it.

[0128] exist Figure 3 In the case of an adult being authenticated, the resulting aerial image is larger than the resulting image of a child. This is because the hands of a taller person are larger than the hands of a shorter person.

[0129] In addition, Figure 3 In the process, the height of the aerial image formed when the subject of the authentication is an adult is higher than the height of the aerial image formed when the subject of the authentication is a child. Regarding the height of the aerial image, it is unrelated to age or gender; the aerial image for taller individuals is positioned higher than the aerial image for shorter individuals.

[0130] If both the aerial image forming device 10 and the authentication sensor device 60 can be addressed, it is desirable to form the aerial image at any height based on the subject's height. Alternatively, the aerial image can be formed at a height close to the subject's shoulder, such as when the subject can easily extend their outstretched arm forward. However, while shoulder height is an example, the image could also be formed at head height, in front of the abdomen, or above the knees.

[0131] For example, in cases where someone has difficulty raising their hand to an object due to injury or illness, such as Figure 3 As shown, it is difficult to raise one's hand to shoulder height. On the other hand, if it is above knee height, it can be verified by flipping the hand while the arm is hanging down. In this case, the hand is formed in the air as if the fingers are pointing towards the ground.

[0132] In addition, it is also possible to divide the height of the person being certified into several stages and set the height of the aerial image to the corresponding division.

[0133] Even when the aerial image forming apparatus 10 and the authentication sensor device 60 are technically capable of handling any height, the number of heights that the information processing system 1 can handle is sometimes limited due to various constraints. For example, if four divisions are set as the heights that can be handled, the aerial image is formed at the height corresponding to the division to which the height of the subject is estimated based on images captured by the camera 30, etc.

[0134] <Example 2>

[0135] Figure 4 It is a diagram illustrating the difference in the formation of an aerial image of the person being authenticated when they are in a wheelchair versus when they are standing.

[0136] exist Figure 4 In Example 2, we assume that both the person in the wheelchair and the person standing are adults. However, in Example 2, the age of the individuals is not important.

[0137] exist Figure 4 In the case of an adult being authenticated, even if the person being authenticated is in a wheelchair, the height of the aerial image representing the hand will be set to match the height of the person in the wheelchair. Specifically, it will be set to the height of the thigh of the standing person. In other words, Figure 4 The example shown is an example of controlling the height of the aerial image based on the height of the head of the person in the wheelchair.

[0138] In addition, Figure 4 In this case, the object in the wheelchair is interpreted as an adult. Therefore, the size of the hand shown as an aerial image around the object in the wheelchair is the same as the size of the hand shown as an aerial image to the standing adult.

[0139] In addition, Figure 4 In cases where the person being certified is in a wheelchair, but not while sitting in a shopping cart with a seat or in a chair, such as... Figure 4 As shown, the height of the aerial image can also be adjusted based on the height and posture of the person being authenticated. Posture here includes characteristics related to the body of the person being authenticated. Posture also includes posture while in a wheelchair, sitting on a seat or chair, bending over, and standing.

[0140] <Example 3>

[0141] Figure 5 This diagram illustrates an example of using the information terminal 70 held by the user to perform authentication.

[0142] exist Figure 5 In this case, information for the authentication of the target is sent from the information terminal 70 to the communication device 40 (refer to...) Figure 1 ).exist Figure 5 In this scenario, we envision the information terminal 70 as a smartphone. The size of the smartphone is approximately the same regardless of the subject. Therefore, the size of the smartphone formed as an aerial image is the same whether the subject is an adult or a child.

[0143] exist Figure 5 In this case, infrared light is used in the communication between the information terminal 70 and the communication device 40. Infrared light is directional communication; if the direction of the output infrared light is not accurately directed towards the light-receiving part of the communication device 40, the communication will fail.

[0144] The infrared light receiving part used for authentication can be one, but... Figure 5 In this case, at least two light-receiving units are installed in different locations within the space.

[0145] For example, when the subject of authentication is an adult, the light-receiving part (not shown) is positioned along the extension of the Y-axis. In this case, the information terminal 70 operated by the adult needs to direct the light source that outputs infrared light in the direction of the arrow representing the Y-axis. Therefore, the aerial image when the subject is an adult is formed in a manner parallel to the plane defined by the X-axis and Z-axis.

[0146] Furthermore, when the subject of authentication is a child, the light-receiving part (not shown) is positioned along the extension of the X-axis. In this case, the information terminal 70 operated by the child needs to orient the light source emitting infrared light toward the direction indicated by the arrow representing the X-axis. Therefore, the aerial image when the child is the subject is formed in a manner parallel to the plane defined by the Y-axis and Z-axis.

[0147] The position of the light-receiving unit in space is determined by a combination of its position within a plane defined by the X and Y axes, its height along the Z-axis, and its light-receiving direction. Here, the direction of receiving infrared light is defined not only by the direction within the plane defined by the X and Y axes but also by the direction of inclination along the Z-axis. For example, multiple light-receiving units can be arranged with only different heights. Furthermore, multiple light-receiving units can be arranged with different combinations of position and light-receiving direction. Figure 5 The example shown is an example of a situation where even if the height of the light-receiving part is the same, the position and direction of the light-receiving part are different.

[0148] In addition, the situation is the same as in Example 1. Figure 5 The height of the aerial image is controlled to correspond to the height of the person being authenticated. Furthermore, similar to Example 2, the height at which the person being authenticated can easily locate the information terminal 70 is selected, whether the person is in a wheelchair or standing.

[0149] In addition, Figure 5 In the example shown, the height of the aerial image is controlled based on the height of the person being authenticated. However, if multiple light-receiving units are configured in the space for authentication, the light-receiving unit used for authentication can be changed for each execution. For example, when authenticating two adults continuously, even if the height of the aerial image is the same, the direction and tilt of the aerial image of the information terminal can be different each time. The same applies to children. However, even if the authentication of an adult is performed before the authentication of a child, the aerial image can be formed with different directions and tilts.

[0150] Furthermore, the position of the aerial image can be changed not every time it is executed, but in units of a predetermined number of times. For example, the position of the aerial image can be changed whenever the number of authentications reaches a multiple of 5. In addition, the cycle for changing the position used for authentication can also be changed randomly. For example, the position can be changed after 3 authentications, then after 2 authentications, and then after 5 authentications.

[0151] Furthermore, when multiple individuals are simultaneously undergoing authentication on-site, an aerial image can be created to guide these individuals to easily authenticated locations. An easily authenticated location refers to a place where authentication can be performed without collisions or overlap between individuals; in the case of contactless communication during authentication, it refers to a location where communication is easier.

[0152] Furthermore, when there are multiple individuals being authenticated, a number of aerial images corresponding to each person can be formed in the air. For example, if there are two individuals being authenticated, two aerial images corresponding to each person can be formed in the same space. Similarly, if there are three individuals being authenticated, three aerial images corresponding to each person can be formed in the same space. In this case, the multiple aerial images formed in the air are positioned according to the physical characteristics of each individual and the situation at the scene.

[0153] Furthermore, the frequency of changes to the authentication location can be varied depending on the required security level. For example, when a higher security level is required, the authentication location can be changed more frequently. Alternatively, when a higher security level is required, the authentication location can be changed randomly. By increasing the frequency of changes to the authentication location, predicting the authentication site becomes more difficult, thereby increasing security.

[0154] Alternatively, changes to the location used for authentication can be made based on a predetermined timeframe, regardless of the number of executions. For example, the location could be changed every hour. Furthermore, changes to the location used for authentication can be performed according to a predetermined schedule, regardless of the number of executions.

[0155] <Example 4>

[0156] Figure 6 This diagram illustrates an example of how the position of an aerial image can be changed based on the orientation of the subject's body. (A) shows the case where the subject's line of sight is in the Y-axis direction, and (B) shows the case where the subject's line of sight is in the X-axis direction.

[0157] In addition, Figure 6 In the case of this, it is also envisioned that information from terminal 70 to communication device 40 (refer to...) Figure 1 This involves sending authentication information for the recipient. Furthermore, it is envisioned that the information terminal 70 is a smartphone.

[0158] exist Figure 6 In the case of (A) the subject's height is the same as the subject's height in (B). The difference lies in the subject's body orientation. In this example, the aerial image of the information terminal 70 is formed in the air according to the orientation of the subject's body. In this case, the subject does not need to change their body orientation for authentication. Furthermore, the subject entering the authentication range can begin authentication while maintaining the same body orientation as when entering the corresponding range.

[0159] In addition, Figure 6 The example shown is an example of using information terminal 70 in authentication, but even in cases where a part of the subject's body is used for authentication as in Examples 1 and 2, the formation of the aerial image shown in Example 4 can be applied.

[0160] <Example 5>

[0161] Figure 7 This is a diagram illustrating the progress of authentication using aerial images and an example of successful authentication notification. (A) shows the situation at time point T1 before authentication begins, (B) shows the situation at time point T2 when aerial image formation begins, and (C) shows the situation at time point T3 when authentication ends.

[0162] At time point T1, in order to distinguish between the person being authenticated and others, the person being authenticated did not enter the predetermined space. Therefore, no aerial image was formed in the air.

[0163] When it is determined that the person is the one being authenticated, such as Figure 7 As shown in B, an aerial image is formed around the object, representing an image of an item or part of the body that is the object used to obtain authentication information. Figure 7 In this case, the vein pattern of the right hand is used in the authentication, therefore, the image of the right hand is formed in the air as an aerial image. The formation of the aerial image at this time point T2 is the same as in Examples 1 to 4 above.

[0164] exist Figure 7 In the case where the subject overlaps their right hand with the aerial image, the vein pattern is obtained from the overlapping right hand, and authentication processing is performed. Additionally, an authentication sensor device 60 (not shown) is used (see reference 60). Figure 1 Obtain vein patterns.

[0165] exist Figure 7In this scenario, we assume successful authentication. Therefore, a "bang" sound is output from speaker 50 to notify the recipient of successful authentication. Furthermore, after the sound notification, the aerial image is erased. By erasing the aerial image, the recipient visually recognizes the end of authentication. The content of the sound can be arbitrary, as long as it enables the recipient to recognize successful authentication.

[0166] In addition, Figure 7 In the case of successful authentication via voice notification, the aerial image is removed from the air, but the formation of the aerial image can also be terminated at the point when the vein pattern required for authentication is obtained.

[0167] <Example 6>

[0168] Figure 8 This is another diagram illustrating the progress of authentication using aerial images and the notification of successful authentication. (A) shows the situation at time point T1 before authentication begins, (B) shows the situation at time point T2 when aerial image formation begins, and (C) shows the situation at time point T3 when authentication ends. Figure 8 In China, targeting and Figure 7 The corresponding parts are marked with corresponding labels.

[0169] Figure 8 The content of time points T1 and T2 in the data is the same as... Figure 7 The content at time point T1 and time point T2 is the same.

[0170] The difference lies in the content at time point T3. Figure 8 In this case, notifications are sent not only by sound but also by changes in the color of the aerial image to indicate successful authentication. Figure 8 In the example shown, the color of the aerial image representing the right hand changes to green to notify the recipient of successful authentication. In this case, the recipient can confirm the successful authentication not only through sound but also visually. Furthermore, the color used for successful authentication is one example; it could also be blue. Additionally, after a predetermined time has elapsed, the green aerial image disappears from the sky.

[0171] <Example 7>

[0172] Figure 9 This is another diagram illustrating the progress of authentication using aerial images and the notification of successful authentication. (A) shows the situation at time point T1 before authentication begins, (B) shows the situation at time point T2 when aerial image formation begins, and (C) shows the situation at time point T3 when authentication ends. Figure 9 In China, targeting and Figure 7 The corresponding parts are marked with corresponding labels.

[0173] exist Figure 9 In this case, the content at time point T1 and time point T2 is also the same as... Figure 7 The content at time point T1 and time point T2 is the same.

[0174] The difference lies in the content at time point T3. Figure 9 In this case, when authentication is successful, not only will a notification be sent via sound, but an air image containing a string indicating successful authentication will also be formed in the air. Figure 9 In the example shown, at the moment of successful authentication, the content of the aerial image is switched from an image representing the back of the right hand to a plate-shaped image displaying the word "success".

[0175] In this case, the recipient can confirm the success of the authentication not only by sound but also by the characters. Furthermore, after a predetermined period, the aerial image containing the characters is erased from the air.

[0176] <Example 8>

[0177] Figure 10 This diagram illustrates the progress of authentication using aerial images and provides examples of authentication failure notifications. (A) shows the case where aerial image formation begins at time T2, and (B) shows the case where authentication ends at time T3. Figure 10 In China, targeting and Figure 7 The corresponding parts are marked with corresponding labels.

[0178] exist Figure 10 In this text, time point T1 is omitted, and the explanation begins from time point T2. Figure 10 The content of time point T2 and Figure 7 The content at time point T2 is the same.

[0179] The difference is Figure 10 In this case, authentication ends in failure. Therefore, in Figure 10 At time T3, the sound "Bu Bu" is output from speaker 50. For this sound, a different sound than the successful one is selected. The recipient who hears the "Bu Bu" sound recognizes their authentication as a failure and the process ends. Alternatively, any sound that can be used to identify failure can also be selected.

[0180] exist Figure 10 In addition to notification via sound, the system also uses changes in the color of aerial images to indicate authentication failure. Figure 10In the example, the color of the aerial image representing the back of the right hand changes to red, notifying the recipient of authentication failure. In this case, the recipient recognizes the authentication failure not only through sound but also through sight. Furthermore, the color used to indicate authentication failure is unique; for example, it could also be black. Additionally, after a predetermined time, the red aerial image is removed from the sky.

[0181] <Example 9>

[0182] Figure 11 This is another diagram illustrating the progress of authentication using aerial images and notification of authentication failure. (A) shows the situation at time point T2 when aerial image formation begins, and (B) shows the situation at time point T3 when authentication ends. Figure 11 In China, targeting and Figure 10 The corresponding parts are marked with corresponding labels.

[0183] exist Figure 11 In this case, the content at time point T2 is also related to Figure 10 The content at time point T2 is the same.

[0184] The difference lies in the content at time point T3. Figure 11 In this case, when authentication fails, a notification is sent not only by sound but also by an air image containing a string indicating the authentication failure. Figure 11 In the example shown, at the point of authentication failure, the content of the aerial image is switched from an image representing the back of the right hand to a plate-shaped image displaying the word "failure".

[0185] In this case, the target party identifies authentication failure not only by sound but also by characters. Furthermore, after a predetermined time has elapsed, the aerial image containing the characters is erased from the air.

[0186] <Example 10>

[0187] Figure 12 This is another diagram illustrating the progress of authentication using aerial images and notification of authentication failure. (A) shows the situation at time point T2 when aerial image formation begins, and (B) shows the situation at time point T3 when authentication ends. Figure 12 In China, targeting and Figure 10 The corresponding parts are marked with corresponding labels.

[0188] The difference lies in the content at time point T3. Figure 12 In this case, the failure to authenticate is not only notified by sound, but also by the formation of an aerial image indicating the authentication failure. Figure 12In this case, an aerial image of a door in a closed state is formed in the direction in front of the person moving. Similar to automatic ticket checking, the person seeing the closed door visually understands that authentication has failed.

[0189] Of course, the image used to notify of authentication failure is just one example; it could also be an aerial image representing a cliff or a damaged bridge. Additionally, it could be an aerial image of a puddle, a river crossing in front of you, a muddy road, or something that makes you hesitate to proceed. Furthermore, it could be an image of a dangerous creature.

[0190] For example, people instinctively stop when they see an object like a cliff or a damaged bridge, resulting in authentication failure. The same applies to puddles, dangerous creatures, etc. Alternatively, dynamic images can be used to notify of authentication failure.

[0191] in addition, Figure 12 The illustrated aerial images can also be applied to notifications of successful authentication. For example, in the case of successful authentication, an aerial image showing a door opening can be created as a dynamic image. The recipient seeing the door open visually understands the success of the authentication. Furthermore, an aerial image can also be created as a dynamic image showing a lock opening and a door opening, or a cover opening. Of course, static images can also be used in the same way as in notifications of failed authentication.

[0192] <Example 11>

[0193] Furthermore, tactile stimulation is used in notifications of successful or failed authentication. In cases where tactile stimulation is used for notifications, the control device 20 (see reference) Figure 1 This connects to an ultrasonic haptic interface device. The ultrasonic haptic interface device consists of an ultrasonic transducer array, which arranges multiple ultrasonic transducers in a grid pattern. The ultrasonic haptic interface device generates ultrasonic waves by connecting the focal point to the subject's body. When the ultrasonic transducer array operates, pressure, known as acoustic radiation pressure, is generated in a specific area where the ultrasonic waves are concentrated. As a result, a tactile stimulus, such as a surface being pressed, is generated at the location where the acoustic radiation pressure is generated. By changing the intensity and pattern of the tactile stimulus in cases of successful and unsuccessful authentication, the authentication result can be communicated to the subject even without using sound or aerial images.

[0194] <Implementation Method 2>

[0195] Next, Embodiment 2 will be described. The system structure used in Embodiment 2 is the same as that in Embodiment 1. That is, information processing system 1 (see...) is used. Figure 1 ).

[0196] In the case of embodiment 1, the camera 30 (see reference) Figure 1In this embodiment, information related to the physical characteristics of the person being authenticated is obtained from the captured images, and information related to the environment of the authentication site is also obtained.

[0197] Figure 13 This is a flowchart illustrating the steps of the authentication process performed in Implementation Method 2. Figure 13 The processing shown is performed by processor 21 (refer to...) Figure 1 This is achieved by executing the program. Additionally, in Figure 13 In China, targeting and Figure 2 The corresponding parts are marked with corresponding labels.

[0198] First, processor 21 determines whether a person exists in the predetermined space (step 1). During the period when a negative result is obtained in step 1, processor 21 repeats the determination in step 1.

[0199] If a positive result is obtained in step 1, the processor 21 acquires information related to the environment of the authentication site (step 11). In this embodiment, the information related to the environment of the authentication site includes, for example, whether there are obstacles that would hinder the formation of an aerial image or the acquisition of information for authentication. These obstacles include, in addition to temporarily installed objects such as billboards or displays, people other than the person being authenticated.

[0200] When these obstacles are present, the space in which an aerial image can be formed may be limited. Furthermore, even if there are no constraints in the space in which an aerial image can be formed, the communication device 40 (see reference) Figure 1 ), Authentication sensor device 60 (reference) Figure 1 The spatial location from which information for authentication can be obtained may also be limited.

[0201] In this embodiment, the processor 21 obtains information related to obstacles that may hinder authentication, for example, by parsing the image captured by the camera 30 as the object.

[0202] Furthermore, methods for obtaining information related to obstacles are not limited to image analysis and processing. For example, sensors pre-configured on-site can also be used to detect obstacles.

[0203] When information related to the environment at the scene is obtained, the processor 21 sets the position, etc., for forming an aerial image representing the object to be authenticated based on the obtained information (step 12). As with embodiment 1, the object to be authenticated can be a specific part of the person's body or an information terminal carried by the person.

[0204] In this embodiment, an aerial image is formed within a space that is not affected by obstacles that would hinder authentication. However, as described in Embodiment 1, information about the subject's physical characteristics can be combined to set the location for forming the aerial image in a manner that is as convenient as possible for the subject.

[0205] When the settings for the position, etc., of forming the aerial image are completed, the processor 21 sends a signal to the aerial image forming apparatus 10 (see reference). Figure 1 (Step 4) indicates the formation of an aerial image. The processing after Step 4 is the same as in Implementation Method 1.

[0206] Figure 14 This diagram illustrates the formation of an aerial image in the presence of obstacles at the authentication site. (A) is a top view of the site, showing the positional relationship between the person being authenticated and the authentication sensor devices 60A and 60B. (B) shows an example of an aerial image formed considering obstacle 80.

[0207] exist Figure 14 Consider the following scenario: Two authentication sensor devices 60A and 60B exist on-site, with an obstacle 80 between the person being authenticated and the authentication sensor device 60B. In this case, obtaining the authentication information using the authentication sensor device 60B is physically difficult.

[0208] Therefore, in Figure 14 In this context, a sensor device 60A, whose authentication is unaffected by obstacles 80, is used for authentication. Regarding this, in... Figure 14 In this case, an aerial image of the right hand is formed between the person being authenticated and the authentication sensor device 60A. When the person overlaps their right hand with the aerial image, the vein pattern is read by the authentication sensor device 60A and processed by the processor 21 (see reference). Figure 1 Perform authentication.

[0209] Figure 15 This diagram illustrates another example of aerial image formation in the presence of obstacles at the authentication site. (A) is a top view of the site, showing the positional relationship between the person being authenticated and the authentication sensor devices 60A and 60B; (B) shows an example of an aerial image formed considering obstacle 80. Figure 15 In China, targeting and Figure 14 The corresponding parts are marked with corresponding labels.

[0210] exist Figure 15 In this case, two certification sensor devices, 60A and 60B, were also present on site. However, in Figure 15In this case, an obstacle 80 exists between the person being authenticated and the authentication sensor device 60A. In this example, obtaining the information used for authentication using the authentication sensor device 60A is also physically difficult.

[0211] Therefore, in Figure 15 In this context, the authentication sensor device 60B, which is unaffected by obstacles 80, is used for authentication. Regarding this, in... Figure 15 In this case, the aerial image of the right hand will be formed between the person being authenticated and the authentication sensor device 60B.

[0212] <Implementation Method 3>

[0213] Next, Embodiment 3 will be described. The system structure used in Embodiment 3 is the same as that in Embodiment 1. That is, information processing system 1 (see...) is used. Figure 1 ).

[0214] In the case of implementation method 3, information related to the security strength required during certification is used as the condition of the site where certification is performed.

[0215] Figure 16 This is a flowchart illustrating the steps of the authentication process performed in Implementation Method 3. Figure 16 The processing shown is performed by processor 21 (refer to...) Figure 1 This is achieved through program execution. Additionally, in Figure 16 In China, targeting and Figure 2 The corresponding parts are marked with corresponding labels.

[0216] First, processor 21 determines whether a person exists in the predetermined space (step 1). During the period when a negative result is obtained in step 1, processor 21 repeats the determination in step 1.

[0217] If a positive result is obtained in step 1, the processor 21 obtains information related to the required security strength (step 21). For security strength, one of several stages is set, for example, one of three stages: weak, moderate, and strong. In this embodiment, the security strength affects the change of the location for forming the aerial image. For example, with a higher security strength, the frequency of location changes increases. Furthermore, with a higher security strength, the randomness of the location used for authentication increases. Specifically, instead of changing locations in a pre-prepared order, the location for forming the aerial image is randomly selected from all possible locations.

[0218] After obtaining information related to security strength, the processor 21 sets the position, size, and orientation of the aerial image of the object to be authenticated based on the obtained information (step 22). Similar to embodiment 1, the object to be authenticated can be a specific part of the subject's body or an information terminal carried by the subject.

[0219] When the settings for the position, etc., of forming the aerial image are completed, the processor 21 sends a signal to the aerial image forming apparatus 10 (see reference). Figure 1 (Step 4) indicates the formation of an aerial image. The processing after Step 4 is the same as in Implementation Method 1.

[0220] Figure 17 This is a diagram illustrating the formation of an aerial image corresponding to the security strength of the certified site. (A) shows the position of the aerial image formed in the Nth execution (hereinafter referred to as "Execution #N"), (B) shows the position of the aerial image formed in the (N+1)th execution (hereinafter referred to as "Execution #N+1"), and (C) shows the position of the aerial image formed in the (N+2)th execution (hereinafter referred to as "Execution #N+2").

[0221] Figure 17 The example shown represents a high level of security. Therefore, the position of the aerial image is changed each time authentication is performed.

[0222] Furthermore, in the case of executing #N, the aerial image representing the right hand will be formed parallel to the plane defined by the X and Z axes. In this case, the back of the right hand faces the object.

[0223] In the case of executing #N+1, the aerial image representing the right hand will be formed parallel to the plane defined by the X and Y axes. In this example, the palm of the right hand faces the ground side.

[0224] In the case of executing #N+2, the aerial image representing the right hand will be formed parallel to the plane defined by the Y and Z axes. In this example, the palm of the right hand faces the right side of the figure.

[0225] Regardless of whether the objects of each execution are the same or different, whether they are adults or children, the orientation of the aerial image is changed, thereby requesting authentication of the orientation corresponding to each execution.

[0226] Furthermore, in this embodiment, the technologies described in Embodiments 1 and 2 above can be combined.

[0227] <Implementation Method 4>

[0228] In this embodiment, another example is described where information related to the security strength required for certification is used as the site conditions for certification.

[0229] In Implementation 3, it was explained that even with a low security level, an aerial image is formed in the air each time authentication is performed, and the aerial image is removed from the air at the end of authentication. In this implementation, an aerial image is always formed in the air even when the security level is lower than a predetermined threshold.

[0230] Figure 18 This is a flowchart illustrating the steps of the authentication process performed in Implementation Method 4. Figure 18 The processing shown is performed by processor 21 (refer to...) Figure 1 This is achieved through program execution. Additionally, in Figure 18 In China, targeting and Figure 16 The corresponding parts are marked with corresponding labels.

[0231] First, processor 21 obtains information related to the required security strength (step 21).

[0232] After obtaining information related to security strength, processor 21 determines whether the obtained security strength is above the threshold (step 23).

[0233] If a positive result is obtained in step 23, the processor 21 determines whether a person exists in the predetermined space (step 1).

[0234] During the period when a negative result is obtained in step 1, processor 21 repeats the determination in step 1.

[0235] If a positive result is obtained in step 1, the processor 21 sets the position, etc., of the aerial image representing the authenticated object based on the obtained security level (step 22). This setting also includes the size of the aerial image. Furthermore, since step 22 is performed under a higher security level, the settings such as the position of the aerial image are changed more frequently. Subsequent processing is the same as in embodiment 3.

[0236] On the other hand, if a negative result is obtained in step 23, the processor 21 sets the position, size, and orientation of the aerial image of the object used for authentication based on the obtained security strength (step 24). However, the frequency of updating the position, etc. settings in step 24 is lower than in step 22. This is because the security strength is lower. In the case of lower security strength, an aerial image is always formed; therefore, the processor 21 determines whether the authentication is successful without indicating the formation of the aerial image (step 5).

[0237] If authentication is successful, processor 21 receives a positive result in step 5. In this case, processor 21 saves the authentication result and notifies the recipient of the successful authentication (steps 6 and 7). Unlike other implementations, the formation of the aerial image is maintained even after step 7 is executed. Therefore, if the color of the aerial image is changed in the notification in step 7, the change to the aerial image is reset at a predetermined time point. Even if the aerial image formed in the air is changed to an aerial image indicating successful authentication, an aerial image indicating the parts used for authentication, etc., is returned.

[0238] On the other hand, in the event of authentication failure, processor 21 obtains a negative result in step 5. In this case, processor 21 saves the authentication result and notifies the target of the authentication failure (steps 9 and 10). After executing step 10, the formation of the aerial image is also maintained. Therefore, if the color of the aerial image is changed in the notification of step 10, the change of the aerial image is reset at a predetermined time point. Furthermore, even if the aerial image formed in the air is changed to an aerial image indicating authentication failure, the aerial image representing the part used for authentication is returned.

[0239] <Implementation Method 5>

[0240] In this embodiment, the information processing system 1 (refer to) described in the above embodiments will be explained. Figure 1 (This refers to the authentication of image forming apparatuses.)

[0241] Figure 19 This is a diagram illustrating a structural example of the information processing system 1A used in Embodiment 5. Figure 19 In China, targeting and Figure 1 The corresponding parts are marked with corresponding labels.

[0242] exist Figure 19 In the information processing system 1A shown, an image forming apparatus 90 is added as an example of an authentication request device. The image forming apparatus 90 is communicatively connected to the control device 20 and receives notification of whether the authentication was successful. If the authentication is successful, the image forming apparatus 90 authorizes use within the scope of the permissions granted to the user.

[0243] The image forming apparatus 90 in this embodiment is provided with multiple functions, including the function of reading the image of the original document, the function of forming an image on paper, and the function of controlling fax communication.

[0244] The hardware used to read images from original documents is also called a scanner or image reading device. The hardware used to create images on paper is also called a printer. The hardware used to control fax communication is also called a fax machine.

[0245] exist Figure 19 In this case, each component constituting the information processing system 1A is depicted as a device independent of the image forming apparatus 90, but the control device 20 may also be built into the image forming apparatus 90. Furthermore, any one or more of the aerial image forming apparatus 10, camera 30, communication device 40, speaker 50, and authentication sensor device 60 may also be included in the image forming apparatus 90.

[0246] Furthermore, the image forming apparatus 90 does not need to have all of the above functions, or it may only have some of the functions, or it may only have specific functions.

[0247] <Other Implementation Methods>

[0248] The embodiments of this disclosure have been described above, but the technical scope of this disclosure is not limited to the scope described in the above embodiments. As can be seen from the claims, embodiments with various modifications or improvements to the above embodiments are also included within the technical scope of this disclosure.

[0249] For example, in the above embodiment, the aerial image forming apparatus 10 (refer to...) Figure 1 ) and control device 20 (refer to) Figure 1 The aerial image forming device 10 and the control device 20 are described as independent devices, but they can also be an integrated device.

[0250] Furthermore, the control device 20 in the above embodiments can be a computer, a smartphone or other information terminal, or a server set up on the Internet.

[0251] In the above embodiments, it is envisioned that when an object for authentication is located in an aerial image, the authentication result is obtained in a short time. However, if the authentication process takes time, an aerial image can also be generated to notify that authentication takes time, or to notify of the time required for authentication. Of course, this notification is not limited to an aerial image-based notification; it can also be a sound-based notification or a notification based on other methods.

[0252] The processor 21 in the above embodiments (refer to) Figure 1The term "processor" refers to processors in a broad sense, including not only general-purpose processors (such as CPUs (Central Processing Units)) but also dedicated processors (such as GPUs (Graphical Processing Units), ASICs (Application Specific Integrated Circuits), FPGAs (Field Programmable Gate Arrays), and program logic devices).

[0253] Furthermore, the actions of the processor in the above embodiments can be executed by a single processor, or they can be executed collaboratively by multiple processors located in physically separate positions. Moreover, the order in which the actions of the processor are executed is not limited to the order described in the above embodiments and can be changed individually.

Claims

1. An information processing apparatus, wherein the information processing apparatus has a processor, the processor controls change of an image formed in air indicating a position at which information is read from an object for authentication in a non-contact manner, according to a situation of a site of the authentication, the processor changes the position at which the image is formed in accordance with an orientation of a body of a subject of the authentication, in a case where the situation of the site of the authentication is a feature related to the body.

2. An information processing apparatus, wherein the information processing apparatus has a processor, the processor controls change of an image formed in air indicating a position at which information is read from an object for authentication in a non-contact manner, according to a situation of a site of the authentication, the processor changes the position at which the image is formed to a position at which a situation in which reading of the information is hindered can be avoided, in a case where the situation of the site of the authentication is an environment on a site side.

3. An information processing apparatus, wherein the information processing apparatus has a processor, the processor controls change of an image formed in air indicating a position at which information is read from an object for authentication in a non-contact manner, according to a situation of a site of the authentication, the situation of the site of the authentication is a required security strength.

4. The information processing apparatus according to claim 3, wherein the processor changes the position at which the image is formed at a high frequency, in a case where the required security strength is high.

5. The information processing apparatus according to claim 3, wherein the processor changes the position at which the image is formed randomly, in a case where the required security strength is high.

6. The information processing apparatus according to claim 4 or 5, wherein the processor does not form the image before authentication is started.

7. An information processing apparatus, wherein the information processing apparatus has a processor, the processor controls change of an image formed in air indicating a position at which information is read from an object for authentication in a non-contact manner, according to a situation of a site of the authentication, the processor forms the image that guides a plurality of persons present at the site at which the authentication is performed to a place at which authentication is easy, in a case where the plurality of persons are present at the site at which the authentication is performed.

8. A computer-readable medium storing a program that causes a computer to execute processing, wherein in the processing, change of an image formed in air indicating a position at which information is read from an object for authentication in a non-contact manner is controlled according to a situation of a site of the authentication, the position at which the image is formed is changed in accordance with an orientation of a body of a subject of the authentication, in a case where the situation of the site of the authentication is a feature related to the body.

9. A computer-readable medium storing a program that causes a computer to execute processing, wherein in the processing, change of an image formed in air indicating a position at which information is read from an object for authentication in a non-contact manner is controlled according to a situation of a site of the authentication, the position at which the image is formed is changed to a position at which a situation in which reading of the information is hindered can be avoided, in a case where the situation of the site of the authentication is an environment on a site side. In a case where the situation of the authentication site is an environment on the site side, the position at which the image is formed is changed to a position at which a situation that hinders reading of the information can be avoided.

10. A computer-readable medium storing a program that causes a computer to execute a process, wherein in the process, in a case where an image formed in the air indicates a position at which information is read from an object for authentication in a non-contact manner, the change of the image is controlled in accordance with a situation of the authentication site, the situation of the authentication site is a required security strength.

11. A computer-readable medium storing a program that causes a computer to execute a process, wherein in the process, in a case where an image formed in the air indicates a position at which information is read from an object for authentication in a non-contact manner, the change of the image is controlled in accordance with a situation of the authentication site, in a case where a plurality of persons are present at the site at which the authentication is performed, the image that guides the plurality of persons to a place at which authentication is easy is formed.

12. A computer program product including a program that causes a computer to execute a process, wherein in the process, in a case where an image formed in the air indicates a position at which information is read from an object for authentication in a non-contact manner, the change of the image is controlled in accordance with a situation of the authentication site, in a case where the situation of the authentication site is a feature related to a body of a subject of authentication, the position at which the image is formed is changed in accordance with an orientation of the body of the subject of authentication.

13. A computer program product including a program that causes a computer to execute a process, wherein in the process, in a case where an image formed in the air indicates a position at which information is read from an object for authentication in a non-contact manner, the change of the image is controlled in accordance with a situation of the authentication site, in a case where the situation of the authentication site is an environment on the site side, the position at which the image is formed is changed to a position at which a situation that hinders reading of the information can be avoided.

14. A computer program product including a program that causes a computer to execute a process, wherein in the process, in a case where an image formed in the air indicates a position at which information is read from an object for authentication in a non-contact manner, the change of the image is controlled in accordance with a situation of the authentication site, the situation of the authentication site is a required security strength.

15. A computer program product including a program that causes a computer to execute a process, wherein in the process, in a case where an image formed in the air indicates a position at which information is read from an object for authentication in a non-contact manner, the change of the image is controlled in accordance with a situation of the authentication site, in a case where a plurality of persons are present at the site at which the authentication is performed, the image that guides the plurality of persons to a place at which authentication is easy is formed.

Images