Information processing system, information processing device, information processing method, and recording medium

The information processing system improves biometric authentication accuracy by determining the reflection state of biological information and adjusting the lens position to avoid occlusion, ensuring precise iris detection and enhanced authentication.

WO2024247251A1PCT designated stage expired Publication Date: 2024-12-05NEC CORP
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
PCT/JP2023/020618
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-06-02
Publication Date
2024-12-05

AI Technical Summary

Technical Problem

Existing biometric authentication technologies face challenges in obtaining biometric information with high accuracy, particularly when iris information is obscured by eyelids, leading to difficulties in detecting precise biometric data.

Method used

An information processing system and method that includes a photographing state determination unit to assess the reflection state of biological information in images and a display control mechanism to adjust the positional relationship between the camera lens and display information, ensuring accurate detection of iris information by moving the display content to avoid occlusion by eyelids.

Benefits of technology

The system achieves higher accuracy in capturing biometric data by dynamically adjusting the lens position and display content to ensure clear iris images, even when partially obscured, thereby enhancing the authentication process.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure JP2023020618_05122024_PF_FP_ABST
    Figure JP2023020618_05122024_PF_FP_ABST
Patent Text Reader

Abstract

The present invention determines the state of imprinting biological information in a captured image. The positional relationship between the position of a lens of an image capturing device that generates the captured image and a display position of display information is controlled on the basis of the state of imprinting.
Need to check novelty before this filing date? Find Prior Art

Description

Information processing system, information processing device, information processing method, and storage medium

[0001] The present disclosure relates to an information processing system, an information processing device, an information processing method, and a storage medium.

[0002] There is a technology in which an object is photographed with a camera and authentication is performed based on biometric information captured in the photographed image. A related technology is disclosed in Patent Document 1.

[0003] Patent Document 1 discloses a technology for estimating personal information (gender and age) of a subject from an image of the subject's face and displaying information appropriate for the subject based on the personal information.

[0004] JP 2014-232958 A

[0005] When biometric authentication is performed using the above-described techniques, it is necessary to acquire biometric information with higher accuracy.

[0006] An object of this disclosure is to provide an information processing system, an information processing device, an information processing method, and a storage medium that solve the above-mentioned problems.

[0007] According to a first aspect of this disclosure, the information processing system includes a photographing condition determination means for determining the state of reflection of biometric information in a photographed image, and a display control means for controlling the positional relationship between the position of a lens of a photographing device that generates the photographed image based on the state of reflection and the display position of the display information.

[0008] According to a second aspect of this disclosure, the information processing device includes a photographing state determination means for determining the state of reflection of biometric information in a photographed image, and a display control means for controlling the positional relationship between the position of a lens of a photographing device that generates the photographed image based on the state of reflection and the display position of the display information.

[0009] According to a third aspect of this disclosure, the information processing method determines the state of reflection of biometric information in a captured image, and controls the positional relationship between the position of the lens of a photographing device that generates the captured image and the display position of the display information based on the state of reflection.

[0010] According to a fourth aspect of this disclosure, the storage means stores a program that causes the computer of the information processing system to function as a shooting condition determination means that determines the state of reflection of biometric information in a captured image, and a display control means that controls the positional relationship between the position of the lens of the shooting device that generates the captured image based on the state of reflection and the display position of the display information.

[0011] FIG. 1 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. FIG. 2 is a hardware configuration diagram of an information processing device according to an embodiment of the present disclosure. FIG. 3 is a schematic configuration diagram of a display device according to an embodiment of the present disclosure. FIG. 4 is a functional block diagram of an information processing device according to an embodiment of the present disclosure. FIG. 5 is a diagram showing a portion of data stored in a storage device according to an embodiment of the present disclosure. FIG. 6 is a diagram showing a processing flow of an information processing device according to an embodiment of the present disclosure. FIG. 7 is a diagram showing an example of control of display information according to an embodiment of the present disclosure. FIG. 8 is a diagram showing another example of the display mode of display information according to an embodiment of the present disclosure. FIG. 9 is a functional block diagram showing the minimum configuration of an information processing device according to an embodiment of the present disclosure. FIG. 10 is a diagram showing a processing flow by an information processing device with a minimum configuration according to an embodiment of the present disclosure.

[0012] FIG. 1 is a functional block diagram of an information processing system according to an embodiment of the present disclosure. The information processing system 100 is configured by an information processing device 10 communicatively connected to an image capturing device 20, a display device 30, and a storage device 40. The information processing device 10 controls the position at which the display device 30 displays display information based on a captured image acquired from the image capturing device 20. The image capturing device 20 captures an image that includes predetermined biometric information of a person being captured within the capture range. In this disclosure, the biometric information is iris information. The display device 30 displays display information identified by the information processing device 10 at a predetermined position. The storage device 40 stores various information used by the information processing device 10.

[0013] 2 is a hardware configuration diagram of an information processing device according to an embodiment of the present disclosure. As shown in FIG. 2, the information processing device 10 is a computer including various hardware components such as a CPU (Central Processing Unit) 101, a ROM (Read Only Memory) 102, a RAM (Random Access Memory) 103, a HDD (Hard Disk Drive) 104, and a communication module 105. The image capturing device 20, the display device 30, and the storage device 40 may also have similar functions. The storage device 40 may be a database.

[0014] FIG. 3 is a schematic diagram of a display device according to an embodiment of the present disclosure. The display device 30 is, for example, a liquid crystal display. The display device 30 according to the present disclosure has a lens 32 provided within a display area 31 of the liquid crystal display. Alternatively, the display device 30 may have the lens 32 provided outside the display area 31 of the liquid crystal display. The display device 30 has a display area 31 and a lens position set so that, when a person to be photographed views display information 33 displayed in the display area 31, the iris, which is an example of the person's biometric information, can be accurately captured. The display device 30 may project the display information 33 onto the display area 31 after setting the positional relationship between the display area 31 and the lens position. The display device 30 is installed, for example, at a station ticket gate or a store entrance / exit, and captures predetermined biometric information of the person to be photographed.

[0015] 4 is a functional block diagram of an information processing device according to an embodiment of the present disclosure. A CPU 101 of the information processing device 10 executes a pre-stored program. As a result, the information processing device 10 performs the functions of an image acquisition unit 11, a display information identification unit 12, a display control unit 13, a shooting state determination unit 14, a display content update unit 15, and an authentication processing unit 16.

[0016] The image acquisition unit 11 acquires an image from the photographing device 20. The display information specification unit 12 specifies display information to be displayed on the display device 30. The display control unit 13 controls the positional relationship between the position of the lens of the photographing device that generates the photographed image based on the state of biometric information reflected in the photographed image and the display position of the display information. For example, when iris information cannot be detected accurately, the display control unit 13 controls the positional relationship between the position of the lens and the display information to an extent that the iris information can be detected.

[0017] The photographing state determination unit 14 determines the state of biometric information reflected in the photographed image. When the biometric information is the iris of the subject, the photographing state determination unit 14 determines the state of the iris reflected in the photographed image. For example, the photographing state determination unit 14 determines whether the iris is covered by the eyelid, making it impossible to accurately detect iris information.

[0018] The display content update unit 15 updates the display content of the display information based on the degree of reaction, such as the state of interest, of the subject having the biometric information to the display information.

[0019] By being equipped with the above-mentioned functions, the information processing device 10 can control the positional relationship between the position of the lens of the photographing device that generates the photographed image based on the state of the biometric information reflected in the photographed image and the display position of the displayed information, so as to acquire biometric information with higher accuracy.

[0020] FIG. 5 is a diagram showing part of the data stored in the storage device. The storage device 40 stores an advertisement table and an iris table. The advertisement table stores attribute information of the subject identified from, for example, a face image, which is one form of biometric information, an identifier of display information identified by the attribute information, and the actual state of the display information, in association with each other. When the display information is an advertisement, the identifier of the display information is an advertisement ID. The advertisement table may be a data table that stores a user ID indicating the person being photographed, identified from a face image, etc., an advertisement ID, and display information in association with each other. The storage device 40 may store multiple different pieces of display information. The iris table stores user IDs and biometric information (iris information) of the person (subject) identified by the user ID.

[0021] (First embodiment) FIG. 6 is a diagram showing a processing flow of an information processing device. FIG. 7 is a diagram showing an example of control of display information. The processing flow of the information processing device will be explained step by step below. First, when the image capturing device 20 detects a person who is the subject of the image capturing, it captures the person. The subject of the image capturing may be detected by an infrared sensor or the like provided in the image capturing device 20. The image capturing device 20 outputs captured images generated by the image capturing to the information processing device 10. The image capturing device 20 may capture multiple images of the subject every 10 milliseconds, for example, and output the captured images generated by each of the multiple images to the information processing device 10. The subject captured by the image capturing device 20 may be the area of ​​the face in which the iris of the eye is reflected.

[0022] The display information identification unit 12 of the information processing device 10 acquires a captured image from the imaging device 20 (step S101). The display information identification unit 12 estimates attributes of the person being photographed from the face appearing in the captured image (step S102). In this disclosure, the gender and age of the person being photographed are estimated. More specifically, the display information identification unit 12 inputs the captured image into a pre-generated attribute estimation model and outputs the resulting gender and age. The attribute estimation model that outputs gender and the attribute estimation model that outputs age may be different models. The attribute estimation model that outputs gender is a learning model generated by machine learning the relationship between the face image and correct answer data for gender. The attribute estimation model that outputs age is a learning model generated by machine learning the relationship between the face image and correct answer data for age.

[0023] The display information identification unit 12 identifies an advertisement ID linked to the output attribute information including age and gender from the advertisement table (step S103). The display information identification unit 12 outputs the advertisement ID to the display control unit 13. The display control unit 13 specifies that display information corresponding to the advertisement ID should be displayed on the display device 30. The display control unit 13 acquires the display information corresponding to the identified advertisement ID from the advertisement table and outputs it to the display device 30 (step S104). The display device 30 displays the display information input from the information processing device 10. By displaying the display information on the display device 30, the person to be photographed is more likely to view the display information displayed near the lens 32, which enables the imaging device 20 to accurately photograph the iris of the person to be photographed who is looking in the direction of the lens 32.

[0024] In the above-described step S102, the attributes of the person being photographed are estimated, but the ID of the person may be identified based on the face appearing in the photographed image. In this case, in step S103, the display information identification unit 12 may identify an advertisement ID recorded in the advertisement table in association with the ID of the person. The subsequent flow of displaying the display information is similar.

[0025] The shooting state determination unit 14 detects that the display control unit 13 has output the display information to the display device 30. The shooting state determination unit 14 waits to reacquire the captured image. The image acquisition unit 11 acquires the captured image generated by the shooting device 20 after the display information has been displayed on the display device 30 (step S105). The image acquisition unit 11 outputs the captured image to the shooting state determination unit 14. The shooting state determination unit 14 determines the state of the iris of the eye reflected in the captured image (step S106).

[0026] For example, the shooting state determination unit 14 determines whether the iris information cannot be detected accurately because the iris is covered by the eyelid. The shooting state determination unit 14 may determine that the iris information cannot be detected accurately when a portion of the circular iris is covered by the eyelid. This processing by the shooting state determination unit 14 may be performed by image processing. The shooting state determination unit 14 may input an image including the iris of the eye into a determination model and determine whether the iris information cannot be detected accurately based on the result of the determination as to whether the accuracy is good or not. The determination model may be, for example, a learning model generated by machine learning the relationship between an image including the iris and correct answer information indicating whether the iris can be detected accurately from that image.

[0027] The photographing state determination unit 14 outputs a determination result indicating whether or not the iris information cannot be detected accurately to the display control unit 13. When the display control unit 13 obtains a determination result indicating that the iris information cannot be detected accurately, the display control unit 13 corrects the positional relationship between the position of the lens of the photographing device that generates the photographed image and the display position of the display information (step S107). Details of the correction of the positional relationship will be described later. When the display control unit 13 obtains a determination result indicating that the iris information is not in a state where it cannot be detected accurately (the iris information was detected accurately), the display control unit 13 terminates the processing. When the photographing state determination unit 14 generates a determination result indicating that the iris information is not in a state where it cannot be detected accurately (the iris information was detected accurately), the display control unit 13 may instruct the authentication processing unit 16 to perform authentication using the iris information. As a result, the authentication processing unit 16 performs authentication processing based on the highly accurate iris information (step S108).

[0028] Here, the correction of the positional relationship in step S107 will be described. The shooting state determination unit 14 identifies the position of the circular defect indicated by the iris information because the eyelid is covered by the iris information. The position of the defect may be identified by pattern recognition of the iris shape, etc., and if it does not match the pattern, it may be determined that there is a defect. If the position of the defect is in the upper part of the circle indicated by the iris information, the shooting state determination unit 14 generates instruction information to control the display information to move downward. Similarly, if the position of the defect is in the lower part of the circle indicated by the iris information, the shooting state determination unit 14 generates instruction information to control the display information to move downward. The shooting state determination unit 14 outputs the instruction information to the display control unit 13.

[0029] When the display control unit 13 receives instruction information to control the display information to move downward, the display control unit 13 controls the display information 33 to move downward (see FIG. 7 ). When the display control unit 13 receives instruction information to control the display information to move upward, the display control unit 13 controls the display information 33 to move upward.

[0030] Here, the photographing state determination unit 14 may generate instruction information for eliminating a state in which the circle indicated by the iris information is covered by the eyelid, and output the instruction information to the display control unit 13. In this case, the photographing state determination unit 14 may store in advance in a memory or the like the relationship between the state of the iris information and the instruction information for that state, read the instruction information specified based on the state of the iris information, and output it to the display control unit 13. The photographing state determination unit 14 may determine each of the state of the iris being reflected in the photographed image and the state of the face being reflected in the photographed image, and output instruction information according to the combination of these states to the display control unit 13. In this way, the information processing device 10 may control the positional relationship between the position of the lens of the photographing device that photographs the subject and the display position of the display information so that not only the gaze is directed toward the lens 32, but also the face is directed toward the lens 32.

[0031] The information processing device 10 may update the display content of the display information displayed on the display device 30 when photographing the person, based on the person's state of interest in the display information. When performing this process, the display content update unit 15 determines the state of interest based on the facial expression of the person appearing in the image acquired by the image acquisition unit 11 in step S105, and if the state of interest does not indicate interest, updates the display information to display an advertisement with another advertisement ID to the person.

[0032] More specifically, the display content update unit 15 inputs feature information of a face appearing in a captured image into the interest state determination model and obtains output information indicating interest or disinterest as a result. If the output result of the interest state determination model indicates disinterest, the display content update unit 15 may determine to output other display information to the display device 30 the next time the person appears in a captured image. In this case, the display content update unit 15 associates the person ID of the person with an advertisement ID corresponding to the display information not to be displayed and stores them in the storage device 40. Then, when the person ID can be identified from the captured image, the display information identification unit 12 may identify display information corresponding to an ID other than the advertisement ID associated with the person ID as information to be output to the display device 30. Furthermore, if the output result of the interest state determination model indicates interest, the display content update unit 15 may associate the identified advertisement ID with the person ID of the person and record them in the advertisement table. As a result, the next time the person can be identified from the captured image, the advertisement ID linked to the person's person ID can be identified, and the same display information can be output to the display device 30.

[0033] According to the above-described process, the biometric information is information about the iris of the subject, the photographing state determination unit 14 determines the state of the iris reflected in the photographed image, and the display control unit 13 controls the positional relationship between the position of the lens 32 of the photographing device 20 that generates the photographed image based on the state of the iris reflected in the photographed image and the display position of the display information. This makes it possible to control the iris so that it is accurately reflected in the photographed image generated by the photographing device 20.

[0034] Furthermore, according to the above-described process, the photographing state determination unit 14 determines whether the iris information cannot be detected accurately because the iris is covered by the eyelid, and if the iris information cannot be detected accurately, the display control unit 13 controls the positional relationship between the lens position and the display information to an extent that the iris information can be detected. This makes it possible to control the iris so that it is not covered by the eyelid in the photographed image generated by the photographing device 20 and is accurately captured.

[0035] Second Embodiment The display content update unit 15 may update the display information displayed to the subject based on the level of response of the subject having biometric information. In this case, the display content update unit 15 may calculate the level of response based on the eye movement of the subject. Eye movement may be, for example, the direction of the eyes (gaze direction) in the captured image or the time spent gazing at the display information. In step S105, the display content update unit 15 acquires multiple captured images at time intervals of, for example, 10 milliseconds, and determines whether the gaze direction of the eyes in each captured image is in the direction in which the display information is being displayed. The display content update unit 15 calculates the time during which the gaze direction of the eyes in each captured image is in the direction in which the display information is being displayed, based on each captured image. If the time is equal to or greater than a threshold, the display content update unit 15 may determine that the subject is interested in the display information, and if the time is less than the threshold, the display content update unit 15 may determine that the subject is not interested. If the display content update unit 15 determines that the subject is interested or not interested, the processing of the display content update unit 15 may be performed in the same manner as when using the output result of the interest state determination model described above.

[0036] According to the second embodiment, the display content update unit 15 calculates the degree of reaction of the subject based on the eye movement, and updates the display information to be displayed to the subject based on the degree of reaction. As a result, the display information to which the subject responded most strongly is used for the next display, thereby enabling control so that the iris is captured accurately in the next image as well.

[0037] Third Embodiment In the above example, the state of the iris reflection is determined in step S106. However, it is also possible to determine the state of the reflection, such as whether the face is facing forward, and determine whether facial feature information cannot be detected accurately based on whether the face is facing the lens directly. In this case, the facial feature information is an example of biometric information.

[0038] (Fourth Embodiment) The display content update unit 15 may input the attributes of the subject having biometric information, the content of the display information, and the subject's level of reaction, and identify the display information to be displayed to the subject based on the level of reaction. In this case, the display content update unit 15 acquires attribute information of the person being photographed from the display information identification unit 12. As in the third embodiment, the display content update unit 15 detects the level of reaction (gaze direction and time spent gazing at the display information). If the display content update unit 15 determines that the currently output display information, among the display information recorded in the advertisement table based on the attributes of the person being photographed, is display information with a high level of reaction, the display content update unit 15 can record the display information in the advertisement table as display information to be continuously displayed to the subject with that attribute from the next time onwards.

[0039] The display content update unit 15 may identify the display information to be displayed to the subject using a display information identification model generated based on the relationship between the attributes of the subject having a living organism and the content of the display information that elicits a reaction level of the subject having the living organism equal to or greater than a predetermined threshold. In this case, the display content update unit 15 acquires attribute information of the person being photographed from the display information identification unit 12. The display content update unit 15 also detects the reaction level corresponding to the currently displayed display information as described above. The display content update unit 15 then inputs the information into the display information identification model, and can record the resulting display information in the advertisement table as display information to be continuously displayed to the subject having that attribute from the next time onwards. The display information identification model may be a learning model obtained by machine learning a large number of relationships between the attribute information of the person being photographed from the display information identification unit 12 and display information that elicits a reaction level equal to or greater than the identified threshold when the person views the display information.

[0040] 8 is a diagram showing another example of the display mode of the display information. When controlling the positional relationship between the position of the lens of the photographing device that generates a photographed image based on the state of reflection and the display position of the display information, the display control unit 13 may control the range of the display information to be range 81a, range 81b, range 81c, and so on, with the position of the lens as the reference, so that the range becomes successively narrower depending on the degree of the state of reflection, as shown in FIG.

[0041] Fig. 9 is a functional block diagram showing the minimum configuration of an information processing device according to an embodiment of the present disclosure. Fig. 10 is a diagram showing a processing flow by an information processing device with the minimum configuration according to an embodiment of the present disclosure.

[0042] The information processing device 10 includes at least an imaging state determination unit 111 and a display control unit 112. The imaging state determination unit 111 determines the state of biometric information reflected in the captured image (step S901). The display control unit 112 controls the positional relationship between the position of the lens of the imaging device that generates the captured image and the display position of the display information based on the state of reflection (step S902).

[0043] The program of the information processing device 10 may be a program for realizing some of the above-mentioned functions, or may be a so-called differential file (differential program) that can realize the above-mentioned functions in combination with a program already recorded in the computer system.

[0044] The information processing system and information processing device of this disclosure have been described above, but this disclosure is not limited to the above-described embodiments. Various modifications that can be understood by those skilled in the art can be made to the configuration and details of this disclosure within the scope of this disclosure. Furthermore, each embodiment can be combined with other embodiments as appropriate.

[0045] Note that part or all of the above-described embodiments can be described as, but are not limited to, the following supplementary notes.

[0046] (Supplementary Note 1) An information processing system comprising: a photographing state determination means for determining the state of biometric information reflected in a photographed image; and a display control means for controlling the positional relationship between the position of a lens of a photographing device that generates the photographed image based on the state of the biometric information reflected in the photographed image and the display position of display information.

[0047] (Supplementary Note 2) The information processing system according to Supplementary Note 1, further comprising: a display content update unit that updates display content of the display information based on an interest state of the subject having the biometric information in the display information.

[0048] (Supplementary Note 3) The information processing system according to Supplementary Note 1 or Supplementary Note 2, wherein the biometric information is information about an iris of a subject, and the photographing state determining means determines a state of the iris appearing in the photographed image.

[0049] (Supplementary Note 4) The information processing system described in Supplementary Note 3, wherein the photographing state determination means determines whether or not the iris information cannot be detected accurately because the iris is covered by an eyelid, and the display control means, when the iris information cannot be detected accurately, controls the positional relationship between the position of the lens and the display information to an extent that the iris information can be detected.

[0050] (Supplementary Note 5) The information processing system described in Supplementary Note 2, wherein the display content update means inputs attributes of the subject having the biometric information, the content of the display information, and the degree of reaction of the subject, and specifies the display information to be displayed to the subject depending on the degree of reaction.

[0051] (Supplementary Note 6) The information processing system according to Supplementary Note 2 or Supplementary Note 5, wherein the display content update means identifies display information to be displayed to the target using a learning model generated based on the relationship between attributes of the target having the biometric information and the content of the display information that elicits a reaction level of the target having the biometric information equal to or greater than a predetermined threshold.

[0052] (Supplementary Note 7) The information processing system according to Supplementary Note 2, further comprising: the display content update means updates the display information to be displayed to the subject based on a degree of reaction of the subject having the biological information.

[0053] (Supplementary Note 8) The information processing system according to Supplementary Note 5, wherein the display content update means calculates the degree of reaction based on eye movement of the subject.

[0054] (Supplementary Note 9) The information processing system according to any one of Supplementary Note 1 to Supplementary Note 8, wherein the position of the lens is set within a display range of the display information.

[0055] (Supplementary Note 10) An information processing device comprising: a photographing state determination means for determining a state of biometric information being captured in a photographed image; and a display control means for controlling a positional relationship between a position of a lens of a photographing device that generates the photographed image based on the state of the biometric information being captured and a display position of display information.

[0056] (Supplementary Note 11) The information processing device according to Supplementary Note 10, comprising: a display content update unit that updates display content of the display information based on an interest state of the subject having the biometric information in the display information.

[0057] (Supplementary Note 12) The information processing device according to Supplementary Note 10 or Supplementary Note 11, wherein the biometric information is information about an iris of a subject, and the photographing state determining means determines a state of the iris appearing in the photographed image.

[0058] (Supplementary Note 13) The information processing device according to Supplementary Note 12, wherein the photographing state determination means determines whether or not the iris information cannot be detected accurately because the iris is covered by an eyelid, and the display control means, when the iris information cannot be detected accurately, controls the positional relationship between the position of the lens and the display information to an extent that the iris information can be detected.

[0059] (Supplementary Note 14) The information processing device according to Supplementary Note 11, wherein the display content update means inputs attributes of the subject having the biometric information, content of the display information, and a degree of reaction of the subject, and specifies display information to be displayed for the subject according to the degree of reaction.

[0060] (Supplementary Note 15) The information processing device according to Supplementary Note 11 or Supplementary Note 14, wherein the display content update means identifies display information to be displayed to the target using a learning model generated based on a relationship between an attribute of the target having the biometric information and the content of the display information that elicits a reaction level of the target having the biometric information equal to or greater than a predetermined threshold.

[0061] (Supplementary Note 16) The information processing device according to Supplementary Note 11, further comprising: the display content update means updates the display information to be displayed to the subject based on a degree of reaction of the subject having the biological information.

[0062] (Supplementary Note 17) The information processing device according to Supplementary Note 14, wherein the display content update means calculates the degree of reaction based on eye movement of the subject.

[0063] (Supplementary Note 18) The information processing device according to any one of Supplementary Note 10 to Supplementary Note 17, wherein the position of the lens is set within a display range of the display information.

[0064] (Supplementary Note 19) An information processing method comprising: determining a state of biometric information being captured in a captured image; and controlling a positional relationship between a position of a lens of a photographing device that generates the captured image and a display position of display information based on the state of the biometric information being captured.

[0065] (Supplementary Note 20) The information processing method according to Supplementary Note 19, further comprising: updating display content of the display information based on an interest state of the subject having the biometric information in the display information.

[0066] (Supplementary Note 21) The information processing method according to Supplementary Note 19 or Supplementary Note 20, wherein the biometric information is information about an iris of a subject, and a state of the iris appearing in the captured image is determined.

[0067] (Supplementary Note 22) An information processing method as described in Supplementary Note 21, which determines whether the iris information cannot be detected accurately because the iris is covered by an eyelid, and if the iris information cannot be detected accurately, controls the positional relationship between the position of the lens and the display information to the extent that the iris information can be detected.

[0068] (Supplementary Note 23) The information processing method according to Supplementary Note 20, further comprising inputting attributes of a subject having the biometric information, the content of the display information, and the degree of reaction of the subject, and specifying display information to be displayed to the subject according to the degree of reaction.

[0069] (Supplementary Note 24) The information processing method according to Supplementary Note 20 or Supplementary Note 23, comprising: identifying display information to be displayed to the target using a learning model generated based on the relationship between the attributes of the target having the biometric information and the content of the display information that elicits a reaction level of the target having the biometric information equal to or greater than a predetermined threshold.

[0070] (Supplementary Note 25) The information processing method according to Supplementary Note 20, further comprising: updating display information to be displayed to the subject based on a degree of reaction of the subject having the biological information.

[0071] (Supplementary Note 26) The information processing method according to Supplementary Note 23, wherein the degree of reaction is calculated based on eye movements of the subject.

[0072] (Supplementary Note 27) The information processing method according to any one of Supplementary Note 19 to Supplementary Note 26, wherein the position of the lens is set within a display range of the display information.

[0073] (Appendix 28) A program that causes a computer of an information processing system to function as: a photographing condition determination means that determines the state of biometric information reflected in a photographed image; and a display control means that controls the positional relationship between the position of the lens of a photographing device that generates the photographed image based on the state of the reflection, and the display position of the displayed information.

[0074] (Supplementary Note 29) The program according to Supplementary Note 28, which functions as a display content updating means for updating display content of the display information based on an interest state of the subject having the biometric information in the display information.

[0075] (Supplementary Note 30) The program according to Supplementary Note 28 or Supplementary Note 29, wherein the biometric information is information about an iris of a subject, and the photographing state determining means determines a state of the iris appearing in the photographed image.

[0076] (Supplementary Note 31) The program described in Supplementary Note 30, wherein the photographing state determination means determines whether or not the iris information cannot be detected accurately because the iris is covered by an eyelid, and the display control means, when the iris information cannot be detected accurately, controls the positional relationship between the position of the lens and the display information to an extent that the iris information can be detected.

[0077] (Appendix 32) The program according to Appendix 29, wherein the display content update means inputs attributes of the subject having the biometric information, the content of the display information, and the degree of reaction of the subject, and specifies the display information to be displayed for the subject depending on the degree of reaction.

[0078] (Supplementary Note 33) The program according to Supplementary Note 29 or Supplementary Note 32, wherein the display content update means identifies display information to be displayed to the target using a learning model generated based on a relationship between an attribute of the target having the biometric information and the content of the display information that elicits a reaction level of the target having the biometric information equal to or greater than a predetermined threshold.

[0079] (Supplementary Note 34) The program according to Supplementary Note 29, further comprising: the display content update means updates the display information to be displayed to the subject having the biological information based on a degree of reaction of the subject.

[0080] (Supplementary Note 35) The program according to Supplementary Note 32, wherein the display content update means calculates the degree of reaction based on eye movement of the subject.

[0081] (Supplementary Note 36) The program according to any one of Supplementary Note 28 to Supplementary Note 35, wherein the position of the lens is set within a display range of the display information.

[0082] DESCRIPTION OF SYMBOLS 10: Information processing device 11: Image acquisition unit 12: Display information identification unit 13: Display control unit (display control means 112) 14: Shooting state determination unit (shooting state determination means 111) 15: Display content update unit 16: Authentication processing unit 20: Shooting device 30: Display device 32: Lens 40: Storage device 100: Information processing system

Claims

1. An information processing system comprising: a photographing condition determination means for determining the state of biometric information being captured in a photographed image; and a display control means for controlling the positional relationship between the position of a lens of a photographing device for generating the photographed image based on the state of the biometric information being captured, and the display position of displayed information.

2. The information processing system according to claim 1, further comprising: a display content update means for updating the display content of the display information based on an interest state of the subject having the biometric information in the display information.

3. An information processing system as described in claim 1 or claim 2, wherein the biometric information is information about the subject's iris, and the photographing state determination means determines the state in which the iris is reflected in the photographed image.

4. The information processing system of claim 3, wherein the shooting state determination means determines whether or not the iris information cannot be detected accurately because the iris is covered by the eyelid, and the display control means, when the iris information cannot be detected accurately, controls the positional relationship between the lens position and the display information to the extent that the iris information can be detected.

5. The information processing system according to claim 2, wherein said display content update means updates the display information to be displayed to said subject based on the degree of reaction of said subject having said biological information.

6. The information processing system according to claim 5, wherein the display content update means calculates the degree of reaction based on eye movement of the subject.

7. The information processing system according to claim 1, wherein the position of the lens is set within the display range of the display information.

8. An information processing device comprising: a photographing condition determination means for determining the state of biometric information being captured in a photographed image; and a display control means for controlling the positional relationship between the position of a lens of a photographing device for generating the photographed image based on the state of the biometric information being captured, and the display position of displayed information.

9. An information processing method for determining the state of biometric information reflected in a captured image, and controlling the positional relationship between the position of the lens of a photographing device that generates the captured image and the display position of display information based on the state of the biometric information reflected in the captured image.

10. A storage medium storing a program that causes a computer of an information processing system to function as: a photographing condition determination means for determining the state of biometric information being captured in a photographed image; and a display control means for controlling the positional relationship between the position of the lens of a photographing device that generates the photographed image based on the state of the biometric information being captured, and the display position of the displayed information.

Citation Information

Patent Citations

  • Device for obtaining iris data

    JP2000132681A

  • Electronic apparatus, program, control device, and control method

    WO2019058641A1

  • Information acquisition device, information acquisition method, and recording medium

    WO2021245823A1