Information processing device, information processing method, and program

Abstract

The present invention provides an information processing device that can ensure sufficient reliability for granting photographer authentication while preventing the loss of shooting opportunities due to authentication processing. [Solution] The information processing device 100 includes an imaging means 101 for acquiring captured images, a first-stage authentication means 104 for performing first-stage authentication when an image is not being captured, a second-stage authentication means 105 for performing second-stage authentication when an image is being captured, and a matching means 108 for assigning photographer authentication to the captured image based on the results of the first-stage authentication and the second-stage authentication. The matching means 108 assigns photographer authentication if second-stage authentication is performed without first-stage authentication, first-stage authentication is performed within the validity period of the second-stage authentication set after the second-stage authentication, and the photographer can be identified by the first-stage authentication.

Description

【Technical Field】 【0001】 The present invention relates to an information processing apparatus for authenticating a user, and more particularly to an information processing apparatus for imparting photographer authentication to a photographed image acquired by an imaging apparatus. 【Background Art】 【0002】 In response to the spread of images generated and processed by AI (artificial intelligence), technologies for guaranteeing the originality of photographed images are required. In a camera system, for example, a technique of digitally signing authentication information assigned to each camera in a tamper-proof manner to a photographed image is known. This guarantees that the image was taken by the camera. 【0003】 In addition to these technologies, it is desired to impart the information of the photographer to the photographed image in a tamper-proof manner (also referred to as guaranteeing the authenticity of the photographer). For example, Patent Document 1 discloses acquiring an eye image of a photographer looking through a finder during a photographing operation, and recording photographer information together with image data from personal authentication by analyzing iris information. 【Prior Art Documents】 【Patent Documents】 【0004】 【Patent Document 1】 Japanese Patent Application Laid-Open No. 2003-204427 【Summary of the Invention】 【Problems to be Solved by the Invention】 【0005】 However, when authenticating a photographer based on the information of an eye image during a photographing operation as in Patent Document 1, there are the following problems. During a photographing operation, the consciousness of the photographer is directed towards photographing rather than authentication. The eye image varies greatly depending on how the eye is placed on the finder and the direction of the line of sight, and is not necessarily an image suitable for authentication. There is a concern that due to a decrease in authentication accuracy, personal authentication may continue to fail and the photographer information may not be imparted. 【0006】 Furthermore, lowering the authentication accuracy threshold to avoid continuous failures would reduce the reliability of personal authentication. On the other hand, if the system is designed to acquire eye images suitable for authentication during the shooting process to improve authentication accuracy, the authentication process would involve a time lag, leading to lost shooting opportunities, especially in shooting scenes where the subject changes significantly. 【0007】 This invention has been made in view of the above problems, and aims to provide an information processing device, an information processing method, and a program that can ensure sufficient reliability for granting photographer authentication while preventing the loss of opportunities for photography due to authentication processing. [Means for solving the problem] 【0008】 To solve the above problems, the information processing apparatus of the present invention comprises: an image acquisition means for acquiring a captured image; a first authentication means for performing a first photographer authentication when the image is not being captured; a second authentication means for performing a second photographer authentication when the image is being captured; and an information granting means for granting photographer authentication information to the captured image acquired by the image acquisition means based on the results of the first photographer authentication and the second photographer authentication. The information granting means is characterized in that, if the first photographer authentication is not performed by the first authentication means but the second photographer authentication is performed by the second authentication means, the first photographer authentication is performed within the validity period of the second photographer authentication set after the second photographer authentication, and the photographer can be identified by the first photographer authentication, then the authentication information is granted. [Effects of the Invention] 【0009】 According to the present invention, it is possible to ensure sufficient reliability for granting photographer authentication while preventing the loss of shooting opportunities due to authentication processing. [Brief explanation of the drawing] 【0010】 [Figure 1] This is a schematic diagram illustrating an example of the mechanical structure of the first embodiment of the present invention. [Figure 2] This is a block diagram illustrating a functional configuration example of the first embodiment of the present invention. [Figure 3] This is a schematic flowchart illustrating the processing flow of the first embodiment of the present invention. [Figure 4] This is a schematic diagram illustrating the authentication method of the first embodiment of the present invention. [Figure 5] This is a schematic diagram illustrating another authentication method according to the first embodiment of the present invention. [Figure 6] This is a block diagram illustrating a functional configuration example of a second embodiment of the present invention. [Figure 7] This is a schematic diagram illustrating the authentication method of the second embodiment of the present invention. [Figure 8] This is a schematic diagram illustrating an example of a display for authentication according to the third embodiment of the present invention. [Figure 9] This is a schematic diagram illustrating another example of an authentication display according to the third embodiment of the present invention. [Modes for carrying out the invention] 【0011】 Embodiments of the present invention will be described below with reference to the attached drawings. However, the present invention is not limited to the situations described below, and any embodiment that aligns with the spirit of the present invention is applicable. 【0012】 [First Embodiment] Figure 1 shows an example of the mechanical structure of a camera system 1 equipped with an information processing device according to this embodiment. In this embodiment, a mirrorless camera is used as the camera system 1 for explanation. However, it is not limited to a camera system and can be applied to any information device having similar functions. 【0013】 The camera system 1 has necessary camera mechanisms such as a camera body 12, a lens 13, an electronic viewfinder 14, a touch panel display 15, a release button 16, an imaging device 17, etc. The lens 13 has an aperture mechanism 18 and a focus mechanism 19, and with the control of these mechanisms, external information is condensed onto the imaging device 17 through the lens 13. Also, external information is acquired and stored as electronic data by the imaging device 17 triggered by the operation of the release button 16. 【0014】 Moreover, on the touch panel display 15 and the display 22 for the electronic viewfinder, it is possible to display a photographed image stored in the memory unit 11 or external information (live view) output by the imaging device 17 during non-photographing via a display driving circuit 23. When the photographer looks into the electronic viewfinder 14, the photographer can confirm the video displayed on the display 22 for the electronic viewfinder through the eyepiece lens 21. 【0015】 Also, in the camera system 1, it is possible to acquire an image of the eyeball 20 of the photographer looking into the electronic viewfinder 14 (hereinafter referred to as an eyeball image). The eyeball image is acquired and stored, for example, by branching a part of the optical information inside the electronic viewfinder 14 with an optical splitter 25 and condensing it onto the imaging device 27 for the eyeball with a light receiving lens 26. When the optical information is directly condensed depending on the arrangement of the imaging device 27 for the eyeball, the optical splitter 25 can be omitted. Also, the optical information of the eyeball can appropriately use light from visible light to infrared light. 【0016】 When the camera system 1 further has a gaze detection function, particularly when gaze detection is performed by the corneal reflection method using the Purkinje image method, infrared light that generally does not obstruct the normal visual field is used. In that case, the illumination light source 24 irradiates infrared light, and the imaging device 27 for the eyeball uses a sensor that has sensitivity to infrared light. 【0017】 FIG. 2 shows a functional configuration example of the information processing apparatus 100 included in the camera system 1 of the present embodiment. The central processing unit 10 (hereinafter referred to as the CPU) shown in FIG. 1 functions as some of the means described below and controls each means. The memory unit 11 associated with the CPU 10 has a storage function for each data output from each means. The data in the memory unit 11 can be output to each means via the CPU 10. 【0018】 The imaging means 101 has a function of imaging external information, and in FIG. 1, the image sensor 17 and the like correspond to it. That is, the imaging means 101 functions as imaging image acquisition means for acquiring a captured image. The eye image acquisition means 102 has a function of imaging an eye image, and the eye image sensor 27 in FIG. 1 and the like correspond to it. The signal voltages from a plurality of pixels in the CCD or CMOS constituting the image sensor 17 and the eye image sensor 27 are A / D converted and output to the CPU 10. The CPU 10 can acquire external information and an eye image from the signals of the input plurality of pixels. 【0019】 In addition, the eye image acquisition means 102 includes a proximity sensor that detects the contact / non-contact state of the photographer with respect to the electronic viewfinder 14 in order to determine whether an eye image can be acquired. While the proximity sensor detects contact with the eye, it becomes possible to acquire an eye image and execute biometric authentication using the eye image. 【0020】 The registrant information acquisition means 103 pre-registers the authentication information of a person who is expected to be the user in the camera system 1 (hereinafter, a person whose authentication information has been registered is referred to as a registrant). The registrant is granted the authority to perform photographer authentication. There may be one registrant, or there may be multiple people who share the camera system 1. In addition to personal information such as name, the registrant's authentication information includes biometric information (registrant characteristics) used for authentication. Examples of biometric information include characteristics obtained from eyeball images, as well as fingerprint information and characteristic information obtained from facial images. Furthermore, the authentication information may also be non-biometric information such as a passcode set for each registrant. In Figure 1, the registrant information acquisition means 103 corresponds to the CPU 10, and the registrant's authentication information may be stored in, for example, the memory unit 11. 【0021】 In this embodiment, the camera system 1 identifies a registered user, for example, "Mr. A," or limits the user to "Several people including Mr. A," and then acquires the authentication information (registered user characteristics) of that registered user. This can be done by pre-registering the authentication information of the registered user, including Mr. A, in the memory unit 11 of the camera system 1, or by reading the authentication information of the registered user, including Mr. A, from an external memory such as a CF card that has been pre-registered. 【0022】 Furthermore, the registrant characteristics described above must be matchable values ​​so that they can be matched with the user characteristics described later by the matching means 108 described later. Typically, it is preferable to use the same calculation method and measurement method as for the user characteristics. 【0023】 For example, the registrant can select their own data from the registrant list through the camera menu. In other words, the registrant can be identified by operating physical buttons or the touch panel display 15 on the body 12. Furthermore, the method of identifying and restricting the registrant is not limited to camera menu operation; it can also be done by entering a password used by an individual or group, reading an ID card, or other methods as appropriate. 【0024】 In this embodiment, it is assumed that the registrant information is correct, and authentication of the user (photographer) of the camera system 1 is performed by comparing the registrant characteristics with the user characteristics obtained from the user. If the user characteristics are similar to the registrant characteristics, the user (photographer) is determined to be the registrant (authenticated). In this embodiment, the user refers to the person who is actually using the camera system 1 (also referred to as the photographer). Furthermore, the user may be a different person from the registrant. 【0025】 The first-stage authentication means 104 acquires authentication information for the first-stage authentication (first photographer authentication) performed when no photography is taking place. The first-stage authentication may be an authentication method using the user's (photographer's) biometric information, but it may also be an authentication method using non-biometric information such as a passcode. In Figure 1, the CPU 10 corresponds to the first-stage authentication means 104. 【0026】 In the case of an authentication method using biometric information, the first-stage authentication means 104 extracts information that can identify the individual user (user features), such as feature quantities and feature vectors, from an eyeball image as authentication information. User features based on eyeball images have the property that, if there are multiple eyeball images of the same person, the feature quantities calculated from any of the images will have a high degree of similarity to each other, while the feature quantities calculated from eyeball images of other people will have a low degree of similarity to each other. Therefore, it is possible to identify the user (photographer) by matching the user features with the registered user features in the matching means 108 described later. 【0027】 Furthermore, to improve authentication accuracy, the authentication process may be calibrated and guided to acquire eye images that are easier to authenticate. Note that feature extraction is a well-known technique in fields such as object recognition, facial recognition, and iris recognition, so details will be omitted. 【0028】 Furthermore, as an authentication method using biometric information, in addition to eye images, a fingerprint authentication mechanism (not shown) may be used, and a face detection mechanism that detects the user's face image captured by an in-camera (not shown) located on the back of the body 12 may also be used. In these cases, the user does not necessarily need to look through the electronic viewfinder 14, and feature extraction is performed using fingerprints or face images. 【0029】 In the case of authentication methods using non-biometric information, authentication information may be obtained by having each registered user enter a passcode individually set for them via a physical button or touch panel display 15. Furthermore, if the camera system 1 has access to a network environment, the camera system 1 may transmit its passkey in real time to an information communication device such as a smartphone owned by the user, and personal authentication may be performed by entering this passkey. 【0030】 The first-stage authentication performed by the first-stage authentication means 104, compared to the second-stage authentication described later, is a time-consuming process specifically for authentication, and is therefore characterized by its high accuracy in identifying users as registered users. For this reason, once a user is identified, the first-stage authentication state may be maintained for a predetermined validity period. This validity period for first-stage authentication can be set as appropriate, such as until a certain amount of time has elapsed, until the power to camera system 1 is turned off, or until the user of camera system 1 changes even without turning off the power. Furthermore, the validity period for first-stage authentication is longer than the validity period for second-stage authentication described later. 【0031】 The second-stage authentication means 105 acquires authentication information for the second-stage authentication (second photographer authentication) performed at the time of shooting. In this embodiment, the second-stage authentication uses an authentication method that utilizes the photographer's biometric information, particularly an eyeball image. In Figure 1, the CPU 10 corresponds to the second-stage authentication means 105. 【0032】 While it is assumed that most of the captured images were taken by the user identified by the first-stage authentication means 104, this is not always the case. For example, someone else might have temporarily taken the picture at the shooting location. In order to correctly determine that the captured image was taken by the user identified by the first-stage authentication means 104 (for example, person A), it is necessary to obtain information about the user (photographer) at the moment of shooting and use that information to determine that person A is the photographer. 【0033】 Therefore, in this embodiment, at the moment of shooting, or almost simultaneously, the eyeball image acquisition means 102 acquires an eyeball image of the photographer (user), and the second-stage authentication means 105 extracts user characteristics from the eyeball image. Note that, if the authentication processing time for the second-stage authentication is sufficiently short compared to the shooting interval and does not affect the next shooting operation, user characteristics may be extracted at each eyeball image acquisition timing. On the other hand, if the shooting operation is continuous shooting or similar and there is insufficient time to extract user characteristics between frames, the eyeball image may be stored together with the captured image, and user characteristics may be extracted from the stored eyeball image after the shooting operation is completed. 【0034】 The user characteristics used in the second-stage authentication are the same as those described in the first-stage authentication means 104, and by matching the user characteristics with the registered user characteristics, it is possible to identify similar individuals from the registered users of the camera system 1. Compared to the first-stage authentication, the second-stage authentication uses eye images taken during the shooting process, so the eye images may not be suitable for authentication, and the identification accuracy is relatively lower. In other words, the accuracy of person identification by the second photographer authentication is lower than the accuracy of person identification by the first photographer authentication. 【0035】 For images in which the user (photographer) has been identified, the second-step authentication status will be maintained for a predetermined validity period. However, because the identification accuracy of the second-step authentication is relatively low, the validity period of the second-step authentication will be set shorter than that of the first-step authentication. 【0036】 An example of the validity period for second-stage authentication is that it begins with the execution of second-stage authentication during a certain shooting operation, and continues until the shooting operation is completed, the user takes their eye away from the electronic viewfinder 14, and then puts their eye into the electronic viewfinder 14 again for the next shooting operation. 【0037】 Another example of the validity period for the second-stage authentication is to set it to last from the time the shooting operation is completed and the user takes their eye off the electronic viewfinder 14 until the shutter release button 16 is pressed again for the next shot, regardless of whether the eye is taken off or on the viewfinder. The state of eye contact with the electronic viewfinder 14 can be detected using the proximity sensor or the like mentioned above. 【0038】 Furthermore, while the second-stage authentication in the second-stage authentication means 105 is intended to extract user characteristics from eye images, it is also possible to use the user's fingerprint authentication information at the time of shooting. For example, the user presses the shutter release button 16 at the time of shooting. If there is a sensor that can acquire fingerprint information from the user's finger placed on the shutter release button 16, it is possible to acquire the biometric information of the user (photographer) at the moment of shooting. The acquired fingerprint information may be replaced with user characteristics obtained from eye images, but both may be used in combination to further improve authentication accuracy. 【0039】 The user characteristics acquired by the second-stage authentication means 105 described above are linked to the simultaneously captured images and stored in the storage means 106. 【0040】 The holding means 106 holds (stores) the captured image and the information (user characteristics) acquired by the second-stage authentication means 105. In this embodiment, the memory unit 11 corresponds to the holding means 106. This information may also be stored in external memory so that it can be retrieved from the camera system 1. Examples of external memory include removable recording media such as SD cards and CF cards, external storage such as USB memory, or cloud storage accessible via a network. 【0041】 The association between the captured image held in the holding means 106 and the information obtained by the second-stage authentication means 105 is performed, for example, by assigning and managing a hash value, which is a file-specific ID. The hash values ​​for the captured image and the eyeball information may be managed together, or the captured image may be embedded with the photographer information and eyeball information and assigned as a single file. 【0042】 A hash value is a fixed-length value calculated for data of variable length, designed so that different original data will result in different hash values. In principle, it is possible for multiple data to have the same hash value (hash collision), but in reality, this is considered unlikely. Furthermore, since it is difficult to generate data that will have a specific hash value, it is considered impossible to replace an image linked to eyeball information with another image. Hash values ​​can be calculated using technologies such as SHA256. 【0043】 The matching notification means 107 notifies the matching means 108 under the following two conditions. In Figure 1, the matching notification means 107 corresponds to the CPU 10. The first condition is that there are registered user characteristics obtained by the registered user information acquisition means 103 and user characteristics obtained by the first-stage authentication means 104. If this condition is met, the matching means 108 is notified to perform the first-stage authentication determination. 【0044】 The second condition is that there are registered user characteristics obtained by the registered user information acquisition means 103, and user characteristics obtained by the second-stage authentication means 105 are linked to the captured image. If this condition is met, the matching means 108 is notified to perform the second-stage authentication determination. 【0045】 The matching means 108 compares the registered user characteristics with the user characteristics to determine whether the person is the same as the person registered as the registered user. Matching is performed for both the first-stage and second-stage authentication. As mentioned above, the registered user characteristics are information stored in the camera system 1, while the user characteristics are information linked to and stored for each captured image. In Figure 1, the matching means 108 corresponds to the CPU 10. 【0046】 The matching means 108 compares (matches) the registrant characteristics with the user characteristics for each user characteristic, and determines that authentication is successful if the similarity is equal to or greater than a predetermined value. If there are multiple registrant information entries, the determination is made based on whether the highest similarity is equal to or greater than the predetermined value. Therefore, when matching the registrant characteristics using the user characteristics acquired by the first-stage authentication means 104, the first-stage authentication means 104 and the matching means 108 function as a first authentication means that performs first photographer authentication when no shooting is taking place. Furthermore, when matching the registrant characteristics using the user characteristics acquired by the second-stage authentication means 105, the second-stage authentication means 105 and the matching means 108 function as a second authentication means that performs second photographer authentication when shooting is taking place. 【0047】 The matching means 108 performs a predetermined action if the user (photographer) who has been determined to be a registered user after the first stage authentication is successful and the photographer of the captured image who has been determined to be a registered user after the second stage authentication is successful is the same person. The predetermined action is, for example, to immutably add the user (photographer) information to the captured image (add photographer authentication). In this way, it is possible to guarantee who took the captured image (authenticity guarantee). That is, the matching means 108 functions as an information adding means that adds photographer authentication information to the captured image acquired by the captured image acquisition means based on the results of the first photographer authentication and the second photographer authentication. 【0048】 To make information tamper-proof, one can use techniques such as digital signatures. Digital signatures are widely known and can prove that data has not been tampered with since the time the signature was applied, so details will be omitted. 【0049】 The authentication display means 109 provides notifications regarding the status of the first-stage and second-stage authentication. The authentication display means 109 corresponds to the touch panel display 15 and the electronic viewfinder display 22 shown in Figure 1. If the first-stage authentication has not been performed, the authentication display means 109 notifies the user that it has not been performed. The user can then confirm the notification and instruct the system to perform the first-stage authentication. 【0050】 Figure 3 is a schematic flowchart illustrating the processing flow (information processing method) of the information processing device 100 in this embodiment. Steps S100 to S110 in Figure 3 show the operation when the second-stage authentication is performed first, and steps S201 to S207 show the operation when the first-stage authentication is performed first. Each of the following processes shown in Figure 3 is realized by the CPU 10 executing a program stored in, for example, the memory unit 11. In addition, the notation of each process (step) is omitted by prefixing it with S. 【0051】 In camera system 1, it is assumed that the first stage of authentication is performed before the second stage of authentication under normal circumstances. However, there are cases where, after starting camera system 1, there is no time to perform the first stage of authentication and it is necessary to start shooting immediately. This embodiment describes a procedure in which the first stage of authentication is performed after the second stage of authentication, taking such cases into consideration. 【0052】 Furthermore, performing first-stage authentication after second-stage authentication in this embodiment means performing first-stage authentication retroactively within the validity period of second-stage authentication. For example, if the user takes their eyes off the electronic viewfinder 14 after second-stage authentication, the camera system 1 notifies the user that first-stage authentication has not been performed and prompts them to perform first-stage authentication if necessary. 【0053】 First, let's explain the operation when the first-stage authentication is performed first. After starting the camera system 1 in S100, S101 determines whether the user will perform the first-stage authentication. This determination can be made, for example, by detecting when the user selects to perform the first-stage authentication from a menu displayed on the touch panel display 15, or by pressing a function button on the body 12 that is assigned to perform the first-stage authentication. Alternatively, the camera system 1 may send a notification prompting the user to perform the first-stage authentication. 【0054】 If the user chooses to perform first-stage authentication, the process proceeds to S201, where first-stage authentication is performed. Specifically, the first-stage authentication means 104 acquires user characteristics, and the matching means 108 compares the acquired user characteristics with the registered user characteristics to authenticate that the user is a registered user. If first-stage authentication is successful and the user is identified as a registered user, the validity period of the first-stage authentication is set in S202. 【0055】 Subsequently, when the user (photographer) looks through the electronic viewfinder 14 and begins the shooting operation (S203:Yes), an eyeball image is acquired and the second-stage authentication is performed (S204). In other words, the second-stage authentication means 105 acquires user characteristics, and the matching means 108 compares the acquired user characteristics with the registered user characteristics to authenticate that the user is a registered user. If the second-stage authentication is successful and the user is identified as a registered user, the matching means 108 determines whether the person identified in the first-stage authentication and the person identified in the second-stage authentication are the same person (S205). If it is determined in S205 that they are the same person (S205:Yes), and the validity period of the first-stage authentication is still in effect (S206:Yes), the matching means 108 adds photographer authentication to the captured image (S207). 【0056】 In other words, if a first photographer authentication is performed and the photographer is identified by the first photographer authentication, the matching means 108 assigns authentication information if a second photographer authentication is performed within the validity period of the first photographer authentication set after the first photographer authentication. 【0057】 Next, we will explain the operation when second-factor authentication is performed first. After starting camera system 1 in S100, S101 determines whether the user will perform first-factor authentication. As mentioned above, the determination of whether to perform first-factor authentication can be made by detecting actions such as selecting a menu item or pressing a function button. 【0058】 If the user does not choose to perform the first-stage authentication, they may, for example, exit the menu display and return to the live view display, or look through the electronic viewfinder 14 and begin shooting (S102: Yes). Then, if the user presses the release button 16 while looking through the electronic viewfinder 14, the second-stage authentication means 105 will perform the second-stage authentication (S103). 【0059】 In the second-stage authentication of S103, as described above, user characteristics extracted from eye images are linked and stored for each captured image. Then, at the end of the capture, each user characteristic is compared (matched) with the registered user characteristics, and if the similarity is above a predetermined value, the second-stage authentication is considered successful, and the user (photographer) is identified. However, in the second-stage authentication, eye images are not always suitable for authentication, so depending on the user characteristics, there is a possibility that the similarity may not reach the predetermined value, resulting in authentication failure, or that the wrong person may be identified. 【0060】 Therefore, in this embodiment, photographer authentication is applied to a captured image when it is verified that the photographer of the captured image who successfully passed the second-stage authentication is the same person as the user identified by the first-stage authentication performed additionally within the validity period of the second-stage authentication after the second-stage authentication. 【0061】 Next, the validity period for second-factor authentication is set in S104. The validity period for second-factor authentication is set with the expectation that first-factor authentication will be performed retrospectively within that validity period. The validity period for second-factor authentication can be set to any period, but since the identification accuracy of second-factor authentication is relatively lower than that of first-factor authentication, it is set to be shorter than the validity period for first-factor authentication. 【0062】 Next, in S105, the system notifies the user that the first stage of authentication has not yet been performed. For example, when the user takes their eyes off the electronic viewfinder 14, the camera system 1 notifies the user that the first stage of authentication has not yet been performed. 【0063】 If the user requests photographer authentication for the image captured in the most recent shot, they select to perform first-stage authentication (S106: Yes) and proceed to S107. In S107, first-stage authentication is performed to identify the user. That is, similar to S201, the first-stage authentication means 104 acquires user characteristics, and the matching means 108 compares the acquired user characteristics with the registered user characteristics to authenticate that the user is a registered user. 【0064】 In S108, similar to S205, it is determined whether the person identified in the first-step authentication and the person identified in the second-step authentication, which has already been performed, are the same person. 【0065】 If it is determined in S108 that the person is the same (S108: Yes) and the second-stage authentication is still valid (S109: Yes), then photographer authentication is added to the captured image (S110). Once the first-stage authentication in S107 is performed, subsequent authentication for shooting operations can be performed according to S201 to S207. 【0066】 According to the flowchart shown in Figure 3, the first-step authentication is performed within the validity period of the second-step authentication. If the user identified in the first-step authentication and the user (photographer) identified in the previously performed second-step authentication are determined to be the same person, photographer authentication is applied to the previously acquired images. 【0067】 On the other hand, if the user does not perform the first-stage authentication within the validity period of the second-stage authentication and looks through the electronic viewfinder 14 again, the captured image that maintains the state in which the second-stage authentication was achieved will be excluded from the granting of photographer authentication. Alternatively, if the user presses the release button 16 and the validity period of the second-stage authentication ends, the captured image that maintains the state in which the second-stage authentication was achieved will also be excluded from the granting of photographer authentication. 【0068】 In other words, if the first photographer authentication by the first authentication means is not performed and the second photographer authentication by the second authentication means is performed, the matching means 108 operates as follows: If the first photographer authentication is performed within the validity period of the second photographer authentication set after the second photographer authentication, the matching means 108 assigns authentication information. 【0069】 According to the flowchart in Figure 3, S102 functions as the image acquisition process, S103 as the second authentication process, S107 as the first authentication process, and S108 to S110 as the information assignment process. 【0070】 Figure 4 is a schematic diagram illustrating the time-series processing of the authentication method of this embodiment. Figure 4(A) is a schematic diagram when the first stage authentication is performed first, and explains the photographer authentication method corresponding to the operations S201 to S207 in Figure 3. On the other hand, Figure 4(B) is a schematic diagram when the second stage authentication is performed first, and explains the photographer authentication method corresponding to the operations S102 to S110 in Figure 3. 【0071】 In Figure 4(A), first-stage authentication is performed when no photos are being taken. In first-stage authentication, user A is identified from among the registered users, and the validity period of first-stage authentication with user A as the user is set. 【0072】 After the first stage of authentication, when the user looks through the electronic viewfinder 14 and begins the shooting process, an eye image is acquired and the second stage of authentication is performed. The eye image is acquired at the moment of shooting, or almost simultaneously, with each shot. User characteristics are extracted from the eye image and compared with registered user characteristics to identify the photographer. 【0073】 For example, if the eyeball image a2 in Figure 4(A) is identified as belonging to person A, then the person identified in the first stage of authentication and the person identified in the second stage of authentication are considered to be the same person. Then, the captured image a2 corresponding to the eyeball image a2 is assigned photographer authentication, which guarantees that the image was taken by person A at that time. 【0074】 If the second-factor authentication fails to identify the registered user, or identifies a different registered user, the following actions may be taken: If the results of the second-factor authentication are given priority, the image a1 corresponding to the eye image a1 that failed to identify the registered user will not be assigned photographer authentication due to the inconsistency with the first-factor authentication. Similarly, the image a3 corresponding to the eye image a3 that was identified as being taken by person B, a different person from person A, will not be assigned photographer authentication due to the inconsistency with the first-factor authentication. 【0075】 On the other hand, if the second-stage authentication prioritizes the continuity and cumulative number of results in which the photographer is identified as person A, the validity period of the second-stage authentication can be set when, for example, a threshold is reached for the percentage of images identified as person A. During this validity period, the photographer may be identified as person A regardless of the second-stage authentication result (eyeball images a4~aN in Figure 4(A)). This validity period may end when the current shooting operation is judged to be finished by taking the eyes off the electronic viewfinder 14. It may also end if a person other than person A is identified consecutively during shooting. In this case, photographer authentication can be applied to image a3, which was deemed unauthenticated when the second-stage authentication result was prioritized. 【0076】 In Figure 4(B), the first stage of authentication is not performed first; the camera takes a picture first, and then the second stage of authentication is performed. 【0077】 Image a1 corresponding to eyeball image a1, which failed to identify the photographer in the second-stage authentication process, will be treated as unauthenticated. Additionally, image a2 corresponding to eyeball image a2 identified as person A, and image a3 corresponding to eyeball image a3 identified as person B, will be pre-marked as authentication candidates. 【0078】 At this point, the validity period for second-factor authentication begins upon its execution. For captured images in which the user has been identified, the system will maintain a state of second-factor authentication being achieved for the duration of the second-factor authentication validity period, which can be arbitrarily defined. However, because the identification accuracy of second-factor authentication is relatively low, the validity period for second-factor authentication is set to be shorter than that of first-factor authentication. 【0079】 The validity period for the second-stage authentication could be, for example, the period from when the second-stage authentication is performed during a certain shooting operation, until the user takes their eye away from the electronic viewfinder 14 after the shooting operation is completed, and then puts their eye into the electronic viewfinder 14 again for the next shooting operation. 【0080】 Once the shooting operation is completed and the user takes their eyes off the electronic viewfinder 14, the authentication display means 109 notifies the user that the first stage of authentication has not been achieved, and the user can perform the first stage of authentication when not shooting. 【0081】 Subsequently, once the user of camera system 1 is identified as person A through the first-stage authentication, photographer authentication is applied using this result and the result of the second-stage authentication that has already been performed. In other words, among the captured images that were candidates for authentication in the second-stage authentication, photographer authentication is applied to captured images a2, a4, etc., where the photographer in the second-stage authentication was the same person A. Once the first-stage authentication is performed, authentication for subsequent shooting operations can be performed according to the procedure described in Figure 4(a). 【0082】 Furthermore, for images where the second-factor authentication result is not that of person A, the following treatment is acceptable: If the results of the second-factor authentication are given priority as described above, photographer authentication will not be applied to images where the result is not that of person A. 【0083】 Furthermore, if the proportion of captured images identified as Person A exceeds a threshold, even if the second-step authentication results in an identification of someone other than Person A, it is permissible to consider the person as Person A and grant photographer authentication. However, granting photographer authentication to someone as Person A even if the second-step authentication results in an identification of someone other than Person A is preferable only if it is guaranteed that both the first-step authentication and the second-step authentication are highly likely to be of the same person, provided that the first-step authentication is performed within the validity period of the second-step authentication. 【0084】 Furthermore, photographer authentication may be assigned based on the confidence level of the authentication derived from the results of the second-stage and first-stage authentication. In this case, authentication may also be assigned according to the level to images where the second-stage authentication was performed but the first-stage authentication was not. That is, the authentication information may include information indicating the accuracy of photographer identification (for example, the confidence level described later). 【0085】 Figure 5 is a schematic diagram illustrating the time-series process for authentication when multiple levels of authentication are implemented. In Figure 5, as in Figure 4(B), the shooting operation begins first, and then the second level of authentication is performed, without the first level of authentication being executed. 【0086】 In the first shooting operation, the photographer is identified as person A from the eyeball image, and the corresponding captured image a1 is designated as the authentication candidate. The validity period for the second stage of authentication then begins, but the user takes their eyes off the electronic viewfinder 14, and then puts their eyes back in and starts shooting again without performing the first stage of authentication. Therefore, the validity period for the second stage of authentication in the first shooting operation ends when the eyes are taken off. 【0087】 In Figure 4(B), the captured image a1 was removed from authentication at the point of eye separation. However, as shown in Figure 5, confidence levels can be assigned to authentication, and these levels can be applied to photographer authentication. In the case of the captured image a1, the second stage authentication was successful (identification of person A), and the first stage authentication was not performed. Therefore, photographer authentication is assigned, with a confidence level of D corresponding to the authentication content, indicating that the photographer is person A. 【0088】 Next, in the second shooting operation shown in Figure 5, the system obtains image a2, where the photographer identification failed; image a3, where the photographer was identified as person B; and image a4, where the photographer was identified as person A. Then, within the validity period of the second-stage authentication, the first-stage authentication is performed to identify person A as the current user from among the registered users of camera system 1, and the result is applied to images a2 to a4. 【0089】 In Figure 4(B), images a2 and a3 were excluded from authentication at this point, but in Figure 5, photographer authentication is assigned according to the level of confidence. This is based on the assumption that the photographer is the same regardless of the identification result for images acquired with the same shooting operation while looking through the electronic viewfinder 14. Furthermore, by giving more weight to the results of the second-stage authentication, the possibility of missing individual images is eliminated, and the confidence in the authenticity of captured images that have been authenticated at the highest level is further enhanced. 【0090】 In Figure 5, the images a2 to a4 acquired in the second shooting operation are assigned levels as follows: For image a2, where the second-stage authentication fails and the first-stage authentication succeeds (identifying person A), a level C is assigned, which is more reliable than level D for image a1, and photographer authentication is given, confirming that the photographer is person A. 【0091】 In other words, the confidence level of a photograph taken after both first-stage and second-stage authentication have been performed, but where the second-stage authentication has failed, is higher than the confidence level of a photograph taken after only second-stage authentication has been performed. 【0092】 Furthermore, for image a3 where the second-stage authentication is successful (identified as person B) and the first-stage authentication is successful (identified as person A), photographer authentication is assigned, with a level B rating equivalent to or higher than level C, indicating that the photographer is person A. 【0093】 In other words, the confidence level of a photograph where the person identified in the first stage of authentication and the person identified in the second stage of authentication were not determined to be the same person is equivalent to or higher than the confidence level of a photograph where the first stage of authentication was successful but the second stage of authentication failed. 【0094】 Furthermore, for image a4, where both the second-stage authentication and the first-stage authentication are successful (identified as person A), the highest level of confidence, A, is assigned to the image, and photographer authentication is granted, confirming that the photographer is person A, as the image is identified as belonging to the same person. 【0095】 In other words, the confidence level of a photograph where the person identified in the first-step authentication and the person identified in the second-step authentication are determined to be the same person is higher than the confidence level of a photograph where the person identified in the first-step authentication and the person identified in the second-step authentication are not determined to be the same person. 【0096】 The difference between Level C and Level B is based on the fact that at least person B, who is registered with camera system 1, could be identified. However, the level of captured images in which the original user (person A) could not be identified can be changed as appropriate. Furthermore, the information indicating the accuracy of photographer identification is not limited to categories such as Levels A to D, but may also be a numerical value such as a score. 【0097】 Thus, the information indicating high identification accuracy (Level D) contained in images where only the second photographer authentication was performed has lower identification accuracy than the information indicating high identification accuracy (Levels A-C) contained in images where both the first and second photographer authentications were performed. 【0098】 As described above, embodiments of the present invention make it possible to ensure sufficient reliability for photographer authentication in a camera system 1 that provides photographer authentication, while preventing the loss of shooting opportunities due to authentication processing. 【0099】 [Second Embodiment] Next, a camera system 1 that provides photographer authentication according to a second embodiment of the present invention will be described. In this embodiment, the configuration of the camera system 1 and the authentication method for photographer authentication are the same as in the first embodiment. In this embodiment, a mechanism is added to determine whether the person operating the camera system 1 is the same person before and after the shooting operation. This relates to setting the validity period of the second-stage authentication. 【0100】 Figure 6 shows an example of the mechanical configuration of the information processing device 100A in the camera system 1 to which this embodiment is applied. Compared to the configuration of the first embodiment described in Figure 2, a person detection means 110 and an effective period adjustment means 111 have been added. 【0101】 The person detection means 110 has the function of detecting the user (photographer) of the camera system 1. That is, the person detection means 110 functions as a photographer detection means that detects the photographer. Examples of the person detection means 100 include a proximity sensor that detects when the eyes are looking into or away from the electronic viewfinder 14, which is included in the eyeball image acquisition means 102, and a fingerprint authentication sensor located on the release button 16. Furthermore, an in-camera that is provided on the back side of the body 12 and detects the user's face may also be used. 【0102】 The fingerprint sensor may function as a simpler contact sensor. The contact sensor may also be provided on the gripping portion of the body 12. 【0103】 These person detection means 110 may function even before the user of the camera system 1 places their eye into the electronic viewfinder 14 and begins shooting. For example, if the proximity sensor detects eye contact, under normal usage conditions, it can be assumed that the user of the camera system 1 is the same person until the next time the eye is removed. Similarly, if the user places their finger on the release button 16 or grips the handle of the body 12, it can be assumed that the user is the same person as long as that contact continues. 【0104】 Furthermore, the front camera detects the user's face on the back side of the body 12, and can continue to track and detect the user's face as long as it remains within the shooting range, even if the user's face moves. Face detection becomes impossible when the detected user looks into the electronic viewfinder 14, but becomes possible again when they look away. These processes of looking into and out of the eye can be analyzed from the front camera image, and it is possible to detect that the user of the camera system 1 is the same person before and after looking into and out of the eye. 【0105】 Thus, the person detection means 110 is composed of means that can continuously detect a specific person (user). 【0106】 Furthermore, the person detection means 110, such as the contact sensor and in-camera described above, may be used in conjunction with each other. For example, consider a case where, in a non-shooting state, face detection by the in-camera and contact detection (gripping) of the gripping part of the body 12 are performed simultaneously. If the user moves the body 12 while gripping the gripping part, and the in-camera can no longer track the user due to its position or angle, even if face detection is not possible, it can be assumed that the user is the same person as long as contact detection continues. Conversely, if the camera is worn around the neck without being held by the user via a neck strap, contact detection will not be possible, but if face detection tracking by the in-camera is still possible, it can be assumed that the user is the same person. 【0107】 Furthermore, the person detection means 110 may also start detection triggered by the execution of the second-stage authentication during the shooting operation. The person looking through the electronic viewfinder 14 at the release timing of the second-stage authentication is the photographer, and the detection of this photographer continues. 【0108】 As long as the eyepiece state detected by the proximity sensor at the time of shooting continues, it is the same person, and similarly, as long as the gripping state of the body 12 detected by the contact sensor continues, it is the same person. 【0109】 Furthermore, when the shooting operation is temporarily terminated and the user moves their eye away from the electronic viewfinder 14, face detection by the in-camera becomes possible at the moment when detection by the proximity sensor becomes impossible. This switching of detection during the eye-movement process makes it possible to detect the identity of the person. This switching relationship is the same during the process of looking into the electronic viewfinder 14. 【0110】 The validity period adjustment means 111 adjusts the validity period of the second-stage authentication according to the user detection status by the person detection means 110. As described in the first embodiment, for captured images in which the photographer has been identified, the state of second-stage authentication being identified is maintained thereafter within the arbitrarily determined validity period of second-stage authentication. 【0111】 In the first embodiment, if the user does not perform the first-stage authentication within the validity period of the second-stage authentication and the validity period ends when the user looks through the electronic viewfinder 14 again, the captured image that maintains the state in which the second-stage authentication was achieved will be excluded from the subject of photographer authentication. 【0112】 On the other hand, in this embodiment, the person detection means 110 continuously detects whether the user is the same person, either before or after the validity period of the second-stage authentication is established. 【0113】 The validity period adjustment means 111 adjusts the validity period of the second-stage authentication to continue (extend) even if the eyes are repeatedly taken away from and into the electronic viewfinder 14 following the end of the shooting operation, provided that detection of the same person continues. 【0114】 Furthermore, if the same person is no longer detected, the adjustment of the validity period of the second-stage authentication is terminated. If the detection results of the person detection means 110 are given more weight, the validity period of the second-stage authentication itself may be canceled at that point. However, it is necessary to appropriately notify that the first-stage authentication has not been performed within the validity period and to confirm that the first-stage authentication has been performed. In other words, the validity period adjustment means 111 functions as part of the information provision means, and as long as the photographer detection means continues to detect the same photographer since the second photographer authentication, the validity period of the second photographer authentication is extended. 【0115】 Figure 7 is a schematic diagram illustrating the time-series process for the authentication method of this embodiment. In Figure 7, the first stage of authentication is not performed; the camera capture operation is initiated first, and the second stage of authentication is performed. 【0116】 Before the second-step authentication is performed, or at the moment the second-step authentication is achieved, the person detection means 110 is activated and continues to detect whether the person operating the camera system 1 is the same person without any change. 【0117】 In Figure 7, the captured images (a1, a2) corresponding to the eyeball images (a1, a2) identified as Person A during the initial capture operation are pre-marked as authentication candidates. 【0118】 Subsequently, the user takes their eye away from the electronic viewfinder 14 to end the shooting operation, but without performing the first-stage authentication, they look through the viewfinder again and begin the next shooting operation. In this case, the continuous detection by the person detection means 110 determines that the user of the camera system 1 is the same person, and the validity period of the second-stage authentication continues without interruption. That is, the pre-marked captured images (a1, a2) are still maintained as authentication candidates. 【0119】 Similarly, during the second shooting operation, the captured images (b1, b2) are pre-marked as authentication candidates, as they were taken by person A. 【0120】 After the second shooting operation is completed, the photographer (user) will be notified again that the first-step authentication has not been performed, while the second-step authentication is still valid. The photographer will then perform the first-step authentication when not taking a picture. 【0121】 Once the user of camera system 1 is identified as person A through the first-stage authentication, this result is applied to the results of the second-stage authentication performed in the previous multiple shooting operations. That is, among the captured images that became authentication candidates in the second-stage authentication, the images (a1, a2 and b1, b2) in which the photographer in the second-stage authentication was also person A are authenticated by photographer authentication. Captured images in which the second-stage authentication result is other than person A may be treated in the same manner as in the first embodiment. Furthermore, once the first-stage authentication is performed, the subsequent authentication method may follow the procedure described in Figure 4(a). 【0122】 Thus, even if, for example, the user repeatedly moves their eye away from and into the electronic viewfinder 14, if it is guaranteed that the user of the camera system 1 is the same person, the validity period can be set to continue to the extent guaranteed. 【0123】 According to the embodiment of the present invention, in a camera system 1 that provides photographer authentication, it is possible to ensure sufficient reliability for providing photographer authentication while preventing the loss of shooting opportunities due to the authentication process. 【0124】 Furthermore, in this embodiment, even if the shooting operation is repeated multiple times while moving the eyes apart and then into the eyepiece, it is possible to detect that the camera operator is the same person. This improves the flexibility of the timing of the follow-up first-stage authentication, leading to improved convenience for the user. 【0125】 [Third Embodiment] Next, a camera system that provides photographer authentication according to a third embodiment of the present invention will be described. In this embodiment, the configuration of the camera system 1 and the photographer authentication method are the same as in the first embodiment. In this embodiment, specific examples of the authentication display means 109 will be given. 【0126】 The authentication display means 109 displays notifications of the authentication status, confirmation of the authentication execution, and a GUI (graphical user interface) for the authentication execution. 【0127】 Figure 8 illustrates the configuration and operation example of the authentication display means 109 in this embodiment. Figure 8(A) shows an example configuration of the authentication display means 109 in the camera system 1, where user notifications regarding authentication are made by displaying information on the electronic viewfinder 14 (specifically, the electronic viewfinder display 22) and the touch panel display 15. The touch panel display 15 is used when the user has taken their eyes off the electronic viewfinder 14, and the electronic viewfinder display 22 is used when the user has their eyes on the electronic viewfinder 14. 【0128】 Furthermore, if the touch panel display 15 is used, the selection of the GUI for authentication will be performed via the touch panel of the touch panel display 15 or via the controller 28 located on the body 12. If the electronic viewfinder display 22 is used, the selection will be performed via the controller 28. Alternatively, the selection may be performed using the user's gaze, the user's voice, or from an external device capable of operating the camera system 1. 【0129】 Figures 8(B) to 8(D) show examples of notifications to the user by the authentication display means 109. For example, in Figure 8(B), the user is notified that the first stage of authentication is pending, that is, that the user of the camera system 1 has not yet been identified and authenticated. 【0130】 The timing of the notification may be from the time the camera system 1 is started up, or from the start of the validity period of the second-stage authentication, and can be selected as appropriate. By checking the notification in Figure 8(B), the user can recognize that the first-stage authentication has not been performed and can start the first-stage authentication if necessary. That is, if the first photographer authentication has not been performed at the start of the validity period of the second photographer authentication, the authentication display means 109 will display that the first photographer authentication has not been performed. 【0131】 The content of the notification may be changed once the first-step authentication is performed and the user is identified. The notification itself may be dismissed or hidden, returning to the normal display mode, or it may be switched to a notification indicating that the first-step authentication has been performed. In addition to text, the notification may be replaced with an icon or other element that conveys the same meaning. 【0132】 Furthermore, for example, in Figure 8(C), the user is asked to confirm their choice to perform the first-step authentication. This confirmation may be displayed within the validity period of the second-step authentication, for example, when the user takes their eyes off the electronic viewfinder 14. 【0133】 If the user selects "Yes" from the "Yes" and "No" command buttons, the command is notified and camera system 1 begins the first-stage authentication process. Alternatively, a command button to directly initiate the first-stage authentication process may be displayed as a GUI element, rather than requiring a "Yes" or "No" selection. Furthermore, for example, the waiting string in Figure 8(B) may itself be treated as a command button. 【0134】 Furthermore, for example, in Figure 8(D), the user is shown the suspension and cancellation of the photographer authentication due to the failure to perform the first-stage authentication. This confirmation may be displayed within the validity period of the second-stage authentication, for example, during the transition period when the system proceeds to negate the validity of the second-stage authentication while the first-stage authentication has not been performed. 【0135】 If the user selects "Yes" from the "Yes" or "No" commands, camera system 1 will discard the photographer authentication for the previously acquired image and proceed to the next action. This notifies the user that the first stage of authentication has not been performed and leaves it to the user to decide whether or not it is acceptable for photographer authentication to be disabled. 【0136】 Figure 9 illustrates another example of the operation of the authentication display means 109 in this embodiment. Figures 9(A) and (B) show a specific example of a GUI used when performing first-stage authentication after second-stage authentication, and an example of its operation. Note that the selection of commands on the screens in Figures 9(A) and (B) may be made before or after the first-stage authentication is performed. As shown in Figure 9, the touch panel display 15 functions as a selection means for selecting multiple captured images displayed on the display means. Alternatively, the controller 28 shown in Figure 8 may be used as the selection means. 【0137】 In Figure 9, the user can select which of the images that have undergone second-stage authentication they wish to have photographer authentication applied to, before performing the first-stage authentication. For example, in Figure 9(A), when performing the first-stage authentication, the user is left to select which images they wish to have photographer authentication applied to. That is, the first authentication means performs first photographer authentication on the images selected by the selection means. 【0138】 If the user executes the "Select All" command, all captured images within the validity period of the second-factor authentication will be treated as eligible. Subsequently, when the first-factor authentication is performed, the result will be applied. The assignment of photographer authentication based on the results of the second-factor authentication and the first-factor authentication will follow the authentication method described in Figure 4(B) or Figure 5. 【0139】 Furthermore, if the user executes the "Select Thumbnail" command, previously taken images that are still within the validity period will be displayed as thumbnails 29, for example, as shown in Figure 9(B). The user then selects the desired thumbnail from among the multiple thumbnails 29 and performs the first stage of authentication by selecting the "Perform Authentication" command. The results of the first stage of authentication are applied only to the images selected by the thumbnail, and photographer authentication is granted collectively according to the authentication method. Note that even images that were not selected by the thumbnail last time can be treated as subjects for photographer authentication by performing the selection process again, as long as they are still within the validity period of the second stage of authentication. 【0140】 Alternatively, as shown in Figures 9(A) and (B), the user can select the images they wish to authenticate after completing the first-stage authentication. After both the second-stage and first-stage authentications are completed, the user can apply photographer authentication to all images that are eligible for authentication by selecting them all at once using the "Select All" command. Alternatively, the user can select the desired thumbnails using "Thumbnail Selection" and then apply photographer authentication only to the selected images using the "Perform Authentication" command. 【0141】 Furthermore, Figures 9(C) and 9(D) show specific examples of how captured images with photographer authentication already applied can be displayed. For example, in Figure 9(C), the user is left to choose how to display captured images with photographer authentication applied. 【0142】 The user can select a command such as "Show one by one" or "Show thumbnails." If "Show thumbnails" is selected, for example, as shown in Figure 9(D), the captured images that have been authenticated will be displayed in a list and the user can view them. 【0143】 In this embodiment, the decision to perform photographer authentication is left to the user, and the user can select which images to which photographer authentication should be applied. The user can choose not to apply photographer authentication to images that are of little value to them. By excluding images of little value, it is possible to suppress the increase in processing load (processing time, power consumption, memory usage, etc.) associated with photographer authentication in the camera system 1. Furthermore, by excluding images of little value, it is possible to improve the efficiency of managing and searching for images to which photographer authentication has been applied. 【0144】 In the above-described embodiment, a camera was used to acquire user characteristics from the eyepiece image during shooting. Furthermore, an example was shown in which, after user (photographer) authentication, photographer information was added to the captured image in an immutable manner. However, the present invention is not limited to this example, and the implementation form is not limited as long as the spirit of the invention is carried out. 【0145】 The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or storage medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions. 【0146】 Although preferred embodiments of the present invention have been described above, the present invention is not limited to these embodiments, and various modifications and changes are possible within the scope of its essence. Embodiments of this disclosure include the following configurations, methods, and programs. 【0147】 [Configuration 1] A means for acquiring captured images, A first authentication means for performing first photographer authentication when the aforementioned captured image is not being captured, A second authentication means for performing second photographer authentication when capturing the aforementioned image, The system includes an information-adding means that adds photographer authentication information to the captured image acquired by the captured image acquisition means based on the results of the first photographer authentication and the second photographer authentication, If the first photographer authentication by the first authentication means is not performed and the second photographer authentication by the second authentication means is performed, the information assigning means assigns the authentication information if the first photographer authentication is performed within the validity period of the second photographer authentication set after the second photographer authentication, and the photographer can be identified by the first photographer authentication. An information processing device characterized by the following: [Configuration 2] The information processing device according to configuration 1, characterized in that the first photographer authentication is an authentication method using the photographer's biometric information. [Configuration 3] The information processing device according to configuration 1, characterized in that the first photographer authentication is an authentication method using non-biometric information. [Structure 4] The information processing device according to any one of configurations 1 to 3, characterized in that the accuracy of person identification by the second photographer authentication is lower than the accuracy of person identification by the first photographer authentication. [Composition 5] The information granting means is characterized in that, when the first photographer authentication is performed and the photographer is identified by the first photographer authentication, if the second photographer authentication is performed within the validity period of the first photographer authentication set after the first photographer authentication, the authentication information is granted. This is the information processing device according to any one of configurations 1 to 4. [Composition 6] The information processing device according to configuration 5, characterized in that the validity period of the first photographer authentication is longer than the validity period of the second photographer authentication. [Composition 7] The information processing device according to any one of configurations 1 to 6, characterized in that the authentication information includes information indicating the high accuracy of identifying the photographer. [Structure 8] The information processing device according to configuration 7, characterized in that the information indicating the high level of identification accuracy included in the captured image, on which only the second photographer authentication has been performed, is set to include information indicating that the photographer's identification accuracy is lower than the information indicating the high level of identification accuracy included in the captured image, on which both the first photographer authentication and the second photographer authentication have been performed. [Composition 9] It further includes a photographer detection means for detecting the photographer, The information-granting means extends the validity period of the second photographer authentication as long as the photographer detection means continues to detect the same photographer from the time of the second photographer authentication. An information processing device according to any one of configurations 1 to 8 characterized by the above. [Configuration 10] The information processing apparatus according to configuration 9, characterized in that the photographer detection means is comprised of one or more of the following: a proximity sensor for detecting the approach of the photographer, a contact sensor for detecting contact with the photographer, and an imaging means capable of capturing at least the face of the photographer. [Composition 11] It further has a means for displaying information, If the first photographer authentication has not been performed at the start of the validity period of the second photographer authentication, the display means will indicate that the first photographer authentication has not been performed. An information processing device according to any one of configurations 1 to 10 characterized by the above. [Composition 12] The display means displays a plurality of the captured images, The system further includes a selection means for selecting a plurality of the captured images displayed on the display means, The first authentication means performs the first photographer authentication on the captured image selected by the selection means. The information processing apparatus according to configuration 11, characterized by the features described above. [Composition 13] The information processing apparatus according to configuration 11 or 12, characterized in that the multiple captured images are displayed in thumbnail format on the display means. [Method 1] An information processing method performed by an information processing device, The process of acquiring captured images, The first authentication process involves performing the first photographer authentication when no shooting is taking place, A second authentication process is performed during shooting to verify the photographer, The system includes an information assignment step which assigns photographer authentication information to the captured image acquired in the captured image acquisition step based on the results of the first photographer authentication and the second photographer authentication, The information assignment step, if the first photographer authentication by the first authentication step is not performed and the second photographer authentication by the second authentication step is performed, assigns the authentication information if the first photographer authentication is performed within the validity period of the second photographer authentication set after the second photographer authentication, and the photographer can be identified by the first photographer authentication. An information processing method characterized by the following: [program] A program characterized by causing a computer to execute the information processing method described in Method 1. [Explanation of Symbols] 【0148】 1 Camera System 10 CPU 11 Memory section 12 Body 14 Electronic viewfinder 15 Touch panel display 17 Image sensor 22. Display for electronic viewfinder 27. Image sensor for the eye 28 Controller (Selection Method) 29 Thumbnails 100 Information Processing Devices 100A Information Processing Device 101 Imaging means (means for acquiring captured images) 102 Eyeball image acquisition means 103 Means of obtaining registrant information 104 First-stage authentication means (first authentication means) 105 Second-stage authentication method (second authentication method) 106 Holding means 107 Verifiable notification means 108 Verification means (first authentication means, second authentication means, information assignment means) 109 Authentication display means (display means) 110 Person detection means (photographer detection means) 111 Validity Period Adjustment Means (Information Assignment Means)

Claims

[Claim 1] A means for acquiring captured images, A first authentication means for performing first photographer authentication when the aforementioned captured image is not being captured, A second authentication means for performing second photographer authentication when the aforementioned captured image is taken, The system includes an information-adding means that adds photographer authentication information to the captured image acquired by the captured image acquisition means based on the results of the first photographer authentication and the second photographer authentication, If the first photographer authentication by the first authentication means is not performed and the second photographer authentication by the second authentication means is performed, the information assigning means assigns the authentication information if the first photographer authentication is performed within the validity period of the second photographer authentication set after the second photographer authentication, and the photographer can be identified by the first photographer authentication. An information processing device characterized by the following: [Claim 2] The information processing apparatus according to claim 1, characterized in that the first photographer authentication is an authentication method using the photographer's biometric information. [Claim 3] The information processing apparatus according to claim 1, characterized in that the first photographer authentication is an authentication method using non-biometric information. [Claim 4] The information processing device according to claim 1, characterized in that the accuracy of person identification by the second photographer authentication is lower than the accuracy of person identification by the first photographer authentication. [Claim 5] The information granting means is characterized in that, when the first photographer authentication is performed and the photographer is identified by the first photographer authentication, the second photographer authentication is performed within the validity period of the first photographer authentication set after the first photographer authentication, and the authentication information is granted. [Claim 6] The information processing device according to claim 5, characterized in that the validity period of the first photographer authentication is longer than the validity period of the second photographer authentication. [Claim 7] The information processing device according to claim 1, characterized in that the authentication information includes information indicating the high accuracy of identifying the photographer. [Claim 8] The information processing device according to claim 7, characterized in that the information indicating the high level of identification accuracy included in the captured image in which only the second photographer authentication has been performed is set to include information indicating that the photographer's identification accuracy is lower than the information indicating the high level of identification accuracy included in the captured image in which both the first photographer authentication and the second photographer authentication have been performed. [Claim 9] It further includes a photographer detection means for detecting the photographer, The information-granting means extends the validity period of the second photographer authentication as long as the photographer detection means continues to detect the same photographer from the time of the second photographer authentication. The information processing apparatus according to feature 1. [Claim 10] The information processing apparatus according to claim 9, characterized in that the photographer detection means comprises one or more of the following: a proximity sensor for detecting the approach of the photographer, a contact sensor for detecting contact with the photographer, and an imaging means capable of capturing at least the face of the photographer. [Claim 11] It further has a means for displaying information, If the first photographer authentication has not been performed at the start of the validity period of the second photographer authentication, the display means will indicate that the first photographer authentication has not been performed. The information processing apparatus according to feature 1. [Claim 12] The display means displays a plurality of the captured images, The system further includes a selection means for selecting a plurality of the captured images displayed on the display means, The first authentication means performs the first photographer authentication on the captured image selected by the selection means. The information processing apparatus according to feature 11. [Claim 13] The information processing apparatus according to claim 12, characterized in that the multiple captured images are displayed in thumbnail format on the display means. [Claim 14] An information processing method performed by an information processing device, The process of acquiring captured images, The first authentication process involves performing first-level photographer authentication when not taking pictures, A second authentication process is performed during shooting to verify the photographer, The system includes an information assignment step which adds photographer authentication information to the captured image acquired in the captured image acquisition step based on the results of the first photographer authentication and the second photographer authentication, The information assignment step, if the first photographer authentication by the first authentication step is not performed and the second photographer authentication by the second authentication step is performed, assigns the authentication information if the first photographer authentication is performed within the validity period of the second photographer authentication set after the second photographer authentication, and the photographer can be identified by the first photographer authentication. An information processing method characterized by the following: [Claim 15] A program characterized by causing a computer to execute the information processing method described in claim 14.

Images