Imaging apparatus, imaging system, method, and program

Abstract

The present invention provides a technique for allowing a specific target to use biological information of a subject.SOLUTION: An imaging apparatus for imaging a subject includes an authentication means for authenticating a user, and a control means for controlling the use of biological information of the subject on the basis of subject agreement information in which user information of the user authenticated by the authentication means is associated with agreement information for agreeing to the use of the biological information of the subject to the user.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to an imaging device, an imaging system, a method, and a program. [Background technology]

[0002] Artificial intelligence (AI) is known that performs detection or estimation processing using parameters obtained through image learning. AI is capable of intelligent processing and judgment equivalent to that of humans. As a result, AI has been increasingly utilized in various fields in recent years. However, there are opinions that restrictions should be placed on the use of a subject's biometric information (e.g., facial images, facial feature vectors, fingerprints, and irises) without the subject's consent. Currently, various countries and regions are working to establish laws regarding the handling of subjects' biometric information. Therefore, Patent Document 1 discloses a method for obtaining consent information from a subject who has biometric information and restricting the use of the biometric information based on the obtained consent information. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Patent No. 6150019 [Patent Document 2] Patent No. 3307936 [Non-patent literature]

[0004] [Non-Patent Document 1] K. He, X. Zhang, S. Ren, and J. Sun. Identity mappings in deep residual networks. In ECCV, 2016. [Non-patent document 2] Alexey Dosovitskiy, et al. An image is worth 16x16 words: Transformers for image recognition at scale. In ICLR, 2021. [Non-patent document 3] J. Deng, J. Guo, N. Xue, and S. Zafeiriou. Arcface: Additive angular margin loss for deep face recognition. In CVPR, 2019. [Non-patent document 4] Coalition for Content Provenance and Authenticity (C2PA), "C2PA Specifications", Technical Specifications Version 1.2, [online], November 3, 2022, [Retrieved January 23, 2023], Internet URL: https: / / c2pa.org / specifications / specifications / 1.2 / specs / C2PA_Specification.html Summary of the Invention [Problem to be solved by the invention]

[0005] Consider a situation in which a photographer captures an image of a subject using an imaging device. The subject wants to provide consent information (hereinafter simply referred to as consent information) to the use of the biometric information for each photographer, who is a user of the biometric information. The reason is that whether or not the photographer has the ability to properly handle the subject's biometric information is a factor in the subject's decision when providing consent information. For example, the subject wants to provide consent information to a photographer who has the ability to properly handle the biometric information. Conversely, the subject does not want to provide consent information to a photographer who does not have the ability to properly handle the biometric information. However, Patent Document 1 fails to satisfy the above-mentioned needs of the subject, and has the problem of providing consent information to the use of the subject's biometric information to all photographers in the same way.

[0006] Therefore, an object of the present invention is to provide a technique for allowing a specific target to utilize the biological information of a subject. [Means for solving the problem]

[0007] In order to achieve the object of the present invention, an imaging device according to one embodiment of the present invention comprises the following configuration: an imaging device for imaging a subject, comprising: authentication means for authenticating a user; and control means for controlling use of the biometric information based on subject consent information that links user information of the user authenticated by the authentication means with consent information for the user agreeing to use of the biometric information of the subject. [Effects of the Invention]

[0008] According to the present invention, it is possible to provide a technique for allowing a specific target to utilize the biological information of a subject. [Brief explanation of the drawings]

[0009] [Figure 1A] FIG. 1 is a front perspective view of an imaging device according to a first embodiment. [Figure 1B] FIG. 2 is a rear perspective view of the imaging device according to the first embodiment. [Figure 1C] FIG. 1 is a schematic diagram of an imaging system according to a first embodiment. [Figure 1D] FIG. 10 is a schematic diagram of an imaging system according to a second embodiment. [Figure 2] 1B is a cross-sectional view of the imaging device taken along a YZ plane defined by the Y axis and Z axis shown in FIG. 1A. [Figure 3] FIG. 1 is a block diagram showing the electrical configuration within an imaging device according to a first embodiment. [Figure 4] FIG. 1 is a diagram showing the functional configuration of an imaging apparatus according to a first embodiment. [Figure 5] 2 is a block diagram showing the hardware configuration of the mobile terminal according to the first embodiment. FIG. [Figure 6] FIG. 2 is a diagram showing the functional configuration of the mobile terminal according to the first embodiment. [Figure 7]4 is a flowchart illustrating processing executed by the imaging system according to the first embodiment. [Figure 8] 8 is a flowchart illustrating the processing executed by the imaging apparatus in S701 of FIG. 7. [Figure 9] 10 is an example of a registered user information table according to the first embodiment. [Figure 10] 10 is an example of a registered user characteristic vector table according to the first embodiment. [Figure 11] 8 is a flowchart illustrating processing executed by the imaging apparatus in S702 of FIG. 7. [Figure 12] 1 is a flowchart illustrating a user authentication process executed by an imaging device according to a first embodiment. [Figure 13] 5 is a flowchart illustrating processing executed by the mobile terminal according to the first embodiment. [Figure 14] 10 is an example of a confirmation message displayed on the mobile terminal according to the first embodiment. [Figure 15] 10 is an example of consent information according to the first embodiment. [Figure 16] 10 shows an example of subject consent information according to the first embodiment. [Figure 17] 8 is a flowchart illustrating processing executed by the imaging apparatus in step S703 of FIG. 7. [Figure 18] 10 shows an example of a biological information utilization management table according to the first embodiment. [Figure 19] 8 is a flowchart illustrating processing executed by the imaging apparatus in S704 of FIG. 7. [Figure 20] 10 is an example of a subject feature vector table according to the first embodiment. [Figure 21] 8 is a flowchart illustrating processing executed by the imaging apparatus in S704 of FIG. 7. [Figure 22] 3 shows an example of a file format of a captured image according to the first embodiment. [Figure 23] FIG. 10 is a diagram showing the functional configuration of an imaging apparatus according to a second embodiment. [Figure 24] FIG. 10 is a diagram showing the functional configuration of a mobile terminal according to a second embodiment. [Figure 25]FIG. 10 is a diagram showing the functional configuration of a server according to the second embodiment. [Figure 26] 10 is a flowchart illustrating processing executed by an imaging device according to a second embodiment. [Figure 27] 10 is a flowchart illustrating processing executed by a mobile terminal according to a second embodiment. [Figure 28] 10 is a flowchart illustrating processing executed by a server according to the second embodiment. [Figure 29] 10 is an example of a registered user information table according to the second embodiment. [Figure 30] 10 shows an example of subject consent information according to the second embodiment. [Figure 31] 10 is an example of a confirmation message displayed on the mobile terminal according to the second embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. Note that the following embodiments do not limit the scope of the claimed invention. Although multiple features are described in the embodiments, not all of these multiple features are necessarily essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same reference numerals are used to designate the same or similar components, and redundant explanations will be omitted.

[0011] (First embodiment) FIG. 1C is a schematic diagram of an imaging system according to a first embodiment. The imaging system 10 is a system capable of controlling the use of biometric information of a subject. The imaging system 10 includes an imaging device 100 that captures an image of a subject, and a mobile terminal 500. The imaging device 100 is a digital still camera, such as an interchangeable lens camera. The mobile terminal 500 is a mobile terminal carried by the subject, such as a PC (Personal Computer), a smartphone, or a tablet. The mobile terminal 500 is not limited to a mobile terminal carried by the subject, and may be, for example, another terminal not carried by the subject (hereinafter also referred to as a terminal other than a mobile terminal). The terminal other than the mobile terminal 500 is, for example, a terminal installed in a photo studio or a hospital.

[0012] 1A and 1B are front and rear perspective views of the imaging device according to the first embodiment.

[0013] 1A includes a lens unit 100a and a housing 100b. The housing 100b is provided with a release button 101. The release button 101 is an operating member that accepts an image capturing operation from a user (photographer).

[0014] 1B is provided on the back of housing 100b with eyepiece 102 (finder) through which the user looks to view display device 214 (display panel) (described later) included in housing 100b. Operation members 103, 104, and 105 that accept various operations from the user are provided on the back of housing 100b.

[0015] The operation member 103 is, for example, a touch panel that accepts touch operations by the user. The operation member 104 is an operation lever that can be pushed down in all directions. The operation member 105 is a four-way key that can be pushed in each of four directions. The operation member 103 (touch panel) includes a display panel (for example, a liquid crystal panel). The operation member 103 has a function of displaying images on the display panel.

[0016] 2 is a cross-sectional view of the imaging device taken along the YZ plane defined by the Y axis and Z axis shown in FIG.

[0017] The lens unit 100 a includes a lens 201 , a lens 202 , an aperture 203 , an aperture driver 204 , a lens drive motor 205 , a lens driver 206 , a photocoupler 207 , a pulse plate 208 , a mount contact 209 , and a focus adjustment circuit 210 .

[0018] The lens driving member 206 includes a driving gear. A photocoupler 207 detects the rotation of a pulse plate 208 that is linked to the lens driving member 206, and transmits the detection information to a focus adjustment circuit 210.

[0019] The focus adjustment circuit 210 drives the lens drive motor 205 based on information from the photocoupler 207 and information from the housing 100b (information on the lens drive amount), and moves the lens 201 to change the focus position.

[0020] Mount contact 209 is an interface between lens unit 100a and housing 100b. For ease of explanation, two lenses (lens 201 and lens 202) are shown, but in reality, two or more lenses are included in lens unit 100a.

[0021] The housing 100b includes an imaging element 211, a CPU 212, a memory unit 213, a display device 214, and a display device drive circuit 215.

[0022] The image sensor 211 is disposed on the intended imaging plane of the lens unit 100a.

[0023] The CPU 212 is a central processing unit of the microcomputer, and controls the entire imaging device 100 .

[0024] The memory unit 213 stores various information, for example, an image captured by the image sensor 211.

[0025] The display device 214 displays various information on the screen of the display device 214. For example, the display device 214 is a liquid crystal panel, and displays a captured image (subject image) on the screen.

[0026] A display device drive circuit 215 drives the display device 214. A user can view the screen of the display device 214 through the eyepiece 102.

[0027] Housing 100b further includes light source 216a, light source 216b, light splitter 217, receiving lens 218, and eye imaging element 219.

[0028] The light sources 216a and 216b are light sources conventionally used in single-lens reflex cameras to detect the line of sight from the relationship between the pupil and a reflection image (corneal reflection image) of light reflected by the cornea. The light sources 216a and 216b are light sources for illuminating the eyeball 220 of a user looking through the viewfinder (eyepiece 102). For example, the light sources 216a and 216b are infrared light-emitting diodes that emit infrared light insensitive to the user, and are arranged around the eyepiece 102. An optical image of the illuminated eyeball 220 (eye optical image; an optical image formed by light emitted from the light sources 216a and 216b and reflected by the eyeball 220) passes through the eyepiece 102 and is reflected by the beam splitter 217. The eye optical image is then formed by the light receiving lens 218 on an eye imaging element 219, which has a plurality of photoelectric conversion elements (e.g., CCD or CMOS) arranged two-dimensionally.

[0029] The light receiving lens 218 positions the pupil of the eyeball 220 and the eye image pickup element 219 in a conjugate imaging relationship. By a gaze detection process described later, the gaze of the eyeball 220 is detected from the position of the corneal reflection image in the eye optical image formed on the eye image pickup element 219. For example, at least one of information indicating the gaze direction (direction of the gaze) and information indicating the viewpoint (position to which the gaze is directed) on the screen of the display device 214 is obtained as information related to the gaze. The viewpoint is the position at which the user is looking or the gaze position.

[0030] FIG. 3 is a block diagram showing the electrical configuration within the imaging device according to the first embodiment.

[0031] The CPU 212 is connected to a line-of-sight detection circuit 301 , a photometry circuit 302 , an autofocus detection circuit 303 , a signal input circuit 304 , a display device drive circuit 215 , a light source drive circuit 305 , and a communication circuit 306 .

[0032] The CPU 212 transmits signals to a focus adjustment circuit 210 disposed in the lens unit 100a and to an aperture control circuit 307 included in an aperture drive unit 204 in the lens unit 100a via a mount contact 209. A memory unit 213 attached to the CPU 212 has a function of storing image signals from the image sensor 211 and the eye image sensor 219.

[0033] The gaze detection circuit 301 A / D converts the output of the eye imaging element 219 (eye image obtained by capturing an image of the eyeball 220) when an eye optical image is formed on the eye imaging element 219, and transmits the result to the CPU 212. The CPU 212 extracts feature points required for gaze detection from the eye image according to gaze detection processing, and detects the user's gaze from the positions of the feature points.

[0034] The photometry circuit 302 performs predetermined processing (e.g., amplification, logarithmic compression, and A / D conversion) on a signal obtained from the image sensor 211, which also functions as a photometry sensor, such as a luminance signal corresponding to the brightness of the field, and transmits the result to the CPU 212 as field luminance information.

[0035] The autofocus detection circuit 303 A / D converts signals from multiple detection elements (multiple pixels) included in the image sensor 211 and used for phase difference detection, and transmits the A / D conversion results to the CPU 212. The CPU 212 calculates the distance to the subject corresponding to each focus detection point from the signals from the multiple detection elements. This is a well-known technique known as image plane phase difference AF.

[0036] Switches SW1 and SW2 are connected to the signal input circuit 304. Switch SW1 transmits an ON signal with the first stroke of the release button 101. Switch SW1 is a switch for starting the imaging preparation operation (e.g., photometry and distance measurement) of the imaging device 100. Switch SW2 transmits an ON signal with the second stroke of the release button 101. Switch SW2 is a switch for starting the imaging operation. The ON signals from switches SW1 and SW2 are input to the signal input circuit 304 and transmitted to the CPU 212. Note that when switch SW1 is turned ON, line of sight detection may also be started.

[0037] The light source drive circuit 305 drives the light source 216a and the light source 216b.

[0038] The communication circuit 306 connects to and communicates with external devices in accordance with communication standards such as Bluetooth and WiFi.

[0039] Furthermore, operation members 103, 104, and 105 are connected to CPU 212. When a user operates operation members 103, 104, and 105, operation members 103 to 105 output operation signals according to the user's operations to CPU 212. CPU 212 performs processing (control) according to the operation signals. For example, CPU 212 moves a selection frame of a displayed menu according to the operation signals.

[0040] 4 is a diagram showing the functional configuration of an imaging device according to the first embodiment. The imaging device 100 is an imaging device capable of controlling the use of biometric information. The imaging device 100 uses an image of the eyeball 220 of a user looking through a finder (eyepiece 102) to authenticate whether the user looking through the finder is a registered user.

[0041] The eye image acquisition unit 401 acquires an image of the eyeball 220 of the user looking through the finder (eyepiece 102).

[0042] The feature vector calculation unit 402 calculates a feature vector to be used for user authentication from the eye image.

[0043] The user registration unit 403 creates data to be registered in the user information storage unit 404 (user registration information).

[0044] The user information storage unit 404 is configured from the memory unit 213 and stores registration information of users who use the imaging device 100 .

[0045] The user authentication unit 405 authenticates whether or not a user (photographer) using the imaging device 100 is a user registered in the user information storage unit 404. The user authentication unit 405 is an authentication means for authenticating a user. The user authentication unit 405 can authenticate a user based on an eye image acquired from the user.

[0046] The consent request unit 406 is an acquisition unit that acquires consent information that consents to the use of the subject's biometric information. The consent request unit 406 transmits a request to the portable terminal 500 or a terminal other than the portable terminal 500 that the subject possesses to transmit consent information that consents to the use of the subject's biometric information. The consent request unit 406 can then acquire the consent information from the portable terminal 500 or a terminal other than the portable terminal 500 that the subject possesses.

[0047] The consent information management unit 407 manages authenticated user information in association with consent information that consents to the use of the subject's biometric information acquired from the subject's mobile terminal 500.

[0048] The consent information storage unit 408 is configured from the memory unit 213. The consent information storage unit 408 stores authenticated user information and consent information that consents to the use of the subject's biometric information in association with each other.

[0049] When the imaging unit 410 receives a signal indicating that the release button 101 has been pressed by the user, the imaging unit 410 stores the image captured by the imaging element 211 in the memory unit 213 .

[0050] The subject feature vector calculation unit 411 calculates the feature vector of the subject captured by the imaging unit 410.

[0051] The object feature vector storage unit 412 stores the feature vector of the object.

[0052] The subject identification unit 413 identifies the subject (for example, the name of the subject) based on the feature vector of the subject registered in the subject feature vector storage unit 412 and the feature vector of the subject extracted from the captured image.

[0053] The biometric information usage control unit 409 is a control means for controlling the use of the subject's biometric information. The biometric information usage control unit 409 controls to restrict the use of functions that use biometric information (for example, the function of the subject identification unit 413) and the image file creation unit 414 based on the subject's consent information managed by the consent information management unit 407. For example, the biometric information usage control unit 409 controls to restrict the storage, distribution, and display of biometric information based on the subject's consent information. Furthermore, the biometric information usage control unit 409 can control the use of biometric information based on the subject's authentication result by the subject authentication unit 603 (described later) and consent information.

[0054] The image file creation unit 414 is an output unit that outputs an image file, and creates an image file to which user information and consent information are added as metadata of an image of a captured subject, and outputs the image file.

[0055] The image storage unit 415 is configured from the memory unit 213. The image storage unit 415 stores image files to which user information and consent information are added as metadata.

[0056] 5 is a block diagram showing the hardware configuration of a mobile terminal according to the first embodiment. The mobile terminal 500 includes a CPU 501, a ROM 502, a RAM 503, a secondary storage device 504, an input device 505, a display device 506, a network I / F 507, and a bus 508.

[0057] The CPU 501 executes instructions according to programs stored in the ROM 502 and RAM 503. The CPU 501 reads software that implements processes corresponding to the steps of the flowcharts described below from the secondary storage device 504 and RAM 503, and executes the read results.

[0058] The ROM 502 is a non-volatile memory that stores programs for implementing each embodiment, programs required for other controls, and data.

[0059] The RAM 503 is a volatile memory that stores temporary data such as frame image data and pattern discrimination results.

[0060] The secondary storage device 504 is a rewritable secondary storage device such as a hard disk drive or flash memory. The secondary storage device 504 stores images, programs, and various settings. This stored information is transferred to the RAM 503. The CPU 501 executes the programs in the RAM 503 and uses the data.

[0061] The input device 505 is a device (input means) that accepts user input, and is, for example, a keyboard and a mouse.

[0062] The display device 506 is a device that displays the processing results to the user, and is, for example, any one of a cathode ray tube (CRT), a liquid crystal display, and an organic EL display.

[0063] The network I / F 507 is a modem and LAN that connects to a network such as the Internet or an intranet.

[0064] Bus 508 interconnects the various components of mobile terminal 500 and performs input and output of data between the components.

[0065] 6 is a diagram showing the functional configuration of the mobile terminal of Embodiment 1. The mobile terminal 500 includes a request receiving unit 601, a consent information obtaining unit 602, a subject recognizing unit 603, and a consent information transmitting unit 604.

[0066] The request receiving unit 601 is configured from the network I / F 507. The request receiving unit 601 receives a request from the image capturing device 100 to transmit consent information indicating consent to the use of biometric information.

[0067] The consent information acquisition unit 602 is composed of the input device 505 and the display device 506. The consent information acquisition unit 602 is an acquisition means for acquiring consent information that consents to the use of the subject's biometric information. The consent information acquisition unit 602 acquires consent information that consents to the use of the subject's biometric information based on input information input by the subject via the input device 505 (input means). For example, the subject can input information about an imaging device that consents to the use of the biometric information from information about one or more imaging devices via the input device 505 (input means) as shown in FIG. 31. Then, the consent information acquisition unit 602 receives the input from the input device 505.

[0068] The subject authentication unit 603 is a subject authentication means that authenticates whether or not a subject is a subject registered in the mobile terminal 500. The subject authentication unit 603 can authenticate a subject using the mobile terminal 500 using biometric authentication such as face authentication, fingerprint authentication, and iris authentication.

[0069] The consent information transmitting unit 604 is configured from the network I / F 507 etc. The consent information transmitting unit 604 is a transmitting unit that transmits consent information to the imaging device 100. The consent information transmitting unit 604 transmits consent information, which consents to the use of the biometric information acquired by the consent information acquiring unit 602, to the imaging device 100.

[0070] 7 is a flowchart illustrating the processing executed by the imaging system according to the first embodiment. This imaging system controls the use of biological information of a subject.

[0071] Step S701 is user information registration processing, in which the imaging device 100 registers user information in order to perform user authentication.

[0072] S702 is consent / management processing for use of biometric information. In S702, the mobile terminal 500 acquires consent information from the subject agreeing to the use of the biometric information. Meanwhile, the imaging device 100 associates the user information registered in S701 with the consent information agreeing to the use of the biometric information acquired from the mobile terminal 500.

[0073] S703 is a process for preparing to use biometric information. In S703, before the imaging device 100 starts capturing an image of the subject, preparations (settings) are made to make the biometric information of the subject available for use.

[0074] S704 is a process for using biometric information. In S704, the image capturing apparatus 100 uses the biometric information of the subject.

[0075] FIG. 8 is a flowchart illustrating the process executed by the imaging device in S701 of FIG.

[0076] Before a user (photographer) captures an image of a subject with the imaging device 100, the user operates the imaging device 100 to perform user registration. When the user operates a menu screen (not shown) of the imaging device 100 to call up user registration processing, the user registration processing is executed. For example, a menu screen is displayed on the touch panel (operation member 103) of the imaging device 100. The user operates the menu screen using the operation members 103 to 105 to select a menu that calls up the user registration processing. When this menu is selected by the user, the user registration processing is executed.

[0077] In S801, the user inputs user information to the imaging device 100. In this embodiment, the user inputs "name." For example, a screen (not shown) for inputting the name is displayed on the touch panel (operation member 103). The user inputs the name by operating the operation members 103 to 105. After the user inputs the name, the name input is completed by pressing the complete button displayed on the screen.

[0078] In S802, the imaging device 100 displays instructions for registering the user's eye images. The imaging device 100 displays the instructions for the user on, for example, a touch panel (operation member 103). The instructions for the user are instructions for the user to look into the finder (eyepiece 102). At this time, instructions including instructions for the user not to blink and to open their eyes wide may be displayed on the touch panel (operation member 103) so that the imaging device 100 can capture a good image of the user's eyes.

[0079] In S803, the image capturing device 100 captures an image of the user's eye while the user is looking through the viewfinder (eyepiece 102) and acquires an image of the user's eye. The image capturing device 100 acquires the user's eye image (eye image signal; electrical signal of the eye image) from, for example, the eye image capturing element 219 via the gaze detection circuit 301. The image capturing device 100 calculates the pupil center from the gaze detection result of the gaze detection circuit 301 and acquires an eye image in which the pupil center is located at the center of the image.

[0080] In S804, the feature vector calculation unit 402 calculates a feature vector from the eye image. To calculate the feature vector from the eye image, the feature vector calculation unit 402 uses, for example, a neural network as a feature extractor. The neural network is, for example, a convolutional neural network (hereinafter, CNN). CNN repeatedly performs processing on an input image, including convolution processing, activation processing, and pooling processing. This allows the CNN to extract abstract information from the input image. Here, a processing unit consisting of the convolution processing, activation processing, and pooling processing is generally called a layer. The activation processing may be performed using a known method, such as a method called rectified linear unit (ReLU). The pooling processing may be performed using a known method, such as a method called maximum pooling. For example, the CNN structure may be configured with ResNet, as described in Non-Patent Document 1. The neural network may also be a neural network called Vision Transformer (ViT), as described in Non-Patent Document 2. The configuration of the neural network is not limited to these. The memory unit 213 stores information on the structure and weights of the neural network.

[0081] The weights of the neural network are assumed to have been acquired in advance by training the neural network, for example, using pre-acquired training images of various people's eyes and the ArcFace method described in Non-Patent Document 3.

[0082] Although a method using a neural network has been exemplified as a method of user authentication using eye images, for example, a known iris authentication method (see Patent Document 2) may also be used as a method of user authentication. However, the user authentication method is not limited to these.

[0083] In S805, the imaging device 100 stores in the memory unit 213 information linking the feature vector of the user's eye image with the user's name.

[0084] In S806, the imaging device displays a screen on the touch panel (operation member 103) and / or the display device 214 to notify the user that the registration of the user information has been completed. The imaging device 100 displays, for example, a message saying "User information registration has been completed!" on the operation member 103. This allows the user to recognize that the registration work of the user information has been completed.

[0085] FIG. 9 shows an example of a registered user information table according to the first embodiment. FIG. 10 shows an example of a registered user feature vector table according to the first embodiment. The user's name acquired by the imaging device 100 in S801 is recorded in the user name field of the registered user information table 900 in FIG. 9. The registered user information table 900 may also be simply referred to as "user information." The feature vector extracted from the user's eye image by the imaging device 100 in S804 is recorded in the feature vector field of the registered user feature vector table 1000 in FIG.

[0086] The registered user information table 900 and the registered user feature vector table 1000 have the same common user ID (i.e., user ID: 1, user ID: 2). The registered user information table 900 records information of user names (Yamada Taro, Yamada Hanako). The registered user feature vector table 1000 records feature vectors (feature vector 1, feature vector 2) used by the user authentication unit 405.

[0087] <Acquisition and management of consent information for consenting to the use of biometric information> Fig. 11 is a flowchart illustrating the processing executed by the imaging device in S702 of Fig. 7. After the processing of S1103 is executed, the mobile terminal 500 executes the processing of Fig. 13. Then, after the processing of Fig. 13 is completed, the processing of S1104 of Fig. 11 resumes.

[0088] In S1101, the user authentication unit 405 performs a user authentication process.

[0089] FIG. 12 is a flowchart illustrating the user authentication process executed by the imaging device according to the first embodiment.

[0090] The user authentication process is executed when the user operates the imaging device 100 to call up the user authentication process from a menu screen. For example, a menu screen (not shown) is displayed on the touch panel (operation member 103) of the imaging device 100. Then, the user operates the operation members 103 to 105 to select a menu for calling up the user authentication process from the menu screen. This starts the user authentication process.

[0091] In S1201, the imaging device 100 displays instructions for user authentication on the screen. For example, the imaging device 100 displays instructions on the touch panel (operation member 103) to have the user look into the viewfinder (eyepiece 102). The instructions for user authentication may include, for example, instructions to not blink, to keep the eyes wide open, and to hold the imaging device 100 firmly so that the imaging device 100 can capture a good image of the user's eyes.

[0092] In S1202, the imaging device 100 captures an image of the user's eye while the user is looking through the finder (eyepiece 102). The method for capturing the image of the user's eye is the same as that in S803, and therefore a description thereof will be omitted.

[0093] In S1203, the image capturing apparatus 100 calculates a feature vector from the image of the user's eye captured in S1202.

[0094] In S1204, the imaging device 100 acquires a registered feature vector to be used for user authentication from the user information storage unit 404. The imaging device 100 acquires all feature vectors (feature vector 1, feature vector 2) in the registered user feature vector table 1000 in FIG.

[0095] In S1205, the image capturing device 100 calculates the cosine similarity by comparing the feature vector of the eye image acquired in S1203 with the registered feature vector acquired in S1204. The image capturing device 100 determines the user ID based on whether the calculated cosine similarity exceeds a predetermined threshold. If the cosine similarity exceeds the threshold, the image capturing device 100 identifies the user ID (user ID: 1 or user ID: 2) corresponding to the registered feature vector (feature vector 1 or feature vector 2) used to calculate the cosine similarity. If the cosine similarity does not exceed the threshold, the image capturing device 100 does not perform user ID determination.

[0096] In S1206, it is determined whether user authentication has been successful. For example, if the cosine similarity exceeds the threshold in S1205 and there is a registered feature vector used to calculate the cosine similarity, it is determined that user authentication has been successful. If it is determined that user authentication has been successful (YES in S1206), the process proceeds to S1207. If it is determined that user authentication has not been successful (NO in S1206), the process proceeds to S1209.

[0097] In S1207, the imaging apparatus 100 updates the authentication status information stored in the memory unit 213 with the user ID identified in S1205. The authentication status information indicates the currently authenticated user ID.

[0098] In S1208, the imaging device 100 displays on the touch panel (operation member 103) and / or the display device 214 a screen notifying the user that user authentication has been successful.

[0099] In S1209, the imaging device 100 deletes the user ID from the authentication status information, and overwrites the authentication status information with, for example, a NULL value indicating that the authentication status information is empty.

[0100] In S1210, the imaging device 100 displays a screen notifying the user of a user authentication failure on the touch panel (operation member 103) and / or the display device 214. Now, return to the description of FIG.

[0101] In S1102, the imaging device 100 determines whether or not the user authentication has been successful. If the imaging device 100 determines that the user authentication has been successful (YES in S1102), the processing proceeds to S1103. On the other hand, if the imaging device 100 determines that the user authentication has failed (NO in S1102), the processing proceeds to S1107.

[0102] In S1103, the consent request unit 406 of the imaging device 100 requests the mobile terminal 500 carried by the subject to transmit consent information agreeing to the use of the biometric information in order to obtain consent information agreeing to the use of the biometric information from the subject.

[0103] 13 is a flowchart illustrating processing executed by the mobile terminal according to the first embodiment. The processing program shown in FIG. 13 is downloaded in advance to the mobile terminal 500 from a predetermined website. In other words, the processing program is provided in the form of an application that runs on the mobile terminal 500.

[0104] In S1301, the request receiving unit 601 of the mobile terminal 500 determines whether or not a request to transmit consent information has been received from the imaging device 100. The request to transmit consent information includes a predetermined code indicating a request to transmit consent information and user information (user name) authenticated in S1101. If the request receiving unit 601 determines that a request to transmit consent information has been received from the imaging device 100 (YES in S1301), the process proceeds to S1302. If the request receiving unit 601 determines that a request to transmit consent information has not been received from the imaging device 100 (NO in S1301), the request receiving unit 601 waits until a request to transmit consent information is received from the imaging device 100.

[0105] In S1302, the consent information acquisition unit 602 displays a confirmation message on the screen of the mobile terminal 500 to ask the subject whether or not he or she agrees to the transmission of the consent information.

[0106] FIG. 14 shows an example of a confirmation message displayed on the mobile terminal according to the first embodiment.

[0107] A confirmation message 1402 is displayed on screen 1401. The confirmation message 1402 is a message indicating the content of a request to transmit consent information. A standard message based on the name of the authenticated user (the photographer's name, "Yamada Hanako") and the name of the biometric information utilization function used by the photographer ("subject identification function") is displayed on screen 1401. The standard message in FIG. 14 is, for example, "Do you agree to capture images of (user name) and use (biometric information utilization function)?" In FIG. 14, the (user name) is Yamada Hanako, but this is not limited to this and may be the name of another photographer. Screen 1401 also displays a message stating, "If you agree, please press the YES button and then perform fingerprint authentication." The purpose of displaying a message prompting the subject to perform fingerprint authentication is to verify the subject's identity using the biometric authentication function (in this embodiment, fingerprint authentication) of mobile terminal 500. This can prevent malicious third parties from impersonating the subject and violating the subject's privacy. The YES button 1403 is a button for the subject to decide to consent to the request to transmit consent information. The NO button 1404 is a button for the subject to decide not to consent to the request to transmit consent information. Now, returning to the description of FIG. 13.

[0108] In S1303, the consent information acquisition unit 602 determines whether the subject has pressed the YES button 1403 by touch operation or the like. If the consent information acquisition unit 602 determines that the YES button 1403 has been pressed (YES in S1303), the process proceeds to S1304. Pressing the YES button 1403 means that the subject has indicated their intention to consent to the use of their biometric information. On the other hand, if the consent information acquisition unit 602 determines that the YES button 1403 has not been pressed (NO in S1303), the process proceeds to S1307. Pressing the NO button 1404 means that the subject has indicated their intention not to consent to the use of their biometric information.

[0109] In S1304, in order to confirm that the instruction in S1303 is an instruction from the subject himself / herself, the subject authentication unit 603 authenticates the subject using the biometric authentication function (i.e., fingerprint authentication) of the mobile terminal 500. Note that in S1304, the subject authentication unit 603 may execute the same process as the user authentication by the user authentication unit 405 (FIG. 12).

[0110] In S1305, portable terminal 500 determines whether or not authentication of the subject has been successful. If portable terminal 500 determines that authentication of the subject has been successful (YES in S1305), the process proceeds to S1306. If portable terminal 500 determines that authentication of the subject has not been successful (NO in S1305), the process proceeds to S1307.

[0111] In S1306, the consent information transmitting unit 604 transmits consent information 1500, which will be described later, to the imaging device 100.

[0112] In S1307, the consent information transmitting unit 604 transmits non-consent information (not shown) to the imaging device 100.

[0113] FIG. 15 shows an example of consent information according to the first embodiment.

[0114] The consent information 1500 includes the subject ID, the subject name, and the consent date and time. The subject ID is a combination of an ID issued to the subject by the subject's mobile terminal 500 and the individual number of the mobile terminal 500 (such as a telephone number or IP address).

[0115] The subject name is the name of the subject that is registered in advance in the mobile terminal 500 (for example, John Smith). The consent date and time is the date and time when the subject indicates their consent to the use of their biometric information (for example, the date and time when the YES button 1403 is pressed). If the subject does not consent to the use of their biometric information (if the NO button 1404 is pressed), the mobile terminal 500 invalidates the consent information 1500 by recording NULL values ​​for the subject ID, subject name, and consent date and time. Information that has invalidated the consent information 1500 in this way is referred to as "non-consent information." Now, we return to the explanation of Figure 11.

[0116] In S1104, the consent request unit 406 determines whether or not consent information (see FIG. 15) has been received from the mobile terminal 500. If the consent request unit 406 determines that consent information has been received from the mobile terminal 500 (YES in S1104), the process proceeds to S1105. On the other hand, if the consent request unit 406 determines that consent information has not been received from the mobile terminal 500 (that is, non-consent information has been received) (YES in S1104), the process proceeds to S1105.

[0117] In S1105, the consent information management unit 407 stores in the consent information storage unit 408 subject consent information 1600 (see FIG. 16) which will be described later and which links the consent information with the user information.

[0118] FIG. 16 shows an example of subject consent information according to the first embodiment.

[0119] The subject consent information 1600 includes the consent information 1500 (subject ID, subject name, consent date and time) received from the mobile terminal 500 and the authorized user ID (i.e., photographer ID) to which the subject consented to the use of their biometric information. Thus, the presence or absence of consent from the subject (TRUE) indicates the presence or absence of consent from the current user. The subject consent information 1600 may also include the consent information 1500, the authorized user ID, and information on the imaging device for which the subject consented to the use of their biometric information (e.g., model name, serial number, information on the imaging device that supports image authenticity assurance). Alternatively, the subject consent information 1600 may also include the consent information 1500 and information on the imaging device for which the subject consented to the use of their biometric information (e.g., model name, serial number, information on the imaging device that supports image authenticity assurance). In this way, the subject's consent to the use of their biometric information (also referred to as a specific subject) may include only the user, both the user and the imaging device, or only the imaging device.

[0120] The image capturing apparatus 100 may acquire consent information 1500 from a plurality of subjects. In Fig. 16, two subjects (subject IDs = 100 and 102) each consent to the use of their biometric information by authorized user ID = 2.

[0121] In S1106, the imaging device 100 displays a screen notifying the user that the subject has agreed to the use of their biometric information on the display touch panel (operation member 103) and / or the display device 214. For example, the imaging device 100 can display a message saying "Subject's consent has been obtained!" on the screen.

[0122] In S1107, the imaging device 100 displays a screen notifying the user that the subject has not consented to the use of the biometric information on the touch panel (operation member 103) and / or the display device 214. For example, the imaging device 100 can display a message saying "Subject's consent has not been obtained" on the screen.

[0123] <Preparation for use of biometric information> FIG. 17 is a flowchart illustrating the process executed by the imaging device in S703 of FIG.

[0124] In S1701, the imaging device 100 determines whether the user has operated the imaging device 100 to call up user authentication processing from a menu. The method for calling up user authentication processing is the same as the method for calling up user information registration processing, so a detailed description will be omitted. If the imaging device 100 determines that user authentication processing has been called up (YES in S1701), the processing proceeds to S1702. On the other hand, if the imaging device 100 determines that user authentication processing has not been called up (NO in S1701), the processing proceeds to S1708.

[0125] In S1702, the user authentication unit 405 performs user authentication processing. Details of the user authentication processing are the same as those described in Fig. 12, and therefore will not be described again.

[0126] In S1703, if the imaging device 100 determines that the user authentication in S1702 is successful (YES in S1703), the process proceeds to S1704. If the imaging device 100 determines that the user authentication in S1702 is not successful (NO in S1703), the process proceeds to S1708.

[0127] In S1704, the imaging device 100 displays a list of subjects who have consented to the use of their biometric information. The consent information management unit 407 creates a list of subjects by reading the subject consent information 1600 from the consent information storage unit 408. When the authorized user ID in the subject consent information 1600 is 2 (see FIG. 16 ), the imaging device 100 displays a list of "John Smith" and "Richard Ghosn" on the touch panel (operation member 103) and / or the display device 214.

[0128] In S1705, the imaging device 100 receives an input of a subject selected by the user. For example, the user selects a subject to be imaged from a list of subjects by touch operation or the like.

[0129] In S1706, the imaging device 100 determines whether the subject selected by the user from the list of subjects is the same as the subject whose image is about to be captured. For example, the imaging device 100 transmits a request to the portable terminal 500 of the subject to perform biometric authentication of the subject, similar to the method of acquiring the consent information 1500. Then, the subject uses the biometric authentication function (fingerprint authentication in this case) of the portable terminal 500. The imaging device 100 can determine whether the subject selected by the user is the same as the subject whose image is about to be captured, based on the fingerprint authentication result received from the portable terminal 500. Alternatively, the imaging device 100 may verify the identity of the subject by transmitting the subject ID (subject ID issued by the portable terminal 500) of the subject consent information 1600 to the portable terminal 500 of the subject to be verified. Then, the portable terminal 500 may verify whether the subject ID received from the imaging device 100 matches the subject ID stored in the portable terminal 500. The imaging device 100 may verify the identity of the subject based on the result of matching the subject ID received from the mobile terminal 500.

[0130] If the imaging device 100 determines that the subject selected by the user from the list of subjects is the same as the subject the user is about to capture (YES in S1706), the processing proceeds to S1707. If the imaging device 100 determines that the subject selected by the user from the list of subjects is not the same as the subject the user is about to capture (NO in S1706), the processing proceeds to S1708.

[0131] In S1707, the biometric information usage control unit 409 registers the subject ID in a table 1800 (see FIG. 18) described later so that the imaging device 100 can use the biometric information of the subject. This enables the biometric information usage function of the imaging device 100.

[0132] Here, FIG. 18 shows an example of the biological information utilization management table according to the first embodiment.

[0133] Table 1800 (biometric information usage management table) indicates subject IDs for which biometric information can be used. Memory unit 213 stores table 1800. In FIG. 18, only subject ID=100 is selected. Also, in S1706, it is assumed that identity verification of the subject corresponding to subject ID=100 has been successful.

[0134] In S1708, the biometric information usage control unit 409 sets predetermined information in the table 1800 so that the imaging device 100 cannot use the biometric information of the subject. The biometric information usage control unit 409 disables the biometric information usage function of the imaging device 100, for example, by setting a NULL value in the subject ID in the table 1800.

[0135] <Biometric information processing> Fig. 19 is a flowchart illustrating the process executed by the image capturing apparatus in S704 of Fig. 7. First, the process executed by the image capturing apparatus 100 to extract a feature vector, which is one type of biometric information, will be described with reference to Fig. 19.

[0136] In S1901, the imaging device 100 determines whether or not a subject ID for which biometric information can be used exists in the table 1800. If the imaging device 100 determines that a subject ID for which biometric information can be used exists in the table 1800 (YES in S1901), the processing proceeds to S1902. On the other hand, if the imaging device 100 determines that a subject ID for which biometric information can be used does not exist in the table 1800 (NO in S1901), the processing ends.

[0137] In S1902, the image capturing unit 410 captures an image of the subject.

[0138] In S1903, the subject feature vector calculation unit 411 extracts a feature vector of the subject from a captured image of the subject. The subject feature vector calculation unit 411 extracts facial features of the subject from the captured image, but may also extract features of the upper body and whole body of the subject from the captured image. As a method of extracting the subject features from the captured image, a method using CNN, similar to the feature vector calculation unit 402, can be used.

[0139] In S1904, the imaging device 100 stores in the subject feature vector memory unit 412 a subject feature vector table 2000 (see Figure 20) that links the feature vector extracted from the captured image by the subject feature vector calculation unit 411 with the consent information 1500 (subject ID, subject name) received from the mobile terminal 500.

[0140] 20 shows an example of an object feature vector table according to the first embodiment. The object feature vector table 2000 includes object IDs, object names, and feature vectors. The object IDs include, for example, 100 and 102. The object names include, for example, John Smith and Richard Ghosn. The feature vectors include, for example, feature vector A and feature vector B. The feature vectors are the feature vectors of the objects extracted from the captured image by the object feature vector calculation unit 411 in S1904.

[0141] Fig. 21 is a flowchart illustrating the processing executed by the imaging device in S704 of Fig. 7. Fig. 22 shows an example of a file format of a captured image according to the first embodiment. The processing in Fig. 21 is executed when the release button 101 is pressed down to the second stroke. The processing in Fig. 21 will be described with reference to Fig. 22.

[0142] In S2101, the image capturing unit 410 captures an image of a subject. For example, an image capturing process is performed in which light received by the image sensor 211 is converted into an electrical signal.

[0143] In S2102, the imaging unit 410 generates image data. For example, the imaging unit 410 performs image processing such as development processing and encoding processing on the electrical signal obtained by the imaging processing in S2101 to generate image data 2207 in FIG.

[0144] In S2103, the imaging device 100 determines whether or not there is a subject ID for which biometric information can be used in the table 1800. If the imaging device 100 determines that there is a subject ID for which biometric information can be used in the table 1800 (YES in S2103), the processing proceeds to S2104. If the imaging device 100 determines that there is not a subject ID for which biometric information can be used in the table 1800 (NO in S2103), the processing proceeds to S2110.

[0145] In S2104, the object identification unit 413 reads the current object ID and object feature vector from the object feature vector storage unit 412. The object identification unit 413 refers to the object feature vector table 2000.

[0146] In S2105, the object feature vector calculation unit 411 calculates the object feature vector from the image data 2207. The process of calculating the object feature vector is the same as the process in S804, and therefore a description thereof will be omitted.

[0147] In S2106, the subject identification unit 413 identifies the subject by comparing the subject feature vectors (feature vector A, feature vector B) read out in S2104 with the feature vector of the subject extracted in S2105. The subject identification process can be performed using cosine similarity, as in the process of S1205. If the cosine similarity exceeds a threshold, the subject identification unit 413 identifies the subject ID and subject name corresponding to the feature vector (feature vector A or feature vector B) used to calculate the cosine similarity. This allows the imaging device 100 to display the subject name of the captured subject in the captured image (image data 2207).

[0148] In S2107, the imaging device 100 creates metadata based on the table 1800 and the subject consent information 1600. The metadata includes the subject's name, consent date and time, and the user name associated with the authorized user ID obtained from the registered user information table 900. This makes it possible to indicate which subject, for which user, and when the image was captured with their consent.

[0149] An example of a method for recording image metadata is a method known as C2PA, described in Non-Patent Document 4. C2PA is a method for adding metadata indicating the editing content performed on an image to an image in order to authenticate the origin, history, and provenance of the image. Therefore, the image capture device 100 may record the authentication status based on C2PA, but this is not limited thereto and the authentication status may be recorded by other methods. Alternatively, the image capture device 100 may record the image file and the metadata file separately. Furthermore, the image capture device 100 may manage the metadata in a database. Note that the metadata recording method is not limited to these.

[0150] In S2108, the image file creation unit 414 executes a hash function on the binary data of the image data 2207, the user information 2203, and the subject consent information 2204 in FIG.

[0151] In S2109, the image file creation unit 414 generates a digital signature 2206. The digital signature 2206 includes information indicating a signature value, a signer, and a signature date and time. The signature value is generated by encrypting the hash value 2205 generated in S2108 using a private key prepared in advance. A public key that pairs with the private key used here is also stored in the digital signature 2206. In the signer of this embodiment, information indicating the manufacturer of the image capture device 100 is stored. Note that the model name of the image capture device 100 may be stored in place of the manufacturer of the image capture device 100. In addition, the date and time when the generation of the digital signature is completed is stored in the signature date and time.

[0152] In S2110, the image file creation unit 414 generates an image file 2201 by adding user information 2203, a hash value 2205, and a digital signature 2206 as metadata 2202 to image data 2207. Here, if the image data 2207 is a still image, the image file creation unit 414 generates the image file 2201 based on the JPEG format. If the image data 2207 is a moving image, the image file creation unit 414 generates the image file 2201 based on the MPEG format.

[0153] In S2109, the image file creation unit 414 stores the image file 2201 in the memory unit 213. Note that the memory unit 213 may be a storage medium that is detachable from the imaging device 100. The image file 2201 may be stored in the memory unit 213, which is a storage medium.

[0154] Note that the following verification method is used to confirm that the image file 2201 has not been tampered with. First, the imaging device 100 restores a hash value using a public key based on the signature value. Then, the imaging device 100 recalculates hash values ​​of the image data 2207 and the user information 2203. If the restored hash value matches the recalculated hash value, the imaging device 100 can determine that the image data 2207 has not been tampered with. On the other hand, if the restored hash value does not match the recalculated hash value, the imaging device 100 can determine that the image data 2207 has been tampered with.

[0155] If someone has tampered with the image data 2207, the person who tampered with the image data 2207 cannot change the signature value because the signature value is encrypted with a private key. Therefore, if the image data 2207 has been tampered with, the hash value calculated from the image data 2207 will not match the restored hash value. This allows the imaging device 100 to detect tampering of the image data 2207.

[0156] In this embodiment, the hash value is included in the image file 2201. However, the imaging device 100 can recalculate the hash value from the image data 2207 and user information 2203 included in the image file 2201. Therefore, the hash value does not need to be included in the image file 2201.

[0157] When the image capturing device 100 captures a video of a subject, video capturing begins after the release button 101 is pressed down to the second stroke. When the release button 101 is pressed down again to the second stroke, video capturing is completed. Then, video data is generated by executing the processes from S2101 to S2102. The image capturing device 100 can calculate a hash value of the video data and store the hash value of the video data instead of the hash value of the image data. In this case, the image capturing device 100 stores a video file in which the video data and metadata are linked.

[0158] As described above, the imaging device 100 can display the subject's name, consent date and time, and user name as character strings in the image data 2207. This allows the user and / or the subject to confirm that the subject's biometric information has been acquired and used in accordance with the correct procedures.

[0159] In S2110 (S2110 executed if NO in S2103), the image file creation unit 414 stores the image file 2201 for which the metadata 2202 does not exist in the memory unit. Here, even if the image file 2201 for which the metadata 2202 does not exist is read, the person's name is not displayed. Furthermore, if there is no subject ID for which biometric information can be used, the imaging device 100 may execute processing that prevents the image file 2201 from being saved and processing that prevents the image file 2201 from being transmitted to another device. This processing is not limited to these, and any method may be applied as long as it is possible to realize control that prevents the biometric information of the subject from being used.

[0160] As described above, according to the first embodiment, a subject can allow a specific target to use the subject's biometric information. The specific target in the first embodiment is a user (photographer) who uses the image capture device 100, but is not limited thereto, and may be both the user and the image capture device 100, or only the image capture device 100.

[0161] (Second embodiment) In the first embodiment, the imaging device 100 manages the subject's consent information 1500, but this is not limiting. In the second embodiment, the server 50, which will be described later, manages the subject's consent information. The differences from the first embodiment will be described below.

[0162] 1D is a schematic diagram of an imaging system according to a second embodiment. The imaging system 20 includes an imaging device 100 that captures an image of a subject, a mobile terminal 500, and a server 50. The imaging device 100 is a digital still camera, such as a camera with interchangeable lenses. The mobile terminal 500 is a mobile terminal carried by the subject, such as a PC, smartphone, or tablet.

[0163] FIG. 23 is a diagram showing the functional configuration of the imaging device according to the second embodiment.

[0164] The eye image acquisition unit 2301 has the same function as the eye image acquisition unit 401. The feature vector calculation unit 2302 has the same function as the feature vector calculation unit 402. The user registration unit 2303 has the same function as the user registration unit 403. The user information storage unit 2304 has the same function as the user information storage unit 404. The user authentication unit 2305 has the same function as the user authentication unit 405. The consent request unit 2307 has the same function as the consent request unit 406. The imaging unit 2310 has the same function as the imaging unit 410. The subject feature vector calculation unit 2311 has the same function as the subject feature vector calculation unit 411. The subject feature vector storage unit 2312 has the same function as the subject feature vector storage unit 412. The subject identification unit 2313 has the same function as the subject identification unit 413. The biometric information usage control unit 2309 has the same function as the biometric information usage control unit 409. The image storage unit 2315 has the same function as the image storage unit 415. The image file creation unit 2314 has the same function as the image file creation unit 414.

[0165] The user information transmission unit 2306 transmits the user information from the image capture device 100 to the server 50 .

[0166] The consent information receiving unit 2308 receives consent information from the server 50 .

[0167] FIG. 24 is a diagram illustrating the functional configuration of a mobile terminal according to the second embodiment.

[0168] The request receiving unit 2401 has the same function as the request receiving unit 601. The consent information obtaining unit 2403 has the same function as the consent information obtaining unit 602. The object recognizing unit 2404 has the same function as the object recognizing unit 603. The consent information transmitting unit 2405 has the same function as the consent information transmitting unit 604.

[0169] The imaging device information request unit 2402 acquires from the server 50 information on the imaging device 100 owned by the user (photographer) who requests transmission of consent information.

[0170] Fig. 25 is a diagram showing the functional configuration of a server according to the second embodiment. Note that the hardware configuration of the server 50 is the same as that in Fig. 5, and therefore a description thereof will be omitted.

[0171] The user information receiving unit 2501 includes the network I / F 507. The user information receiving unit 2501 receives user information (information about the photographer) from the image capturing device 100.

[0172] The user information registration unit 2502 stores the user information received by the user information receiving unit 2501 in the user information storage unit 2503 .

[0173] The user information storage unit 2503 is configured from the secondary storage device 504 and / or the RAM 503. The user information storage unit 2503 stores the user information received from the imaging device 100.

[0174] The imaging device information request receiving unit 2504 is configured from the network I / F 507. The imaging device information request receiving unit 2504 receives a request from the mobile terminal 500 to transmit user information of the imaging device 100.

[0175] The imaging device information transmission unit 2505 is configured from the network I / F 507. The imaging device information transmission unit 2505 reads out, from the user information storage unit 2503, the user information of the imaging device 100 that is requesting transmission of consent information, and transmits the user information to the mobile terminal 500.

[0176] The consent information receiving unit 2506 is configured from the network I / F 507. The consent information receiving unit 2506 receives consent information from the mobile terminal 500.

[0177] The consent information management unit 2507 associates the consent information from the mobile terminal 500 with the user information stored in the user information storage unit 2503 .

[0178] The subject consent information storage unit 2508 manages the subject consent information that the consent information management unit 2507 associates with user information.

[0179] The consent information transmitting unit 2509 transmits the consent information of the subject to the image capturing apparatus 100.

[0180] The processing flow of the second embodiment will be described. The processing is executed in roughly the same manner as in FIG. 7. However, since the server 50 is used in this embodiment, the "processing for obtaining and managing consent for use of biometric information (S702)" in the second embodiment is slightly different from the processing in FIG. 7. The user information registration processing in the second embodiment is similar to S701 in the first embodiment, and therefore will not be described here.

[0181] Fig. 26 is a flowchart illustrating processing executed by an imaging device according to the second embodiment. Fig. 27 is a flowchart illustrating processing executed by a mobile terminal according to the second embodiment. Fig. 28 is a flowchart illustrating processing executed by a server according to the second embodiment. The processing in Figs. 26 to 28 shows detailed processing of "processing for obtaining and managing consent for use of biometric information (S702)" in the first embodiment. First, the processing in Fig. 26 will be described.

[0182] In S2601, the user authentication unit 2305 of the image capturing apparatus 100 performs user authentication.

[0183] In S2602, the imaging device 100 determines whether or not the user authentication has been successful. If the imaging device 100 determines that the user authentication has been successful (YES in S2602), the processing proceeds to S2603. If the imaging device 100 determines that the user authentication has not been successful (NO in S2602), the processing proceeds to S2608.

[0184] In S2603, the user information transmission unit 2306 transmits the user information to the server 50. The user information includes the user's name and the model name of the imaging device 100.

[0185] 28, the user information receiving unit 2501 of the server 50 determines whether or not user information has been received from the imaging device 100. If the user information receiving unit 2501 determines that user information has been received from the imaging device 100 (YES in S2801), the process proceeds to S2802. On the other hand, if the user information receiving unit 2501 determines that user information has not been received from the imaging device 100 (NO in S2801), the process proceeds to S2803.

[0186] In S2802, the user information registration unit 2502 registers the user information in the user information storage unit 2503.

[0187] As explained in S805 of the first embodiment, user information is registered in the registered user information table 900. However, in consideration of the case where one user (photographer) uses multiple image capture devices 100, an item for the model name of the image capture device 100 can be added to the registered user information table 900 (see FIG. 29).

[0188] FIG. 29 shows an example of a registered user information table according to the second embodiment.

[0189] The registered user information table 2900 includes a user ID, a user name, and the model name of the imaging device. Three models (Camera01, Camera02, and Camera03) are registered as model names of imaging devices that satisfy the conditions of "user ID=2" and "user name=Yamada Hanako." Now, we will return to the explanation of FIG. 26.

[0190] In S2604, the consent request unit 2307 of the imaging device 100 transmits a request to transmit consent information to the subject's mobile terminal 500. The request to transmit consent information includes a predetermined code and the user name authenticated in S2601.

[0191] In S2701, the request receiving unit 2401 of the mobile terminal 500 determines whether or not a request to transmit consent information has been received from the imaging device 100. If the request receiving unit 2401 determines that a request to transmit consent information has been received from the imaging device 100 (YES in S2701), the process proceeds to S2702. If the request receiving unit 2401 determines that a request to transmit consent information has not been received from the imaging device 100 (NO in S2701), the request receiving unit 2401 waits until a request to transmit consent information is received.

[0192] In S2702, the imaging device information requesting unit 2402 transmits a request to the server 50 to transmit information about the imaging device 100 (for example, the model name of the imaging device) owned by the user who has requested the transmission of the consent information. The request to transmit the information about the imaging device 100 includes a predetermined code, a user ID, and a user name. Now, we return to the description of FIG. 28.

[0193] In S2804, the imaging device information transmission unit 2505 reads information about the imaging device 100 (model name of the imaging device) from the user information storage unit 2503 based on the user ID and user name. Then, the imaging device information transmission unit 2505 transmits the information about the imaging device 100 to the portable terminal 500. For example, assuming a condition including "user ID=2" and "user name=Yamada Hanako" (see FIG. 29), the imaging device information transmission unit 2505 transmits information about three models of imaging devices (Camera01, Camera02, Camera03) to the portable terminal 500. Now, we return to the description of FIG. 27.

[0194] In S2703, the imaging device information requesting unit 2402 of the mobile terminal 500 determines whether or not information about the imaging device 100 (model name: Camera01, Camera02, Camera03) has been received from the server 50. If the imaging device information requesting unit 2402 determines that information about the imaging device 100 has been received from the server 50 (YES in S2703), the processing proceeds to S2704. On the other hand, if the imaging device information requesting unit 2402 determines that information about the imaging device 100 has not been received from the server 50 (NO in S2703), the imaging device information requesting unit 2402 waits until information about the imaging device 100 is received.

[0195] In S2704, the consent information acquisition unit 2403 displays two confirmation messages (see FIGS. 14 and 31) on the screen of the mobile terminal 500.

[0196] The confirmation message may be, but is not limited to, the same message as in Fig. 14 of the first embodiment. In the second embodiment, the mobile terminal 500 receives information (model name) of the imaging device 100, and therefore may further display a confirmation message different from that in Fig. 14.

[0197] FIG. 31 shows an example of a confirmation message displayed on the mobile terminal according to the second embodiment.

[0198] Screen 3101 has an area 3102. A fixed phrase reflecting the name of the user who requested transmission of consent information ("Yamada Hanako" in FIG. 31) is displayed in area 3102. The fixed phrase includes the message "Photographer: (user name) owns the following equipment. Please uncheck any equipment you do not want to use." Based on the imaging device information received from server 50, thumbnail images 3103, 3104, and 3105 indicating the model of the imaging device are displayed on screen 3101. In addition to these thumbnail images, text (not shown) indicating the model name of the imaging device 100 may be displayed on screen 3101. Furthermore, check boxes 3106, 3107, and 3108 are displayed on screen 3101. The user can select at least one of check boxes 3106 to 3108. OK button 3109 is a button for confirming the model of the imaging device for which biometric information is not to be used. Here, we return to the explanation of FIG.

[0199] In S2705, the consent information acquisition unit 2403 determines whether the YES button 1403 in Fig. 14 and the OK button 3109 in Fig. 31 have been pressed. If the consent information acquisition unit 2403 determines that the YES button 1403 and the OK button 3109 have been pressed (YES in S2705), the process proceeds to S2706. On the other hand, if the consent information acquisition unit 2403 determines that the YES button 1403 and the OK button 3109 have not been pressed (NO in S2705), the process proceeds to S2709.

[0200] The processing of S2706 is the same as S1304. The processing of S2707 is the same as S1305. The processing of S2708 is the same as S1306, but the destination of the consent information is the server 50, not the imaging device 100. The processing of S2709 is the same as S1307, but the destination of the consent information is the server 50, not the imaging device 100. Now, return to the description of FIG. 28.

[0201] In S2805, the consent information receiving unit 2506 of the server 50 determines whether or not consent information has been received from the mobile terminal 500. If the consent information receiving unit 2506 determines that consent information has been received from the mobile terminal 500 (YES in S2805), the process proceeds to S2806. On the other hand, if the consent information receiving unit 2506 determines that consent information has not been received from the mobile terminal 500 (NO in S2805), the process proceeds to S2808.

[0202] In S2806, the consent information management unit 2507 stores, in the subject consent information storage unit 2508, subject consent information (see FIG. 30) that links the consent information with the user information.

[0203] FIG. 30 shows an example of subject consent information according to the second embodiment.

[0204] Compared to Fig. 16 of the first embodiment, the model names of permitted image capture devices have been added to the subject consent information 3000 in Fig. 30. For example, "subject name = John Smith" with "subject ID = 100" has agreed to the use of his / her biometric information by "permitted user ID = 2" with "permitted image capture device model names = Camera02 and Camera03." Now, we return to the explanation of Fig. 28.

[0205] In S2807, the consent information transmission unit 2509 of the server 50 transmits the subject consent information 3000 to the imaging device 100. Assuming that the subject ID in the subject consent information 3000 is 100, the consent information transmission unit 2509 transmits the subject consent information 3000 (subject ID and subject name) to the imaging devices (Camera02 and Camera03).

[0206] In S2808, the server 50 can disable the biometric information use function of the imaging device 100 by setting NULL values ​​to the subject ID and the subject name of the subject consent information 3000. The server 50 transmits subject non-consent information (not shown) that invalidates the subject consent information 3000 to the imaging device 100. Now, return to the description of FIG. 26.

[0207] In S2605, the consent request unit 2307 of the imaging device 100 receives the subject consent information 3000 or the subject non-consent information (not shown) from the server 50. The consent request unit 2307 stores the subject consent information 3000 or the subject non-consent information (not shown) received from the server 50 in the memory unit 213.

[0208] In S2606, the imaging device 100 determines whether or not the subject's consent has been obtained by referring to the subject's consent information 3000 or the subject's non-consent information (not shown). When the imaging device 100 receives the subject's consent information 3000, it determines that the subject's consent has been obtained. On the other hand, when the imaging device 100 receives the subject's non-consent information (not shown), it determines that the subject's consent has not been obtained.

[0209] If the imaging device 100 determines that the subject's consent has been obtained (YES in S2606), the process proceeds to S2607. On the other hand, if the imaging device 100 determines that the subject's consent has not been obtained (NO in S2606), the process proceeds to S2608.

[0210] In S2607, the imaging device 100 displays a screen notifying the user that consent has been obtained from the subject regarding the use of the biometric information on the touch panel (operation member 103) and / or the display device 214. For example, the imaging device 100 can display a message saying "Subject's consent has been obtained!" on the screen.

[0211] In S2606, a screen notifying the user that consent has not been obtained from the subject regarding the use of the biometric information is displayed on the touch panel (operation member 103) and / or the display device 214. For example, the imaging device 100 can display a message saying "Consent has not been obtained from the subject" on the screen.

[0212] Next, the differences between the biometric information use preparation process (S703) according to the second embodiment and the first embodiment will be described.

[0213] In S1704, a list of consenting subjects is created based on the subject consent information received by the consent information receiving unit 2308 from the server 50. The consent information management unit 2507 of the server 50 references the "permitted user" and "model name of permitted imaging device" from the subject consent information 3000. The consent information management unit 2507 then reads out the user ID of the destination imaging device, the subject ID corresponding to the model of the imaging device, the subject name, and the consent date and time, and creates the subject consent information.

[0214] The process of using biometric information (S704) according to the second embodiment is the same as that according to the first embodiment, and therefore a description thereof will be omitted.

[0215] As described above, according to the second embodiment, when one user (photographer) uses multiple imaging devices (models), the subject does not need to provide consent information for consenting to the use of biometric information for each imaging device. In other words, the subject can easily specify the model of the imaging device that will use the biometric information. Furthermore, the user only needs to register the model of the imaging device once.

[0216] (supplement) In the second embodiment, the server 50 manages the consent information, but the consent information may be managed by the subject's mobile terminal 500. In this case, the subject's mobile terminal 500 manages the consent information including the consent date and time in association with user information including the ID, user name, and model of the imaging device of the user to whom the consent information was transmitted.

[0217] In the first and second embodiments, user names are registered in the registered user information table 900 and the registered user information table 1300. However, thumbnail images of the user's face may also be registered in addition to the user name. This has the advantage that a thumbnail image of the user's face is displayed in Fig. 14, making it easier for the subject to confirm the user to whom the consent information is to be sent.

[0218] Furthermore, although the mobile terminal 500 is a mobile terminal 500 carried by the subject, it does not necessarily have to be a mobile terminal 500 carried by the subject. The mobile terminal 500 may be, for example, a mobile terminal 500 provided in a photo studio or the like.

[0219] Furthermore, the consent information acquisition unit 602 is present in the mobile terminal 500, but may also be present in the imaging device 100. The imaging device 100 may acquire consent information of the subject based on, for example, the subject's movements (signs, gestures) (see Patent Document 1).

[0220] The metadata may also include the following items: User information may include the model name, manufacturer name, and individual number of the imaging device 100. This can indicate to the subject, etc., that an imaging device that supports authenticity assurance, such as C2PA, was used. Subject consent items may include the model name, individual number, and MAC address used during communication of the mobile device used for consent. This can leave evidence that the subject's consent information was obtained through the correct procedures. Furthermore, by using this metadata, it is possible to identify from the image file which subject agreed to the use of their biometric information for which user's imaging device model.

[0221] Furthermore, the biometric information usage control unit 409 and the biometric information usage control unit 2309 have controlled the extraction of subject features, the function using biometric information (subject identification function), and the output of metadata, but any control may be performed as long as it is based on the subject's consent. For example, if consent information from the subject cannot be obtained, the biometric information usage control unit 409 and the biometric information usage control unit 2309 may perform control to prevent the image file from being transmitted and control to mask the area of ​​the subject when displaying the captured image to prevent it from being visible.

[0222] Furthermore, in the present invention, the holder of biometric information (subject) can specify the user of the biometric information and the device (imaging device) to use it, and only the specified user and device can use the biometric information. For example, if the biometric information is an X-ray image, the holder of the biometric information can be a patient, and the user of the biometric information can be a doctor and an X-ray technician who performs imaging under the doctor's instructions. An example of a situation to which the present invention is applied will be described. For example, consider a situation in which a subject consents to the acquisition of biometric information (X-ray photography). The subject undergoes X-ray photography after receiving an explanation about X-ray photography from a doctor. Here, a situation can be considered in which the subject confirms with the doctor (and X-ray technician) using a terminal or the like installed in the hospital and then consents to the acquisition of the biometric information. If the X-ray device cannot confirm the consent information, it is controlled so that the subject cannot be photographed, thereby preventing patient mix-ups.

[0223] The present invention can also be applied to ATMs (Automatic Teller Machines) that use face, vein, and fingerprint authentication of a subject. In particular, because face authentication carries the risk of identity theft, customers may be reluctant to use face authentication. However, a customer may be willing to use face authentication with a specific ATM near their home. By specifying an ATM using a bank terminal and / or a home PC, a customer can give consent to the use of biometric information on those terminals. For example, a customer can have face authentication performed only on ATMs near their home.

[0224] The object of the present invention may be achieved by the following method: A recording medium (or storage medium) on which program code of software that realizes the functions of the above-described embodiments is recorded is supplied to a system or device. Then, a computer (or CPU, MPU, GPU) of the system or device reads and executes the program code stored on the recording medium. In this case, the program code read from the recording medium itself realizes the functions of the above-described embodiments, and the recording medium on which the program code is recorded constitutes the present invention.

[0225] Furthermore, the functions of the above-described embodiments are not only realized by the computer reading and executing the program code, but also include the operating system (OS) running on the computer performing some or all of the actual processing based on the instructions of the program code.

[0226] Furthermore, the functions of the above-described embodiments may be realized by the following method: Program code is read from a recording medium and written to memory in a function expansion card inserted into a computer or in a function expansion unit connected to the computer. Then, based on the instructions of the program code, a CPU or the like in the function expansion card or function expansion unit performs some or all of the actual processing.

[0227] When the present invention is applied to the above-mentioned recording medium, the recording medium stores program code corresponding to the flowcharts described above.

[0228] (Other embodiments) The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0229] The disclosure of this specification includes the following imaging device, imaging system, method, and program. (Item 1) An imaging device for capturing an image of a subject, an authentication means for authenticating a user; and a control unit that controls use of the biometric information based on subject consent information that links user information of the user authenticated by the authentication unit with consent information that gives consent to the use of the subject's biometric information for the user. Imaging device. (Item 2) The consent information is consent information for both the user and an imaging device owned by the user to use the biometric information of the subject. Item 1. The imaging device according to item 1. (Item 3) The photographic subject may further include an acquisition unit that acquires the consent information from a mobile terminal carried by the subject or a terminal other than the mobile terminal. Item 1 or 2. The imaging device according to item 1 or 2. (Item 4) The control means controls to restrict storage, distribution, and display of the biometric information based on the subject consent information. 4. The imaging device according to any one of items 1 to 3. (Item 5) further comprising an output unit that outputs an image file to which the user information and the consent information are added as metadata of an image of the subject; 5. The imaging device according to any one of items 1 to 4. (Item 6) the authentication means authenticates the user based on an eye image acquired from the user. 6. The imaging device according to any one of items 1 to 5. (Item 7) An imaging device for capturing an image of a subject, a control unit that controls the use of the biometric information based on subject consent information that links information about the imaging device with consent information that gives consent to the imaging device using the biometric information of the subject; Imaging device. (Item 8) The photographic subject may further include an acquisition unit that acquires the consent information from a mobile terminal carried by the subject or a terminal other than the mobile terminal. Item 8. The imaging device according to item 7. (Item 9) The control means controls to restrict storage, distribution, and display of the biometric information based on the subject consent information. Item 9. The imaging device according to item 7 or 8. (Item 10) further comprising an output unit that outputs an image file to which information about the imaging device and the consent information are added as metadata of an image obtained by capturing an image of the subject; 10. The imaging device according to any one of items 7 to 9. (Item 11) An imaging system including an imaging device that captures an image of a subject and a mobile terminal, The imaging device, an authentication means for authenticating a user; an imaging device including: a control unit that controls use of the biometric information based on subject consent information that links user information of the user authenticated by the authentication unit with consent information that gives consent to the use of the subject's biometric information for the user; and The mobile terminal, a portable terminal including a transmission means for transmitting the consent information to the imaging device based on an instruction to transmit the consent information; Imaging system. (Item 12) The mobile terminal The mobile terminal further includes a subject authentication means for authenticating a subject using the mobile terminal, the control means controls use of the biometric information based on the authentication result of the subject by the subject authentication means and the consent information. Item 12. The imaging system according to item 11. (Item 13) An imaging system including a server and an imaging device that captures an image of a subject, The server, a registration means for registering user information of a user authenticated by the imaging device and information of one or more imaging devices including the imaging device linked to the user information; a management means for managing subject consent information that links the user information, information on the one or more image capture devices, and consent information that gives consent to the use of the subject's biometric information for both the user and the one or more image capture devices; a server including a transmitting means for transmitting the subject consent information to the imaging device when the consent information is received from a mobile terminal carried by the subject; The imaging device, an authentication means for authenticating a user; and a control unit that controls use of the biometric information based on the subject consent information received from the server. Imaging system. (Item 14) The server The photographic subject further includes an acquisition unit configured to acquire the consent information from a mobile terminal carried by the photographic subject or a terminal other than the mobile terminal. Item 14. The imaging system according to item 13. (Item 15) The control means controls to restrict storage, distribution, and display of the biometric information based on the subject consent information. Item 15. The imaging system according to item 13 or 14. (Item 16) The imaging device is further comprising an output unit that outputs an image file to which the user information and the consent information are added as metadata of an image of the subject; 16. The imaging system according to any one of items 13 to 15. (Item 17) The imaging system includes: a mobile terminal that communicates with both the server and the imaging device; The mobile terminal further comprising an object authentication means for authenticating the object, the control means controls use of the biometric information based on the authentication result of the subject by the subject authentication means and the consent information. 17. The imaging system according to any one of items 13 to 16. (Item 18) The mobile terminal further comprising an input unit for inputting information on an imaging device that consents to the use of the biometric information from among the information on the one or more imaging devices; The imaging device is an output unit that outputs an image file to which the user information, the consent information, and the result input by the input unit are added as metadata of the image of the subject; 18. The imaging system according to any one of items 13 to 17. (Item 19) A method executed by an imaging device that captures an image of a subject, comprising: an authentication step for authenticating a user; a control step of controlling use of the biometric information based on subject consent information that links user information of the user authenticated in the authentication step with consent information that gives consent to the use of the biometric information of the subject for the user, method. (Item 20) A method executed by an imaging device that captures an image of a subject, comprising: a control step of controlling use of the biometric information based on subject consent information linking information about the imaging device with consent information that gives consent to the imaging device using the biometric information of the subject; method. (Item 21) A method executed by an imaging system including an imaging device that captures an image of a subject and a mobile terminal, an authentication step of authenticating a user using the imaging device; a control step of controlling use of the biometric information based on subject consent information that links user information of the user authenticated in the authentication step with consent information that gives consent to the use of the biometric information of the subject for the user; a transmitting step of transmitting the consent information from the mobile terminal to the imaging device based on an instruction to output the consent information. method. (Item 22) A method executed by an imaging system including a server and an imaging device that captures an image of a subject, a registration step of registering user information of a user authenticated by the imaging device and information of one or more imaging devices including the imaging device linked to the user information; a management step of managing subject consent information that links the user information, information on the one or more image capture devices, and consent information that gives consent to the use of the subject's biometric information for both the user and the one or more image capture devices; a transmitting step of transmitting the subject consent information to the imaging device when the consent information is received from a mobile terminal carried by the subject; an authentication step of authenticating the user using the imaging device; and a control step of controlling use of the biometric information based on the subject consent information received from the server. method. (Item 23) Item 19. A program for causing a computer to execute the method described in Item 19. (Item 24) 21. A program for causing a computer to execute the method described in item 20. (Item 25) 22. A program for causing a computer to execute the method described in Item 21. (Item 26) 23. A program for causing a computer to execute the method described in Item 22.

[0230] The invention is not limited to the above-described embodiments, and various changes and modifications can be made without departing from the spirit and scope of the invention. Accordingly, the following claims are appended to apprise the public of the scope of the invention. [Explanation of symbols]

[0231] 401 Eye image acquisition unit 402 Feature Vector Calculation Unit 403 User Registration 404 User information storage unit 405 User Authentication 406 Consent Request Department 407 Consent Information Management Department 408 Consent information storage unit 409 Biometric Information Utilization Control Unit 410 Imaging unit 411 Object feature vector calculation unit 412 Object feature vector storage unit 413 Subject identification section 414 Image File Creation Department 415 Image storage unit

Claims

1. An imaging device for capturing an image of a subject, an authentication means for authenticating a user; and a control unit that controls use of the biometric information based on subject consent information that links user information of the user authenticated by the authentication unit with consent information that gives consent to the use of the subject's biometric information for the user. Imaging device.

2. The consent information is consent information for both the user and an imaging device owned by the user to use the biometric information of the subject. The imaging device according to claim 1 .

3. The photographic subject may further include an acquisition unit that acquires the consent information from a mobile terminal carried by the subject or a terminal other than the mobile terminal. The imaging device according to claim 1 .

4. The control means controls to restrict storage, distribution, and display of the biometric information based on the subject consent information. The imaging device according to claim 1 .

5. further comprising an output unit that outputs an image file to which the user information and the consent information are added as metadata of an image of the subject; The imaging device according to claim 1 .

6. the authentication means authenticates the user based on an eye image acquired from the user. The imaging device according to claim 1 .

7. An imaging device for capturing an image of a subject, a control unit that controls the use of the biometric information based on subject consent information that links information about the imaging device with consent information that gives consent to the imaging device using the biometric information of the subject; Imaging device.

8. The photographic subject may further include an acquisition unit that acquires the consent information from a mobile terminal carried by the subject or a terminal other than the mobile terminal. The imaging device according to claim 7 .

9. The control means controls to restrict storage, distribution, and display of the biometric information based on the subject consent information. The imaging device according to claim 7 .

10. further comprising an output unit that outputs an image file to which information about the imaging device and the consent information are added as metadata of an image obtained by capturing an image of the subject; The imaging device according to claim 7 .

11. An imaging system including an imaging device that captures an image of a subject and a mobile terminal, The imaging device, an authentication means for authenticating a user; an imaging device including: a control unit that controls use of the biometric information based on subject consent information that links user information of the user authenticated by the authentication unit with consent information that gives consent to the use of the subject's biometric information for the user; and The mobile terminal, a portable terminal including a transmission means for transmitting the consent information to the imaging device based on an instruction to transmit the consent information; Imaging system.

12. The mobile terminal The mobile terminal further includes a subject authentication means for authenticating a subject using the mobile terminal, the control means controls use of the biometric information based on the authentication result of the subject by the subject authentication means and the consent information. The imaging system according to claim 11 .

13. An imaging system including a server and an imaging device that captures an image of a subject, The server, a registration unit that registers user information of a user authenticated by the imaging device and information of one or more imaging devices including the imaging device that are linked to the user information; a management unit for managing subject consent information that links the user information, information on the one or more image capture devices, and consent information that gives consent to the use of the subject's biometric information for both the user and the one or more image capture devices; a server including a transmitting means for transmitting the subject consent information to the imaging device when the consent information is received from a mobile terminal carried by the subject; The imaging device, an authentication means for authenticating a user; and a control unit that controls use of the biometric information based on the subject consent information received from the server. Imaging system.

14. The server The photographic subject further includes an acquisition unit configured to acquire the consent information from a mobile terminal carried by the photographic subject or a terminal other than the mobile terminal. The imaging system according to claim 13.

15. The control means controls to restrict storage, distribution, and display of the biometric information based on the subject consent information. The imaging system according to claim 13.

16. The imaging device is further comprising an output unit that outputs an image file to which the user information and the consent information are added as metadata of an image of the subject; The imaging system according to claim 13.

17. The imaging system includes: a mobile terminal that communicates with both the server and the imaging device; The mobile terminal further comprising an object authentication means for authenticating the object, the control means controls use of the biometric information based on the authentication result of the subject by the subject authentication means and the consent information. The imaging system according to claim 13.

18. The mobile terminal further comprising an input unit for inputting information on an imaging device that consents to the use of the biometric information from among the information on the one or more imaging devices; The imaging device is an output unit that outputs an image file to which the user information, the consent information, and the result input by the input unit are added as metadata of the image of the subject; 18. The imaging system according to any one of claims 13 to 17.

19. A method executed by an imaging device that captures an image of a subject, comprising: an authentication step for authenticating a user; a control step of controlling use of the biometric information based on subject consent information that links user information of the user authenticated in the authentication step with consent information that gives consent to the use of the biometric information of the subject for the user, method.

20. A method executed by an imaging device that captures an image of a subject, comprising: a control step of controlling use of the biometric information based on subject consent information linking information about the imaging device with consent information that gives consent to the imaging device using the biometric information of the subject; method.

21. A method executed by an imaging system including an imaging device that captures an image of a subject and a mobile terminal, an authentication step of authenticating a user using the imaging device; a control step of controlling use of the biometric information based on subject consent information that links user information of the user authenticated in the authentication step with consent information that gives consent to the use of the biometric information of the subject for the user; a transmitting step of transmitting the consent information from the mobile terminal to the imaging device based on an instruction to output the consent information. method.

22. A method executed by an imaging system including a server and an imaging device that captures an image of a subject, a registration step of registering user information of a user authenticated by the imaging device and information of one or more imaging devices including the imaging device linked to the user information; a management step of managing subject consent information that links the user information, information on the one or more image capture devices, and consent information that gives consent to the use of the subject's biometric information for both the user and the one or more image capture devices; a transmitting step of transmitting the subject consent information to the imaging device when the consent information is received from a mobile terminal carried by the subject; an authentication step of authenticating the user using the imaging device; and a control step of controlling use of the biometric information based on the subject consent information received from the server. method.

23. A program for causing a computer to execute the method according to claim 19.

24. A program for causing a computer to execute the method according to claim 20.

25. A program for causing a computer to execute the method according to claim 21.

26. A program for causing a computer to execute the method according to claim 22.

Images