Information processing apparatus, information processing method, and program

Abstract

Information for identifying the belonging destination of the specified user of the camera is recorded in association with the image.SOLUTION: An information processing apparatus includes a user specifying unit that specifies a user who has captured an image using an imaging device, an affiliation destination specifying unit that specifies an affiliation destination of the user based on personal identification information for identifying an individual of the user specified by the user specifying unit and acquires attribute information of the affiliation destination of the user, and a recording unit that records the attribute information of the affiliation destination of the user in association with the image captured by the user.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present invention relates to a process for identifying and recording a user of an imaging device. [Background technology]

[0002] In recent years, cameras equipped with technology to guarantee the authenticity of captured images have begun to appear on the market, ensuring that the images are not created by AI (artificial intelligence). This is achieved, for example, by assigning a unique number assigned to each camera to the captured image in a way that prevents it from being tampered with. In addition to these technologies, there is a demand for the ability to assign user information to captured images in a way that prevents it from being tampered with (user authenticity assurance).

[0003] Conventionally, there have been methods for personally authenticating users (people) of information processing devices. Patent Document 1 describes a method for personally authenticating users using an image of the user's eyes looking through a viewfinder. User authenticity assurance can be achieved by combining such a method for personally authenticating users of information processing devices (cameras). [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Publication No. 2024-002562 Summary of the Invention [Problem to be solved by the invention]

[0005] However, the method of Patent Document 1 cannot record information identifying an organization (affiliation) made up of multiple people including the camera user identified by personal authentication in association with the image.

[0006] The present invention has been made in view of the above circumstances, and its object is to provide an information processing device that records information identifying the affiliation of a specified camera user in association with an image. [Means for solving the problem]

[0007] In order to achieve the above object, an information processing device as one aspect of the present invention has a user identification means for identifying a user who captured an image using an imaging device, an affiliation identification means for identifying the user's affiliation based on personal identification information that identifies the individual user identified by the user identification means and acquiring attribute information of the user's affiliation, and a recording means for recording the attribute information of the user's affiliation in association with the image captured by the user. [Effects of the Invention]

[0008] According to the present invention, information for identifying the affiliation of the identified camera user can be recorded in association with the image. [Brief explanation of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating an example of the appearance of a camera according to a first embodiment. [Figure 2] FIG. 1 is a diagram illustrating an example of the configuration of a camera according to a first embodiment. [Figure 3] FIG. 1 is a block diagram of the electrical configuration of a camera according to a first embodiment. [Figure 4] FIG. 1 is a functional block diagram of a camera according to a first embodiment. [Figure 5] 5 is a flowchart showing processing in the camera according to the first embodiment. [Figure 6] 4 is a diagram showing an example of a data structure recorded by a recording unit according to the first embodiment. FIG. [Figure 7] 4 is a diagram showing an example of a data structure recorded by a recording unit according to the first embodiment. FIG. [Figure 8] FIG. 10 is a diagram showing an example of a data structure recorded by a recording unit according to the second embodiment. [Figure 9] FIG. 11 is a diagram showing an example of a data structure recorded by a recording unit according to the third embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a data structure recorded by a recording unit according to the fourth embodiment. [Figure 11] 13A and 13B are diagrams showing examples of a user interface displayed on an operation member of a camera according to a fifth embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0010] Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. Note that the present invention is not limited to the situations described below, and can be applied to any embodiment that meets the spirit of the present invention. In addition, in the following drawings, the optical axis direction of the lens is defined as the Z axis, a specific direction in a plane perpendicular to the Z axis is defined as the X axis, and a direction perpendicular to the X axis is defined as the Y axis.

[0011] <Embodiment 1> In this embodiment, as an example of applying the present invention to a camera, a method is described in which identification information of the organization to which the camera user belongs is obtained and the obtained identification information is recorded in association with an image taken (imaged) by the camera.

[0012] FIG. 1 is a diagram illustrating an example of the hardware configuration of a camera (image capture device) 100, which is a device for implementing this embodiment. Specifically, it is an external view of the camera 100 (interchangeable lens camera), which is a digital still camera in this embodiment. FIG. 1(A) is a front oblique view of the camera 100. FIG. 1(B) is a rear oblique view of the camera 100. FIG. 1(C) is a diagram illustrating an example of operation of an operation member 104 provided on the camera 100.

[0013] In the following, the CPU 212, which will be described later, functions as an information processing device that executes the processes shown in FIG. 5 and the like. In this case, the camera 100 has an information processing device built therein. In the following, an example will be described in which the functions of the information processing device are located within the imaging device 100, but some or all of the functions of this information processing device may be located outside the camera 100. In other words, an information terminal such as a PC or tablet, which is an external device connected to the camera 100 by wire or wirelessly, can function as the information processing device in this embodiment. Note that the camera 100 may also function as an information processing device that executes the processes described below.

[0014] As shown in FIG. 1A, camera 100 has photographing lens unit 100A and camera housing 100B. Camera housing 100B is provided with release button 101, an operation member that accepts image capture operations from the user. As shown in FIG. 1B, an eyepiece 102 (finder) is provided on the rear surface of camera housing 100B, through which the user looks to view a display device 214 (display panel) (described later) included within camera housing 100B. Operation members 103, 104, and 105 are provided on the rear surface of camera housing 100B, each of which accepts various operations from the user. For example, operation member 103 is a touch panel (input device) that accepts touch operations. Operation member 104 is a control lever that can be pushed down in each direction. Operation member 105 is a four-way key that can be pressed in each of four directions. The operation member (touch panel) 103 includes a display panel (for example, a liquid crystal panel) and has a function of displaying images on the display panel.

[0015] 2 is a cross-sectional view of camera 100 taken along the YZ plane defined by the Y axis and Z axis shown in Fig. 1(A), illustrating the internal configuration of camera 100. Photographing lens unit 100A has lens 201, lens 202, aperture 203, aperture drive unit 204, lens drive motor 205, lens drive member 206, photocoupler 207, pulse plate 208, mount contact 209, and focus adjustment circuit 210.

[0016] Lens drive member 206 is a member that includes a drive gear. Photocoupler 207 detects the rotation of pulse plate 208, which is linked to lens drive member 206, and transmits this information to focus adjustment circuit 210. Focus adjustment circuit 210 drives lens drive motor 205 based on information from photocoupler 207 and information from camera housing 100B (lens drive amount information), moving lens 201 and changing the focus position. Mount contact 209 is an interface between photographic lens unit 100A and camera housing 100B. Note that for simplicity, two lenses 201 and 202 are shown, but in reality, more than two lenses are included in photographic lens unit 100A.

[0017] Camera housing 100B includes an image sensor 211, a CPU 212, a memory unit 213, a display device 214, and a display device drive circuit 215. Image sensor 211 is disposed on a planned imaging plane of photographing lens unit 100A. Image sensor 211 is configured by an image sensor such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor).

[0018] The CPU (processor) 212 is a central processing unit of the microcomputer, and controls the entire camera 100 by executing a control program stored in the memory unit 213. In other words, it controls each component of the camera 100 in an integrated manner.

[0019] The memory unit 213 is a storage medium configured with a volatile memory such as RAM (Random Access Memory) or a non-volatile memory such as ROM (Read Only Memory), and stores various information related to the camera 100. For example, the memory unit 213 stores images captured by the image sensor 211, setting values ​​for various parameters and ISO sensitivity, shooting modes, various correction data, and the like. The memory unit 213 also stores control programs, variables, constants, and the like that control the operation of the camera 100. The memory unit 213 may also have a secondary storage device (not shown) as a separate storage medium, and the secondary storage device may be included in the memory unit 213. The secondary storage device is a rewritable storage device (storage medium) such as a hard disk or flash memory, and is configured to store data received via a communication unit (communication device) 307 (described later).

[0020] The display device 214 displays various information on the screen (display surface) of the display device 214. For example, the display device 214 is a liquid crystal panel, and displays a captured image (subject image) on the screen. The display device drive circuit 215 drives the display device 214. The user can view the screen of the display device 214 through the eyepiece 102.

[0021] Camera housing 100B has light source 216a, light source 216b, light splitter 217, light receiving lens 218, and eye imaging element 219. Light source 216a and light source 216b are light sources conventionally used in single-lens reflex cameras to detect the line of sight from the relationship between the pupil and the image of light reflected by the cornea (corneal reflection image). Light source 216a and light source 216b also serve as light sources for illuminating eyeball 220 of a user looking through the viewfinder (eyepiece 102). For example, light source 216a and light source 216b are infrared light-emitting diodes that emit infrared light that is insensitive to the user, and are arranged around eyepiece 102.

[0022] An optical image of the illuminated eyeball 220 (eye optical image; an optical image formed by light emitted from the light source 216a and the light source 216b and reflected by the eyeball 220) passes through the eyepiece 102 and is reflected by the light splitter 217. The eye optical image is then formed by the light receiving lens 218 on an eye imaging element 219, which is a two-dimensional arrangement of multiple photoelectric conversion elements (e.g., CCD or CMOS). The light receiving lens 218 positions the pupil of the eyeball 220 and the eye imaging element 219 in a conjugate imaging relationship. Using a predetermined algorithm described below, the line of sight of the eyeball 220 is detected (information about the line of sight is acquired) from the position of the corneal reflection image in the eye optical image formed on the eye imaging element 219. For example, at least one of information indicating the line of sight direction (direction of the line of sight) and information indicating the viewpoint (position where the line of sight is fixed) on the screen of the display device 214 is obtained as the information about the line of sight. The viewpoint can be regarded as the position where the user is looking or as the gaze position.

[0023] 3 is a block diagram showing the electrical configuration within camera 100. Connected to CPU 212 are gaze detection circuit 301, photometry circuit 302, autofocus detection circuit 303, signal input circuit 304, display device drive circuit 215, and light source drive circuit 305. CPU 212 transmits signals via mount contacts 209 to focus adjustment circuit 210 disposed within photographing lens unit 100A and aperture control circuit 306 included in aperture drive unit 204 within photographing lens unit 100A. Memory unit 213 attached to CPU 212 further has a function of storing image pickup signals from image sensor 211 and eye image sensor 219, and a function of storing gaze correction parameters, which will be described later.

[0024] The gaze detection circuit 301 A / D converts the output of the eye imaging element 219 (an eye image obtained by capturing an image of the eye (eyeball 220)) when an eye optical image is formed on the eye imaging element 219, and transmits the result to the CPU 212. The CPU 212 extracts feature points required for gaze detection from the eye image according to a predetermined algorithm described later, and detects the user's gaze from the positions of the feature points.

[0025] The photometry circuit 302 performs predetermined processing (e.g., amplification, logarithmic compression, and A / D conversion) on the signal obtained from the image sensor 211, which also functions as a photometry sensor, such as a luminance signal corresponding to the brightness of the field, and sends the result to the CPU 212 as field luminance information.

[0026] The autofocus detection circuit 303 A / D converts signals from multiple detection elements (multiple pixels) used for phase difference detection included in the image sensor 211 and sends the converted signals to the CPU 212. The CPU 212 calculates the distance to the subject corresponding to each focus detection point from the signals from the multiple detection elements. This is a well-known technique known as image plane phase difference AF, so a description thereof will be omitted.

[0027] Switches SW1 and SW2 are connected to the signal input circuit 304. Switch SW1 is turned on by the first stroke of the release button 101, and is a switch for starting a shooting preparation operation (e.g., photometry and distance measurement) of the camera 100. Switch SW2 is turned on by the second stroke of the release button 101, and is a switch for starting a shooting operation. ON signals from switches SW1 and SW2 are input to the signal input circuit 304 and transmitted to the CPU 212. Line-of-sight detection may be started when switch SW1 is turned on. Light source drive circuit 305 drives light source 216a and light source 216b.

[0028] Furthermore, operation members 103 to 105 are also connected to CPU 212. When the user operates operation members 103 to 105, operation members 103 to 105 output operation signals according to the user's operation to CPU 212, and CPU 212 performs processing (control) according to the operation signals. For example, CPU 212 moves a frame (item, indicator) displayed at the viewpoint according to the operation signal.

[0029] The CPU 212 is also connected to a communication unit 307, a GPS receiving unit 308, and a timer 309. The communication unit 307 performs wireless communication with information devices such as a user's smartphone, tablet terminal, smartwatch, or PC, and acquires GPS location information of the information device. The wireless communication is assumed to be Wi-Fi, Bluetooth, or the like, but is not limited to these. The GPS receiving unit 308 receives radio waves from a GPS satellite and acquires GPS location information of the camera 100. The timer 309 outputs the current time.

[0030] 4 is a block diagram showing the functional configuration of the camera 100 of this embodiment. In other words, it is a diagram showing the module configuration of the information processing device (CPU 212) of this embodiment. The information processing device is composed of, as its functional units, an image acquisition unit 400, a user identification unit 401, an affiliation information holding unit 402, an affiliation identification unit 403, and a recording unit 404. Each of these functional units is realized by the CPU 212 executing a program stored in the memory unit 213. The CPU 212 then stores the execution results of each process, which will be described later, in a storage medium such as the memory unit 213.

[0031] The image acquisition unit 400 acquires an image created by converting an imaging signal obtained from the image sensor 211 of the camera 100 into a video signal. The image acquisition unit 400 outputs the acquired image to the recording unit 404. The user identification unit 401 identifies (identifies by authentication) the person (user) using the camera 100. The user identification unit 401 outputs personal identification information corresponding to the identified user of the camera 100 to the affiliation identification unit 403. The affiliation information storage unit 402 stores attribute information (metadata) including at least identification information of the user's affiliation, in association with information identifying the user.

[0032] The affiliation identification unit 403 identifies the affiliation of the user identified by the user identification unit 401, based on the attribute information stored in the affiliation information storage unit 402. The affiliation identification unit 403 outputs the attribute information of the affiliation of the identified user of camera 100 to the recording unit 404. The recording unit 404 records the attribute information including the identification information of the affiliation of the user determined by the affiliation identification unit 403 in the memory unit 213, in association with the image acquired by the image acquisition unit 400. Note that the recording unit 404 may record the attribute information in an external data storage device that can be removed from the camera 100, in addition to the memory unit 213.

[0033] Fig. 5 is a flowchart showing the processing of the camera 100 (information processing device) according to the first embodiment. The processing performed by the camera 100 of this embodiment will be described below with reference to Fig. 5. Each of the following processes is realized by the CPU 212 of the camera 100 executing a program stored in the memory unit 213. Each process (step) is represented by adding an S to the beginning, thereby abbreviating the notation of the process (step).

[0034] In S510, the image acquisition unit 400 acquires an image obtained from the camera 100. The image acquisition unit 400 outputs the acquired image to the recording unit 404. The image acquisition unit 400 may store the acquired image in an external data storage device that can be removed from the camera 100. The external data storage device may be a removable recording medium such as an SD card or a CF card, an external storage such as a USB memory connected via a wired or wireless connection, or storage on the cloud.

[0035] In S520, the user identification unit 401 identifies the person (user) currently using the camera 100. That is, the camera user is identified as the person who is currently operating the camera 100 and has captured the image acquired by the image acquisition unit 400 in this process. In this embodiment, the user identification unit 401 performs biometric authentication using eyeball information as a method for identifying the user of the camera 100. Specifically, the user of the camera 100 is identified by performing iris authentication on an image of the eyeball 220 of the user of the camera 100 looking through the eyepiece 102.

[0036] Here, the user of the camera 100 of this embodiment registers color pattern information as eyeball information in advance in the memory unit 213 of the camera 100. The memory unit 213 stores iris pattern information (registered person characteristics) obtained from the user's eyeball, linked (associated) with information identifying the user (personal identification information). The process of identifying the user of the camera 100 is performed by comparing the registered person characteristics (registered person color pattern information) registered in advance as described above with the iris pattern information (user characteristics) obtained from the user's eyeball during image capture. That is, the user identification unit 401 compares the user characteristics of the user with the registered person characteristics of the registrant, and if the similarity is equal to or greater than a predetermined threshold, determines that the user is the registrant, thereby identifying the person (user) who captured the image acquired in S510. The user identification unit 401 then identifies personal identification information corresponding to the identified user of the camera 100. In other words, the personal identification information linked to the registrant characteristics of the registrant identified as the user of camera 100 is determined as the personal identification information of the identified user of camera 100. Thereafter, user identification unit 401 outputs the personal identification information of the determined user of camera 100 to affiliation identification unit 403.

[0037] If multiple registrant characteristics are registered, the user characteristics are compared with all registered registrant characteristics to determine whether there are any registrant characteristics whose similarity is equal to or greater than a predetermined threshold. If the determination result indicates that multiple registrant characteristics are equal to or greater than the predetermined threshold, the user identification unit 401 identifies the person with the registrant characteristic having the highest similarity as the user of the camera 100. If there is only one registrant characteristic whose similarity is equal to or greater than the predetermined threshold, the person with that registrant characteristic is identified as the user of the camera 100. Thereafter, the user identification unit 401 identifies personal identification information corresponding to the identified user of the camera 100. In this case, as in the above, the personal identification information linked to the registrant characteristic identified as the user is determined to be the personal identification information of the identified user of the camera 100.

[0038] In the above description, the process of identifying the user of the camera 100 in S520 is performed using iris authentication, but this is not limited to this and any other method that can identify the user may be used. For example, fingerprint authentication or password authentication may be used.

[0039] In S530, the affiliation identification unit 403 identifies the affiliation of the user of the camera 100 identified by the user identification unit 401 in S520, based on the attribute information stored in the affiliation information storage unit 402. Specifically, the affiliation identification unit 403 searches a database that associates the personal identification information of registrants recorded in the memory unit 213 with the attribute information of their affiliations, using the personal identification information of the user of the camera 100 identified in S520 as a key, and identifies the affiliation of the user. This makes it possible to obtain the attribute information of the affiliation of the identified user of the camera 100. The affiliation information storage unit 402 may function as a database that stores attribute information including the identification information of the user's affiliation, in association with the personal identification information that identifies the user. Note that when identifying the affiliation of the user of the camera 100, the affiliation identification unit 403 may use the personal identification information output from the user identification unit 401, or may use the personal identification information of registrants recorded in the memory unit 213. Thereafter, the affiliation identification unit 403 outputs attribute information of the identified affiliation of the user of the camera 100 to the recording unit 404 .

[0040] In S540, the recording unit 404 records the image acquired in S510 and the attribute information of the organization of the user of the camera 100 identified in S530 in the memory unit 213. Here, the attribute information of the organization of the user of the camera 100 recorded in the memory unit 213 is identification information that uniquely identifies the organization of the user. In addition to the memory unit 213, the attribute information may also be stored in an external data storage device that can be removed from the camera 100.

[0041] The configuration of data (images and attribute information) recorded by the recording unit 404 in the processing of S540 in the first embodiment will be described below with reference to Fig. 6. Fig. 6 is a diagram showing the configuration of data recorded by the recording unit 404 in the processing of S540 in the first embodiment.

[0042] Specifically, in S540, the recording unit 404 records an image file 600, which is data including the image acquired by the image acquisition unit 400 in S510 and attribute information of the user's affiliation identified by the affiliation identification unit 403 in S530, in the memory unit 213. The image file 600 is composed of image data 620, which is the image acquired by the image acquisition unit 400 in S510, and metadata 610. The metadata 610 is data including user information 630 and attribute information 631 of the user's affiliation.

[0043] 6, the metadata 610 may include information relating to a shooting time 640 and information relating to a shooting location 650 in addition to the attribute information 631. The information relating to the shooting time 640 is acquired using the timer 309 of the camera 100, and is information relating to the time when the video input from the image sensor 211 was actually recorded in the memory unit 213. The information relating to the shooting location 650 is information relating to the longitude and latitude acquired using the GPS receiving unit 308 of the camera 100.

[0044] As described above, the camera 100 having the information processing device (CPU 212) of the first embodiment can record information identifying an organization made up of multiple people in association with an image taken by the user of the camera 100.

[0045] (Variation 1) As described above, in the first embodiment, the identification information of the affiliation of the user of camera 100 is recorded in association with an image captured by the user of camera 100 as attribute information of the affiliation of the user of camera 100. Here, the attribute information is not limited to the identification information of the affiliation, as long as it relates to the affiliation of the user of camera 100. For example, the name of an organization may be used. Furthermore, the affiliation may be a corporation, a department within a corporation, or a group of individuals without legal personality. Furthermore, as described above, recording unit 404 records attribute information for one affiliation, but this is not limited thereto. For example, if the affiliation of the user of camera 100 has a multi-level hierarchy, attribute information for the affiliations of the multiple levels may be listed and recorded. Furthermore, if the user concurrently holds positions in multiple different departments or divisions, attribute information for the multiple affiliations to which the user belongs may be recorded.

[0046] (Variation 2) Furthermore, the affiliation information storage unit 402 may store a change history (transfer history information) of the affiliation attribute, and may search for history information corresponding to the affiliation attribute information 631 and the image shooting time 640. This makes it possible to acquire the affiliation attribute information at the time of image shooting from the transfer history information, even if the affiliation attribute of the user of the camera 100 has changed since the image was shot due to organizational reform or abolition. Furthermore, by searching for the history of changes in the affiliation attribute, it is possible to identify the organization that managed the image at a specified time.

[0047] <Embodiment 2> In the first embodiment, the recording unit 404 recorded attribute information including identification information of the affiliation of the user of the camera 100 in association with an image captured by the user of the camera 100. In the second embodiment, the recording unit 404 records personal identification information 632 that identifies the individual user of the camera 100, in addition to the attribute information including identification information of the affiliation of the user of the camera 100. Note that the configuration and each functional unit of the camera 100 in the second embodiment are the same as those in the first embodiment, and therefore a description of the same points as those in the first embodiment will be omitted below.

[0048] The processing performed by the camera 100 of the second embodiment will be described below with reference to Fig. 5. Each of the following processes is realized by the CPU 212 of the camera 100 executing a program stored in the memory unit 213. Each process (step) is denoted by adding an S to the beginning to omit the description of the process (step). Note that in the second embodiment, the processes of S510, S520, and S530 are the same as those in the first embodiment, and therefore description thereof will be omitted.

[0049] In S540, the recording unit 404 records the image acquired in S510, the personal identification information 632 of the user of the camera 100 identified in S520, and the attribute information 631 of the organization to which the user of the camera 100 belongs identified in S530 in the memory unit 213. As in the first embodiment, the recording unit 404 records the personal identification information 632 and the attribute information 631 of the organization in association with the image acquired in S510.

[0050] 7 is a diagram showing the structure of data recorded by the recording unit 404 in the processing of S540 in the second embodiment. That is, it is a diagram showing an image file 600 recorded by the recording unit 404 in the second embodiment. In the second embodiment, as shown in FIG. 7, personal identification information 632 is added to the data structure shown in FIG. 6 in the first embodiment. Specifically, the user information 630 includes the personal identification information 632 in addition to attribute information 631 of the organization to which the user of the camera 100 belongs. Furthermore, as shown in FIG. 7, the image file 600 may be recorded with information about the shooting time 640 and the shooting location 650 included in the metadata 610, as in the first embodiment.

[0051] As described above, according to the camera 100 having the information processing device (CPU 212) of the second embodiment, images can be managed as information associated with the organization to which the user belongs, and can also be managed as information associated with the user of the camera 100.

[0052] (Variation 1) Information relating to authentication of the user of camera 100 may be added to the information recorded by recording unit 404. This will be described below with reference to Fig. 8. Fig. 8 is a diagram showing the structure of data recorded in this modification. In Fig. 8, compared to the data configuration shown in Fig. 7, user authentication information 670 is included in metadata 610.

[0053] The user authentication information 670 is composed of an authentication status 671 and identity assurance information 672 of the user of the camera 100. The authentication status 671 is information indicating whether the identity of the user of the camera 100 has been assured. The recording unit 404 records the authentication status as ON when identity assurance information corresponding to the user of the camera 100 identified by the user identification unit 401 is acquired from the memory unit 213, and records the authentication status as OFF in other cases. The identity assurance information is information that officially identifies the user, such as a passport number. In this way, the recording unit 404 associates the authentication status 671 and identity assurance information 672 with the image acquired in S510 in the memory unit 213, in addition to the personal identification information of the user of the camera 100 and attribute information of the organization to which the user of the camera 100 belongs.

[0054] 8, both personal identification information 632 and identity assurance information 672 are included in the metadata 610, but if the identity assurance information 672 can be acquired, the identity assurance information 672 may be recorded, and the personal identification information 632 may not be recorded. Also, if the identity assurance information 672 cannot be acquired, the identity assurance information 672 may not be recorded, while omitting the recording of the authentication status 671. In this way, according to this modification, the authenticity of images captured by the camera 100 can be ensured.

[0055] <Embodiment 3> In the first embodiment, attribute information including identification information of the organization to which the user of the camera 100 belongs is recorded in association with an image. In the third embodiment, a method of recording information (personal identification information) that identifies individuals (members) who belong to the organization to which the user belongs, including the user of the camera 100, in association with an image will be described. Note that the configuration and each functional unit of the camera 100 in the third embodiment are the same as those in the first embodiment, and therefore a description of the same points as those in the first embodiment will be omitted.

[0056] In the third embodiment, the affiliation information holding unit 402 holds the identification information of the affiliation of the user of the camera 100, which is held in association with the personal identification information of the user of the camera 100, as well as the personal identification information of members who belong to the affiliation of the user of the camera 100. Then, the recording unit 404 records, in addition to the identification information of the user of the camera 100, the personal identification information (personal identification information) of members other than the user who belong to the affiliation of the user of the camera 100.

[0057] The processing performed by the camera 100 of the third embodiment will be described below with reference to Fig. 5. Each of the following processes is realized by the CPU 212 of the camera 100 executing a program stored in the memory unit 213. Each process (step) is denoted by adding an S to the beginning, thereby eliminating the need to specify the process (step). In the third embodiment, the processes of S510, S520, and S530 are the same as those in the first embodiment, and therefore will not be described here.

[0058] In S540, the recording unit 404 records data including the image acquired in S510, the personal identification information 632 of the user of the camera 100 identified in S520, and the personal identification information 681 of members other than the user who belong to the same organization as the user of the camera 100, in the memory unit 213. As in the first embodiment, the recording unit 404 records the personal identification information 632 and the personal identification information 681 of members other than the user who belong to the same organization as the user of the camera 100, in association with the image acquired in S510.

[0059] FIG. 9 is a diagram showing the structure of data recorded by the recording unit 404 in the third embodiment. That is, it is a diagram showing an image file 600 recorded by the recording unit 404 in the third embodiment. Note that FIG. 9 shows an example in which two people belong to the organization to which the user of the camera 100 belongs. Member information 680 is information on members (members) who belong to the organization to which the user of the camera 100 belongs, other than the user. Each member information includes personal identification information 681 that identifies the member (individual). Furthermore, as shown in FIG. 9, the image file 600 may be recorded with information about the shooting time 640 and the shooting location 650 included in the metadata 610, as in the first embodiment.

[0060] As described above, according to the camera 100 having the information processing device (CPU 212) of the third embodiment, even in a situation where it is not possible to access a database or the like that stores the members of the affiliation, it is possible to identify the people involved in the captured image from the image file 600. Furthermore, even if the affiliation is changed, altered, or abolished, or the members of the affiliation are changed, it is possible to identify the people involved in the captured image from the image file 600 without searching the history of the affiliation or the members of the affiliation.

[0061] (Variation 1) In the third embodiment, the personal identification information 632 of the user of the camera 100 and the personal identification information 681 of the members of the user's organization are recorded in association with the image. However, the information recorded in association with the image is not limited to this. For example, identity assurance information may be recorded instead of personal identification information for the user of the camera 100 and all members of the user's organization. Alternatively, both personal identification information and identity assurance information may be recorded. Furthermore, for example, the recording unit 404 may record the personal identification information and identity assurance information of the user of the camera 100, and record only the personal identification information of the members, and the information to be recorded may be combined depending on the situation or the person.

[0062] (Variation 2) In the above-described first modification of the third embodiment, a method was shown in which the personal identification information or identity assurance information of all members of the organization to which the user of the camera 100 belongs is recorded in association with an image. However, the targets of recording do not have to be all members of the organization. For example, in addition to the user of the camera 100, the personal identification information or identity assurance information of a manager who is one of the members of the organization to which the user belongs may be recorded. Alternatively, the personal identification information or identity assurance information may be recorded only for the members who were involved in the work of capturing the image. In this way, the personal identification information or identity assurance information of any person can be recorded, rather than for all members.

[0063] <Embodiment 4> In the second embodiment, the recording unit 404 associates with an image the identity assurance information 672 identifying the individual user of the camera 100, in addition to the attribute information including the identification information of the user's affiliation, and records the associated information. Here, information related to authentication may be added to the affiliation of the user of the camera 100 and recorded. In the fourth embodiment, the affiliation information storage unit 402 associates with the identification information of the affiliation of the user of the camera 100 and stores the identity assurance information of the affiliation. Note that the identity assurance information 691 of the affiliation of the user of the camera 100 is, for example, a corporation's personal identification number (My Number) or an authentication number registered with and issued by a certification authority. Note that the configuration and each functional unit of the camera 100 in the fourth embodiment are the same as those in the first embodiment, and therefore a description of the same points as in the first embodiment will be omitted.

[0064] The processing performed by the camera 100 of the fourth embodiment will be described below with reference to Fig. 5. Each of the following processes is realized by the CPU 212 of the camera 100 executing a program stored in the memory unit 213. Each process (step) is denoted by adding an S to the beginning, thereby eliminating the need to specify the process (step). In the fourth embodiment, the processes of S510, S520, and S530 are the same as those in the first embodiment, and therefore will not be described here.

[0065] In S540, the recording unit 404 records data including the image acquired in S510, personal identification information 632 of the user of the camera 100 identified in S520, and attribute information 631 of the organization of the user of the camera 100 identified in S530 in the memory unit 213. In addition, the recording unit 404 records identity assurance information 691 of the organization of the user of the camera 100 in the memory unit 213. Note that, as in the first embodiment, the recording unit 404 records the personal identification information 632, the attribute information 631 of the organization of the user of the camera 100, and the identity assurance information 691 of the organization of the user of the camera 100 in association with the image acquired in S510.

[0066] 10 is a diagram showing the structure of data recorded by the recording unit 404 in the fourth embodiment. That is, it is a diagram showing an image file 600 recorded by the recording unit 404 in the fourth embodiment. The affiliation authentication information 690 is information that officially authenticates the affiliation of the user of the camera 100, and includes identity assurance information 691 relating to the affiliation of the user of the camera 100. Furthermore, as shown in FIG. 10, the image file 600 may be recorded with information about the shooting time 640 and the shooting location 650 included in the metadata 610, as in the first embodiment.

[0067] As described above, according to the camera 100 having the information processing device (CPU 212) of the fourth embodiment, if the right to use a captured image belongs to the organization to which the user of the camera 100 belongs, the authenticity of the right holder can be guaranteed.

[0068] (Variation 1) In the fourth embodiment, both the attribute information 631 of the affiliation of the user of the camera 100 and the identity assurance information 691 as affiliation authentication information 690 are recorded in association with the image. However, the present invention is not limited to this, and for example, it is also possible to record only the identity assurance information 691 without recording the attribute information 631 of the affiliation of the user of the camera 100.

[0069] (Variation 2) Furthermore, the information about the affiliation of the user of camera 100 to be recorded in association with an image may be selectable from affiliation attribute information 631 and affiliation authentication information 690. For example, if the target image is to be used within the affiliation, affiliation attribute information 631 is recorded, and if it is to be made public outside the affiliation, affiliation authentication information 690 is recorded. According to the method of this modification, if there is no need to guarantee the rights of the affiliation, it is possible to reduce the complexity of obtaining authentication of the affiliation and recording authentication information.

[0070] (Variation 3) Furthermore, when the rights to use an image are transferred between organizations, the identity assurance information 691 recorded in association with the image may be changed to identification information of the organization to which the rights have been transferred (updated to the identity identification information of the organization to which the rights have been transferred). Alternatively, the history of changes in the affiliation authentication information 690 may be added to the image using blockchain technology or the like. According to the method of this modified example, information on the organization to which the rights of an image have been transferred can be managed and updated in association with the image.

[0071] <Embodiment 5> In the fifth embodiment, a user interface that allows confirmation or editing of images and attribute information of the organizations that are recorded in association with the images will be described. The screen of the user interface that will be described in the fifth embodiment is displayed on the operation member 103 of the camera 100. Note that the configuration and each functional unit of the camera 100 in the fifth embodiment are the same as those in the first embodiment, and therefore a description of the similar points will be omitted.

[0072] The user interface of the fifth embodiment will be described below with reference to Fig. 11. Fig. 11 is a diagram showing an example of a user interface screen displayed on the operation member 103 of the camera 100 according to the fifth embodiment.

[0073] FIG. 11(A) is a diagram showing an example of displaying an image and attribute information of the affiliation of the user of the camera 100 associated with the image on the screen of the operation member 103. A screen 700 is a screen displayed on the operation member (touch panel) 103. A display image 701 is an image displayed on the screen of the operation member 103. A name display section 702 displays the name of the affiliation of the user of the camera 100 associated with the display image 701. The name display section 702 is configured to be touch-operable. FIG. 11(B) is a diagram showing an example of displaying an image, for which the affiliation of the user of the camera 100 has not been set, on the screen of the operation member 103. As shown in FIG. 11(B), when the affiliation associated with the display image 703 has not been set, the name of the affiliation displayed in the name display section 704 is displayed as "N / A." The name display section 704 is configured to be touch-operable.

[0074] Fig. 11(C) is a diagram showing an example of a screen for selecting an affiliation to be associated with an image. When name display section 702 or name display section 704 is touched, the screen of Fig. 11(C) is displayed. Name display section 710, name display section 711, and name display section 712 display the names of the affiliations of the user of camera 100, which are recorded in memory section 213 or the like in camera 100. When the user (user of camera 100) touches any of name display sections 710 to 712 on screen 700 that the user wishes to register as an affiliation, the user can associate that affiliation with the image selected before displaying it on screen 700. Furthermore, a mark is displayed within frame 720, frame 721, and frame 722 indicating whether or not the respective affiliation is associated with any image.

[0075] For example, in FIG. 11C , the group "Group A" is indicated by a black circle in frame 720, indicating that the group is associated with an image, making it clear that the group is associated with one of the images. Furthermore, the group "Group B" is also indicated by a black circle in frame 721, indicating that the group is associated with one of the images, just like the group "Group A." Meanwhile, the group "Group C" is indicated by an X in frame 722, indicating that the group is not associated with any image, indicating that the group is not associated with any image. Note that the mark is not limited to a black circle or X, as described above, and may be a mark of other shape, such as a white circle or triangle. Furthermore, the mark may be displayed as a letter or a graphic representing a letter, such as "OK" if the group is associated with an image and "NO" if the group is not associated with an image. Furthermore, the color may be used to make the distinction, such as filling the frame with blue if the group is associated with an image and filling the frame with red if the group is not associated with an image, or a combination of these may be used.

[0076] 11(D) and 11(E) are diagrams showing user interfaces for checking images associated with a certain group. FIG. 11(D) is a group selection screen. When any of the group name display areas 730, 731, and 732 displayed on the screen shown in FIG. 11(D) is touched, an image group consisting of one image or multiple images associated with the group that was touched is displayed. That is, the screen transitions to the screen shown in FIG. 11(E). FIG. 11(E) is a screen that can display a list of images associated with the group "Group A." In the example shown in FIG. 11(E), the name of the group and the image group are displayed. As described above, each name display area in this embodiment also serves as a user interface that can be touched.

[0077] In this way, the screen of the operation member 104, which is a touch panel, displays the image captured by the user of the camera 100 and the organization to which the user of the camera 100 belongs, which is associated with the image and recorded by the recording unit 404. Each of the above-mentioned processes related to the display control is executed by the CPU 212.

[0078] As described above, the camera 100 having the information processing device (CPU 212) of the fifth embodiment makes it possible to visually check whether the user's affiliation information is properly recorded in the image captured by the camera. Also, it is possible to add or change the user's affiliation information recorded in association with the image.

[0079] (Variation 1) In the above example, the name of the affiliation attribute information is displayed, but the displayed information is not limited to this and may be any attribute information of the affiliation. For example, the identification information of the affiliation may be displayed instead of the name. Furthermore, for example, the identification information of the affiliation may be displayed in addition to the name. In this way, the image captured by the user of camera 100 and the attribute information of the affiliation of the user of camera 100, which is recorded by recording unit 404 in association with the image, may be displayed on the screen of operation member 104, which is a touch panel.

[0080] (Variation 2) If identity assurance information of the affiliation of the user of the camera 100 is recorded in association with the image, the fact that identity assurance information has been recorded may be displayed so that it is visible. For example, the affiliation may be highlighted, or a predetermined mark may be displayed near the affiliation.

[0081] Although the preferred embodiments of the present invention have been described in detail above, the present invention is not limited to such specific embodiments, and various modifications and variations are possible within the scope of the gist of the present invention as set forth in the claims.

[0082] In each of the above-described embodiments, an example has been described in which the processing shown in Fig. 5, i.e., the processing in each embodiment, is executed by the CPU 212 in the camera 100. However, the hardware configuration is not limited to this. For example, the processing in each of the above-described embodiments, including the processing shown in Fig. 5, can be realized by running some or all of the processing performed by the functional units shown in Fig. 4 on an external device such as a PC or server or on the cloud.

[0083] The present invention can also be realized by supplying a program that realizes one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and having one or more processors in the computer of the system or device read and execute the program.The present invention can also be realized by a circuit (e.g., ASIC) that realizes one or more functions.

[0084] The disclosure of this embodiment includes the following configuration, method, and program.

[0085] (Configuration 1) a user identification means for identifying a user who captured an image using the imaging device; an affiliation identification means for identifying the affiliation of the user based on personal identification information that identifies the individual user identified by the user identification means, and acquiring attribute information of the affiliation of the user; and a recording means for recording attribute information of the user's organization in association with the image captured by the user. 1. An information processing device comprising:

[0086] (Configuration 2) image acquisition means for acquiring the image captured by the user; 2. The information processing apparatus according to configuration 1, wherein the user identification means identifies, as the user, a person who captured the image acquired by the image acquisition means using a current imaging device.

[0087] (Configuration 3) The information processing device described in configuration 1 or 2, characterized in that the user identification means identifies the user based on registered person characteristic information recorded in association with personal identification information of a registered person who has been registered in advance and user characteristic information acquired when photographing using the imaging device.

[0088] (Configuration 4) 4. The information processing device according to configuration 3, wherein the registrant characteristic information and the user characteristic information are information on color patterns of eyeballs.

[0089] (Configuration 5) 5. The information processing device according to any one of configurations 1 to 4, wherein the user identification means identifies the user using any one of authentication methods including biometric authentication using eyeball information, fingerprint authentication, and password authentication.

[0090] (Configuration 6) The user identification means determines personal identification information linked to the registrant characteristic information of the registrant identified as the user as personal identification information of the identified user, The information processing device described in configuration 3, characterized in that the affiliation identification means identifies the affiliation of the user by searching a database that associates the personal identification information of the registrant with attribute information of the affiliation, based on the determined personal identification information of the user.

[0091] (Configuration 7) An information processing device according to any one of configurations 1 to 6, characterized in that it has a storage means for storing at least attribute information of the affiliation of a person including the user identified by the user identification means, and transfer history information of the affiliation.

[0092] (Configuration 8) 8. The information processing device according to any one of configurations 1 to 7, wherein the attribute information of the user's affiliation recorded by the recording means in association with the image is information that uniquely identifies the user's affiliation.

[0093] (Configuration 9) An information processing device according to any one of configurations 1 to 8, characterized in that the attribute information of the user's affiliation recorded by the recording means in association with the image includes information identifying all or some of the members of the user's affiliation.

[0094] (Configuration 10) 10. The information processing device according to any one of configurations 1 to 9, wherein the recording means records at least one of information about the time when the image was taken and information about the location where the image was taken in association with the image.

[0095] (Configuration 11) 11. The information processing apparatus according to any one of configurations 1 to 10, wherein the recording means records the personal identification information of the user in association with the image.

[0096] (Configuration 12) 12. The information processing device according to any one of configurations 1 to 11, wherein the recording means records identity assurance information, which is information that certifies that the user is the person in question, in association with the image.

[0097] (Configuration 13) 13. The information processing device according to any one of configurations 1 to 12, wherein the recording means records the identity assurance information of the organization in association with the image.

[0098] (Configuration 14) The information processing device described in configuration 13 is characterized in that, when the rights to use the image are transferred, the recording means changes the identity assurance information of the affiliation recorded in association with the image to identification information at the destination of the transfer of rights to the image.

[0099] (Configuration 15) 15. The information processing apparatus according to any one of configurations 1 to 14, further comprising a display means for displaying the image and attribute information of the user's affiliation that is recorded by the recording means in association with the image.

[0100] (Configuration 16) 16. An information processing device according to any one of configurations 1 to 15, further comprising a display control means for displaying on a display means the image and attribute information of the user's affiliation that is recorded by the recording means in association with the image.

[0101] (Configuration 17) An information processing device according to any one of configurations 1 to 15, characterized in that it has a display control means for associating the image with the destination or displaying one or more images associated with the destination on a display means when a predetermined input operation is performed on a user interface displayed on a screen.

[0102] (Configuration 18) a user identification step of identifying a user who captured an image using the imaging device; an affiliation identification step of identifying the affiliation of the user based on personal identification information that identifies the individual user identified in the user identification step, and acquiring attribute information of the affiliation of the user; a recording step of recording attribute information of the user's organization in association with the image captured by the user, 1. An information processing method comprising:

[0103] (Configuration 19) A program for causing a computer to execute an information processing method, the program including: a user identification step of identifying a user who captured an image using the imaging device; an affiliation identification step of identifying the affiliation of the user based on personal identification information that identifies the individual user identified in the user identification step, and acquiring attribute information of the affiliation of the user; a recording step of recording attribute information of the organization to which the user belongs in association with the image captured by the user, A program characterized by: [Explanation of symbols]

[0104] 100 cameras 212 CPU 401 User Identification Department 402 Affiliation Information Holding Department 403 Affiliation Identification Department 404 Recording Department

Claims

1. a user identification means for identifying a user who captured an image using the imaging device; an affiliation identification means for identifying the affiliation of the user based on personal identification information that identifies the individual user identified by the user identification means, and acquiring attribute information of the affiliation of the user; and a recording means for recording attribute information of the user's organization in association with the image captured by the user.

1. An information processing device comprising:

2. image acquisition means for acquiring the image captured by the user; 2. The information processing apparatus according to claim 1, wherein the user identification means identifies, as the user, a person who has taken the image acquired by the image acquisition means using a current image capture device.

3. The information processing device according to claim 1, characterized in that the user identification means identifies the user based on registered person characteristic information recorded in association with the personal identification information of a previously registered registered person and user characteristic information acquired when photographing using the imaging device.

4. 4. The information processing apparatus according to claim 3, wherein the registrant characteristic information and the user characteristic information are information on color patterns of eyeballs.

5. 2. The information processing apparatus according to claim 1, wherein the user identification means identifies the user using any one of biometric authentication using eyeball information, fingerprint authentication, and password authentication.

6. The user identification means determines personal identification information linked to the registrant characteristic information of the registrant identified as the user as personal identification information of the identified user, The information processing device according to claim 3, characterized in that the affiliation identification means identifies the affiliation of the user by searching a database that corresponds the personal identification information of the registrant with attribute information of the affiliation based on the determined personal identification information of the user.

7. 2. The information processing apparatus according to claim 1, further comprising: a storage means for storing at least attribute information of the affiliation of a person including the user identified by the user identification means, and transfer history information of the affiliation.

8. 2. The information processing apparatus according to claim 1, wherein the attribute information of the user's affiliation recorded by the recording means in association with the image is information that uniquely identifies the affiliation of the user.

9. 2. The information processing device according to claim 1, wherein the attribute information of the user's organization recorded by the recording means in association with the image includes information identifying all or some of the members of the organization to which the user belongs.

10. 2. The information processing apparatus according to claim 1, wherein said recording means records at least one of information on the time when said image was taken and information on the location where said image was taken in association with said image.

11. 2. The information processing apparatus according to claim 1, wherein said recording means records said personal identification information of said user in association with said image.

12. 2. The information processing apparatus according to claim 1, wherein said recording means records identity assurance information, which is information that certifies that the user is an actual person, in association with the image.

13. 2. The information processing apparatus according to claim 1, wherein said recording means records the identity assurance information of the organization in association with the image.

14. The information processing device according to claim 13, characterized in that, when the right to use the image is transferred, the recording means changes the identity assurance information of the affiliation recorded in association with the image to identification information at the destination of the transfer of the right to the image.

15. 2. The information processing apparatus according to claim 1, further comprising display means for displaying the image and attribute information of the user's affiliation that is recorded by the recording means in association with the image.

16. 2. The information processing apparatus according to claim 1, further comprising a display control means for displaying on a display means the image and the attribute information of the organization to which the user belongs, which is recorded by the recording means in association with the image.

17. The information processing device according to claim 1, further comprising a display control means for associating the image with the destination or displaying one or more images associated with the destination on a display means when a predetermined input operation is performed on a user interface displayed on a screen.

18. a user identification step of identifying a user who captured an image using the imaging device; an affiliation identification step of identifying the affiliation of the user based on personal identification information that identifies the individual user identified in the user identification step, and acquiring attribute information of the affiliation of the user; a recording step of recording attribute information of the user's organization in association with the image captured by the user, 1. An information processing method comprising:

19. A program for causing a computer to execute an information processing method, the program including: a user identification step of identifying a user who captured an image using the imaging device; an affiliation identification step of identifying the affiliation of the user based on personal identification information that identifies the individual user identified in the user identification step, and acquiring attribute information of the affiliation of the user; a recording step of recording attribute information of the organization to which the user belongs in association with the image captured by the user, A program characterized by:

Images