Imaging system, server, imaged file output method, and program

Abstract

To allow for limiting persons who can browse a captured image, on a terminal shared by a plurality of persons.SOLUTION: An imaging apparatus 100 encrypts and stores an imaged file captured by an imaging unit 107. When a user wants to browse the imaged file, the user is requested to input information (imaged contents, an image capture time, an image capture position, biological information, a password set by a photographer, and so on) determined from the imaged file. If the information inputted by the user in response to the request is correct, the imaging apparatus 100 permits display or transfer of the decrypted imaged file.SELECTED DRAWING: Figure 2

Description

[Technical field]

[0001] The present disclosure relates to protection of files captured on a terminal shared by multiple people. [Background technology]

[0002] Image data captured by a camera is stored in the camera's internal memory, on portable storage media, or in cloud storage. If the camera is shared by multiple people, such as a family or company, the images stored in the camera can be viewed by anyone who shares the camera using the camera's image playback function. However, when capturing images that contain private information, the photographer may want to restrict who can view the captured images.

[0003] Regarding restrictions on viewing images captured by a camera, Patent Document 1 describes a mechanism in which image files are encrypted and stored in the camera, and a person wishing to view the image files is permitted to obtain them if they make a request to view the images that meets the permission conditions previously set in the camera. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] JP 2017-46193 A Summary of the Invention [Problem to be solved by the invention]

[0005] However, when multiple people share a camera, if they are required to log in before shooting or to switch users, it takes time to prepare for shooting, and there is a risk of missing a valuable photo opportunity. In addition, the method of setting viewing permission conditions as shown in Patent Document 1 requires the user to set the conditions, which places a heavy burden on the user.

[0006] An object of the present disclosure is to make it possible to restrict who can view captured images on a terminal shared by multiple people. [Means for solving the problem]

[0007] The imaging system disclosed herein is characterized by having a concealment means for making an imaging file captured by an imaging means into a concealed state, a request means for requesting a user to input information determined by the imaging file, a reception means for receiving information input in response to a request by the request means, and an output means for releasing the concealment of the imaging file and outputting it if the information received by the reception means is correct. Effect of the Invention

[0008] According to the present disclosure, it is possible to restrict who can view images captured on a terminal shared by multiple people. [Brief description of the drawings]

[0009] [Figure 1] FIG. 2 is a block diagram showing an example of a hardware configuration of the imaging system. [Diagram 2] FIG. 2 is a block diagram showing an example of a functional configuration of the imaging system. [Diagram 3] 1A is a diagram showing an example of imaging file data, and FIG. 1B is a diagram showing an example of a list of imaging objects. [Figure 4] 11 is a flowchart showing the flow of an imaging process. [Diagram 5] 13 is a flowchart showing the flow of captured image file output processing. [Figure 6] FIG. 13A is a diagram showing an example of a file list display, and FIG. 13B is a diagram showing an example of a question screen display. [Figure 7] FIG. 13 is a block diagram showing a hardware configuration of an imaging system according to a second embodiment. [Figure 8] FIG. 11 is a block diagram illustrating an example of a functional configuration of an imaging system according to a second embodiment. [Figure 9] 10 is a flowchart showing the flow of imaging processing according to the second embodiment. [Figure 10] 13 is a flowchart showing the flow of captured image file output processing according to the second embodiment. [Figure 11] FIG. 13 is a diagram showing a display example of a request screen. [Figure 12] FIG. 11 is a diagram showing another display example of the request screen. [Figure 13] FIG. 13 is a block diagram illustrating an example of a functional configuration of an imaging system according to a third embodiment. [Figure 14] 13 is a flowchart showing the flow of imaging processing according to a third embodiment. [Figure 15] 1A is a diagram showing an example of a display of captured image file data, and FIG. 1B is a diagram showing an example of a file list. [Figure 16] 13 is a flowchart showing the flow of captured image file output processing according to the third embodiment. [Figure 17] 13A is a diagram showing an example of a file list display, and FIG. 13B is a diagram showing updated captured image file data. [Figure 18] FIG. 13 is a block diagram showing the configuration of an imaging system according to a fourth embodiment. [Figure 19] FIG. 13 is a block diagram showing the configuration of an imaging system according to a fifth embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. Note that the configurations shown in the following embodiments are merely examples, and the scope of the present disclosure is not limited to these configurations.

[0011] <First embodiment> FIG. 1 is a diagram illustrating an example of the hardware configuration of an image capturing apparatus 100 according to a first embodiment of an image capturing system.

[0012] The imaging device 100 includes a CPU 101, a ROM 102, a RAM 103, a storage medium 104, a power supply unit 105, a communication unit 106, an imaging unit 107, an operation unit 108, and an audio processing unit 109, and each unit is connected to each other via a bus 110. The imaging device 100 is a camera device such as a digital camera or a digital video camera, or an information terminal having a camera function such as a smartphone or a tablet terminal.

[0013] The CPU 101 is a control unit that is made up of at least one processor or circuit, and controls the entire imaging device 100 .

[0014] The ROM 102 is an electrically erasable and recordable memory, and stores constant data, programs, etc. for the operation of the CPU 101. The programs referred to here are computer programs for executing the processes shown in various flowcharts described later. In the RAM 103, constant data, variable data for operating the CPU 101, and programs read from the ROM 102, etc. are developed.

[0015] The storage medium 104 is a memory card or the like for recording image files including data of captured images, and is composed of a semiconductor memory or the like.

[0016] The power supply unit 105 supplies power to the imaging device 100. In addition to a built-in battery such as a lithium ion battery, a removable portable battery, or a configuration in which power is supplied from an AC power source may be used.

[0017] The communication unit 106 is an interface for communicating with an external device such as a network device or a USB device, and performs data communication via a network such as a LAN, or transmits and receives data to and from an external device. The communication may be wired or wireless.

[0018] The imaging unit 107 has an imaging element such as a CCD or CMOS element that converts an optical image into an electrical signal. The imaging unit 107 quantizes the electrical signal obtained from the imaging element, converts it into data, and inputs it to the CPU 101.

[0019] The operation unit 108 has a display unit such as an LED display or a liquid crystal panel, and an input unit such as a touch panel, a button switch, etc. The display unit displays images included in an imaging file and the status of the imaging device 100. The input unit accepts operations by a user who operates the imaging device 100, and inputs the operations to the CPU 101.

[0020] The audio processing unit 109 includes a microphone and a speaker, inputs audio input from the microphone to the CPU 101, and outputs audio data and acoustic data generated by the CPU 101 from the speaker.

[0021] FIG. 2 is a block diagram showing an example of the functional configuration of the imaging device 100. As shown in FIG. 2, the imaging device 100 includes, in addition to the imaging unit 107 and storage medium 104 described above, a file storage unit 201, a file selection unit 211, a decryption unit 212, a file temporary storage unit 213, an image recognition unit 214, a question unit 215, and an output unit 220. The file storage unit 201 includes a file generation unit 202 and an encryption unit 203. The question unit 215 includes a question generation unit 216, a question presentation unit 217, an answer acceptance unit 218, and a correct / incorrect determination unit 219. The output unit 220 includes a display unit 221 and a transfer unit 222.

[0022] The file generation unit 202 encodes the data captured by the imaging unit 107 into a format such as JPEG or RAW for still images, or into a format such as MP4 or MOV for moving images, to generate file data. Hereinafter, the file data generated by the file generation unit 202 is referred to as a captured file. The file generation unit 202 issues an imaging ID and a file name, which are information for uniquely identifying the captured file, and links them to the captured file. Note that the above-mentioned file data formats are merely examples, and are not limited to these formats.

[0023] The encryption unit 203 encrypts the captured image file generated by the file generation unit 202 and stores the file in the storage medium 104. The encryption is performed using a common key cryptosystem or a public key cryptosystem. In this embodiment, since encryption and decryption are performed within the imaging device 100, it is preferable to use a common key cryptosystem. This is because the public key cryptosystem does not require separate key management of the public key and private key, and the common key cryptosystem is faster than the public key cryptosystem.

[0024] Fig. 3(a) is an example of imaging file data stored in the storage medium 104. In the imaging file data, an encrypted imaging file 312 is stored in association with an imaging ID 311. In the example of Fig. 3(a), a plurality of imaging files are stored in the storage medium 104 in association with respective imaging IDs, such as imaging file "Image_002" for imaging ID "002," imaging file "Image_003" for imaging ID "003," and so on.

[0025] The file selection unit 211 accepts the selection of the captured image file that the user wishes to display or transfer. The file selection unit 211 acquires the captured image file data 310 stored in the storage medium 104, generates a file list, and displays it on the screen of the operation unit 108 (FIG. 6(a)). The file list displays, for example, thumbnail images, imaging IDs, or file names corresponding to each captured image file. For captured image files encrypted by the encryption unit 203, the file selection unit 211 may display, for example, a lock icon to indicate that thumbnails cannot be displayed.

[0026] The decryption unit 212 reads the captured image file selected by the file selection unit 211 from the storage medium 104 and decrypts it. When decrypting, a common key is used if the encryption method used by the encryption unit 203 is a common key encryption method. Information on the key used when decrypting is stored in an area that is difficult for the user to access, such as a non-volatile memory area of ​​the RAM 103.

[0027] The file temporary storage unit 213 temporarily stores the captured image file decoded by the decoding unit 212 in the RAM 103, which is a volatile memory.

[0028] The image recognition unit 214 reads the decoded captured image file stored in the file temporary storage unit 213, and detects objects captured in the image in the captured image file. Hereinafter, an object captured in an image is referred to as a captured object. The image recognition unit 214 detects the captured object by, for example, a known captioning process, generates a list of pair information of the names and image sizes of all the detected captured objects, and stores the list in the RAM 104 as the captured object list 320.

[0029] Captioning is a process that uses image recognition technology that utilizes neural networks to detect and recognize objects captured in an image. For example, the following reference document describes a technology that expresses objects captured in an image in natural language.

[0030] References: Justin Johnson, 2 others, Dense Cap: Fully Convolutional Localization Networks for Dense Captioning", [online], [Retrieved June 14, 2020], Internet<URL:https: / / cs.stanford.edu / people / karpathy / densecap / >

[0031] The image recognition unit 214 performs captioning processing on the image of the still image in the case of a still image, and on images cut out from each frame of the video in the case of a video. The image recognition unit 214 may calculate the image similarity between frames of the video, group similar frames, and perform captioning processing on an image cut out from one frame of each group. Note that any method for detecting an object from an image may be used, and is not limited to the above-mentioned captioning processing.

[0032] Fig. 3(b) is a diagram showing an example of the image capture object list 320. As shown in Fig. 3(b), the image capture object list 320 stores names (image capture objects) 321 of objects detected from an image capture file in association with their image sizes 322. For example, objects such as a ship, a person, a traffic light, and a car are detected from a certain image capture file, and their image sizes (horizontal size x vertical size) are detected as 150 x 100, 50 x 100, 10 x 50, and 30 x 10, respectively. Along with the names of the objects, the image capture object list 320 may also store the composition, color, and size of the objects, and the positional relationships between the objects.

[0033] The question generator 216 generates a question to ask the user about an object captured in an image of the imaging file. For example, the question generator 216 generates options that mix the object names of one or more objects with a larger image size 322 among the imaging objects 321 included in the imaging object list 320 with any object name not included in the imaging object list 320. Then, a question is generated in a selection format to ask which of the options is captured in the image of the imaging file. The options may be expressed in text or may be expressed in images representing the objects.

[0034] The difficulty of answering a question may be set in advance in the imaging device 100. The question generator 216 generates a question according to the set difficulty of answering. For example, when the difficulty of answering is set high, the question generator 216 may increase the number of imaging objects 321 to be answered, or may include imaging objects 321 with smaller image sizes 322 as options, or may perform both. Depending on the difficulty of answering, the composition, color, size, positional relationship between objects, etc. of the imaging objects 321 may be added to the question. Also, a security level may be set in advance for the imaging file, and the difficulty of answering may be changed depending on the security level.

[0035] Question presenter 217 displays the question generated by question generator 216 on a liquid crystal panel of operation unit 108. Alternatively, question presenter 217 may generate audio data of the question generated by question generator 216, read the question out through an audio speaker, and display options on the liquid crystal panel of operation unit 108.

[0036] The answer receiving unit 218 receives a selection of an option by operating the software keyboard of the operation unit 108 or by operating the touch panel of the operation unit 108. Alternatively, an answer to a question is received by the user's voice into a sound sensor (microphone).

[0037] The correctness determining unit 219 determines whether the answer received by the answer receiving unit 218 is correct or not. If an imaging object that matches the object name input as the answer exists in the imaging object list 320, the correctness determining unit 219 determines the answer as correct. If not, the correctness determining unit 219 determines the answer as incorrect.

[0038] If the answer is correct, the output unit 220 outputs the decoded imaging file stored in the file temporary storage unit 213. The output is a display on the liquid crystal panel of the operation unit 108 by the display unit 221, or a transfer by the transfer unit 222 to a transfer destination designated by the user. If the answer is incorrect, the correctness determining unit 219 displays an error message on the liquid crystal panel of the operation unit 108.

[0039] Next, an example of imaging processing by the imaging device 100 will be described. 4 is a flowchart showing the flow of imaging processing. The processing shown in this flowchart is executed by the CPU 101 of the imaging device 100, in which a processing program stored in the ROM 102 or storage medium 104 is called by the CPU 101, loaded into the RAM 103, and executed by the CPU 101. After power is turned on, the CPU 101 of the imaging device 100 starts the processing of this flowchart in a standby state for imaging. In the following explanation, the symbol "S" denotes a step.

[0040] In S401, when the user operates the shutter button, the imaging unit 107 captures an image. In S402, the CPU 101 (file generation unit 202) acquires imaging data from the imaging unit 107, encodes the data into a predetermined file data format, issues an imaging ID, a file name, etc., and generates an imaging file.

[0041] In S403, the CPU 101 (encryption unit 203) encrypts the captured image file. In S404, the CPU 101 stores the encrypted captured image file in the storage medium 104, and ends this flowchart. Since the captured image file is encrypted and stored, it is stored in a confidential state.

[0042] Next, an example of captured image file output processing executed by the imaging device 100 will be described. 5 is a flowchart showing the flow of captured image file output processing, which starts when the user selects an image playback menu.

[0043] In S501, the CPU 101 (file selection unit 211) acquires information about captured image files stored in the storage medium 104, generates a file list 600, and displays it on the screen of the operation unit . In S502, the CPU 101 (file selection unit 211) accepts the selection of a file that the user wishes to display or transfer.

[0044] 6(a) is a diagram showing an example of a file list 600 displayed on the operation unit 108. As shown in the figure, the file list 600 displays a message 601 such as "Please select a file" and a group of thumbnail images 602 of the imaging files stored in the storage medium 104. In this embodiment, since all the imaging files stored in the storage medium 104 are encrypted, a lock icon is displayed together with the file name or imaging ID instead of the thumbnail image.

[0045] In S503, the CPU 101 (decoding unit 212) acquires the imaging file selected in S502 from the storage medium 104 and decodes it. The CPU 101 stores the decoded imaging file in the file temporary storage unit 213, an area of ​​which is reserved in the RAM 103. If the imaging file does not fit in the size of the RAM 103, the file may be divided and stored.

[0046] In S504, the CPU 101 (image recognition unit 214) detects an image capturing object from the image of the captured image file stored in the file temporary storage unit 213, and recognizes the name of the image capturing object. The object is detected by the above-mentioned captioning process or the like. In S505, the CPU 101 (image recognition unit 214) creates a list of recognized image capture objects, that is, an image capture object list 320. For example, as shown in FIG. 3B, image capture objects (names) 321 such as a ship, a person, a traffic light, a car, etc. are stored in the image capture object list 320 together with image sizes 322.

[0047] In S506, the CPU 101 (question generating unit 216) refers to the imaging object list 320 and generates a question asking about the imaging object. In S507, the CPU 101 (question presenting unit 217) presents the question generated in S506. The question is presented by displaying it on the liquid crystal panel of the operation unit 108, or by outputting it from the speaker of the voice processing unit 109, or the like.

[0048] FIG. 6(b) shows an example of a question screen 610 displayed on the operation unit 108. A question 611 such as "What did you photograph?" and options 612, 613, and 614 are displayed on the question screen 610. An OK button 615 and a MENU button 616 are displayed on the question screen 610. In the example of FIG. 6(b), "1. Boat", "2. Car", and "3. Airplane" are presented as options 612 to 614 generated based on the image capture object list 320. In this example, the options include the image capture objects "1. Boat" and "2. Car" in the image capture object list 320 shown in FIG. 3(b) and the image capture object "3. Airplane" not in the image capture object list 320.

[0049] In S508, the CPU 101 (answer receiving unit 218) receives an answer input by the user. The answer is input by operating the touch panel of the operation unit 108, input from the microphone of the audio processing unit 109, or the like. In the example of Fig. 6(b), when the user selects one of options 612, 613, or 614 and operates an OK button 615, the selected option is input as the answer. When the MENU button 616 is operated, the screen returns to the menu screen.

[0050] In S509, the CPU 101 (correctness determination unit 219) determines whether an object matching the object name of the answer accepted in S508 exists in the image capture object list 320 stored in the RAM 103. If it is confirmed that a matching object exists, the answer is determined to be correct (S509; YES), and the process proceeds to S510. If a matching object does not exist, the answer is determined to be incorrect (S509; NO), and the process proceeds to S511.

[0051] The correct answers to the question in Fig. 6(b) are "1. Boat" and "2. Car". The CPU 101 determines that the answer is correct when both options 612 and 613 are selected. When only one of options 612 and 613 is selected, or when option 614 is selected, it determines that the answer is incorrect. Note that the number of options and the number of correct answers among the options are arbitrary.

[0052] In S510, the CPU 101 (display unit 221, transfer unit 222) outputs the decoded captured image file stored in the file temporary storage unit 213. The output is a display on the liquid crystal panel of the operation unit 108, or a file transfer to a predetermined transfer destination. Note that whether to display or transfer may be specified by the user when selecting the file in S502, or a user specification may be accepted after output is enabled in S510.

[0053] In S511, the CPU 101 displays an error message to the effect that the captured image file cannot be opened because the answer is incorrect. When the file is output in S510 or an error message is displayed in S511, this flowchart ends.

[0054] As described above, the imaging device 100 of the first embodiment encrypts the file after capturing an image, thereby making it secret. Then, when viewing the file, a question is generated based on the captured object detected from the captured file, and an answer based on the photographer's memory is accepted. If the answer is correct, output of the captured file is permitted. This allows shooting without interfering with the shutter chance, while restricting the viewing or transfer of the captured file to only those who know the captured content, that is, the photographer himself or those who have shared the fact that the image was captured.

[0055] As a rescue measure for when the photographer has forgotten what to do and is unable to input the correct answer, the imaging device 100 may be provided with a special mode that allows the captured file to be viewed or transferred without answering. However, it is preferable to restrict users who can use the special mode by, for example, requiring the user to enter a preset special mode password to enter the special mode.

[0056] Furthermore, the questions, question formats, answering methods, etc. described above are not limited to the above examples, and any answering method suitable for the questions and question formats based on the content of the shooting may be used.

[0057] <Second embodiment> In the second embodiment, an example will be described in which, instead of questions about the image capture content, the user is requested to input information determined when the image is captured. For example, metadata added to the captured image file, biometric information acquired from the photographer when capturing the image, authentication information set in the file by the photographer when capturing the image, etc. will be used.

[0058] 7 is a diagram showing an example of the hardware configuration of an imaging device 100A according to the second embodiment. The imaging device 100A is a camera device such as a digital camera or a digital video camera, or an information terminal having a camera function such as a smartphone or a tablet terminal. The imaging device 100A includes a CPU 101, a ROM 102, a RAM 103, a storage medium 104, a power supply unit 105, a communication unit 106, an imaging unit 107, an operation unit 108, an audio processing unit 109, a biometric information input unit 711, a position information acquisition unit 712, a date and time information acquisition unit 713, etc. Each unit is connected by a bus 110. The CPU 101, the ROM 102, the RAM 103, the storage medium 104, the power supply unit 105, the communication unit 106, the imaging unit 107, the operation unit 108, and the audio processing unit 109 are the same as those in the first embodiment, and therefore description thereof will be omitted.

[0059] The biometric information input unit 711 is composed of, for example, a fingerprint sensor and an in-camera. The fingerprint sensor acquires fingerprint information of the user's fingers. The in-camera is composed of an image sensor and the like arranged to face the photographer, and acquires a face image and an iris image of the user. The biometric information input unit 711 extracts features based on the input fingerprint information, face image, and iris image, and stores them in the RAM 103 as biometric information unique to the user.

[0060] The position information acquisition unit 712 is configured with a positioning system such as a GPS, and acquires position information of the imaging device 100A. The file generation unit 202 saves the position information acquired by the position information acquisition unit 712 as metadata of the imaging file together with the captured image.

[0061] The date and time information acquisition unit 713 is a clock, such as a real time clock, built into the imaging device 100A. The file generation unit 202 saves the acquired time information as metadata of the imaging file together with the captured image.

[0062] Fig. 8 is a block diagram showing the functional configuration of an image capturing device 100A according to the second embodiment. As shown in Fig. 8, the image capturing device 100A includes a storage medium 104, an image capturing unit 107, a file saving unit 201, a decryption unit 212, a file temporary holding unit 213, a file selecting unit 211, an output unit 220, an information acquiring unit 831, an information input request unit 835, and the like. The storage medium 104, the image capturing unit 107, the file saving unit 201, the decryption unit 212, the file temporary holding unit 213, the file selecting unit 211, and the output unit 220 are the same as those in the first embodiment, and therefore description thereof will be omitted.

[0063] The following describes information acquisition unit 831 and information input request unit 835, which are different from the first embodiment.

[0064] The information acquisition unit 831 has at least one of a shooting time / location information acquisition unit 832 , a biometric information acquisition unit 833 , and a password setting unit 834 . The information input request unit 835 includes a request generation unit 836 , a request presentation unit 837 , an information reception unit 838 , and a correctness determination unit 839 . The functions provided by each block are explained below.

[0065] A shooting time / position information acquisition section 832 of the information acquisition unit 831 acquires EXIF ​​metadata recorded at the time of image capture, such as shooting time information and shooting position information, when the image capture unit 107 captures an image, and stores the acquired file in the file generation unit 202.

[0066] When an image is captured, the biometric information acquisition unit 833 of the information acquisition unit 831 acquires fingerprint information of the photographer using the fingerprint sensor of the biometric information input unit 711, and stores the acquired information in an image file in the file generation unit 202. Alternatively, the biometric information acquisition unit 833 captures an iris image or a face image of the user (photographer) using an imaging element of the in-camera of the biometric information input unit 711, extracts feature information thereof, and stores the extracted information in the image file in the file generation unit 202.

[0067] When the user captures an image, the password setting unit 834 of the information acquisition unit 831 accepts the setting of a password by character input by the photographer using the touch panel of the operation unit 108. The password is saved in the captured image file by the file generation unit 202. Alternatively, the password setting unit 834 of the information acquisition unit 831 acquires the password spoken by the user using the microphone of the audio processing unit 109 when the user captures an image as information at the time of capturing an image. The acquired audio password is saved in the captured image file by the file generation unit 202. The password may be composed of letters, numbers, symbols, etc., or may be a PIN code, etc.

[0068] In this specification, the expressions "when a photograph is taken" and "during a photograph" include not only the moment the shutter button is operated, but also a predetermined time before and after. For example, if a password is entered within a preset time after a user presses the shutter button to take a photograph, the password is recorded in the image file as the password set "when a photograph is taken." Alternatively, if biometric information is entered within a predetermined time before the shutter button is operated, the biometric information is treated as information obtained "when a photograph is taken."

[0069] When still images are captured continuously using the continuous shooting function, the password may be entered only once after the continuous shooting is completed. In this case, the entered password is saved in all still image files resulting from the continuous shooting.

[0070] In the following description, the imaging file handled by the encryption unit 203, the decryption unit 212, and the temporary file storage unit 213 includes shooting time information, shooting location information, fingerprint information, facial feature information, iris feature information, password, etc. acquired by the information acquisition unit 831. Note that it is not necessary to include all of the shooting time information, shooting location information, fingerprint information, facial feature information, iris feature information, password, etc., but it is sufficient to include at least one of them. Hereinafter, information such as shooting time information, shooting location information, fingerprint information, facial feature information, iris feature information, and password acquired at the time of shooting is referred to as information acquired at the time of imaging.

[0071] The request generating unit 836 generates a sentence requesting the user to input the image capture acquired information by using the image capture acquired information stored in the file temporary storage unit 213. When the image capture acquired information stored in the captured file is EXIF ​​metadata, the request generating unit 836 generates a request sentence asking about metadata, such as the image capture time. The request sentence may be generated to include options that include a mixture of correct and incorrect image capture times. Alternatively, a request sentence asking about image capture location information may be generated.

[0072] If the image-capturing acquired information stored in the imaging file is fingerprint information, the request generating unit 836 generates a request sentence prompting the user to touch a finger to the fingerprint sensor. If the image-capturing acquired information stored in the imaging file is iris information or face information, the request generating unit 836 generates a request sentence prompting the user to turn their eyes (iris) or face toward the in-camera. If the image-capturing acquired information stored in the imaging file is a password entered by the photographer or spoken by the photographer, the request generating unit 836 generates a request sentence asking for the password.

[0073] The request presentation unit 837 displays the request text generated by the request generation unit 836 on the liquid crystal panel of the operation unit 108. Alternatively, the request text is read out by the audio speaker of the voice processing unit 109, and options are displayed on the liquid crystal panel of the operation unit 108.

[0074] When the image capture acquired information stored in the captured file is EXIF ​​metadata or a password, the information receiving unit 838 receives input of a response to the request from a software keyboard by operating the touch panel of the operation unit 108. Alternatively, the information receiving unit 838 receives a selection of an option by operating the touch panel of the operation unit 108. Alternatively, the information receiving unit 838 receives input of a response to the request by the user speaking into the microphone of the audio processing unit 109.

[0075] If the information acquired at the time of capturing images stored in the captured image file is fingerprint information, the information accepting unit 838 accepts input of a response to the request by touching the finger at the time of capturing images to the fingerprint sensor of the biometric information input unit 711. If the information acquired at the time of capturing images stored in the captured image file is iris information or face information, the information accepting unit 838 captures an image of the eyes or face using the in-camera of the biometric information input unit 711, extracts features, and acquires the iris information or face information of the user. The acquired information becomes a response to the request.

[0076] If the information acquired at the time of capturing stored in the captured file is EXIF ​​metadata or a password, the correctness determining unit 839 checks whether the input content accepted by the information accepting unit 838 matches the information acquired at the time of capturing stored in the captured file. If they match, it is determined to be a correct answer, and if not, it is determined to be an incorrect answer.

[0077] If the image-captured information stored in the captured image file is fingerprint information, iris information, or face information, a correct / incorrect judgment unit 839 calculates the similarity between the fingerprint information, iris information, or face information received by the information receiving unit 838 and the fingerprint information, iris information, or face information stored in the captured image file. If the similarity is equal to or greater than a predetermined threshold, the answer is determined to be correct, and if not, the answer is determined to be incorrect.

[0078] The similarity may be calculated by, for example, using a model using a neural network to find the distance in the feature space. A threshold value for the similarity is 99% for accurate determination, but any value can be set. The threshold value may be changeable by the image capture device 100 through a user operation.

[0079] Next, an example of imaging processing by the imaging device 100A of the second embodiment will be described. 9 is a flowchart for explaining the flow of image capture processing in the second embodiment. After power is turned on, the CPU 101 of the image capture device 100A starts the processing of this flowchart in a standby state for image capture.

[0080] In S901, when the user performs a shutter operation, the imaging unit 107 captures an image. In S902, the CPU 101 (information acquisition unit 831) acquires image capture acquisition information. The image capture acquisition information may be any one of metadata, biometric information, and a password. In addition, a plurality of these pieces of information may be acquired.

[0081] In S903, the CPU 101 (file generating unit 202) acquires the captured image data from the imaging unit 107, encodes the captured image data into a predetermined file format, and generates a captured image file. At this time, the CPU 101 (file generating unit 202) also records the captured image acquisition information acquired in S902 in the captured image file. The captured image acquisition information is recorded as metadata of the captured image file.

[0082] For example, in the case of a JPEG file of a still image, the image capture information acquired in S902 can be recorded as metadata in EXIF. Alternatively, the image capture information acquired in S902 may be recorded by combining it as binary data at the end or beginning of the image data.

[0083] In S904, the CPU 101 (encryption unit 203) encrypts the captured image file. In S905, the CPU 101 stores the encrypted captured image file in the storage medium 104. By storing the captured image file in an encrypted form, the captured image file is stored in a confidential state. The captured image acquisition information is also encrypted and stored together with the captured image file.

[0084] Next, an example of captured image file output processing by the imaging device 100A will be described. Fig. 10 is a flowchart for explaining the flow of captured image file output processing in the second embodiment. This flowchart is started when the user selects an image playback menu by operating the menu of the imaging device 100. Note that the process shown in Fig. 10 differs from the captured image file output processing in the first embodiment (Fig. 5) in that S1004 to S1005 are performed instead of S504 to S507. That is, in the first embodiment, a question is generated based on the captured image contents of the captured image file, but in the second embodiment, the user is requested to input metadata, biometric information, or a password acquired at the time of capturing an image.

[0085] In S1001, the CPU 101 (file selection unit 211) acquires information on the captured image files stored in the storage medium 104, generates a file list, and displays it on the screen of the operation unit . In S1002, the CPU 101 (file selection unit 211) accepts the user's selection of a file to be displayed or transferred.

[0086] In S1003, the CPU 101 (decryption unit 204) decrypts the imaging file selected in S502. The CPU 101 stores the decrypted imaging file in the file temporary storage unit 213, an area of ​​which is allocated in the RAM 103.

[0087] In S1004, the CPU 101 acquires the image capture acquisition information recorded in the captured image file decoded in S1003. In S1005, the CPU 101 (request generation unit 836) generates a request sentence for requesting the user to input information acquired during imaging. The CPU 101 (request presentation unit 837) presents the request sentence. The presentation is performed by displaying on the liquid crystal panel of the operation unit 108, or outputting from the speaker of the audio processing unit 109, or the like.

[0088] 11 is a diagram showing an example of a request screen 1100 displayed on the operation unit 108. As shown in the figure, the request screen 1100 displays a request sentence 1101 such as "When was the photo taken?", and options 1102, 1103, and 1104. The request screen 1100 also displays an OK button 1105 and a MENU button 1106.

[0089] In the example of Fig. 11, the options presented are "1. May 11, 14:32", "2. May 11, 20:32", and "3. May 11, 10:32". In other words, options that include a mixture of shooting time information recorded in the metadata and time information not included in the metadata are generated and presented.

[0090] 12(a) is a diagram showing another example of a request screen 1200 displayed on the operation unit 108. As shown in the figure, the request screen 1200 displays a request sentence 1201 such as "Please touch the fingerprint sensor." The request screen 1200 displays an OK button 1202 and a MENU button 1203. When requesting face information or iris information, the request sentence 1201 such as "Please read your face with the in-camera" is displayed.

[0091] 12(b) is a diagram showing another example of a request screen 1210 displayed on the operation unit 108. As shown in the figure, the request screen 1210 displays a request sentence 1211 such as "Please enter the password you set," and is provided with a password input field 1212 and a software keyboard 1213. In addition, the request screen 1210 displays an OK button 1214 and a MENU button 1215.

[0092] In S1006, the CPU 101 (information receiving unit 838) receives information input by the user. Information is input by operating the touch panel of the operation unit 108, input from the microphone of the audio processing unit 109, or the like. When the user inputs information corresponding to a request on the request screens 1100, 1200, 1210 and operates the OK buttons 1105, 1202, 1214, the input information is input as a response to the request. When the MENU buttons 1106, 1203, 1215 are operated, the screen returns to the menu screen.

[0093] In S1007, the CPU 101 (correctness determination unit 839) determines whether the information entered by the user matches the image capture information recorded in the image capture file. If a match is confirmed (S1007; YES), the input content is determined to be correct, and the process proceeds to S1008. If a match is not confirmed (S1007; NO), the process proceeds to step S1009.

[0094] In S1008 , the CPU 101 (the display unit 221 , the transfer unit 222 ) outputs the decoded captured image file held in the file temporary holding unit 213 . In S1009, the CPU 111 displays an error message to the effect that the captured image file cannot be opened because the input contents are incorrect. When the file is output in S1008 or an error message is displayed in S1009, this flowchart ends.

[0095] As described above, the user is requested to input information recorded as metadata such as shooting time information and shooting location information, the photographer's biometric information, or a password set by the photographer when capturing an image, and only when the input is correct is output of the captured image file permitted. This allows photography without interfering with photo opportunities, while restricting the viewing and transfer of captured image files to only those who know the information set at the time of capturing an image.

[0096] In the above example, the information requested to be input by the user is any one of information recorded as metadata, biometric information of the photographer, and a password set by the photographer at the time of image capture, but the information is not limited to this and multiple pieces of information may be requested to be input. Also, as shown in the first embodiment, the input of information acquired at the time of image capture may be requested in combination with a question asking about an image capture object detected from an image capture file.

[0097] <Third embodiment> In the third embodiment, the setting of a user account in an imaging device and the setting of access rights to captured files will be described.

[0098] 13 is a block diagram showing an example of a functional configuration of an imaging device 100B according to the third embodiment. The imaging device 100B is a camera device such as a digital camera or a digital video camera, or an information terminal having a camera function such as a smartphone or a tablet terminal. As shown in the figure, the imaging device 100B includes a storage medium 105 and an imaging unit 107. The imaging device 100B includes a user account unit 1301, a file storage unit 201, a decryption unit 212, a file temporary storage unit 213, a file selection unit 211, an information acquisition unit 831, an information input request unit 835, a file update unit 1311, an authorized file output unit 1320, and the like.

[0099] The storage medium 105, imaging unit 107, file storage unit 201, decoding unit 212, file temporary storage unit 213, file selection unit 211, information acquisition unit 831, and information input request unit 835 are similar to those in the first and second embodiments, and therefore descriptions thereof will be omitted. Also, the hardware configuration of imaging device 100B is similar to that of imaging devices 100 and 100A in the first and second embodiments, and therefore descriptions thereof will be omitted.

[0100] The following describes the differences from the first and second embodiments: user account unit 1301, file update unit 1311, and authorized file output unit 1320. User account unit 1301 has an account registration unit 1302 and a login processing unit 1303. File update unit 1311 has a decrypted file storage unit 1312 and a file authority setting change unit 1313. Authorized file output unit 1320 has an authorized file display unit 1321 and an authorized file transfer unit 1322. The functions provided by each block are described below.

[0101] The account registration unit 1302 creates account data for each of a plurality of users who use the image capture device 100B, and stores the created account data in the storage medium 104 in association with a user ID, which is information for identifying the user, and authentication information required at the time of login. The login processing unit 1303 enables a user to log in with an account when using the imaging device 100B. However, logging in is not essential when using the imaging device 100B, and in particular logging in is not necessarily required when capturing an image.

[0102] If the image capture information input by the user in response to a request presented by the information input request unit 835 is correct, the decrypted file storage unit 1312 stores the decrypted image file in the storage medium 104 instead of the image file before decryption. The file authority setting change section 1313 changes the authority information of the imaging file so as to give access authority to the decrypted imaging file to the account logged in to the imaging device 100B.

[0103] The authorized file display section 1321 makes it possible to display captured files for which the logged-in user account has access authority. The authorized file transfer unit 1322 enables a logged-in user account to transfer files for which it has access authority.

[0104] The imaging device 100B of the third embodiment has a user account unit 1300 and realizes a multi-account function. In the imaging process, as described in the first and second embodiments, a user can immediately shoot without logging in. However, if a user shoots without logging in, access rights to the captured image file are not given to any account. Therefore, since no user can access the captured image file, the captured image file is kept secret.

[0105] Furthermore, if a user is logged in when taking a picture, the captured image file is saved in association with the account data currently logged in. Therefore, the currently logged-in user account is given the right to access the captured image file.

[0106] The flow of imaging processing by the imaging device 100B of the third embodiment will be described with reference to FIG. 14 is a flowchart for explaining the flow of image capture processing in the third embodiment. The CPU 101 of the image capture device 100B starts the processing of this flowchart in a standby state after power is turned on.

[0107] In S1401, when a user performs a shooting operation, the imaging unit 107 captures an image. In S1402, the CPU 101 (file generating unit 202) acquires imaging data from the imaging unit 107, encodes the data into a predetermined file format, and generates an imaging file.

[0108] In S1403, CPU 101 determines whether or not the user has logged in. If the user has logged in (S1403; YES), the process proceeds to S1404, and if the user has not logged in (S1403; NO), the process proceeds to S1405. In S1404, the CPU 101 associates the captured image file generated in S1402 with the currently logged-in account, stores the captured image file in the storage medium 104, and ends the processing of this flowchart.

[0109] In S1405, the CPU 101 (information acquisition unit 831) acquires information acquired at the time of capturing images, such as shooting time information, shooting position information, biometric information of the photographer, a password, etc., in the same manner as in the second embodiment. The information acquired at the time of capturing images is recorded as metadata of the captured image file.

[0110] In S1406, the CPU 101 (encryption unit 203) encrypts the captured image file. In S1407, the CPU 101 stores the encrypted captured image file in the storage medium 104. The captured image acquisition information is also encrypted and stored together with the captured image file. Thereafter, the process of this flowchart ends.

[0111] 15(a) is a diagram showing an example of data 1510 stored in the storage medium 104 after imaging processes have been performed by a plurality of users using an imaging device 100B having a multi-account function. An imaging ID 1511 is issued and stored in each imaging file 1512. Furthermore, if a user is logged in when capturing an image, account data 1513 of the logged-in user is linked to the imaging file 1512.

[0112] In the example of Fig. 15(a), the imaging file with imaging ID "002" is stored in association with user account data "User_A", and the imaging file with imaging ID "003" is stored in association with another user account "User_B". Furthermore, the imaging files with imaging IDs "004", "005", and "006" do not have user account data 1513 recorded. This means that the imaging files with imaging IDs "004", "005", and "006" were captured without logging in.

[0113] In this case, the user "User_A" has access authority to the captured image file with the capture ID "002." Similarly, the user "User_B" has access authority to the captured image file with the capture ID "003."

[0114] Next, captured image file output processing by the imaging device 100 will be described with reference to FIG. Fig. 16 is a flowchart for explaining the flow of captured image file output processing in the third embodiment. It is assumed that a plurality of captured image files 1512 shown in Fig. 15(a) are stored in the storage medium 104. This flowchart starts when the image playback menu is selected by the user.

[0115] In S1601, the CPU 101 (login processing unit 1303) executes login processing and accepts the login of a user. In S1602, the CPU 101 checks whether or not a captured image file linked to the login account is stored by referring to the storage medium 104. If a captured image file linked to the login account is stored (S1602; YES), the process proceeds to S1603, and if not (S1602; NO), the process proceeds to S1607.

[0116] In S1603, the CPU 101 acquires the captured image files for which the login account has access authority and the captured image files for which no user has access authority, and displays the file list 1520 on the operation unit .

[0117] For example, when a user "User_A" is logged in, a thumbnail image 1521 of an imaging file "Image_002" linked to "User_A" is displayed as shown in Fig. 15(b). In addition, lock icons 1522, 1523, and 1524 are displayed in a list for imaging files "Image_004," "Image_005," and "Image_006," which are not linked to any account.

[0118] In S1604, the CPU 101 (file selection unit 211) accepts the selection of a captured image file that the user wishes to display or transfer. In S1605, the CPU 101 (file selection unit 211) checks the access authority set for the selected imaging file. If the selected imaging file is linked to the logged-in user account data, it is determined that the authority exists (S1605; YES) and the process proceeds to S1606. If not (S1605; NO), the process proceeds to S1609.

[0119] In S1606, the CPU 101 (authorized file output unit 1320) displays or transfers the captured image file selected by the user, and ends this flowchart.

[0120] The processing of S1609 to S1616 is the same as that of S1003 to S1009 in the second embodiment. That is, if the access authority of the user is not set for the captured image file selected by the user, the captured image file is decrypted and the input of information determined when the captured image is received is accepted. Only when the input information is correct, the captured image file can be output.

[0121] In S1609 , the CPU 101 (decoding unit 204 ) decodes the selected captured image file and stores it in the file temporary storage unit 213 . In S1610, the CPU 101 acquires the image capture acquisition information recorded in the decoded captured image file. In S1611, the CPU 101 (information input request unit 835) requests input of image capture acquisition information. The CPU 101 (request presentation unit 837) presents a request statement.

[0122] In S1612, CPU 101 (information receiving unit 838) receives information input by the user. In S1613, the CPU 101 (correctness determination unit 839) determines whether the information input in S1612 matches the image capture information recorded in the captured image file. If a match is confirmed (S1613; YES), the input content is determined to be correct, and the process proceeds to S1614. If a match is not confirmed (S1613; NO), the input content is determined to be incorrect, and the process proceeds to S1616, where an error message is displayed indicating that access rights to the file cannot be set.

[0123] In S1614, the CPU 101 (decoded file storage unit 1312) stores the decoded captured image file in the storage medium 104 in place of the file before decoded. In S1615, the CPU 101 (file authority setting change unit 1313) sets the authority for the decrypted captured image file so that the account logged in by the login processing unit 1303 has access authority.

[0124] For example, in the file list 1520 shown in Fig. 15(b), assume that the currently logged-in user "User_A" has selected an image file "Image_004" for which he does not have the authority. If the logged-in user "User_A" inputs correct information regarding the information determined when the image file "Image_004" is captured (information acquired at the time of capturing an image), the access authority of the user "User_A" is set for the image file "Image_004". In other words, the image file "Image_004" is linked to the account data of the logged-in user "User_A" and updated and saved.

[0125] The process of S1607 in the case where the captured image file linked to the login account is not stored in the storage medium 104 in S1602 (S1602; NO) will be described.

[0126] 15A, it is assumed that there is no captured image file associated with the user account "User_C" in the storage medium 104. In this state, when the user of the user account "User_C" logs in in S1601, NO is determined in S1602, and the process proceeds to S1607.

[0127] In S1607, the CPU 101 acquires imaging files for which no authority has been set, and displays a file list 1710 on the operation unit 108. For example, as shown in Fig. 17(a), padlock icons 1711, 1712, and 1713 indicating imaging files "Image_004", "Image_005", and "Image_006" that are not linked to any account data are displayed in a list.

[0128] In S1608, for example, the captured file 1713 "Image_006" is selected by the login account "User_C." In this case, the CPU 101 performs the above-mentioned processes of S1609 to S1616. If the currently logged-in user "User_C" can input correct information regarding the information determined when the captured file "Image_006" was captured (information acquired at the time of capturing), access authority is set for "User_C" to the captured file "Image_006."

[0129] As shown in FIG. 17(b), the captured file 1722 of "Image_006" is updated to a decrypted file, and account data 1723 of the login account "User_C" is linked to the decrypted file.

[0130] In this manner, access authority can be set that allows the currently logged-in user "User_C" to read and write to the captured image file "Image_006" for which no other user has authority.

[0131] As described above, according to the third embodiment, access authority to a captured image file can be set for a user account that has entered correct information determined when the captured image file was captured. By logging in, the user can display or transfer the captured image file for which access authority has been set.

[0132] 16 shows an example of inputting information determined when an image is captured as in the second embodiment, but instead of this, a question about the image capture object as in the first embodiment may be presented. Also, the image capture device 100B of the third embodiment may be configured to omit the encryption unit 203 and the decryption unit 212. This is because when an image is captured without logging in, the access authority to the captured image file is not given to any account, and the image is kept secret.

[0133] <Fourth embodiment> Next, an imaging system 1800 using a cloud service will be described as a fourth embodiment. Fig. 18 is a block diagram showing a configuration of an imaging system 1800 according to the fourth embodiment. As shown in the figure, in the imaging system 1800, an imaging device 1810 and a server 1820 are communicatively connected via a network. The imaging system 1800 may also include a storage 1830 for saving imaging files. In Fig. 18, the same reference numerals are used for the same components as those in the first embodiment.

[0134] The imaging device 1810 is a camera device such as a digital camera or a digital video camera, or an information terminal having a camera function such as a smartphone or a tablet terminal. The hardware configuration of the imaging device 1810 includes a CPU 101, a ROM 102, a RAM 103, a storage medium 104, a power supply unit 105, a communication unit 106, an imaging unit 107, an operation unit 108, and an audio processing unit 109, similar to the imaging devices 100 and 100A of the first and second embodiments. In addition, the imaging device 1810 may include a biometric information input unit 711, a position information acquisition unit 712, and a date and time information acquisition unit 713.

[0135] The server 1820 is an information processing device including a CPU, a ROM, a RAM, a communication unit, a storage unit, etc. The ROM or storage unit of the server stores a program for executing the processing related to this embodiment, and the CPU calls up the program from the ROM or storage unit, expands it in the RAM, and executes the processing.

[0136] The storage 1830 is a storage area accessible from the server 1820 or the imaging device 1810 via a network. An imaging file captured by the imaging device 1810 is stored in the storage medium 104 in the imaging device 1810, a storage medium (not shown) in the server 1820, or the storage 1830. When an imaging file is stored in the storage 1830, identification information that uniquely identifies the imaging device 1810 or a user is stored in association with the imaging file.

[0137] In the imaging system 1800 of the fourth embodiment, the imaging device 1810 includes a file storage unit 201, a transmission / reception unit 1814, a file selection unit 211, a question presentation unit 217, an answer reception unit 218, and an output unit 220. The file storage unit 201 includes a file generation unit 202 and an encryption unit 203. The output unit 220 includes a display unit 221 and a transfer unit 222.

[0138] Server 1820 includes a file transmitting / receiving unit 1821, a decrypting unit 212, a file temporary storage unit 213, an image recognition unit 214, and a questioning unit 1822. Questioning unit 1822 includes a question generating unit 216, a question transmitting unit 1823, an answer receiving unit 1824, and a true / false determining unit 219.

[0139] The difference from the configuration of the first embodiment is that the decoding unit 212, the file temporary storage unit 213, the image recognition unit 214, and the question unit 1822 are provided in a server 1820 that is external to the imaging device 1810. The server 1820 is also provided with a file transmission / reception unit 1821 that transmits and receives captured files between the imaging device 1810 and a storage 1830. The imaging device 1810 is provided with a transmission / reception unit 1814 that transmits and receives captured files, questions, and answers to and from the server 1820. The differences from the first embodiment will be described below.

[0140] The file transmission / reception unit 1821 of the server 1820 receives the encrypted captured image file transmitted from the imaging device 1810, and transfers it to the storage 1830. The file transmission / reception unit 1821 also reads the captured image file selected by the file selection unit 211 of the imaging device 1810 from the storage medium 104 or the storage 1830, and inputs it to the decryption unit 212. If the answer received from the imaging device 1810 is correct, the file transmission / reception unit 1821 also transmits the decrypted captured image file held in the file temporary holding unit 213 to the imaging device 1810.

[0141] The question unit 1822 generates a question to the user about the imaging object for the imaging file selected by the file selection unit 211 of the imaging device 1810 using the question generation unit 216. The question transmission unit 1823 transmits the question generated by the question generation unit 216 to the imaging device 1810. The answer reception unit 1824 receives the answer transmitted from the imaging device 1810. The correctness determination unit 219 determines whether the answer received by the answer reception unit 1824 is correct or incorrect. The method of generating the question is the same as in the first embodiment.

[0142] The file generation unit 202 and encryption unit 203 of the imaging device 1810 are the same as those in the first embodiment. When storing an imaging file in the storage 1830, the file storage unit 201 transmits the encrypted imaging file together with identification information of the imaging device 1810 to the server 1820 via the transmission / reception unit 1814. The server 1820 transmits the imaging file and the identification information of the imaging device 1810 to the storage 1830 and stores them.

[0143] Next, a description will be given of the flow of captured image file output processing in the imaging system 1800. It is assumed that a captured image file captured by the imaging device 1810 is encrypted and stored in the storage 1830.

[0144] The CPU 101 (file selection unit 211) of the imaging device acquires information on the captured image files stored in the storage 1830 from the server 1820, generates a file list, and displays it on the screen of the operation unit 108. The CPU 101 (file selection unit 211) accepts the user's selection of a file to be displayed or transferred, and transmits identification information of the selected file to the server 1820. The CPU (decoding unit 204) of the server 1820 decodes the selected captured image file, and stores it in the file temporary storage unit 213.

[0145] The CPU (image recognition unit 214) of the server 1820 detects an imaging object from the image of the imaging file stored in the file temporary storage unit 213, and recognizes the name of the imaging object. The CPU (image recognition unit 214) creates an imaging object list 320 that is a list of the recognized imaging objects (FIG. 3(b)).

[0146] The CPU (question generation unit 216) of the server 1820 refers to the image capture object list 320 and generates a question asking about the image capture object. The CPU (question transmission unit 1823) transmits the generated question to the image capture device 1810. The image capture device 1810 receives the question transmitted from the server 1820 by the transmission / reception unit 1814, and presents the question to the user by the question presentation unit 217. The question is presented by displaying on the liquid crystal panel of the operation unit 108, or outputting from the speaker of the audio processing unit 109. For example, a question and options as shown in FIG. 6(b) are displayed.

[0147] The CPU 101 (answer receiving unit 218) of the imaging device 1810 receives an answer input by the user. The answer is input by operating the touch panel of the operation unit 108, input from the microphone of the audio processing unit 109, or the like. When the answer is input, the answer is transmitted to the server 1820 by the transmitting / receiving unit 1814. The answer receiving unit 1824 of the server 1820 receives the answer, and the correctness of the answer is determined by the correctness determining unit 219.

[0148] If the answer is determined to be correct, the CPU (file transmission / reception unit 1821) of the server 1820 transmits the decoded captured image file held in the file temporary storage unit 213 to the imaging device 1810. The imaging device 1810 receives the file transmitted from the server 1820 by the transmission / reception unit 1814, and outputs it by the output unit 220. The output is a display on the liquid crystal panel of the operation unit 108, or a file transfer to a predetermined transfer destination.

[0149] If the answer is determined to be incorrect, the CPU of the server 1820 transmits an error message to the imaging device 1810 to the effect that the captured image file cannot be opened. When the imaging device 1810 receives the error message via the transmitting / receiving unit 1814, it displays it on the liquid crystal panel of the operation unit 108.

[0150] As described above, in the imaging system 1800 of the fourth embodiment, the server 1820, which is an external device to the imaging device 1810, performs object detection on image data included in an imaging file and generates a question related to the imaging content. Also, the display of the question and the input of the answer are performed by the imaging device 1810. This makes it possible to reduce the processing load of the imaging device 1810 in addition to the effect of the first embodiment.

[0151] In the fourth embodiment, as in the first embodiment, an example is shown in which a question about an object detected from image data of an imaging file is presented and an answer is requested, but as shown in the second embodiment, it is also possible to request input of information determined when imaging is performed.

[0152] In this case, the server 1820 judges whether the information (photographing time information, photographing position information, biometric information, password, etc.) input by the user to the imaging device 1810 is correct or not when it receives the information. If the information input is correct, the server 1820 transmits the decrypted imaging file to the imaging device 1810 so that it can be output.

[0153] Also, the imaging device 1810 of the fourth embodiment may include the user account unit 1301, the file update unit 1311, and the authorized file output unit 1320, as in the third embodiment, and may be capable of managing the imaging file by linking it to the user's account. In this case, the encryption unit 203 and the decryption unit 212 may be omitted.

[0154] <Fifth embodiment> Next, as the fifth embodiment, a description will be given of another example of the imaging system 1900. The imaging system 1900 enables a captured image file captured by an imaging device 1910 and secretly stored to be viewed on a PC 1940.

[0155] Fig. 19 is a block diagram showing a configuration of an imaging system 1900 according to the fifth embodiment. As shown in the figure, in the imaging system 1900, a PC 1940 and a server 1920 are communicatively connected via a network. Also, an imaging device 1910 and a server 1920 are communicatively connected via a network. The imaging system 1900 may be configured to include a storage 1930 for saving imaging files. Note that in Fig. 19, the same components as those in the first or fourth embodiment are denoted by the same reference numerals.

[0156] The PC 1940 is an information processing device equipped with a CPU, a ROM, a RAM, a communication unit, a storage unit, an input unit, a display unit, etc. The PC 1940 reads data from the storage medium 104 via the communication unit. The storage unit of the PC 1940 stores a program for executing the processing related to this embodiment, and the CPU calls up the program from the ROM or the storage unit, expands it in the RAM, and executes the processing.

[0157] In the imaging system 1900 of the fifth embodiment, a PC 1940 includes an imaging file acquisition unit 1941, a file selection unit 211, a question presentation unit 217, an answer reception unit 218, and an output unit 220. The output unit 220 includes a display unit 221 and a transfer unit 222.

[0158] The imaging device 1910 is a camera device such as a digital camera or a digital video camera, or an information terminal having a camera function such as a smartphone or a tablet terminal. The imaging device 1910 includes the imaging unit 107, the storage medium 104, a file storage unit 201, and a transmission / reception unit 1911.

[0159] The server 1920 is similar to that of the fourth embodiment, and includes a file transmitting / receiving unit 1821, a decrypting unit 212, a file temporary storage unit 213, an image recognition unit 214, a questioning unit 1822, and an output unit 220. The questioning unit 1822 has a question generating unit 216, a question transmitting unit 1823, an answer receiving unit 1824, and a true / false determining unit 219.

[0160] The difference from the imaging system 1800 of the fourth embodiment is that the file selection unit 211, the question presentation unit 217, the answer reception unit 218, and the output unit 220 are provided in a PC 1940. Also, in order to transmit and receive imaging files to and from a server 1920, the imaging device 1910 has a transmitting / receiving unit 1911, and the PC 1940 has an imaging file acquisition unit 1941.

[0161] The captured image file acquisition unit 1941 acquires captured image files stored in the storage 1930 via the server 1920. Alternatively, the captured image files are acquired from a portable storage medium 104 such as a memory card.

[0162] Next, a description will be given of the flow of captured image file output processing in the imaging system 1900. As a specific example, a case will be described in which an captured image file captured by the imaging device 1910 is stored in a memory card, and the captured image file written in the memory card is read and displayed (output) by the PC 1940. It is assumed that the captured image file captured by the imaging device 1910 is encrypted by the encryption unit 203 and stored in the memory card.

[0163] The CPU of the PC 1940 acquires information on the captured image files stored in the memory card, generates a file list, and displays it on the display unit. The CPU (file selection unit 211) accepts the selection of the file that the user wishes to display. The CPU transmits the selected captured image file to the server 1920 via the communication unit. The CPU (decoding unit 212) of the server 1920 decodes the received captured image file, and stores it in the file temporary storage unit 213.

[0164] The CPU (image recognition unit 214) of the server 1920 detects an imaging object from the imaging file stored in the file temporary storage unit 213, and recognizes the name of the imaging object. The CPU (image recognition unit 214) creates an imaging object list 320 that is a list of the recognized imaging objects (FIG. 3(b)).

[0165] The CPU (question generation unit 216) of the server 1920 refers to the image capture object list 320 and generates a question asking about the image capture object. The CPU (question transmission unit 1823) transmits the generated question to the PC 1940. The PC 1940 receives the question transmitted from the server 1920 via the communication unit, and presents the question to the user via the question presentation unit 217. The question is presented by displaying it on the display of the display unit, or by outputting it from a speaker, etc. For example, a question and options as shown in FIG. 6(b) are displayed.

[0166] The CPU (answer receiving unit 218) of the PC 1940 receives input of an answer from the user. The answer is input by operating the input unit's keyboard, touch panel, etc., or by input from a microphone. When the answer is input, the CPU (answer receiving unit 218) transmits the answer to the server 1920. The answer receiving unit 1824 of the server 1920 receives the answer, and the correctness of the answer is judged by the correctness judgment unit 219.

[0167] If the answer is determined to be correct, the CPU (file transmitting / receiving unit 1821) of the server 1920 transmits the decoded imaging file stored in the file temporary storage unit 213 to the PC 1940. The PC 1940 receives the decoded imaging file transmitted from the server 1920, and displays it on the display unit.

[0168] If the correctness determining unit 219 determines that the answer is incorrect, the CPU of the server 1920 transmits an error message to the PC 1940 to the effect that the captured image file cannot be opened. When the PC 1940 receives the error message, it displays it on the display unit.

[0169] As described above, the imaging system 1900 of the fifth embodiment performs image recognition of an imaging file and generates a question related to the captured content in the server 1920, which is an external device of the imaging device 1910. Also, display of questions, input of answers, and display of imaging files can be performed by the PC 1940. This makes it possible to output an encrypted imaging file stored in a memory card or the like to a device other than the imaging device 1810, in addition to the effects of the first and fourth embodiments.

[0170] In the above example, an example is shown in which an imaging file stored in a memory card is output by the PC 1940, but this embodiment can also be applied when outputting an imaging file stored in the storage 1930. Also, the content of the question is a question about the imaging content, but as shown in the second embodiment, the server 1920 may request the user of the PC 1940 to input information determined when imaging is performed.

[0171] In this case, when the server 1920 receives information entered by the user on the PC 1940 (shooting time information, shooting location information, biometric information, password, etc.), it determines whether the information is correct, and if the information is correct, it sends the decrypted image file to the PC 1940.

[0172] Also, the imaging device 1810 of the fifth embodiment may include the user account unit 1301, the file update unit 1311, and the authorized file output unit 1320, as in the third embodiment, and may be capable of managing the imaging file by linking it to the user's account. In this case, the encryption unit 203 and the decryption unit 212 may be omitted.

[0173] <Other embodiments> The present disclosure can also be realized by a process in which a program for implementing one or more functions of the above-described embodiments is supplied to a system or device via a network or a storage medium, and one or more processors in a computer of the system or device read and execute the program. It can also be realized by a circuit (e.g., ASIC) that implements one or more functions.

[0174] The disclosure of the above-described embodiment includes the following configurations. (Configuration 1) a concealment means for concealing an image file captured by the image capture means; a requesting means for requesting a user to input information determined by the imaging file; a receiving means for receiving an input of information in response to a request made by the requesting means; an output means for releasing the confidentiality of the imaging file and outputting the imaging file when the information accepted by the accepting means is correct; An imaging system comprising:

[0175] (Configuration 2) The system further includes a login unit for performing a login process using an account set for each user, The concealment means comprises: The imaging system according to configuration 1, wherein when imaging is performed without logging in using the login means, access rights to the captured image file are not set for any of the accounts.

[0176] (Configuration 3) 2. The imaging system according to configuration 1, wherein the concealment means encrypts the imaging file captured by the imaging means.

[0177] (Configuration 4) 4. The imaging system according to any one of configurations 1 to 3, wherein the requesting means requests a user to input information to be recorded as metadata when an image is captured.

[0178] (Configuration 5) An acquisition means for acquiring biometric information of a user; a storage unit that stores the biometric information acquired by the acquisition unit when the imaging file is captured in association with the imaging file, 5. The imaging system according to any one of configurations 1 to 4, wherein the requesting means requests a user to input the biometric information.

[0179] (Configuration 6) a setting means for accepting a password when the image file is captured; a storage unit that stores the password set by the setting unit in association with the image file, 6. The imaging system according to any one of configurations 1 to 5, wherein the requesting means requests input of the password.

[0180] (Configuration 7) The imaging device further includes an object detection unit that analyzes the imaging file and detects an object being imaged, 7. The imaging system according to any one of configurations 1 to 6, wherein the request means requests a user to input information regarding the object detected by the object detection means.

[0181] (Configuration 8) the request means further comprises a question generating means for generating a question regarding information determined by the imaging file, 8. The imaging system according to any one of configurations 1 to 7, wherein the accepting means accepts an answer to the question generated by the question generating means.

[0182] (Configuration 9) 9. The imaging system according to configuration 8, wherein the question is in a multiple-choice format.

[0183] (Configuration 10) The imaging system according to configuration 8 or 9, wherein the questions are generated based on a preset level of difficulty.

[0184] (Configuration 11) 4. The imaging system according to configuration 3, wherein the output means decodes and outputs the imaging file.

[0185] (Configuration 12) The image processing device further includes a selection unit for selecting a file to be output from the plurality of image files, The imaging system according to any one of configurations 1 to 11, characterized in that the request means requests a user to input information determined by the imaging file for the imaging file selected by the selection means.

[0186] (Configuration 13) The imaging system according to configuration 2, further comprising an authority setting means for, when the login is performed by the login means and the information received by the reception means is correct, linking the imaging file related to the request to the account of the user who performed the login and applying the authority of the account to the imaging file.

[0187] (Configuration 14) A server of an imaging system in which an imaging device and a server are communicatively connected via a network, a file acquisition means for acquiring an image file captured by the imaging device and stored in a confidential state; a transmission means for transmitting an input request to a user of the imaging device regarding information determined by the imaging file; a receiving means for receiving information inputted into the imaging device in response to the input request; an output means for releasing the confidentiality of the imaging file and outputting the imaging file to the imaging device when the information received by the receiving means is correct; A server comprising:

[0188] (Configuration 15) A server of an imaging system communicatively connected to an information processing device via a network, a file acquisition means for acquiring an image file captured by an image capture device and stored in a confidential state; a transmission means for transmitting an input request to a user of the information processing device regarding information determined by the imaging file; a receiving means for receiving information inputted into the information processing device in response to the input request; an output means for releasing the confidentiality of the imaging file and outputting the imaging file to the information processing device when the information received by the receiving means is correct; A server comprising:

[0189] (Configuration 16) A step of making the image file captured by the image capturing means into a secret state; a step of requesting a user to input information determined by the imaging file; accepting input of information in response to the request; If the received information is correct, canceling the confidential state of the imaging file and outputting the imaging file; 13. A method for outputting an imaging file, comprising:

[0190] (Configuration 17) Computer, a concealment means for concealing an image file captured by the imaging means; a requesting means for requesting a user to input information determined by the imaging file; a receiving means for receiving input of information in response to a request made by the requesting means; an output means for releasing the confidentiality of the imaging file and outputting the imaging file when the information accepted by the accepting means is correct; A program to function as a

Claims

1. a concealment means for concealing an image file captured by the image capture means; a requesting means for requesting a user to input information determined by the imaging file; a receiving means for receiving an input of information in response to a request made by the requesting means; an output means for releasing the confidentiality of the imaging file and outputting the imaging file when the information accepted by the accepting means is correct; An imaging system comprising:

2. The system further includes a login means for performing a login process using an account set for each user, The concealment means comprises:

2. The imaging system according to claim 1, wherein when imaging is performed without logging in using said login means, access rights to said captured file are not set for any of said accounts.

3. 2. The imaging system according to claim 1, wherein the concealment means encrypts the imaging file captured by the imaging means.

4. 4. The imaging system according to claim 1, wherein the requesting unit requests a user to input information to be recorded as metadata when an image is captured.

5. An acquisition means for acquiring biometric information of a user; a storage unit that stores the biometric information acquired by the acquisition unit when the imaging file is captured in association with the imaging file, 4. The imaging system according to claim 1, wherein the requesting unit requests a user to input the biometric information.

6. a setting means for accepting a password when the image file is captured; a storage unit that stores the password set by the setting unit in association with the image file, 4. The imaging system according to claim 1, wherein the requesting unit requests input of the password.

7. The imaging device further includes an object detection unit that analyzes the imaging file and detects an object being imaged, 4. The imaging system according to claim 1, wherein the requesting unit requests a user to input information regarding the object detected by the object detecting unit.

8. the request means further comprises a question generating means for generating a question regarding information determined by the imaging file, 2. The imaging system according to claim 1, wherein the accepting unit accepts an answer to the question generated by the question generating unit.

9. 9. The imaging system according to claim 8, wherein the question is in a multiple-choice format.

10. 9. The imaging system according to claim 8, wherein the questions are generated based on a preset level of difficulty.

11. 4. The imaging system according to claim 3, wherein the output means decodes the imaging file and outputs it.

12. The image processing device further includes a selection unit for selecting a file to be output from the plurality of image files, 4. The imaging system according to claim 1, wherein the requesting unit requests a user to input information determined by the imaging file selected by the selecting unit.

13. 3. The imaging system according to claim 2, further comprising an authority setting means for, when a login is performed by the login means and the information received by the reception means is correct, linking the imaging file related to the request to the account of the user who performed the login and applying the authority of the account to the imaging file.

14. A server of an imaging system in which an imaging device and a server are communicatively connected via a network, a file acquisition means for acquiring an image file captured by the imaging device and stored in a confidential state; a transmission means for transmitting an input request to a user of the imaging device regarding information determined by the imaging file; a receiving means for receiving information inputted into the imaging device in response to the input request; an output means for releasing the confidentiality of the imaging file and outputting the imaging file to the imaging device when the information received by the receiving means is correct; A server comprising:

15. A server of an imaging system communicatively connected to an information processing device via a network, a file acquisition means for acquiring an image file captured by an image capture device and stored in a confidential state; a transmission means for transmitting an input request to a user of the information processing device regarding information determined by the imaging file; a receiving means for receiving information inputted into the information processing device in response to the input request; an output means for releasing the confidentiality of the imaging file and outputting the imaging file to the information processing device when the information received by the receiving means is correct; A server comprising:

16. A step of making the image file captured by the image capturing means into a secret state; a step of requesting a user to input information determined by the imaging file; accepting input of information in response to the request; If the received information is correct, canceling the confidential state of the imaging file and outputting the imaging file; 13. A method for outputting an imaging file, comprising:

17. Computer, a concealment means for concealing an image file captured by the imaging means; a requesting means for requesting a user to input information determined by the imaging file; a receiving means for receiving input of information in response to a request made by the requesting means; an output means for releasing the confidentiality of the imaging file and outputting the imaging file when the information accepted by the accepting means is correct; A program to function as a

Images