Imaging device, control method for imaging device, and program

Abstract

The present invention provides, for example, a technique for proving the authenticity of image data captured by an imaging device. [Solution] The imaging device comprises an imaging unit, a setting unit that records processing of imaging data captured by the imaging unit and makes a first setting for performing shooting in a shooting mode that proves the authenticity of image data based on the imaging data, a first determination unit that determines whether or not the first setting has been made, and an image processing unit that controls the execution of predetermined processing on the imaging data according to the first setting, wherein the image processing unit does not execute the predetermined processing when the first determination unit determines that the first setting has been made.

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method for the imaging device, and a program.

Background Art

[0002] In recent years, information sharing via the Internet and SNS has become active, and it has become an era in which anyone can view and transmit information. Also, in recent years, digital image processing technology has evolved. Under such circumstances, it has become difficult for information viewers to view processed digital images and confirm the authenticity of the viewed content, and as a result, problems such as fake news have become serious. In Patent Document 1, an imaging device equipped with an authenticity proof shooting mode that can prove the authenticity of an image by attaching a digital signature to the image has been proposed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In recent digital cameras, various processing operations are performed on the captured data between when the user gives an instruction to take a picture and when it is saved as image data. However, in Patent Document 1, it is possible to attach a digital signature to the image data after these processing operations. Therefore, even when shooting in the authenticity proof shooting mode, it is not possible to eliminate the possibility that the image itself with the digital signature is an image that has been subjected to fact distortion processing.

[0005] An object according to one aspect of the present invention is to provide a technique for proving the authenticity of image data captured by an imaging device.

Means for Solving the Problems

[0006] One aspect of the present invention is, Imaging unit, A setting unit records the processing of the image data captured by the imaging unit and makes a first setting for performing shooting in a shooting mode that proves the authenticity of the image data based on the image data, A first determination unit that determines whether the first setting has been made, The system includes an image processing unit that controls the execution of predetermined processing on the imaging data according to the first setting, The image processing unit is characterized in that it does not perform the predetermined processing when the first determination unit determines that the first setting has been made. [Effects of the Invention]

[0007] According to the present invention, the authenticity of image data captured by an imaging device can be proven. [Brief explanation of the drawing]

[0008] [Figure 1] External view of an imaging device according to one embodiment. [Figure 2] Block diagram of an imaging device according to one embodiment. [Figure 3] Configuration diagram of image data according to one embodiment [Figure 4] A diagram showing a flowchart of the process according to one embodiment. [Figure 5] A diagram showing a settings screen according to one embodiment. [Figure 6] A diagram showing a flowchart of the process according to one embodiment. [Modes for carrying out the invention]

[0009] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0010] Using Figures 1(A) and 1(B), a digital camera 100 will be described as an example of a device to which this embodiment can be applied. Figure 1(A) is a front perspective view of the digital camera 100, and Figure 1(B) is a rear perspective view of the digital camera 100. A display unit 28 for displaying images and various information is provided on the back of the digital camera 100. In addition, an external viewfinder display unit 43 for displaying various camera settings, including shutter speed and aperture, is provided on the top surface of the digital camera 100.

[0011] The digital camera 100 is also equipped with a shutter button 61, a mode selector switch 60, a terminal cover 40, a main electronic dial 71, a power switch 72, a sub electronic dial 73, a cross key 74, and a SET button 75. The shutter button 61 is an operation unit for issuing shooting instructions. The mode selector switch 60 is an operation unit for switching between various modes. The terminal cover 40 is a cover that protects connectors (not shown) such as connection cables that connect external devices to the digital camera 100.

[0012] The main electronic dial 71 is a rotary control part included in the control unit 70, and by rotating this main electronic dial 71, settings such as shutter speed and aperture can be changed. The power switch 72 is an operating component that switches the power of the digital camera 100 ON and OFF. The sub electronic dial 73 is a rotary dial included in the control unit 70. By operating this sub electronic dial 73, the user can move the selection frame, advance images, etc. The directional pad 74 is included in the control unit 70 and is a directional pad (4-way key) with up, down, left, and right sections that can be pressed. The user can perform operations according to the part of the directional pad 74 that is pressed. The SET button 75 is included in the control unit 70 and is a push button, mainly used to confirm selection items.

[0013] The digital camera 100 is also equipped with an LV button 76, a zoom in button 77, a zoom out button 78, a playback button 79, a quick-return mirror 12, a communication terminal 10, an eyepiece viewfinder 16, a cover 202, and a grip section 90. The LV button 76 is included in the control unit 70 and is a button that allows switching the live view (hereinafter referred to as LV) ON and OFF in the menu button. In video recording mode, the LV button 76 is used to instruct the start and stop of video recording. The zoom in button 77 is included in the control unit 70 and is an operation button for switching the zoom mode ON and OFF and changing the magnification ratio in the live view display in shooting mode. In playback mode, the zoom in button 77 functions as a zoom button to enlarge the playback image and increase the magnification ratio.

[0014] The minimizing button 78 is included in the operation unit 70 and is used to reduce the magnification of the enlarged playback image, thereby shrinking the displayed image. The playback button 79 is also included in the operation unit 70 and is an operation button for switching between shooting mode and playback mode. By pressing the playback button 79 while in shooting mode, the user can switch to playback mode and display the latest image from the images recorded on the recording medium 200 on the display unit 28. The quick-return mirror 12 is raised and lowered by an actuator (not shown) instructed by the system control unit 50. The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens side (detachable). The eyepiece viewfinder 16 is a look-through type viewfinder that allows the user to check the focus and composition of the optical image of the subject obtained through the lens unit 150 by observing the focusing screen 13. The cover 202 is the cover of the slot that stores the recording medium 200. The grip part 90 is a holding part shaped to be easily gripped by the user with their right hand when holding the digital camera 100.

[0015] Figure 2 illustrates the block configuration of the digital camera 100. The digital camera 100 consists of a lens unit 150, communication terminals (6, 10), a system control unit 50, a lens system control circuit 4, an aperture drive circuit 2, an aperture 1, an AF drive circuit 3, and a lens 103. The lens unit 150 is a lens unit equipped with an interchangeable photographic lens. The lens 103 is usually composed of multiple lenses, but here it is shown as a single lens for simplicity. Communication terminal 6 is a communication terminal for the lens unit 150 to communicate with the digital camera 100. Communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens unit 150. The lens unit 150 communicates with the system control unit 50 via these communication terminals (6, 10). The internal lens system control circuit 4 controls the aperture 1 via the aperture drive circuit 2 and focuses by displacing the position of the lens 103 via the AF drive circuit 3.

[0016] The digital camera 100 also includes an AE sensor 17, a focus detection unit 11, a quick return mirror 12, an imaging unit 22, an eyepiece finder 16, a pentaprism 14, a focusing screen 13, a shutter 101, and an A / D converter 23. The AE sensor 17 measures the luminance of the subject passing through the lens unit 150. The focus detection unit 11 outputs defocus amount information to the system control unit 50. The system control unit 50 controls the lens unit 150 using this defocus amount information to perform phase difference AF. The quick return mirror 12 (hereinafter also referred to as the mirror 12) is moved up and down by an actuator (not shown) according to an instruction from the system control unit 50 during exposure, live view shooting, and video shooting.

[0017] The mirror 12 is a mirror for switching the light beam incident from the lens 103 to the eyepiece finder 16 side and the imaging unit 22 side. Normally, the mirror 12 is arranged to reflect the light beam to the eyepiece finder 16. However, during shooting or live view display, it jumps upward to avoid being in the light beam and guides the light beam to the imaging unit 22 (mirror up). Also, the central part of the mirror 12 is a half mirror so that part of the light can pass through, and part of the light beam is transmitted to the focus detection unit 11 for performing focus detection.

[0018] The photographer can observe the focusing screen 13 through the pentaprism 14 and the eyepiece finder 16 to confirm the focus and composition of the optical image of the subject obtained through the lens unit 150. The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50. The imaging unit 22 is an image sensor (image sensor) composed of a CCD, a CMOS element, etc., which converts an optical image into an electrical signal. The A / D converter 23 converts an analog signal into a digital signal. The A / D converter 23 is used to convert the analog signal output from the imaging unit 22 into a digital signal.

[0019] The digital camera 100 also includes an image processing unit 24, a memory control unit 15, a memory 32, a D / A converter 19, a display unit 28, a liquid crystal display unit 41 in the viewfinder, and a drive circuit 42 for the display unit in the viewfinder. The digital camera 100 also includes an external viewfinder display unit 43 and a drive circuit 44 for the external viewfinder display unit. The image processing unit 24 performs resizing processes such as predetermined pixel interpolation and reduction, and color conversion processes on the data from the A / D converter 23 or the data from the memory control unit 15. The image processing unit 24 also performs predetermined arithmetic processing using the captured image data. The system control unit 50 performs exposure control and distance measurement control using the arithmetic result obtained by the image processing unit 24. As a result, TTL (through-the-lens) AF (autofocus) processing, AE (automatic exposure) processing, and EF (flash pre-emission) processing are performed. The image processing unit 24 further performs predetermined arithmetic processing using the captured image data, and performs TTL AWB (auto white balance) processing using the obtained arithmetic result.

[0020] The output data from the A / D converter 23 is written directly into the memory 32 via the image processing unit 24 and the memory control unit 15, or via the memory control unit 15. The memory 32 stores the image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, and the image data for display on the display unit 28. The memory 32 includes a storage capacity sufficient to store a predetermined number of still images, a moving image for a predetermined time, and audio. The memory 32 also doubles as an image display memory (video memory). The D / A converter 19 converts the image display data stored in the memory 32 into an analog signal and supplies it to the display unit 28. Thus, the image data for display written into the memory 32 is displayed by the display unit 28 via the D / A converter 19.

[0021] The display unit 28 displays information on an LCD or other display device in accordance with the analog signal from the D / A converter 19. The display unit 28 converts the digital signal, which has been temporarily stored in the memory 32 by the A / D converter 23, into an analog signal using the D / A converter 19. The display unit 28 then sequentially transfers the converted analog signal to the display unit 28 for display, thereby functioning as an electronic viewfinder and enabling through-image display (live view display (LV display)). Hereafter, the image displayed in live view will also be referred to as the LV image. The in-finder LCD display unit 41 displays, via the in-finder display unit drive circuit 42, a frame indicating the AF point where autofocus is currently being performed, and icons representing the camera's settings. The external display unit 43 displays various camera settings, including shutter speed and aperture, via the external display unit drive circuit 44.

[0022] The digital camera 100 also includes a non-volatile memory 56, a system timer 53, a mode selector switch 60, a shutter button 61, a first shutter switch 62, a second shutter switch 64, a system memory 52, and an operation unit 70. The non-volatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM. Constants and programs for the operation of the system control unit 50 are stored in the non-volatile memory 56. Here, "program" refers to a program for executing the various flowcharts described later. The system control unit 50 is a control unit that includes at least one processor and / or at least one circuit, and controls the entire digital camera 100. The system control unit 50 realizes the various processes described later by executing the program stored in the non-volatile memory 56. For example, RAM is used for the system memory 52, and constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 56, etc. are stored there. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 19, and the display unit 28, etc.

[0023] The system timer 53 is a timing unit that measures the time used for various controls and the time of the built-in clock. The mode switch 60, shutter button 61, first shutter switch 62, second shutter switch 64, and operation unit 70 are means for inputting various operation instructions to the system control unit 50. More specifically, the mode switch 60 switches the operation mode of the system control unit 50 to one of the modes such as still image recording mode, video recording mode, and playback mode. Modes included in the still image recording mode include auto shooting mode, auto scene detection mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode. Modes included in the still image recording mode include various scene modes that are shooting settings for different shooting scenes, or custom modes. The user can directly switch the operation mode to one of these modes using the mode switch 60. Alternatively, the user may switch the display to the shooting mode list screen using the mode switch 60, select one of the displayed modes, and then switch the operation mode using the other operation unit. Similarly, video recording modes may also include multiple modes.

[0024] The first shutter switch 62 turns ON during the operation of the shutter button 61 on the digital camera 100, specifically when it is half-pressed (instruction to prepare for shooting), and generates the first shutter switch signal SW1. The first shutter switch signal SW1 initiates operations such as AF (autofocus), AE (automatic exposure), AWB (auto white balance), or EF (flash pre-flash). The second shutter switch 64 turns ON when the operation of the shutter button 61 is completed, specifically when it is fully pressed (instruction to shoot), and generates the second shutter switch signal SW2. The system control unit 50, upon receiving the second shutter switch signal SW2, initiates a series of shooting operations, from reading the signal from the imaging unit 22 to writing the image data to the recording medium 200.

[0025] Each control unit of the control unit 70 is assigned a function as appropriate for each situation by the user selecting various function icons displayed on the display unit 28, and functions as various function buttons. Examples of function buttons include an exit button, back button, image forward button, jump button, filter button, or attribute change button. For example, when the menu button is pressed, various configurable menu screens are displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28 and the four directional buttons (up, down, left, right) and the SET button. The control unit 70 consists of various control units that act as input units that accept operations from the user. The control unit 70 is composed of push buttons, rotary dials, or touch sensors. Specifically, the control unit 70 includes at least a shutter button 61, a main electronic dial 71, a power switch 72, a sub electronic dial 73, a cross key 74, a SET button 75, an LV button 76, a zoom in button 77, a zoom out button 78, and a playback button 79.

[0026] The digital camera 100 also includes a power control unit 80, a power supply unit 30, a recording medium interface 18, a communication unit 54, and a posture detection unit 55. The power control unit 80 is composed of a battery detection circuit, a DC-DC converter, and a switch circuit for switching which blocks are energized, and detects whether a battery is installed, the type of battery, or the remaining battery level. The power control unit 80 also controls the DC-DC converter using the detection results and instructions from the system control unit 50, and supplies the necessary voltage to each part, including the recording medium 200, for the required period of time. The power supply unit 30 is composed of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, and lithium-ion batteries, and an AC adapter, etc.

[0027] The recording medium I / F 18 is an interface to the recording medium 200, such as a memory card or hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and can be a semiconductor memory or magnetic disk. The communication unit 54 is composed of a communication module. The communication unit 54 is connected wirelessly or via a wired cable and transmits and receives video signals and audio signals. The communication unit 54 can also connect to a wireless LAN (Local Area Network) or the Internet. In addition, the communication unit 54 can communicate with external devices using Bluetooth® or Bluetooth Low Energy. The communication unit 54 can transmit images captured by the imaging unit 22 (including LV images) and images recorded on the recording medium 200, and can also receive images and other various information from external devices.

[0028] The attitude detection unit 55 detects the orientation of the digital camera 100 relative to the direction of gravity. Using the detected orientation, the attitude detection unit 55 determines whether the image captured by the imaging unit 22 was taken with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the attitude detection unit 55 to the image data captured by the imaging unit 22, or rotate the image and store it in the storage medium. For example, an acceleration sensor or a gyroscope sensor can be used as the attitude detection unit 55. Furthermore, if an acceleration sensor or a gyroscope sensor is used in the attitude detection unit 55, the attitude detection unit 55 can also detect the movement of the digital camera 100 (pan, tilt, lift, and whether it is stationary or not).

[0029] Figures 3(A) to 3(C) illustrate the image generation process and the authenticity verification mechanism when shooting in authenticity verification mode. Figure 3(A) illustrates the data structure of an image file shot in normal shooting mode. Image file 301 represents the entire file containing the captured image data. Image file 301 includes metadata 302 and main image data 303. Metadata 302 represents an area for recording metadata corresponding to image file 301, and stores parameters such as settings at the time of shooting. Main image data 303 is an area where the captured main image data is stored.

[0030] On the other hand, Figures 3(B) and 3(C) illustrate the data structure of an image file containing image data captured in authenticity verification mode. The recorded image file 310 includes a metadata area, authenticity verification data 304, and a main image data area. The authenticity verification data 304 is information for verifying the authenticity of the image file 301 and is used when verifying the origin and history of the image file 301. The authenticity verification data 304 has a structure generated in accordance with a predetermined technical standard (for example, C2PA (Coalition for Content Prevenance and Authenticity)). More specifically, the authenticity verification data 304 includes provenance information (Assertion) 305, a hash value 308 to guarantee the authenticity verification data 304, and a digital signature 309 obtained by encrypting the hash value 308. The provenance information 305 stores provenance identifier information (Manifest ID) to uniquely identify the provenance, provenance metadata 306 which stores editing history showing the editing content of the image file 301, and a thumbnail image 307 corresponding to the main image data 303. This thumbnail image 307 may be a copy of the main image data 303 or it may be a resized version.

[0031] The hash value 308 includes the value obtained by inputting the metadata 302, the main image data 303, and the provenance information 305 into a hash function. The digital signature 309 includes the signature value generated by encrypting the hash value 308 using a pre-prepared private key. The public key that forms the pair of the private key used here is also stored in the authenticity verification data 304 together with the digital signature 309. These provenance information 305, hash value 308, and digital signature 309 are stored in the authenticity verification data 304. Then, the generated authenticity verification data 304 is inserted into a predetermined position in the data structure of the image file 301, thereby generating the recorded image file 310 (Figure 3(C)) taken in authenticity verification shooting mode.

[0032] To verify whether this image has been tampered with, the hash value obtained by decrypting the digital signature 309 with a public key is compared with the hash value obtained by inputting the metadata 302, the main image data 303, and the provenance information 305 into a hash function. If the two hash values ​​match, the verification is considered successful. On the other hand, if the two hash values ​​do not match, it means that one of the data input into the hash function has been changed since the time the hash value was obtained, indicating the possibility of data tampering.

[0033] As described above, Figures 3(A) to 3(C) illustrate the mechanism for creating authenticity verification data for an image file, embedding it within the image file, and verifying its authenticity. However, this mechanism can create authenticity verification data even for images that have been processed to the extent that the actual scene being photographed is distorted. Therefore, it is difficult to determine whether an image taken with the digital camera 100 is free from factual distortion. Thus, Figures 4 and 5 will be used to explain a method for determining whether an image taken with the digital camera 100 is free from factual distortion.

[0034] <Example of processing> Figure 4 illustrates the processing flow from the start of shooting to the creation of authenticity verification data and the generation of an image file. Each step is realized by the system control unit 50 loading the program stored in the non-volatile memory 56 into memory 32 and executing it. The shooting process in Figure 4 is executed when the system control unit 50 receives a shooting start operation, such as when the photographer presses the shutter button 61 on the digital camera 100. It is assumed that before this process starts, the system control unit 50 (an example of a "setting unit") has set the shooting mode in advance and stored the setting value in the non-volatile memory 56.

[0035] In S401, the system control unit 50 drives the shutter to control the exposure time. In S402, the system control unit 50 performs imaging processing, converting the light received from the subject by the imaging unit 22 into an electrical signal. In S403, the system control unit 50 causes the A / D converter 23 to convert the electrical signal (analog signal) output from the imaging unit 22 into a digital signal. In S404, the system control unit 50 generates imaging data by performing basic development processing, such as color and gradation correction and optical correction, on the data represented by the digital signal generated in S403. Then, the system control unit 50 writes the generated imaging data to the memory 32. Specifically, the processing in S404 consists of a group of image processing operations that are always performed when the shutter is pressed, regardless of user settings.

[0036] In S405, the system control unit 50 (an example of the "first determination unit") reads the setting value related to the shooting mode from the non-volatile memory 56 and determines whether the shooting mode is set to normal mode or authenticity verification shooting mode. If the system control unit 50 determines that the shooting mode is set to normal mode, the process proceeds to S406. On the other hand, if the system control unit 50 determines that the shooting mode is set to authenticity verification shooting mode, the process proceeds to S411. In S406, the system control unit 50 reads the setting value related to the image processing process from the non-volatile memory 56 and determines whether the image processing process is set or not. If the system control unit 50 determines that the image processing process is set, the process proceeds to S407; otherwise, the process proceeds to S408.

[0037] In S407, the system control unit 50 performs the image processing applied to the image data expanded in memory 32. In S408, the system control unit 50 compresses the image data expanded in memory 32 into JPEG format or the like to create main image data 303. In S409, the system control unit 50 creates metadata 302 and writes it to memory 32. In S410, the system control unit 50 combines the metadata 302 created in S409 and the main image data 303 created in S408 to create a single recorded image file 301 (Figure 3(A)). The system control unit 50 then records this recorded image file 301 onto the recording medium 200. The process then ends. These steps S406 to S410 represent the process when the digital camera 100 is in normal shooting mode, not authenticity verification shooting mode.

[0038] On the other hand, the processing flow in authenticity verification shooting mode will be explained below using S411 to S419. If the system control unit 50 determines in S405 that authenticity verification shooting mode is set, in S411 the system control unit 50 (an example of the "second determination unit") determines whether or not a specific shooting setting has been made. If the system control unit 50 determines that a specific shooting setting has been made, the process proceeds to S412; otherwise, the process proceeds to S413.

[0039] In S412, the system control unit 50 temporarily disables a specific shooting setting. That is, even if a specific shooting setting is enabled only for this shooting, the system control unit 50 will not execute the processing (an example of "predetermined processing") that would be performed if that specific shooting setting were enabled in the following S413. In S413, the system control unit 50 performs image processing on the image data expanded in memory 32. This image processing is basically the same as the processing in S407. However, the processing that would be performed if a specific shooting setting were enabled is not included in this image processing. In S414, the system control unit 50 resizes the image data after the image processing written to memory 32 in S413, compresses it to JPEG format or the like as needed, and creates a thumbnail image 307. This thumbnail image 307 is an image that is recorded in the authenticity verification data as an image that is in the same state as the main image after image processing.

[0040] In S415, the system control unit 50 compresses the image data after image processing, which was written to the memory 32 in S413, into JPEG format or the like, to create the main image data and stores it in the main image data area. In S416, the system control unit 50 creates image metadata to be stored in the metadata area. In S417, the system control unit 50 inputs the metadata, main image data, and provenance information 305 into a hash function to generate a hash value 308. In S418, the system control unit 50 encrypts the hash value 308 using a pre-prepared secret key to create a digital signature 309.

[0041] In S419, the system control unit 50 synthesizes the provenance information 305, hash value 308, and digital signature 309 generated up to S418 as authenticity verification data 304. Then, the process proceeds to S410, where the metadata area, main image data area, and authenticity verification data 304 are synthesized to create a recorded image file 310 (Figure 3(C)), which is then recorded on the recording medium 200. The process then ends.

[0042] Here, we will explain specific shooting settings. Specific shooting settings are those that perform processing that essentially distorts the facts. For example, this includes processing image data to create a fisheye, toy camera, diorama, oil painting, or watercolor effect. Image processing settings that significantly alter the shape of the subject or background are treated as specific shooting settings. Disabling such shooting settings when shooting in authenticity verification mode makes it possible to verify the authenticity of the main image to which authenticity verification data is attached.

[0043] Alternatively, specific shooting settings may include, for example, HDR (High Dynamic Range) composite shooting or multiple exposure composite shooting. Images generated by taking multiple shots and combining them should preferably be excluded from authenticity verification because they may distort facts. Among composite shooting methods, shooting functions that combine two or more images taken at different times, and shooting functions that combine two or more frames taken by the user taking multiple shutter releases, are particularly likely to distort facts. Therefore, these composite shooting settings may be treated as specific shooting settings.

[0044] On the other hand, debayering, noise reduction, white balance adjustment, color correction, brightness adjustment, contrast adjustment, sharpness, or optical correction are basic development processes performed during shooting. Settings related to these processes are not treated as specific shooting settings because they have a low probability of factual distortion. Also, processes that reduce the overall color of an image, such as sepia or black and white processing, reduce the amount of information represented by the image, but are unlikely to distort the facts. Therefore, settings related to these processes do not need to be treated as specific shooting settings. Furthermore, settings related to processes other than these, which have a high probability of factual distortion, may be treated as specific shooting settings. In addition, in resizing, which reduces the size of the captured image, and upscaling, which increases the number of recorded pixels in the image, pixel interpolation is performed, but the resulting image shows little visible change. Therefore, settings related to these processes do not need to be treated as specific shooting settings. Furthermore, settings related to processes other than these, which have a high probability of factual distortion, may be treated as specific shooting settings.

[0045] <One aspect of action / effect> As explained above, by disabling specific shooting settings that may perform image processing that could distort facts when the authenticity verification shooting mode is ON, it is possible to prevent the creation of authenticity verification data for images that may distort facts.

[0046] Furthermore, the digital camera 100 converts metadata, main image data, and provenance information 305 into hash values. Therefore, it is possible to determine whether or not the image has been tampered with using these hash values. Moreover, since such conversion is unique and irreversible, the reliability of the determination is ensured. Furthermore, the digital camera 100 converts such hash values ​​into digital signatures 309 using a secret key. Therefore, the confidentiality of the hash values ​​is ensured. Thus, it is possible to determine whether or not the image has been tampered with with greater certainty.

[0047] (First variation) In the above embodiment, as shown in Figure 4, when the authenticity verification shooting mode is ON, the settings for image processing that may distort facts are temporarily disabled during the flow for generating the recorded image file. In this way, when the authenticity verification shooting mode is ON, image processing that may distort facts is not performed. On the other hand, in the first modified example, in order to prevent image processing that may distort facts from being performed in authenticity verification shooting mode, the setting of authenticity verification shooting mode and the enable / disable status of specific shooting settings are switched in advance via the GUI of the digital camera 100 before the execution of the flow.

[0048] Figures 5(A) and 5(B) illustrate the display of the multiple exposure shooting setting screen, which is an example of a specific shooting setting. As shown in Figure 5(A), the system control unit 50 detects a touch operation in the area where the multiple exposure shooting setting (an example of "one of the settings") is in the "off" state. The system control unit 50 then determines whether the authenticity verification shooting mode (an example of "the other setting other than the one") is ON. If the system control unit 50 determines that the authenticity verification shooting mode is ON, the system control unit 50 does not accept this operation. The system control unit 50 then displays a message 501 on the screen indicating that the specific shooting setting cannot be enabled because the authenticity verification shooting mode is ON.

[0049] Alternatively, the system control unit 50 detects a touch operation in the area indicating that the multiple exposure shooting setting (an example of "one of the settings") is "off". Upon receiving this operation, the system control unit 50 sets the multiple exposure shooting to "on" and switches the screen display to "on". The system control unit 50 then determines whether the authenticity verification shooting mode (an example of "the other setting other than one of the settings") is ON. If the system control unit 50 determines that the authenticity verification shooting mode is ON, the system control unit 50 forcibly turns off the authenticity verification shooting mode and displays a message 502 to that effect on the screen, as shown in Figure 5(B). On the other hand, if the system control unit 50 determines that the authenticity verification shooting mode is OFF, it leaves the authenticity verification shooting mode OFF and does not display a message on the screen.

[0050] Furthermore, Figure 5(C) will be used to explain the display of the authenticity verification shooting mode setting screen. The system control unit 50 detects a touch operation in the area indicating that the authenticity verification shooting mode setting (an example of "one of the settings") is in the "off" state. The system control unit 50 then accepts this operation and sets the authenticity verification shooting mode to "on," and switches the screen display to "on." The system control unit 50 then determines whether a specific shooting setting (an example of "the other setting other than one of the settings") is ON. If the system control unit 50 determines that the specific shooting setting is ON, it forcibly disables the specific shooting setting. The system control unit 50 then displays a message indicating that it has been disabled and the content 503 of the disabled shooting setting on the screen. On the other hand, if the system control unit 50 determines that the specific shooting setting is OFF, it leaves the specific shooting setting OFF and does not display a message on the screen.

[0051] Alternatively, the system control unit 50 does not have to accept a touch operation if it detects a touch operation in an area indicating that the authenticity verification shooting mode setting is "off", a specific shooting setting is ON, and the authenticity verification shooting mode setting is "off". The system control unit 50 may also display a message on the screen, as shown in Figure 5(A), indicating that the authenticity verification shooting mode setting cannot be enabled because the specific shooting setting is ON. In such a case, the authenticity verification shooting mode setting is an example of "one of the settings", and the specific shooting setting is "the other setting other than the one of the settings".

[0052] <One aspect of action / effect> The first modified example can achieve the same effects as the embodiment. In addition, with the digital camera 100 according to the first modified example, if one of the settings—the authenticity verification shooting mode setting and the specific shooting setting—is ON before executing the flow shown in Figure 4, the other setting can be turned OFF. Therefore, image processing according to the shooting mode can be executed without executing the processes S411 and S412 shown in Figure 4. Thus, with the digital camera 100 according to the first modified example, the number of steps in the flow shown in Figure 4 can be reduced.

[0053] (Second variation) In the flow chart of Figure 4 in the above embodiment, when the authenticity verification shooting mode is set, a specific shooting setting is temporarily disabled in S412, and image processing is performed in S413. The second modified example shows an example in which these steps are not performed when the authenticity verification shooting mode is set.

[0054] Using Figure 6, another example of the processing flow from the start of shooting to the creation of authenticity verification data and the generation of an image file will be explained. Each step from S401 to S404 is executed in the same way as the flow in Figure 4. After the execution of S404, in S420 the system control unit 50 determines whether or not shooting settings other than the specific shooting settings have been made. If the system control unit 50 determines that shooting settings other than the specific shooting settings have been made, the process proceeds to S421; otherwise, the process proceeds to S405. In S421, the system control unit 50 performs image processing according to the shooting settings other than the specific shooting settings. Then the process proceeds to S405.

[0055] S405 is executed in the same way as the flow in Figure 4. However, in the second modified example, if the system control unit 50 determines in S405 that the shooting mode is set to normal mode, the process proceeds to S422. In S422, the system control unit 50 determines whether a specific shooting setting has been made. If the system control unit 50 determines that a specific shooting setting has been made, the process proceeds to S423; otherwise, the process proceeds to S408. In S423, the system control unit 50 performs image processing according to the specific shooting setting. Then the process proceeds to S408. The processing from S408 to S410 is the same as the flow in Figure 4. Then the process ends.

[0056] On the other hand, if the system control unit 50 determines in S405 that the shooting mode is set to authenticity verification shooting mode, the process proceeds to S414. The process from S414 to S419 is the same as the flow shown in Figure 4. Then the process proceeds to S410 and then terminates.

[0057] <One aspect of action / effect> The second modified version can achieve the same effects as the first modified version. In addition, the digital camera 100 according to the second modified version can reduce the number of steps in the flow shown in Figure 4.

[0058] (Other variations) In Figure 4, all image processing processes other than the development process in S404 may be treated as processes that distort reality, and S411 to S413 may not be executed when the authenticity verification shooting mode is ON. Also, the development process in S404 may include multiple processes. Furthermore, as a substitute for the provenance metadata 306, record metadata that records combinations of multiple development processes may be generated. Furthermore, hash values ​​corresponding to combinations of development processes may be generated. With such modifications, even if the execution order of multiple development processes is different, the generated image data will be determined to be authentic.

[0059] (Other embodiments) The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or recording medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0060] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention.

[0061] The disclosures herein include the following imaging device, a method for controlling the imaging device, and a program. [Item 1] Imaging unit, A setting unit records the processing of the image data captured by the imaging unit and makes a first setting for performing shooting in a shooting mode that proves the authenticity of the image data based on the image data, A first determination unit that determines whether the first setting has been made, The system includes an image processing unit that controls the execution of predetermined processing on the imaging data according to the first setting, The imaging apparatus is characterized in that the image processing unit does not execute the predetermined process when the first determination unit determines that the first setting has been made. [Item 2] The imaging apparatus according to item 1, further characterized in that the setting unit makes a second setting for executing the predetermined processing on the imaging data. [Item 3] The system further includes a second determination unit that determines whether or not the above-mentioned second setting has been made, If the first determination unit determines that the first setting has been made, and the second determination unit further determines that the second setting has been made, The setting unit temporarily disables the second setting, The image processing unit does not perform the predetermined processing. The imaging device described in item 2, characterized by the features described herein. [Item 4] The system further includes a display unit that displays a screen for operating the activation of either the first setting or the second setting, The imaging device according to item 2, characterized in that the setting unit enables one of the first setting and the second setting and disables the other setting based on the operation on the screen. [Item 5] The setting unit, if the other setting other than the one operated on the screen is valid, The activation of one of the settings operated on the aforementioned screen will not be accepted. The selected setting is disabled, The screen will display a message indicating that the selected setting has been disabled. The imaging device described in item 4, characterized by the features described herein. [Item 6] The setting unit, if the other setting other than the one operated on the screen is valid, The setting that was operated on the aforementioned screen is activated, Disable the other setting mentioned above, The display unit will indicate that the other setting has been disabled. The imaging device described in item 4, characterized by the features described herein. [Item 7] The imaging device according to item 6, characterized in that the display unit displays the content of the disabled predetermined process when the other setting is the second setting. [Item 8] The setting unit, if the other setting is invalid, The setting that was operated on the aforementioned screen is activated, The display unit does not display a message regarding the other setting. The imaging device described in item 4, characterized by the features described herein. [Item 9] The imaging device according to any one of items 1 to 8, characterized in that the predetermined processing includes at least one shooting process from among fisheye effect, toy camera effect, diorama effect, oil painting effect, watercolor effect, HDR (high dynamic range), and multiple exposure. [Item 10] The imaging device according to any one of items 1 to 9, characterized in that the predetermined processing includes an imaging process that synthesizes a plurality of imaging data captured at different timings. [Item 11] The imaging apparatus according to any one of items 1 to 10, characterized in that the predetermined processing includes a shooting process that synthesizes multiple image data captured by the user performing multiple shutter releases. [Item 12] The imaging apparatus according to any one of items 1 to 11, characterized in that the predetermined processing includes processing to deform the shape of the subject or the background of the subject. [Item 13] The imaging apparatus according to any one of items 1 to 12, characterized in that the predetermined processing includes processing other than optical correction, color correction, sepia processing, black and white processing, and noise reduction. [Item 14] The imaging apparatus according to any one of items 1 to 13, characterized in that the predetermined processing includes processing other than resizing the image shown in the imaging data and upscaling to increase the number of recorded pixels in the imaging data. [Item 15] A method for controlling an imaging device, The imaging process performed by the imaging unit, The setting unit records the processing of the image data captured by the imaging unit and performs a first setting step to execute shooting in a shooting mode that proves the authenticity of the image data based on the image data. The first determination unit performs a first determination step of determining whether or not the first setting has been made, The image processing unit includes an image processing step that controls the execution of a predetermined process on the imaging data according to the first setting, A control method for an imaging device, characterized in that the image processing unit does not execute the predetermined process when the first determination unit determines that the first setting has been made. [Item 16] A program for causing a computer to execute each step in a control method for an imaging device, wherein the control method is: The imaging process performed by the imaging unit, The setting unit records the processing of the image data captured by the imaging unit and performs a first setting step to execute shooting in a shooting mode that proves the authenticity of the image data based on the image data. The first determination unit performs a first determination step of determining whether or not the first setting has been made, The image processing unit includes an image processing step that controls the execution of a predetermined process on the imaging data according to the first setting, The image processing unit is a program characterized in that it does not execute the predetermined process when the first determination unit determines that the first setting has been made. [Explanation of symbols]

[0062] 16: Eyepiece viewfinder, 19: D / A converter, 22: Imaging unit, 23: A / D converter, 24: Image processing unit, 28: Display unit, 32: Memory, 50: System control unit, 54: Communication unit, 55: Attitude detection unit, 56: Non-volatile memory, 60: Mode selector switch, 61: Shutter button, 70: Operation unit, 100: Digital camera, 150: Lens unit, 200: Recording medium, 301: Image file, 302: Metadata, 303: Main image data, 304: Authenticity verification data, 305: Provenance information, 307: Thumbnail image, 308: Hash value, 309: Digital signature

Claims

1. Imaging unit, A setting unit records the processing of the image data captured by the imaging unit and sets a first setting for performing shooting in a shooting mode that proves the authenticity of the image data based on the image data, A first determination unit that determines whether the first setting has been made, The system includes an image processing unit that controls the execution of predetermined processing on the imaging data according to the first setting, The imaging apparatus is characterized in that the image processing unit does not perform the predetermined processing when the first determination unit determines that the first setting has been made.

2. The imaging apparatus according to claim 1, further characterized in that the setting unit makes a second setting for executing the predetermined processing on the imaging data.

3. The system further includes a second determination unit that determines whether or not the above-mentioned second setting has been made, If the first determination unit determines that the first setting has been made, and the second determination unit further determines that the second setting has been made, The setting unit temporarily disables the second setting, The image processing unit does not perform the predetermined processing. The imaging device according to feature 2.

4. The system further includes a display unit that displays a screen for operating the activation of either the first setting or the second setting, The imaging apparatus according to claim 2, characterized in that the setting unit enables one of the first setting and the second setting and disables the other setting based on the operation on the screen.

5. The setting unit, if the other setting other than the one operated on the screen is valid, The activation of one of the settings operated on the aforementioned screen will not be accepted. The selected setting is disabled, The screen will display a message indicating that the selected setting has been disabled. The imaging apparatus according to feature 4.

6. The setting unit, if the other setting other than the one operated on the screen is valid, The setting that was operated on the aforementioned screen is activated, Disable the other setting mentioned above, The display unit will indicate that the other setting has been disabled. The imaging apparatus according to feature 4.

7. The imaging device according to claim 6, characterized in that the display unit displays the content of the disabled predetermined process when the other setting is the second setting.

8. The setting unit, if the other setting is invalid, The setting that was operated on the aforementioned screen is activated, The display unit does not display a message regarding the other setting. The imaging apparatus according to feature 4.

9. The imaging apparatus according to any one of claims 1 to 8, characterized in that the predetermined processing includes at least one shooting process from among fisheye effect, toy camera effect, diorama effect, oil painting effect, watercolor effect, HDR (high dynamic range), and multiple exposure.

10. The imaging apparatus according to any one of claims 1 to 8, characterized in that the predetermined processing includes an imaging process that synthesizes a plurality of imaging data captured at different timings.

11. The imaging apparatus according to any one of claims 1 to 8, characterized in that the predetermined processing includes a shooting process that synthesizes a plurality of image data captured by the user performing multiple shutter releases.

12. The imaging apparatus according to any one of claims 1 to 8, characterized in that the predetermined processing includes processing to deform the shape of the subject or the background of the subject.

13. The imaging apparatus according to any one of claims 1 to 8, characterized in that the predetermined processing includes processing other than optical correction, color correction, sepia processing, black and white processing, and noise reduction.

14. The imaging apparatus according to any one of claims 1 to 8, characterized in that the predetermined processing includes processing other than resizing the image indicated by the imaging data and upscaling to increase the number of recorded pixels of the imaging data.

15. A method for controlling an imaging device, The imaging process performed by the imaging unit, The setting unit records the processing of the image data captured by the imaging unit and performs a first setting step to execute shooting in a shooting mode that proves the authenticity of the image data based on the image data. The first determination unit performs a first determination step of determining whether or not the first setting has been made, The image processing unit includes an image processing step that controls the execution of a predetermined process on the imaging data according to the first setting, A control method for an imaging device, characterized in that the image processing unit does not execute the predetermined process when the first determination unit determines that the first setting has been made.

16. A program for causing a computer to execute each step in a control method for an imaging device, wherein the control method is: The imaging process performed by the imaging unit, The setting unit records the processing of the image data captured by the imaging unit and performs a first setting step to execute shooting in a shooting mode that proves the authenticity of the image data based on the image data. The first determination unit performs a first determination step of determining whether or not the first setting has been made, The image processing unit includes an image processing step that controls the execution of a predetermined process on the imaging data according to the first setting, The image processing unit is a program characterized in that it does not execute the predetermined process when the first determination unit determines that the first setting has been made.

Images