Imaging device, control method for imaging device, and program

Abstract

It was sometimes difficult to determine that an image with a digital signature had not been altered between the time the user instructed the camera to take the picture and the time it was saved as image data. [Solution] The imaging device includes imaging means including an image sensor, a first development process which processes image data generated by processing electrical signals from the image sensor, a second development process which is a development process on the image data that has undergone the first development process and includes image processing set by the user, and generation means which generates proof data that proves the authenticity of the image data. If the image data is recorded without the second development process being performed, the generation means generates the proof data so as to include information for understanding that the second development process has not been performed.

Description

Technical Field

[0001] The present invention relates to an imaging device, a control method of the imaging device, and a program.

Background Art

[0002] In recent years, information sharing via the Internet and SNS has become active, and it has become an era when anyone can view and transmit information. Also, in recent years, digital image processing technology has evolved. Under such circumstances, it has become difficult for information viewers to view processed digital images and confirm the authenticity of the viewed content, and as a result, problems such as fake news have become more serious. Therefore, a technique for proving the authenticity of an image by attaching a digital signature to the image is known. Also, in Patent Document 1, an imaging device equipped with a shooting mode for proving such authenticity has been developed.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In modern digital cameras, various processing steps are performed on the captured data between the time the user initiates a shot and the data is saved as image data. Depending on the settings, this processing may not be performed at all, or it may be limited to minor processing. Patent Document 1 does not take this into consideration, and instead relies on attaching a digital signature to prove authenticity according to the setting of the tamper-proof mode. Therefore, an image with a digital signature may be an image that has not undergone various processing steps, or it may be an image that has been processed. Consequently, even if a digital signature is attached to an image that has been processed to the extent that it distorts the facts between the time the user initiates a shot and the data is saved as image data, it may be treated as if the image is not distorted and its authenticity is guaranteed, which is problematic. Furthermore, even if a digital signature is attached to an image that has not been processed between the time the user initiates a shot and the data is saved as image data, there is a risk that it may raise suspicion that the image has been processed.

[0005] Therefore, the objective is to ensure that images with digital signatures are identifiable as images that have not undergone any processing between the time the user instructs the camera to take a picture and the time they are saved as image data. [Means for solving the problem]

[0006] One aspect of the present invention is an imaging device comprising: an imaging means including an image sensor; a first development process which processes image data generated by processing electrical signals from the image sensor; a second development process which is a development process on the image data subjected to the first development process and includes image processing set by the user; and a generation means which generates proof data that proves the authenticity of the image data, wherein if the second development process is not performed and the image data is recorded, the generation means generates the proof data so as to include information for understanding that the second development process has not been performed. [Effects of the Invention]

[0007] According to the present invention, it is possible to determine that an image with a digital signature has not undergone any processing between the time the user instructs the user to take the picture and the time it is saved as image data. [Brief explanation of the drawing]

[0008] [Figure 1] External view of the imaging device according to the first embodiment [Figure 2] Block diagram of the imaging device according to the first embodiment [Figure 3] Configuration diagram of image data according to the first embodiment [Figure 4] Rear view of the camera according to the first embodiment [Figure 5] Diagram illustrating the method for recording authenticity verification data according to the first embodiment. [Figure 6] A diagram illustrating an example configuration of the image processing unit 24 according to the first embodiment. [Figure 7] Diagram illustrating the method for displaying authenticity verification data according to the second embodiment. [Figure 8] A diagram illustrating an example of displaying authenticity verification data according to the second embodiment. [Figure 9] Table illustrating multiple display examples of authenticity verification data according to the second embodiment. [Figure 10] A diagram illustrating an example of displaying authenticity verification data according to the second embodiment. [Figure 11] A diagram illustrating an example of how authenticity verification data is displayed in each image file display format according to the second embodiment. [Modes for carrying out the invention]

[0009] [First Embodiment] The embodiments will be described in detail below with reference to the attached drawings. Note that the following embodiments do not limit the invention as defined in the claims. While the embodiments describe multiple features, not all of these features are essential to the invention, and the features may be combined in any way. Furthermore, in the attached drawings, identical or similar configurations are given the same reference numerals, and redundant descriptions are omitted.

[0010] Using Figures 1(A) and 1(B), a digital camera 100 will be described as an example of a device to which this embodiment can be applied. Figure 1(A) is a front perspective view of the digital camera 100, and Figure 1(B) is a rear perspective view of the digital camera 100. A display unit 28 for displaying images and various information is provided on the back of the digital camera 100. In addition, an external viewfinder display unit 43 for displaying various camera settings, including shutter speed and aperture, is provided on the top surface of the digital camera 100.

[0011] The digital camera 100 is also equipped with a shutter button 61, a mode selector switch 60, a terminal cover 40, a main electronic dial 71, a power switch 72, a sub electronic dial 73, a cross key 74, and a SET button 75. The shutter button 61 is an operation unit for issuing shooting instructions. The mode selector switch 60 is an operation unit for switching between various modes. The terminal cover 40 is a cover that protects connectors (not shown) such as connection cables that connect external devices to the digital camera 100.

[0012] The main electronic dial 71 is a rotary control part included in the control unit 70, and by rotating this main electronic dial 71, settings such as shutter speed and aperture can be changed. The power switch 72 is an operating component that switches the power of the digital camera 100 ON and OFF. The sub electronic dial 73 is a rotary dial included in the control unit 70. By operating this sub electronic dial 73, the user can move the selection frame, advance images, etc. The directional pad 74 is included in the control unit 70 and is a directional pad (4-way key) with up, down, left, and right sections that can be pressed. The user can perform operations according to the part of the directional pad 74 that is pressed. The SET button 75 is included in the control unit 70 and is a push button, mainly used to confirm selection items.

[0013] The digital camera 100 is also equipped with an LV button 76, a zoom in button 77, a zoom out button 78, a playback button 79, a quick-return mirror 12, a communication terminal 10, an eyepiece viewfinder 16, a cover 202, and a grip section 90. The LV button 76 is included in the control unit 70 and is a button that allows switching the live view (hereinafter referred to as LV) ON and OFF in the menu button. In video recording mode, the LV button 76 is used to instruct the start and stop of video recording. The zoom in button 77 is included in the control unit 70 and is an operation button for switching the zoom mode ON and OFF and changing the magnification ratio in the live view display in shooting mode. In playback mode, the zoom in button 77 functions as a zoom button to enlarge the playback image and increase the magnification ratio.

[0014] The reduction button 78 is included in the operation unit 70 and is a button for reducing the magnification of the enlarged playback image and reducing the displayed image. The playback button 79 is included in the operation unit 70 and is an operation button for switching between the shooting mode and the playback mode. The user can switch to the playback mode by pressing the playback button 79 during the shooting mode and display the latest image recorded on the recording medium 200 on the display unit 28. The quick return mirror 12 is moved up and down by an actuator (not shown) under the instruction from the system control unit 50. The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens side (detachable). The viewfinder 16 is a peephole type finder for the user to observe the focusing screen 13 to confirm the focus and composition of the optical image of the subject obtained through the lens unit 150. The lid 202 is a lid for the slot storing the recording medium 200. The grip portion 90 is a holding portion shaped to be easily held by the right hand when the user holds the digital camera 100.

[0015] Using FIG. 2, the block configuration of the digital camera 100 will be described. The digital camera 100 includes a lens unit 150, communication terminals (6, 10), a system control unit 50, a lens system control circuit 4, an aperture drive circuit 2, an aperture 1, an AF drive circuit 3, and a lens 103. The lens unit 150 is a lens unit equipped with an interchangeable shooting lens. The lens 103 usually consists of a plurality of lenses, but here it is shown simply as a single lens for simplicity. The communication terminal 6 is a communication terminal for the lens unit 150 to communicate with the digital camera 100 side. The communication terminal 10 is a communication terminal for the digital camera 100 to communicate with the lens unit 150 side. The lens unit 150 communicates with the system control unit 50 via these communication terminals (6, 10). Then, the internal lens system control circuit 4 controls the aperture 1 via the aperture drive circuit 2 and focuses by displacing the position of the lens 103 via the AF drive circuit 3.

[0016] In addition, the digital camera 100 includes an AE sensor 17, a focus detection unit 11, a quick return mirror 12, an imaging unit 22, an eyepiece finder 16, a pentaprism 14, a focusing screen 13, a shutter 101, and an A / D converter 23. The AE sensor 17 measures the luminance of the subject passing through the lens unit 150. The focus detection unit 11 outputs defocus amount information to the system control unit 50. The system control unit 50 controls the lens unit 150 using this defocus amount information to perform phase difference AF. The quick return mirror 12 (hereinafter also referred to as the mirror 12) is moved up and down by an actuator (not shown) according to an instruction from the system control unit 50 during exposure, live view shooting, and video shooting.

[0017] The mirror 12 is a mirror for switching the light beam incident from the lens 103 to the eyepiece finder 16 side and the imaging unit 22 side. Normally, the mirror 12 is arranged to reflect the light beam to the eyepiece finder 16. However, when shooting or during live view display, it jumps upward and retracts from the light beam to guide the light beam to the imaging unit 22 (mirror up). Also, the central part of the mirror 12 is a half mirror so that part of the light can pass through, and part of the light beam is transmitted to the focus detection unit 11 for performing focus detection.

[0018] The photographer can confirm the focus and composition of the optical image of the subject obtained through the lens unit 150 by observing the focusing screen 13 through the pentaprism 14 and the eyepiece finder 16. The shutter 101 is a focal plane shutter that can freely control the exposure time of the imaging unit 22 under the control of the system control unit 50. The imaging unit 22 is an image sensor (image sensor) composed of a CCD, a CMOS element, etc. that converts an optical image into an electrical signal. The A / D converter 23 converts an analog signal into a digital signal. The A / D converter 23 is used to convert the analog signal output from the imaging unit 22 into a digital signal.

[0019] The digital camera 100 also includes an image processing unit 24, a memory control unit 15, a memory 32, a D / A converter 19, a display unit 28, a liquid crystal display unit 41 in the viewfinder, and a viewfinder display unit drive circuit 42. The digital camera 100 also includes an external display unit 43 and an external display unit drive circuit 44. The image processing unit 24 is a functional block that performs various image processing such as resizing, color conversion, and predetermined corrections, pixel interpolation, and reduction on data from the A / D converter 23 or data from the memory control unit 15. The image processing unit 24 consists of a plurality of processors such as DSPs (digital signal processors) and / or a plurality of circuits. The configuration of the image processing unit 24 in this embodiment will be described in detail later. The image processing unit 24 also performs predetermined calculation processing using the captured image data. The system control unit 50 performs exposure control and distance measurement control using the calculation results obtained by the image processing unit 24. This enables TTL (Through-the-Lens) AF (Autofocus), AE (Automatic Exposure), and EF (Flash Pre-Flash) processing. The image processing unit 24 further performs predetermined calculations using the captured image data and uses the obtained calculation results to perform TTL AWB (Automatic White Balance) processing.

[0020] The output data from the A / D converter 23 is written to the memory 32 via the image processing unit 24 and the memory control unit 15, or directly via the memory control unit 15. The memory 32 stores image data obtained by the imaging unit 22 and converted into digital data by the A / D converter 23, as well as image data for display on the display unit 28. The memory 32 has sufficient storage capacity to store a predetermined number of still images, a predetermined amount of video footage, and audio. The memory 32 also serves as a memory for image display (video memory). The D / A converter 19 converts the image display data stored in the memory 32 into an analog signal and supplies it to the display unit 28. In this way, the display image data written to the memory 32 is displayed by the display unit 28 via the D / A converter 19.

[0021] The display unit 28 displays information on an LCD or other display device in accordance with the analog signal from the D / A converter 19. The display unit 28 converts the digital signal, which has been temporarily stored in the memory 32 by the A / D converter 23, into an analog signal using the D / A converter 19. The display unit 28 then sequentially transfers the converted analog signal to the display unit 28 for display, thereby functioning as an electronic viewfinder and enabling through-image display (live view display (LV display)). Hereafter, the image displayed in live view will also be referred to as the LV image. The in-finder LCD display unit 41 displays, via the in-finder display unit drive circuit 42, a frame indicating the AF point where autofocus is currently being performed, and icons representing the camera's settings. The external display unit 43 displays various camera settings, including shutter speed and aperture, via the external display unit drive circuit 44.

[0022] The digital camera 100 also includes a non-volatile memory 56, a system timer 53, a mode selector switch 60, a shutter button 61, a first shutter switch 62, a second shutter switch 64, a system memory 52, and an operation unit 70. The non-volatile memory 56 is an electrically erasable and recordable memory, such as an EEPROM. Constants and programs for the operation of the system control unit 50 are stored in the non-volatile memory 56. Here, "program" refers to a program for executing various flowcharts described later. The system control unit 50 is a control unit that includes at least one processor such as a CPU and / or at least one circuit, and controls the entire digital camera 100. The system control unit 50 realizes the various processes described later by executing the program stored in the non-volatile memory 56. For example, RAM is used for the system memory 52, and constants and variables for the operation of the system control unit 50, programs read from the non-volatile memory 56, etc. are stored there. The system control unit 50 also performs display control by controlling the memory 32, the D / A converter 19, and the display unit 28, etc. Furthermore, the system control unit 50 also functions as a development processing control unit, and via the operation unit 70, it controls the development process based on image processing settings instructed by the user. Specifically, this includes controlling the on / off switching of each image processing process in the image processing unit 24, and instructing the image processing unit 24 to execute the development process. In addition, it also functions as an attribute information generation unit, and generates attribute information (referred to as image processing judgment data in this embodiment) indicating whether or not image processing has been performed and the content of the image processing. Details of the image processing judgment data will be described later.

[0023] The system timer 53 is a timing unit that measures the time used for various controls and the time of the built-in clock. The mode switch 60, shutter button 61, first shutter switch 62, second shutter switch 64, and operation unit 70 are means for inputting various operation instructions to the system control unit 50. More specifically, the mode switch 60 switches the operation mode of the system control unit 50 to one of the modes such as still image recording mode, video recording mode, and playback mode. Modes included in the still image recording mode include auto shooting mode, auto scene detection mode, manual mode, aperture priority mode (Av mode), shutter speed priority mode (Tv mode), and program AE mode. Modes included in the still image recording mode include various scene modes that are shooting settings for different shooting scenes, or custom modes. The user can directly switch the operation mode to one of these modes using the mode switch 60. Alternatively, the user may switch the display to the shooting mode list screen using the mode switch 60, select one of the displayed modes, and then switch the operation mode using the other operation unit. Similarly, video recording modes may also include multiple modes.

[0024] The first shutter switch 62 turns ON during the operation of the shutter button 61 on the digital camera 100, specifically when it is half-pressed (instruction to prepare for shooting), and generates the first shutter switch signal SW1. The first shutter switch signal SW1 initiates operations such as AF (autofocus), AE (automatic exposure), AWB (auto white balance), or EF (flash pre-flash). The second shutter switch 64 turns ON when the operation of the shutter button 61 is completed, specifically when it is fully pressed (instruction to shoot), and generates the second shutter switch signal SW2. The system control unit 50, upon receiving the second shutter switch signal SW2, initiates a series of shooting operations, from reading the signal from the imaging unit 22 to writing the image data to the recording medium 200.

[0025] Each control unit of the control unit 70 is assigned a function as appropriate for each situation by the user selecting various function icons displayed on the display unit 28, and functions as various function buttons. Examples of function buttons include an exit button, back button, image forward button, jump button, filter button, or attribute change button. For example, when the menu button is pressed, various configurable menu screens are displayed on the display unit 28. The user can intuitively make various settings using the menu screen displayed on the display unit 28 and the four directional buttons (up, down, left, and right) and the SET button. The control unit 70 is an input unit that accepts operations from the user. The control unit 70 is composed of push buttons, rotary dials, or touch sensors. Specifically, the control unit 70 includes at least a shutter button 61, a main electronic dial 71, a power switch 72, a sub electronic dial 73, a cross key 74, a SET button 75, an LV button 76, a zoom in button 77, a zoom out button 78, and a playback button 79. The control unit 70 also serves as an image processing setting unit. When a user wants to configure image processing settings, they will do so by viewing the image processing settings (selection) screen displayed on the display unit 28 and making the desired image processing settings (for example, turning each image processing function on or off, setting the mode and parameters of the image processing function, etc.) via the operation unit 70.

[0026] The digital camera 100 also includes a power control unit 80, a power supply unit 30, a recording medium interface 18, a communication unit 54, and a posture detection unit 55. The power control unit 80 is composed of a battery detection circuit, a DC-DC converter, and a switch circuit for switching which blocks are energized, and detects whether a battery is installed, the type of battery, or the remaining battery level. The power control unit 80 also controls the DC-DC converter using the detection results and instructions from the system control unit 50, and supplies the necessary voltage to each part, including the recording medium 200, for the required period of time. The power supply unit 30 is composed of primary batteries such as alkaline batteries and lithium batteries, secondary batteries such as NiCd batteries, NiMH batteries, and lithium-ion batteries, and an AC adapter, etc.

[0027] The recording medium I / F 18 is an interface to the recording medium 200, such as a memory card or hard disk. The recording medium 200 is a recording medium such as a memory card for recording captured images, and can be a semiconductor memory or magnetic disk. The communication unit 54 is composed of a communication module. The communication unit 54 is connected wirelessly or via a wired cable and transmits and receives video signals and audio signals. The communication unit 54 can also connect to a wireless LAN (Local Area Network) or the Internet. In addition, the communication unit 54 can communicate with external devices using Bluetooth® or Bluetooth Low Energy. The communication unit 54 can transmit images captured by the imaging unit 22 (including LV images) and images recorded on the recording medium 200, and can also receive images and other various information from external devices.

[0028] The attitude detection unit 55 detects the orientation of the digital camera 100 relative to the direction of gravity. Using the detected orientation, the attitude detection unit 55 determines whether the image captured by the imaging unit 22 was taken with the digital camera 100 held horizontally or vertically. The system control unit 50 can add orientation information corresponding to the orientation detected by the attitude detection unit 55 to the image data captured by the imaging unit 22, or rotate the image and store it in the storage medium. For example, an acceleration sensor or a gyroscope sensor can be used as the attitude detection unit 55. Furthermore, if an acceleration sensor or a gyroscope sensor is used in the attitude detection unit 55, the attitude detection unit 55 can also detect the movement of the digital camera 100 (pan, tilt, lift, and whether it is stationary or not).

[0029] Figures 3(A) to 3(C) illustrate the image generation process and the authenticity verification mechanism when shooting in authenticity verification mode. Figure 3(A) illustrates the data structure of an image file shot in normal shooting mode. Image file 301 represents the entire file containing the captured image data. Image file 301 includes metadata 302 and main image data 303. Metadata 302 represents an area for recording metadata corresponding to image file 301, and stores parameters such as settings at the time of shooting. Main image data 303 is an area where the captured main image data is stored.

[0030] On the other hand, Figures 3(B) and 3(C) illustrate the data structure of an image file containing image data captured in authenticity verification mode. The image file 310 includes a metadata area, authenticity verification data 304 (an example of "verification data"), and a main image data area. The authenticity verification data 304 is information for verifying the authenticity of the image file 301 and is used when verifying the source and history of the image file 301. Authenticity data 304 has a structure generated in accordance with a prescribed technical standard (e.g., C2PA (Coalition for Content Prevenance and Authenticity)). More specifically, authenticity data 304 includes provenance information (Assertion) 305 (an example of “record data”), a hash value 308 to guarantee authenticity data 304, and a digital signature 309 obtained by encrypting the hash value 308. Provenance information 305 includes provenance identification information (Manifest) to uniquely identify the provenance. The data includes the ID, history metadata 306 which stores editing history showing the editing content of the image file 301, and a thumbnail image 307 corresponding to the main image data 303. This thumbnail image 307 may be a copy of the main image data 303 or it may be a resized image. The history information 305 also includes image processing determination data 311 which indicates whether or not the main image data has been processed. The image processing determination data 311 consists of, for example, flag data indicating whether or not the image has been processed, and text data indicating the processing content of the image if it has been processed.

[0031] The hash value 308 includes the value obtained by inputting the metadata 302, the main image data 303, and the provenance information 305 into a hash function. The digital signature 309 includes the signature value generated by encrypting the hash value 308 using a pre-prepared private key. The public key that forms the pair of the private key used here is also stored in the authenticity verification data 304 along with the digital signature 309. The provenance information 305, the hash value 308, and the digital signature 309 are stored in the authenticity verification data 304. The generated authenticity verification data 304 is then inserted into a predetermined position in the data structure of the image file 301, thereby generating the image file 310 (Figure 3(C)) taken in authenticity verification shooting mode.

[0032] To verify whether this image has been tampered with, the hash value obtained by decrypting the digital signature 309 with a public key is compared with the hash value obtained by inputting the metadata 302, the main image data 303, and the provenance information 305 into a hash function. If the two hash values ​​match, the verification is considered successful. On the other hand, if the two hash values ​​do not match, it means that one of the data input into the hash function has been changed since the time the hash value was obtained, indicating the possibility of data tampering.

[0033] As described above, Figures 3(A) to 3(C) illustrate the mechanism for creating authenticity verification data for an image file, embedding it within the image file, and verifying its authenticity. Here, the thumbnail image 307 corresponds to the main image data 303, and the image processing determination data 311 can identify whether various image processing techniques were applied during shooting. Therefore, it is possible to determine whether the captured image represents a real scene captured by the digital camera 100 or whether it is an image that has been processed and distorted. The method for storing this image processing determination data 311 in the provenance information 305 will now be explained.

[0034] <Example of processing> Figures 4 and 5(A) illustrate the processing flow from the start of shooting to the creation of authenticity verification data and the generation of an image file. Each step is realized by the system control unit 50 loading a program stored in the non-volatile memory 56 into memory 32 and executing it. The shooting process in Figure 4 is executed when the system control unit 50 receives a shooting start operation, such as when the photographer presses the shutter button 61 on the digital camera 100. Figure 6 illustrates the configuration of the image processing unit 24, which consists of a basic image processing unit 600 that performs the first development process, an image processing unit 601 that performs the second development process, and an evaluation value calculation unit 602 for calculating parameters such as AF, AE, and AWB. The basic image processing unit 600, the image processing unit 601, and the evaluation value calculation unit 602 are each connected to the system control unit 50, the memory control unit 15, etc., via the system bus 603. The basic image processing unit 600, the image processing unit 601, and the evaluation value calculation unit 602 each consist of at least one processor and / or at least one circuit, such as a DSP (digital signal processor).

[0035] In S401, the system control unit 50 drives the shutter to control the exposure time. In S402, the system control unit 50 performs imaging processing, converting the light received from the subject by the imaging unit 22 into an electrical signal. In S403, the system control unit 50 causes the A / D converter 23 to convert the electrical signal (analog signal) output from the imaging unit 22 into a digital signal. In S404, the system control unit 50 generates imaging data by performing basic development processing (an example of "second processing") such as color and gradation correction and optical correction on the data represented by the digital signal generated in S403. Then, the system control unit 50 writes the generated imaging data to the memory 32. Specifically, the processing in S404 is executed by the basic image processing unit 600 within the image processing unit 24 in response to instructions from the system control unit 50. The image processing performed by the basic image processing unit 600 consists of a group of image processing operations that are always performed when the shutter is pressed, regardless of user settings. In this embodiment, the image processing consists of sensor correction, optical correction, noise reduction, debayering, brightness correction, color correction, sharpness correction, color space conversion, and resizing.

[0036] In S405, the system control unit 50 (an example of a "determination unit") reads setting values ​​related to image processing from the non-volatile memory 56 and determines whether or not image processing has been set by the user. If the system control unit 50 determines that image processing has been set, the process proceeds to S410; otherwise, the process proceeds to S406.

[0037] From here on, S406 to S409 show the processing when image processing is not set, and S410 to S414 show the processing when image processing is set.

[0038] First, in S406, the system control unit 50 compresses the image data expanded in the memory 32 into JPEG format or the like to create the main image data 303.

[0039] Next, in S407, the system control unit 50 takes the image data written to the memory 32 in S404, performs resizing as needed, compresses it into JPEG format or another format, and creates a thumbnail image 501.

[0040] Next, in S408, the system control unit 50 creates image processing judgment data 502 and writes it to memory 32. The flag data is set to "0" to indicate no processing, and the text data indicating the image processing content is set to "none". Next, in S409, the system control unit 50 creates metadata related to the main image generated in S406 and writes it to memory 32.

[0041] On the other hand, in S410, the system control unit 50 performs image processing on the images stored in memory 32. Specifically, the image processing unit 601 within the image processing unit 24 receives instructions from the system control unit 50 and executes the processing in S410. The image processing performed by the image processing unit 601 consists of a group of image processing operations that are triggered by user settings. In this embodiment, the image processing includes object manipulation such as faces, extreme color manipulation, image cropping, image deformation such as fisheye effect, filter effects, synthesis of multiple images, and AI-based image generation processing. Next, in S411, the system control unit 50 compresses the image data written to memory 32 in S404 into JPEG format or the like, after resizing it as needed, and creates a thumbnail image 501.

[0042] Next, in S412, the system control unit 50 resizes the image data written to the memory 32 in S410 as needed, compresses it into JPEG format or the like, and creates a thumbnail image 510.

[0043] Next, in S413, the system control unit 50 creates image processing determination data 511 and writes it to memory 32. The flag data is set to "1" to indicate processing, and the text data indicating the image processing content shows the specific processing content. In this embodiment, we take as an example the case in which a fisheye effect is produced by image deformation processing in S410. In S414, the system control unit 50 creates metadata related to the main image generated in S411 and writes it to memory 32.

[0044] Next, in S415, the system control unit 50 inputs the metadata 302 recorded in the metadata area 504, the main image data, and the newly generated provenance information 505 into a hash function to generate a hash value 506. The metadata 302 input here is the metadata generated in S409 or S414. The main image data input here is either the main image data 503 generated in S406 or the main image data 512 generated in S411. If the main image data 503 is input, the metadata generated in S409 is input. If the main image data 512 is input, the metadata generated in S414 is input. The provenance information 505 includes provenance metadata that records Create information indicating that the image was generated by the digital camera 100, and either the unprocessed information generated in S408 or the processed information generated in S413. Furthermore, it includes either the thumbnail image 501 generated in S407 or the thumbnail image 510 generated in S412. Next, in S416, the system control unit 50 encrypts the hash value 506 using a pre-prepared secret key to create a digital signature 507.

[0045] Next, in S417, the system control unit 50 (an example of a "generation unit capable of generating image data and certification data") synthesizes the provenance information 505, hash value 506, and digital signature 507 generated up to S416 as authenticity certification data 508. Then, the process proceeds to S418, where the metadata area 504, main image data 503 or 512, and authenticity certification data 508 are synthesized to create a recorded image file 509, which is then recorded on the recording medium 200. The process then ends. In this way, during a single capture, it is possible to determine that the image is highly authentic and free from factual distortion by referring to information indicating that no image processing has been performed between the time the metadata 302 and the main image data 303 are saved to the recorded image file.

[0046] Furthermore, if the system control unit 50 determines that image processing is set in S405, the thumbnail image before image processing (corresponding to the thumbnail image generated in S407) may be included in the provenance information 505. This allows for visual confirmation of the image before and after processing. Alternatively, the main image before image processing is executed (corresponding to the image generated in S406) may be included in the provenance information 505, thereby allowing for visual confirmation of the image before and after processing.

[0047] Here, we will provide further details about the basic development process in S404 (processing performed by the basic image processing unit 600) and the image processing process in S410 (processing performed by the image processing unit 601). The thumbnail image generated in S407 must be an image that can be proven to have been taken with the digital camera 100. Therefore, the basic development process in S404, which is performed before S407, does not perform any processing that distorts the facts to the extent that it becomes impossible to prove that the image was taken with the digital camera 100. On the other hand, in the image processing process in S410, the thumbnail image and processing history before and after the image processing are recorded, so the development process in S404 may also perform processing that is of a greater degree. The basic development process and image processing process mentioned in the above embodiment are just examples, and below, instead of the above examples, three patterns for distinguishing between the basic development process in S404 and the image processing process in S410 are described.

[0048] In the first example, the basic development process in S404 is debayering, while the processing in S410 is image processing other than debayering.

[0049] The second example is that the basic development processing in S404 is image processing that automatically executes the default settings of the digital camera 100. That is, for example, the basic development processing in S404 includes debayering, noise reduction, auto white balance adjustment, color correction, brightness adjustment including tone mapping and gamma correction. Alternatively, it may include contrast adjustment, sharpness correction, color space conversion, resizing to match the recorded image size, sensor correction or optical correction. These processes are performed automatically according to algorithms implemented by the camera manufacturer that produced the digital camera 100. In other words, the system control unit 50 controls these processes based on parameters automatically acquired by the evaluation value calculation processing unit 602 at the time of shooting, and are not affected by user settings. The processing in S410 is image processing (black and white, skin tone correction, manual white balance, etc.) that is performed according to the settings when the user changes the camera settings (an example of "according to user settings"). While the above explanation described auto white balance and color correction as basic development processes for the S404, if the user sets these parameters, they may also be treated as image processing for the S410.

[0050] The third example is image processing in S410, which involves processing that alters the shape or color of the image. Specifically, image processing in S410 includes fisheye, toy camera, diorama, oil painting, watercolor, HDR (High Dynamic Range) shooting, or the synthesis of multiple images such as multiple exposures, processing involving AI-based image generation, and manipulation of objects such as faces. The basic development processing in S404 is image processing other than that in S410. It should be noted that some consider optical correction, noise reduction, and sharpness to be processes that alter shape. In that case, these processes may also be considered image processing in S410. Also, some consider white balance, color correction, and brightness adjustment to be processes that alter color. In that case, these processes may also be considered image processing in S413. Furthermore, image processing using deep learning that does not aim to reproduce the shooting scene, such as adding or deleting objects by generation AI, is treated as image processing in S410. Furthermore, deep learning-based image processing for at least one of the following image processing steps aimed at improving the reproducibility of the shooting scene may be treated as a basic development process in S404 rather than as an image processing step in S410. Such image processing steps include, for example, sensor correction, optical correction, noise reduction, debayering, brightness correction including tone mapping and gamma correction, color correction including white balance adjustment, sharpness correction, color space conversion, and resizing to match the recorded image size.

[0051] As explained above, by adding information indicating whether or not the image has been processed to the authenticity verification data, it is possible to determine whether or not an image obtained through photography has been processed during the shooting process. Furthermore, the authenticity of the information regarding whether or not an image obtained through photography has been processed during the shooting process can be guaranteed.

[0052] Furthermore, while the processing in S404 is an image correction process, the processing in S410 may be an image transformation process or an image processing process. Image correction processes include, for example, correcting the contrast, brightness, color, etc. of an image. Image transformation processes include, for example, converting an image to a monochrome image, binarizing image data, or displaying only limited colors. Image processing processes include, for example, removing noise contained in an image, enhancing edges, or enlarging or reducing the image size.

[0053] Furthermore, the development process in S404 may include multiple processes. In addition, as a substitute for the provenance metadata 306, record metadata recording combinations of multiple development processes may be generated. A hash value corresponding to the combination of development processes may also be generated. With such modifications, even if the execution order of the multiple development processes differs, the generated image data can be determined to be authentic.

[0054] [Second Embodiment] In the imaging device described in the first embodiment, a second embodiment will be described that preferably displays an image file captured in authenticity verification mode.

[0055] Using Figures 1(A) and 1(B), a digital camera 100, as an example of a device to which this embodiment can be applied, will be described. The differences in the configuration of the digital camera 100 compared to the first embodiment will be described below.

[0056] The system control unit 50 also functions as an attribute information notification unit in addition to the attribute information generation unit. It verifies the authenticity verification data 304 in Figures 3(B) and 3(C), and analyzes the image processing judgment data 311. Based on the authenticity verification result, whether or not image processing has occurred, and if so, the details of the image processing, it controls the image processing unit 24 and the display unit 28. Detailed control of the image processing unit 24 and the display unit 28 will be explained in the processing examples described later.

[0057] This section describes a method for notifying the user of the result of determining whether the captured image represents a real scene as captured by the digital camera 100, or whether it is an image that has been manipulated and distorted from reality.

[0058] <Example of processing> Using Figures 7 and 8, we will explain the processing flow from starting playback of the image file to verifying the authenticity verification data 304 and displaying the contents of the image processing judgment data.

[0059] Each step is realized by the system control unit 50 loading the program stored in the non-volatile memory 56 into the memory 32 and executing it. Furthermore, the image file playback process shown in Figure 7 is executed when the system control unit 50 receives an image playback start operation, such as when the photographer presses the playback button 79 on the digital camera 100.

[0060] In S701, the system control unit 50 checks the metadata 302 of the image file to be played back for the presence or absence of authenticity verification data 304. Since the authenticity verification data 304 has a structure generated according to a predetermined technical standard (e.g., C2PA), its presence or absence can be detected using the method of the technical standard. If the authenticity verification data 304 exists, the process proceeds to S702; otherwise, it proceeds to S709.

[0061] In S702, the system control unit 50 uses the authenticity verification data 304 to verify the image file to be played back and confirms that the image file has not been tampered with. The verification is performed based on a predetermined technical standard (e.g., C2PA), and includes verification of the digital signature value 309 and the hash value 308. In order to speed up playback display, control may be implemented to skip part of the verification procedure.

[0062] In S703, the system control unit 50 proceeds to S704 if the verification is successful, and to S709 if there is a mismatch.

[0063] In S704, the system control unit 50 analyzes the image processing determination data 311 to determine whether the image file to be played back has been processed or not. As shown in Figure 5, the image processing determination data 502 / 511(311) contains flag data, where a flag value of "0" indicates that the image is unprocessed, and a value of "1" indicates that it has been processed.

[0064] In S705, the system control unit 50 proceeds to S707 if the image file to be played back is unprocessed, and to S706 if it has been processed.

[0065] In S706, the system control unit 50 reads the processing content data from the image processing judgment data 511 (311). The system control unit 50 controls the image processing unit 24 to generate image data for superimposition so that the read text data can be superimposed on the displayed image.

[0066] In S707, the system control unit 50 successfully verifies the authenticity verification data 304 and then controls the display of the image file, which is unprocessed. Figure 8(a) shows an example of image playback display in S707, where two icons are superimposed on the upper right of the displayed image 801. Icon 802 is an icon indicating that the authenticity verification data 304 exists and that verification has been successful, and in this embodiment, it is called the authenticity verification icon. Icon 803 is an icon indicating that the image is unprocessed, and in this embodiment, it is called the unprocessed image verification icon. These icon images are stored as data in, for example, the non-volatile memory 56. The system control unit 50 has previously unpacked the icon images from the non-volatile memory 56 into the memory 32. The system control unit 50 controls the image processing unit 24 to superimpose the authenticity verification icon 802 and the unprocessed image verification icon 803, which have been unpacked in the memory 32, onto the display image data after image processing for playback display has been performed. The system control unit 50 controls the display unit 28 to display the display image data, which consists of two superimposed icon images. Image processing for playback display refers to, for example, decompression processing when the image data in the image file is compressed in JPEG format, and image quality adjustment processing such as brightness to match the device characteristics of the display unit 28, and is performed by the image processing unit 24. The system control unit 50 may also control the image processing unit 24 to perform the image processing for playback display at the timing before the icon superposition in S707 to S709, or to perform it in parallel with S701 to S706.

[0067] In S708, the system control unit 50 successfully verifies the authenticity verification data 304 and then controls the display of the image file in which the image has been processed. Figure 8(b) shows an example of image playback display in S708, where two icons are superimposed on the upper right of the displayed image 801. Icon 804 is an icon indicating that the image has been processed, and in this embodiment, it is called the image processing verification icon. The other is the authenticity verification icon 802, which also appeared in S707. Furthermore, text 805 indicating the details of the image processing is superimposed on the lower right. The control of the system control unit 50 for superimposing the icon images is the same as in S707, so the explanation is omitted. Text 805 was generated as image data by the image processing unit 24 in S706, and the system control unit 50 controls the image processing unit 24 to superimpose text 805 onto the display image data in which the two icon images are superimposed. The system control unit 50 controls the display unit 28 to display display image data in which two icon images and text indicating the processing content are superimposed.

[0068] In S709, the system control unit 50 controls the display of image files that lack authenticity verification data 304, or image files for which the verification of authenticity verification data 304 has failed. Figure 8(c) shows an example of playback display in S707, without the superimposition of the authenticity verification icon 802, the unprocessed image verification icon 803, and the processed image verification icon 804. The system control unit 50 controls the image processing unit 24 to display the display image data, after image processing for playback display has been applied, directly on the display unit 28.

[0069] The above is an example of a processing flow from the start of image file playback to the verification of authenticity verification data 304 and the display of the image processing judgment data along with the image. In this embodiment, icons are superimposed on the black area for adjusting the field of view of the displayed image in the display unit 28, but icons may also be superimposed directly on the displayed image. Furthermore, authenticity verification, unprocessed image verification, and image processing verification may be indicated using other forms of representation such as text instead of icons. In addition, notifications for the absence of authenticity verification data 304 and the failure of verification of authenticity verification data 304 are common in S709, but different notification content may be used for each case.

[0070] <Example of notification> In the embodiments described, we showed an example where, in addition to detecting the authenticity of an image, the user is notified of whether the image has been processed or not. Several examples of methods for notifying the user are described below.

[0071] Using Figures 8, 9, and 10, we will explain several examples of image display control shown in S707, S708, and S709 in Figure 7. Figure 9 is a table summarizing notification examples, which summarizes how the control unit 50 controls the image display in S707, S708, and S709 in the flowchart of Figure 7. Note that the superposition processing flow for icons and other elements of each pattern is based on what was explained in the above-described embodiment, so we will omit the explanation.

[0072] Patterns 1, 2, and 3 are examples of dedicated display control for image files captured in authenticity verification mode. Pattern 1 is the same as the embodiment described above. Pattern 2 is an example of Pattern 1 in which the notification is limited to an icon only by not overlaying text 805 indicating the specific processing details of the image in S708. Pattern 3 is an example of Pattern 1 in which only the authenticity verification icon 802 is overlaid in S708, as shown in Figure 10(d). The presence of the authenticity verification icon 802 and the absence of the unprocessed image verification icon 803 makes it possible to indicate that the image to be displayed has been processed. It is also possible to overlay text 805 indicating the specific processing details in S708.

[0073] Patterns 4 and 5 are examples of controlling the display of an unprocessed image file taken in authenticity verification mode by default. If the authenticity verification of the displayed image is successful and it is unprocessed (S707), the display will be without an icon superimposed, as shown in Figure 8(c). Furthermore, in Pattern 4, if the authenticity verification is successful and the image has been processed (S708), an image processing verification icon 804 and text 805 indicating the image processing details will be superimposed, as shown in Figure 10(e). If the authenticity verification of the image fails, or if there is no authenticity verification data 304 (S709), an icon 1001 (referred to as the unverified authenticity icon) indicating that the authenticity of the image has not been verified will be superimposed, as shown in Figure 10(f). Pattern 5 is an example of limiting the notification to an icon only, by not superimposing text 805 indicating the specific image processing details in S708, compared to Pattern 4.

[0074] The above are examples of variations in how users are notified.

[0075] Next, we will explain how to notify the user in other image file display formats. Note that any of the notification methods shown in Figure 9 may be selected.

[0076] Figures 11(a) and 11(b) show examples of user notifications when multiple image files are displayed simultaneously. As shown in Figure 11(a), if only a few images are displayed simultaneously, the system control unit 50 performs the flow shown in Figure 7 for each image file to be displayed and controls the superimposition of various icons based on the results. Alternatively, the process of displaying multiple images may be completed first, then the flow shown in Figure 7 may be performed, and the various icons may be superimposed afterward. Figure 11(b) shows an example when a large number of images are displayed simultaneously. When there are many images to display, the number of times the flow shown in Figure 7 is performed also increases, which can delay user notification. Furthermore, if measures such as shrinking the icons to match the displayed images are implemented, it becomes difficult for the user to see the results for each image. Therefore, as shown in Figure 11(b), if the number of images to be played simultaneously exceeds a predetermined number, the control unit 50 may skip the flow shown in Figure 7 and only perform the normal image display flow. Figure 11(c) shows an example of user notification when multiple image files are displayed by file name only, similar to how they appear in Windows Explorer on a personal computer. In Figure 11(c), an area where icons can be displayed is provided to the right of each file name. The control unit 50 performs the flow shown in Figure 7 for each image file whose file name is being displayed, and controls the superimposition of various icons based on the results. Also, similar to the flow in Figure 11(b), if the number of image file names to be displayed simultaneously exceeds a predetermined number, the control unit 50 may skip the flow shown in Figure 7 and perform only the normal image display flow.

[0077] <Other Embodiments> The present invention can also be realized by supplying a program that implements one or more of the functions of the above-described embodiments to a system or device via a network or recording medium, and by having one or more processors in the computer of that system or device read and execute the program. It can also be realized by a circuit (e.g., an ASIC) that implements one or more functions.

[0078] The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, claims are attached to disclose the scope of the invention.

[0079] The disclosures herein include the following imaging device, a method for controlling the imaging device, and a control program for the imaging device.

[0080] [Item 1] An imaging means including an image sensor, A control means for controlling a first development process that processes image data generated by processing electrical signals from the image sensor, and a second development process that processes the image data subjected to the first development process and includes image processing set by the user. The system includes a generation means for generating proof data that proves the authenticity of the aforementioned image data, If the image data is recorded without the second development process being performed, the generating means generates the certification data such that it includes information for determining that the second development process has not been performed.

[0081] [Item 2] When the image data that has undergone the second development process is recorded, the generation means generates the certification data so that it includes information for determining that the second development process has been performed. The imaging device described in item 1.

[0082] [Item 3] The first development process includes a debayering process, The aforementioned second development process includes processes other than debayering. The imaging device described in item 2.

[0083] [Item 4] The first development process includes a process that is performed according to the default settings, The second development process includes processing that is performed according to user settings. The imaging device described in item 2.

[0084] [Item 5] The second development process includes at least one of the following: fisheye effect, toy camera effect, diorama effect, oil painting effect, watercolor effect, HDR (high dynamic range) photography, and multiple exposure photography. The first developing process includes all developing processes except for the second developing process. The imaging device described in item 2.

[0085] [Item 6] The generation means generates the certification data, further including encrypted data of a viewing image for viewing the image shown in the imaging data on which the second development process has been performed. An imaging device as described in any one of items 2 through 5.

[0086] [Item 7] The generation means generates the proof data such that it further includes provenance information indicating that the image data was generated by an imaging device. An imaging device as described in any one of items 1 through 6.

[0087] [Item 8] The encrypted data includes a hash value. An imaging device as described in any one of items 1 through 7.

[0088] [Item 9] The encrypted data includes a digital signature obtained by encrypting the hash value. The imaging device described in item 8.

[0089] [Item 10] When the image data subjected to the second development process is recorded, the generation means generates the certification data so that it further includes information for understanding the content of the image processing performed by the second development process. An imaging device as described in any one of items 1 through 9.

[0090] [Item 11] The generation unit compresses the image data, which has not undergone the second development process, to generate the image for viewing. The imaging device described in item 6.

[0091] [Item 12] The aforementioned proof data further includes metadata history containing parameters related to imaging, An imaging device as described in any one of items 1 through 11.

[0092] [Item 13] A method for controlling an imaging device, The imaging process involves an imaging unit, including an image sensor, taking an image, A control step controls a first development process that processes image data generated by processing electrical signals from the image sensor, and a second development process that processes the image data subjected to the first development process, and which includes image processing set by the user. A generation step for generating proof data that proves the authenticity of the aforementioned image data, If the image data is recorded without the second development process being performed, the generation step generates the certification data so that it includes information to determine that the second development process has not been performed. A method for controlling an imaging device.

[0093] [Item 14] A program for causing a computer to execute each step in a control method for an imaging device, wherein the control method is: The imaging process involves an imaging unit, including an image sensor, taking an image, A control step controls a first development process that processes image data generated by processing electrical signals from the image sensor, and a second development process that processes the image data subjected to the first development process, and which includes image processing set by the user. The process includes generating proof data to prove the authenticity of the aforementioned image data, If the image data is recorded without the second development process being performed, the generation step generates the certification data so that it includes information to determine that the second development process was not performed. Control program for imaging device.

[0094] [Item 15] A display unit that displays the captured image data, The system includes an attribute information notification unit that determines whether the second development process has been performed based on proof data that proves the authenticity of the image data, and notifies the determination information. The display unit is characterized in that it displays the image data to be displayed together with the determination information notified by the attribute information notification unit. The imaging device described in item 1.

[0095] [Item 16] The display unit is characterized in that, when the attribute information notification unit notifies that the second development process has not been performed on the image data to be displayed, it displays the image data together with information to understand that the second development process has not been performed. The imaging device described in item 15.

[0096] [Item 17] The display unit is characterized in that, when notified by the attribute information notification unit that a second development process is being performed on the image data to be displayed, it displays the image data together with information for understanding that the second development process is being performed. The imaging device described in item 15.

[0097] [Item 18] The display unit is characterized in that, when notified by the attribute information notification unit that a second development process is being performed on the image data to be displayed, it displays the image data together with information for understanding the content of the second development process. The imaging device described in item 17.

[0098] [Item 19] The display unit is characterized in that, when notified by the attribute information notification unit that the certification data is not available for the image data to be displayed, it displays the image data together with information for understanding that the certification data is not available. The imaging device described in item 15.

[0099] [Item 20] The attribute information notification unit is characterized by performing verification of the certification data and, if the verification is successful, performing a process to determine whether or not the second development process has been performed. The imaging device described in item 15.

[0100] [Item 21] The display unit is characterized in that, when the attribute information notification unit notifies the display unit of the success or failure of the verification of the certification data for the image data to be displayed, it displays the verification information indicating the success or failure of the verification together with the image data to be displayed. The imaging device described in item 20.

[0101] [Item 22] The display unit is characterized in that it displays the judgment information and verification information notified by the attribute information notification unit as icon images for the image data to be displayed. The imaging device described in item 21.

[0102] [Item 23] The display unit is characterized in that, when the number of image data to be displayed simultaneously exceeds a predetermined number, it does not display the judgment information and verification information notified by the attribute information notification unit. The imaging device described in item 22.

[0103] [Item 24] A display unit that displays image data, The system includes an attribute information notification unit that determines whether the second development process has been performed based on proof data that proves the authenticity of the image data, and notifies the determination information. The display unit is characterized in that it displays the image data to be displayed together with the determination information notified by the attribute information notification unit. Display device.

[0104] [Item 25] A program for causing a computer to execute each step in a control method for a display device, wherein the control method is: The display unit performs a display process in which it adds image data, The process includes a notification step of determining whether the second development process has been performed on the proof data that proves the authenticity of the image data, which is included in the image data, and notifying the determination information. In the display process, the image data to be displayed is displayed together with the determination information notified in the notification process. A control program for a display device.

Claims

1. An imaging means including an image sensor, A control means for controlling a first development process that processes image data generated by processing electrical signals from the image sensor, and a second development process that processes the image data subjected to the first development process and includes image processing set by the user. The system includes a generation means for generating proof data that proves the authenticity of the aforementioned image data, If the image data is recorded without the second development process being performed, the generation means is characterized in that it generates proof data that includes information for determining that the second development process has not been performed. Imaging device.

2. When the image data that has undergone the second development process is recorded, the generation means generates the certification data so that it includes information for determining that the second development process has been performed. The imaging apparatus according to claim 1.

3. The first development process includes a debayering process, The aforementioned second development process includes processes other than debayering. The imaging apparatus according to claim 2.

4. The first development process includes a process that is performed according to the default settings, The second development process includes processing that is performed according to user settings. The imaging apparatus according to claim 2.

5. The second development process includes at least one of the following: fisheye effect, toy camera effect, diorama effect, oil painting effect, watercolor effect, HDR (high dynamic range) photography, and multiple exposure photography. The first developing process includes all developing processes except for the second developing process. The imaging apparatus according to claim 2.

6. The generation means generates the certification data, further including encrypted data of a viewing image for viewing the image shown in the imaging data on which the second development process has been performed. The imaging apparatus according to claim 2.

7. The imaging device according to claim 1, wherein the generation means generates the proof data, further including origin information indicating that the image data was generated by the imaging device.

8. The encrypted data includes a hash value. The imaging apparatus according to claim 1.

9. The encrypted data includes a digital signature obtained by encrypting the hash value. The imaging apparatus according to claim 8.

10. When the image data subjected to the second development process is recorded, the generation means generates the certification data so that it further includes information for understanding the content of the image processing performed by the second development process. The imaging apparatus according to claim 1.

11. The generation unit compresses the image data, which has not undergone the second development process, to generate the image for viewing. The imaging apparatus according to claim 1.

12. The aforementioned proof data further includes metadata history containing parameters related to imaging, The imaging apparatus according to any one of claims 1 to 11.

13. A method for controlling an imaging device, The imaging process involves an imaging unit, including an image sensor, taking an image, A control step controls a first development process that processes image data generated by processing electrical signals from the image sensor, and a second development process that processes the image data subjected to the first development process, and which includes image processing set by the user. A generation step for generating proof data that proves the authenticity of the aforementioned image data, Includes, If the image data is recorded without the second development process being performed, the generation step generates the certification data so that it includes information to determine that the second development process was not performed. A method for controlling an imaging device.

14. A program for causing a computer to execute each step in a control method for an imaging device, wherein the control method is: The imaging process involves an imaging unit, including an image sensor, taking an image, A control step controls a first development process that processes image data generated by processing electrical signals from the image sensor, and a second development process that processes the image data subjected to the first development process, and which includes image processing set by the user. The process includes generating proof data to prove the authenticity of the aforementioned image data, If the image data is recorded without the second development process being performed, the generation step generates the certification data so that it includes information to determine that the second development process was not performed. Control program for imaging device.

15. A display unit that displays the captured image data, The system includes an attribute information notification unit that determines whether the second development process has been performed based on proof data that proves the authenticity of the image data, and notifies the determination information. The display unit is characterized in that it displays the image data to be displayed together with the determination information notified by the attribute information notification unit. The imaging apparatus according to claim 1.

16. The display unit is characterized in that, when the attribute information notification unit notifies that the second development process has not been performed on the image data to be displayed, it displays the image data together with information to understand that the second development process has not been performed. The imaging apparatus according to claim 15.

17. The display unit is characterized in that, when notified by the attribute information notification unit that a second development process is being performed on the image data to be displayed, it displays the image data together with information for understanding that the second development process is being performed. The imaging apparatus according to claim 15.

18. The display unit is characterized in that, when notified by the attribute information notification unit that a second development process is being performed on the image data to be displayed, it displays the image data together with information for understanding the content of the second development process. The imaging apparatus according to claim 17.

19. The display unit is characterized in that, when notified by the attribute information notification unit that the certification data is not available for the image data to be displayed, it displays the image data together with information for understanding that the certification data is not available. The imaging apparatus according to claim 15.

20. The attribute information notification unit is characterized by performing verification of the certification data and, if the verification is successful, performing a process to determine whether or not the second development process has been performed. The imaging apparatus according to claim 15.

21. The display unit is characterized in that, when the attribute information notification unit notifies the display unit of the success or failure of the verification of the certification data for the image data to be displayed, it displays the verification information indicating the success or failure of the verification together with the image data to be displayed. The imaging apparatus according to claim 20.

22. The display unit is characterized in that it displays the judgment information and verification information notified by the attribute information notification unit as icon images for the image data to be displayed. The imaging apparatus according to claim 21.

23. The display unit is characterized in that, when the number of image data to be displayed simultaneously exceeds a predetermined number, it does not display the judgment information and verification information notified by the attribute information notification unit. The imaging device according to claim 22.

24. A display unit that displays image data, The system includes an attribute information notification unit that determines whether the second development process has been performed based on proof data that proves the authenticity of the image data, and notifies the determination information. The display unit is characterized in that it displays the image data to be displayed together with the determination information notified by the attribute information notification unit. Display device.

25. A program for causing a computer to execute each step in a control method for a display device, wherein the control method is: The display unit performs a display process in which it adds image data, The process includes a notification step of determining whether the second development process has been performed on the proof data that proves the authenticity of the image data, which is included in the image data, and notifying the determination information. In the display process, the image data to be displayed is displayed together with the determination information notified in the notification process. A control program for a display device.

Images