Imaging device and imaging method

Abstract

The imaging device according to the present disclosure is provided with: a pixel array unit (101) that includes a plurality of pixels, arranged in a matrix, for generating pixel signals corresponding to light received due to exposure, and that acquires image data on the basis of pixel signals generated by the plurality of pixels; a compression unit (1020) that compresses the data volume of the image data to generate compressed image data; a signature generation unit (1021) that generates signature data on the basis of the compressed image data; and an output unit (104, 131, 132) that outputs the image data, and authenticity verification data that is obtained by adding the signature data to the compressed image data.

Description

[Technical Field]

[0001] The present disclosure relates to an imaging device and an imaging method. [Background technology]

[0002] In recent years, with the advancement of image processing technology, authentication to prove that an image is genuine (not tampered with) has become important. To authenticate an image, a method can be considered in which a signature is added to an image captured by a sensor within the sensor and output from the sensor. For example, signature data is generated based on RAW data captured by the sensor, and the RAW data with this signature data added is output from the sensor. The RAW data output from the sensor is generally subjected to image processing such as contrast adjustment and compression encoding processing, and used as a processed image. Patent Document 1 describes an image sensor that outputs signature information in association with image information.

[0003] The authenticity of RAW data can be verified based on the signature data attached to it. Therefore, by comparing an image obtained by processing this RAW data outside the sensor with an image based on this RAW data, it is possible to determine whether the processed image has been tampered with. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Japanese Patent Application Laid-Open No. 2017-184198 Summary of the Invention [Problem to be solved by the invention]

[0005] The existing authentication methods described above require that the processed image, along with the RAW data and its signature to be stored to prove that the processed image has not been tampered with, which imposes a heavy load on the memory of the camera equipped with the sensor and on the load when transferring data from the camera.

[0006] An object of the present disclosure is to provide an imaging device and an imaging method that can generate images that impose a smaller processing load for authenticity proofing. [Means for solving the problem]

[0007] The imaging device according to the present disclosure includes a pixel array unit that includes a plurality of pixels arranged in a matrix array, each of which generates a pixel signal in response to light received by exposure, and acquires image data from each of the pixel signals generated by the plurality of pixels; a compression unit that compresses the amount of image data to generate compressed image data; a signature generation unit that generates signature data based on the compressed image data; and an output unit that outputs image data and authentication proof data in which the signature data is added to the compressed image data. [Brief explanation of the drawings]

[0008] [Figure 1] FIG. 1 is a schematic diagram showing an example of fake image generation using existing technology. [Figure 2] FIG. 1 is a schematic diagram showing an example of fake image generation using existing technology. [Figure 3A] FIG. 1 is a schematic diagram illustrating an example of the configuration of a camera using a sensor that adds signature data to image data and outputs the image data, according to existing technology. [Figure 3B] 10A and 10B are diagrams for explaining an example of authenticating output image data in the existing technology. [Figure 4] FIG. 1 is a block diagram illustrating a schematic configuration of an example of a camera applicable to each embodiment. [Figure 5] FIG. 1 is a block diagram showing an example of a configuration of a pixel array unit applicable to each embodiment. [Figure 6] FIG. 1 is a diagram showing an example of a commonly used Bayer array. [Figure 7A] 10 is a diagram showing an example in which a pixel array section according to each embodiment is formed by a stacked CIS with a two-layer structure. FIG. [Figure 7B] FIG. 10 is a diagram showing an example in which a pixel array section according to each embodiment is formed using a stacked CIS with a three-layer structure. [Figure 8] FIG. 1 is a schematic diagram for explaining an overview of each embodiment. [Figure 9] 1 is a block diagram showing a configuration of an example of a sensor according to a first embodiment. [Figure 10] FIG. 3 is a schematic diagram for explaining a first method for compressing the amount of data that can be applied to the first embodiment. [Figure 11] FIG. 10 is a schematic diagram for explaining a second data volume compression method applicable to the first embodiment. [Figure 12] FIG. 10 is a schematic diagram for explaining a third method for compressing the amount of data, which is applicable to the first embodiment. [Figure 13A] 10A and 10B are schematic diagrams showing an example of changing the compression rate of compressed RAW data depending on the target of authentication proof, which can be applied to the first embodiment. [Figure 13B] 10A and 10B are schematic diagrams showing an example of changing the compression rate of compressed RAW data depending on the target of authentication proof, which can be applied to the first embodiment. [Figure 14] FIG. 10 is a block diagram showing a configuration of an example of a sensor according to a second embodiment. [Figure 15] 10 is a sequence chart showing an example of a data output process according to the second embodiment. [Figure 16] FIG. 10 is a block diagram showing a configuration of an example of a sensor according to a third embodiment. [Figure 17] FIG. 10 is a block diagram showing a configuration of an example of a sensor according to a fourth embodiment. [Figure 18] FIG. 13 is a circuit diagram showing a configuration of an example of a voltage holding pixel applicable to the fifth embodiment. [Figure 19] FIG. 10 is a block diagram showing a configuration of an example of a sensor according to a fifth embodiment. [Figure 20] FIG. 13 is a block diagram showing a configuration of an example of a sensor according to a sixth embodiment. [Figure 21] FIG. 10 is a schematic diagram for explaining an example of authenticating an image. [Figure 22] FIG. 13 is a schematic diagram illustrating a system configuration for authenticating an image according to a seventh embodiment. [Figure 23] FIG. 13 is a diagram for schematically explaining image authentication according to the seventh embodiment. [Figure 24] FIG. 13 is a diagram for explaining a first comparison method based on edges (contours) of objects included in an image, which is applicable to the seventh embodiment. [Figure 25] FIG. 13 is a diagram for explaining a second comparison method that uses color information of an image and is applicable to the seventh embodiment. DETAILED DESCRIPTION OF THE INVENTION

[0009] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In the following embodiments, the same components are denoted by the same reference numerals, and redundant description will be omitted.

[0010] Hereinafter, embodiments of the present disclosure will be described in the following order. 1. Existing technologies 2. Technologies Applicable to Each Embodiment of the Present Disclosure 3. Overview of Each Embodiment of the Present Disclosure 4. First Embodiment of the Present Disclosure 4-1. Configuration according to the first embodiment 4-2. Data compression method applicable to the first embodiment 5. Second Embodiment of the Present Disclosure 6. Third Embodiment of the Present Disclosure 7. Fourth Embodiment of the Present Disclosure 8. Fifth Embodiment of the Present Disclosure 8-1. Example of pixel configuration 8-2. Configuration according to the fifth embodiment 9. Sixth Embodiment of the Present Disclosure 10. Seventh embodiment of the present disclosure 10-1. System configuration for determining the authenticity of an image according to the seventh embodiment 10-2. Image Comparison Processing According to the Seventh Embodiment

[0011] [1. Existing technology] First, prior to describing embodiments of the present disclosure, existing technologies related to the technology of the present disclosure will be described to facilitate understanding. In recent years, proving the authenticity of images published via the Internet by news media, SNS (Social Networking Service), etc. has become an issue. That is, in recent years, the development of image processing tools and fake (fabricated) image generation technology using AI (Artificial Intelligence) has made it difficult to prove the authenticity of images.

[0012] 1 and 2 are schematic diagrams showing examples of fake image generation using existing technology. For example, as shown in Fig. 1, a known technology creates image 301 by hiding the lower half of original image 300, predicts the lower half based on this image 301, and generates image 302a (fake image a) or image 302b (fake image b) that is different from image 302a.

[0013] Also, for video, there is known a technique that can delete only a moving object 304 included in frame 303a of the video shown in section (a) of Fig. 2. In this case, in frame 303b, which is temporally close to frame 303a shown in section (b), object 304 is deleted, and the position where object 304 should be is replaced with a road surface.

[0014] In these examples, if one does not know the original image 300 or frame 303a, it is difficult to determine whether images 302a and 302b and frame 303b are tampered with fake images, i.e., it is difficult to prove the authenticity of images 302a and 302b and frame 303b.

[0015] One known method for facilitating authentication of such images is to add a signature to the captured image, which becomes the original image, inside the sensor that acquires the captured image, and then encrypt the original image with the added signature.

[0016] FIG. 3A is a schematic diagram illustrating an example of the configuration of a camera using a sensor that adds signature data to image data and outputs the image data, according to existing technology.

[0017] 3A, the camera 2000 includes a sensor 2100 and an image processing unit 2120. The sensor 2100 includes a plurality of pixels arranged in a matrix, each generating a pixel signal in response to received light, and is configured, for example, by a single semiconductor chip (or a plurality of semiconductor chips bonded together). The sensor 2100 acquires RAW data frame by frame based on the pixel signals generated by each of the plurality of pixels in response to exposure. The RAW data is unprocessed data that has not undergone demosaic processing or the like on pixel data based on pixel signals.

[0018] The sensor 2100 generates signature data 2210 through signature generation processing 2111 based on RAW data 2200 acquired by the pixel array unit 2110. The sensor 2100 encrypts the RAW data 2200 with the generated signature data 2210 added thereto, using, for example, a private key 2112 in a public key cryptosystem. The encrypted data is output from the sensor 2100 and supplied to the image processing unit 2120. However, the sensor 2100 can also add sensor information 2220 to the encrypted data and supply it to the image processing unit 2120.

[0019] The image processing unit 2120 performs predetermined image processing such as demosaic processing, white balance processing, and image quality improvement processing on the RAW data included in the supplied data to generate visible image data, and then performs predetermined compression encoding processing on the image data to compress the data volume, and outputs the compressed image data as output image data 2230. In the example of Fig. 3A, the output image data 2230 is JPEG data obtained by compressing and encoding the image data using the JPEG (Joint Photographic Experts Group) method.

[0020] When performing image processing on the RAW data included in the supplied data, the image processing unit 2120 decrypts the encrypted data using a public key 2121 corresponding to the private key 2112. The RAW data 2200 included in the data input to the image processing unit 2120 can be proven to be data acquired by the sensor 2100 based on the signature data 2210 included in the decrypted data.

[0021] However, if the RAW data 2200 acquired by the sensor 2100 is subjected to image processing in the image processing unit 2120 to change the RAW data 2200, the signature data 2210 added to the RAW data 2200 by the sensor 2100 becomes meaningless.

[0022] That is, the signature data added by the sensor 2100 could only be used to authenticate the unaltered RAW data 2200. Therefore, with existing technology, it has been difficult to authenticate the output image data 2230 output from the image processing unit 2120 to determine whether it has been tampered with.

[0023] In existing technology, in order to authenticate the output image data 2230 output from the image processing unit 2120, it is conceivable to output RAW data 2200 to which signature data 2210 has been added together with the output image data 2230, as shown in Fig. 3B. The authenticity of the RAW data 2200 can be authenticated based on the signature data 2210. In addition, the authenticity of the output image data 2230 can be authenticated by comparing it with image data based on the RAW data 2200.

[0024] However, the RAW data 2200 generally has a larger data volume than the corresponding output image data 2230, which increases the load of data transfer.

[0025] In the present disclosure, the amount of data in the RAW data 2200 is compressed, signature data 2210 is added, and the data is further encrypted and output together with the output image data 2230. This makes it possible to reduce the load of data transfer when the output image data 2230 and the RAW data 2200 are output.

[0026] 2. Technologies Applicable to Each Embodiment of the Present Disclosure Next, techniques applicable to each embodiment of the present disclosure will be described. Fig. 4 is a block diagram showing a schematic configuration of an example of a camera applicable to each embodiment. In Fig. 4, camera 10 includes sensor 100, overall control unit 110, and image processing unit 120. Overall control unit 110 includes, for example, a CPU (Central Processing Unit) and memory, and controls the overall operation of camera 10 in accordance with a program stored in the memory.

[0027] The sensor 100 includes a pixel array unit 101 and a signature processing unit 1000. The pixel array unit 101 includes a plurality of pixels arranged in a matrix, each of which generates a pixel signal in response to light received by exposure, and acquires image data from each of the pixel signals generated by the plurality of pixels. The image data acquired by the pixel array unit 101 is unprocessed RAW data.

[0028] The signature processing unit 1000 compresses the RAW data acquired by the pixel array unit 101, and generates signature data based on the RAW data with the compressed data volume (referred to as compressed RAW data). The signature processing unit 1000 encrypts the compressed RAW data and the signature data.

[0029] The RAW data acquired by the pixel array unit 101 is supplied to the image processing unit 120 as data for image processing. The image processing unit 120 performs predetermined image processing on the supplied RAW data to generate visible image data. The visible image data generated by the image processing unit 120 is output from the camera 10 together with the compressed RAW data generated and encrypted by the signature processing unit 1000.

[0030] (Configuration example of pixel array section applicable to each embodiment) 5 is a block diagram showing an example of the configuration of a pixel array unit 101 applicable to each embodiment. In FIG. 5, the pixel array unit includes a pixel array 102, a vertical scanning unit 400, a horizontal scanning / AD conversion unit 402, and a control unit 401.

[0031] The pixel array 102 includes a plurality of pixels 103, each having an imaging element that generates a voltage corresponding to received light. A photodiode can be used as the imaging element. In the pixel array 102, the plurality of pixels 103 are arranged in a matrix in the horizontal direction (row direction) and the vertical direction (column direction). In the pixel array 102, the row direction arrangement of the pixels 103 is called a line. One frame of image (image data) is formed based on pixel signals read from a predetermined number of lines in the pixel array 102. For example, if one frame of image is formed with 3000 pixels x 2000 lines, the pixel array 102 includes at least 2000 lines, each including at least 3000 pixels 103. In the pixel array 102, the region including the pixels 103 used to form one frame of image is called the effective pixel region. The image data formed in the pixel array 102 is RAW data.

[0032] In addition, in the pixel array 102, pixel signal lines HCTL are connected to the rows and columns of the pixels 103 for each row, and vertical signal lines VSL are connected to the columns.

[0033] The end of the pixel signal line HCTL that is not connected to the pixel array 102 is connected to a vertical scanning unit 400. The vertical scanning unit 400 transmits a plurality of control signals, such as drive pulses used to read pixel signals from the pixels 103, to the pixel array 102 via the pixel signal line HCTL in accordance with a control signal supplied from, for example, a control unit 401. The end of the vertical signal line VSL that is not connected to the pixel array 102 is connected to a horizontal scanning / AD conversion unit 402.

[0034] The horizontal scanning / AD conversion unit 402 includes an AD (Analog to Digital) conversion unit, an output unit, and a signal processing unit. Pixel signals read from the pixels 103 are transmitted to the AD conversion unit of the horizontal scanning / AD conversion unit 402 via vertical signal lines VSL.

[0035] The following provides an overview of the control of reading out pixel signals from the pixels 103. Reading out pixel signals from the pixels 103 is performed by transferring charges accumulated in the image sensor by exposure to a floating diffusion layer (FD), and converting the transferred charges into a voltage in the floating diffusion layer. The voltage into which the charges are converted in the floating diffusion layer is output to the vertical signal line VSL via an amplifier.

[0036] More specifically, in the pixel 103, during exposure, the connection between the image sensor and the floating diffusion layer is turned off (open), and charges generated in response to incident light by photoelectric conversion are accumulated in the image sensor. After exposure is completed, the floating diffusion layer is connected to the vertical signal line VSL in response to a selection signal supplied via the pixel signal line HCTL. Furthermore, the floating diffusion layer is briefly connected to a power supply voltage VDD or a black level voltage supply line in response to a reset pulse supplied via the pixel signal line HCTL, thereby resetting the floating diffusion layer. A reset level voltage (referred to as voltage P) for the floating diffusion layer is output to the vertical signal line VSL. Thereafter, a transfer pulse supplied via the pixel signal line HCTL turns the connection between the image sensor and the floating diffusion layer on (closed), and the charges accumulated in the image sensor are transferred to the floating diffusion layer. A voltage (referred to as voltage Q) corresponding to the amount of charge in the floating diffusion layer is output to the vertical signal line VSL.

[0037] In the horizontal scanning AD conversion unit 402, the AD conversion unit includes an AD converter provided for each vertical signal line VSL, and pixel signals supplied from the pixels 103 via the vertical signal lines VSL are subjected to AD conversion processing by the AD converter, and two digital values ​​(values ​​corresponding to voltage P and voltage Q, respectively) are generated for correlated double sampling (CDS) processing, which performs noise reduction.

[0038] The two digital values ​​generated by the AD converter are subjected to CDS processing by the signal processing unit, and a pixel signal (pixel data) is generated as a digital signal. The generated pixel data is output from the pixel array unit.

[0039] The horizontal scanning / AD conversion unit 402 performs selective scanning to select the AD converters for each vertical signal line VSL in a predetermined order under the control of the control unit 401, thereby causing each AD converter to sequentially output the digital values ​​temporarily held therein to the signal processing unit. The horizontal scanning / AD conversion unit 402 achieves this operation by using a configuration including, for example, a shift register, an address decoder, etc.

[0040] The control unit 401 controls the driving of the vertical scanning unit 400, horizontal scanning / AD conversion unit 402, etc., in accordance with control signals from, for example, the overall control unit 16. The control unit 401 generates various drive signals that serve as references for the operation of the vertical scanning unit 400 and the horizontal scanning / AD conversion unit 402. The control unit 401 generates control signals that the vertical scanning unit 400 supplies to each pixel 103 via pixel signal lines HCTL, based on a vertical synchronization signal or an external trigger signal supplied from the outside (for example, the control unit 401) and a horizontal synchronization signal. The control unit 401 supplies the generated control signals to the vertical scanning unit 400.

[0041] Based on a control signal supplied from the control unit 401, the vertical scanning unit 400 supplies various signals including drive pulses to the pixel signal lines HCTL of a selected pixel row of the pixel array 102, to each pixel 103 for each line, and causes each pixel 103 to output a pixel signal to a vertical signal line VSL. The vertical scanning unit 400 is configured using, for example, a shift register, an address decoder, etc.

[0042] The pixel array unit configured in this manner is a column AD type CMOS (Complementary Metal Oxide Semiconductor) image sensor in which AD converters are arranged for each column.

[0043] (Outline of color filter arrangement) Each pixel 103 may be provided with an optical filter that selectively transmits light in a predetermined wavelength band. When the transmitted wavelength band is in the visible light region, the optical filter is called a color filter. Hereinafter, it is assumed that each pixel 103 is provided with a plurality of types of optical filters with different characteristics, specifically, color filters for the wavelength bands of red (R), green (G), and blue (B), which constitute the three primary colors. However, it is not limited to this, and color filters of colors that are complementary to each other may be provided with each pixel 103, or optical filters that selectively transmit light in the infrared wavelength band or optical filters that transmit light in all wavelength bands in the visible light region. Hereinafter, unless otherwise specified, these various optical filters will be described as color filters.

[0044] Fig. 6 is a diagram showing an example of a commonly used Bayer array. In Fig. 6, the Bayer array includes two pixels 103G, each having a G color filter, one pixel 103R having an R color filter, and a pixel 103B having a B color filter. In the Bayer array, these four pixels are arranged in a 2 pixel x 2 pixel grid so that no two pixels 103G are adjacent to each other. In other words, the Bayer array is an array in which pixels 103 having color filters that transmit light of the same wavelength band are arranged are not adjacent to each other.

[0045] In the following, unless otherwise specified, the "pixel 103R on which an R color filter is disposed" will be referred to as the "R pixel 103R" or simply as the "pixel 103R." The same applies to the pixel 103G on which a G color filter is disposed and the pixel 103B on which a B color filter is disposed. Furthermore, when the color filters are not of particular concern, the pixels 103R, 110G, and 110B will be described as being represented by the pixel 103.

[0046] (Structural example of pixel array section applicable to each embodiment) Next, an example of the structure of the pixel array section 101 applicable to each embodiment will be roughly described.

[0047] The pixel array unit 101 may be a CMOS image sensor (CIS) in which each unit included in the pixel array unit 101 is integrally formed using a CMOS (Complementary Metal Oxide Semiconductor). The pixel array unit 101 may be formed on a single substrate. However, the pixel array unit 101 may also be a stacked CIS in which multiple semiconductor chips are stacked and integrally formed. Note that the pixel array unit 101 is not limited to this example and may be another type of optical sensor, such as an infrared optical sensor that captures images using infrared light.

[0048] As an example, the pixel array unit 101 can be formed using a two-layer stacked CIS in which semiconductor chips are stacked in two layers. Fig. 7A is a diagram showing an example in which the pixel array unit 101 according to each embodiment is formed using a two-layer stacked CIS. In the structure of Fig. 7A, a pixel unit 3020a is formed in a first layer of semiconductor chips, and a memory + logic unit 3020b is formed in a second layer of semiconductor chips.

[0049] The pixel unit 3020a includes at least the pixel array 102 in the pixel array unit 101. The memory and logic unit 3020b can include, for example, a vertical scanning unit 400, a control unit 401, a horizontal scanning / AD conversion unit 402, and a signature processing unit 1000. The memory and logic unit 3020b can further include a memory for storing image data such as RAW data.

[0050] As shown on the right side of FIG. 7A, the pixel array section 101 is configured as one solid-state imaging element by bonding the semiconductor chip of the first layer and the semiconductor chip of the second layer together while making electrical contact with each other.

[0051] As another example, the pixel array unit 101 can be formed with a three-layer structure in which semiconductor chips are stacked in three layers. FIG. 7B is a diagram showing an example in which the pixel array unit 101 according to each embodiment is formed using a three-layer stacked CIS. In the structure of FIG. 7B, the pixel unit 3020a is formed in a semiconductor chip in the first layer, the memory unit 3020c is formed in a semiconductor chip in the second layer, and the logic unit 3020d is formed in a semiconductor chip in the third layer. In this case, the logic unit 3020d can include, for example, a vertical scanning unit 400, a control unit 401, a horizontal scanning / AD conversion unit 402, and a signature processing unit 1000. The memory unit 3020c can also include a memory for storing image data such as RAW data.

[0052] As shown on the right side of Figure 7B, the pixel array section 101 is constructed as a single solid-state imaging element by bonding the first layer semiconductor chip, the second layer semiconductor chip, and the third layer semiconductor chip together while maintaining electrical contact.

[0053] 3. Overview of Each Embodiment of the Present Disclosure Next, an overview of each embodiment of the present disclosure will be described. Fig. 8 is a schematic diagram for explaining the overview of each embodiment. The configuration shown in Fig. 8 corresponds to the configuration described using Fig. 4, and camera 10 includes a sensor 100 as an imaging device according to the present disclosure and an image processing unit 120. Furthermore, sensor 100 includes a pixel array unit 101 and a signature processing unit 1000. Note that overall control unit 110 is omitted from Fig. 8.

[0054] The pixel array unit 101 acquires RAW data 200 from pixel signals generated by a plurality of pixels in response to exposure. The RAW data 200 acquired by the pixel array unit 101 is based on pixel signals generated by all pixels included in the effective pixel area out of all pixels 103 included in the pixel array 102 in the pixel array unit 101.

[0055] The sensor 100 supplies the RAW data 200 acquired by the pixel array unit 101 to the image processing unit 120 as data for image processing. The image processing unit 120 performs demosaic processing on the supplied RAW data 200 to generate visible image data. The image processing unit 120 also performs image processing such as image quality improvement processing on the image data generated based on the RAW data, and performs compression encoding processing on the image-processed image data to generate output image data 230. The compression encoding method used by the image processing unit 120 can be, for example, the JPEG format.

[0056] The signature processing unit 1000 performs a data compression process on the RAW data acquired by the pixel array unit 101. The signature processing unit 1000 generates signature data 213 based on the RAW data (compressed RAW data 212) whose data volume has been compressed. For example, the signature processing unit 1000 generates a hash value based on the compressed RAW data 212 and uses the generated hash value as the signature data 213. The signature processing unit 1000 adds the generated signature data 213 to the compressed RAW data 212 to generate authentication proof data for authenticating the output image data 230.

[0057] The signature processing unit 1000 may acquire sensor information 211 from the sensor 100 and add the acquired sensor information 211 to the signature data 213 and the compressed RAW data 212 to generate the authentication proof data 210. The sensor information 211 may include, for example, identification information (such as a serial number) of the sensor 100 and information indicating the image capturing conditions. Alternatively, the signature processing unit 1000 may generate the signature data 213 for data that combines the sensor information 211 and the compressed RAW data 212 to generate the authentication proof data 210. By generating the signature data 213 in this way, including the sensor information 211, it is possible to prevent the sensor information 211 from being tampered with.

[0058] The authentication proof data 210 generated by the signature processing unit 1000 is associated with the output image data 230 generated by the image processing unit 120 and is output, for example, to the outside of the camera 10. Alternatively, the authentication proof data 210 and the output image data 230 can be associated with each other and stored in a non-volatile storage medium such as a flash memory included in the camera 10.

[0059] As described above, according to each embodiment of the present disclosure, the amount of RAW data 200 is compressed, and the compressed RAW data with the compressed amount of data is output in association with the visible compressed image data as data for authenticity proof. This reduces the load on the memory of the camera equipped with the sensor and the load during data transfer from the camera.

[0060] Here, the image data used for image processing by the image processing unit 120 needs to be high-quality data. Therefore, the image processing unit 120 is supplied with RAW data based on pixel signals generated by all pixels 103 included in the effective pixel area of ​​the pixel array 102. On the other hand, the authentication proof data 210 only needs to show that no objects have been added or deleted from the image based on the original RAW data. Therefore, compressed RAW data 212, which has been compressed in data volume, can be used as the authentication proof data 210.

[0061] As will be described in detail later, when authenticating the output image data 230, the size of the compressed RAW data 212 is converted to match the size of the output image data 230, and the size-converted compressed RAW data 212 is compared with the output image data 230.

[0062] 4. First Embodiment of the Present Disclosure Next, a first embodiment of the present disclosure will be described. The first embodiment is an example in which a sensor 100 has an output terminal that outputs RAW data 200 for image processing, and an output terminal that outputs authentication proof data 210 including compressed RAW data 212 and signature data 213.

[0063] (4-1. Configuration according to the first embodiment) First, the configuration according to the first embodiment will be described. Fig. 9 is a block diagram showing the configuration of an example of a sensor according to the first embodiment. In Fig. 9, a sensor 100a includes a pixel array unit 101, a signature processing unit 1000a, an output interface (I / F) 104, and a communication and sensor control unit 105.

[0064] The communication and sensor control unit 105 communicates with an external device, such as a host device, via the terminal 130. The communication and sensor control unit 105 also includes, for example, a processor and a memory, and the processor operates according to a program stored in the memory to control the overall operation of the sensor 100a.

[0065] 9, the pixel array unit 101 is shown to include a pixel array 102, a pixel control unit 107, and an ADC (Analog to Digital Converter) 108. Of these, the pixel control unit 107 corresponds to, for example, the vertical scanning unit 400 and the output unit in the horizontal scanning / AD conversion unit 402 shown in FIG. 5. The ADC 108 corresponds to the AD conversion unit in the horizontal scanning / AD conversion unit 402 shown in FIG. 5.

[0066] The signature processing unit 1000a includes data processing units 1010a and 1010b, a compression processing unit 1020, and a signature generation unit 1021. RAW data 200 output from the pixel array unit 101 is input to each of the data processing units 1010a and 1010b. The data processing unit 1010a performs predetermined data processing on the input RAW data 200 so that the input RAW data 200 can be subjected to image processing in a downstream image processing unit 120 (not shown). The RAW data 200 processed by the data processing unit 1010a is supplied to the output I / F 104.

[0067] The data processing unit 1010b performs predetermined data processing on the supplied RAW data 200 to generate authentication proof data 210.

[0068] The RAW data 200 that has been subjected to data processing by the data processing unit 1010b is supplied to the compression processing unit 1020. The compression processing unit 1020 performs compression processing (a specific example will be described later) on the supplied RAW data 200 to compress the data amount, thereby generating compressed RAW data 212. The compression processing unit 1020 supplies the generated compressed RAW data 212 to the output I / F 104 and the signature generation unit 1021.

[0069] The signature generation unit 1021 generates signature data 213 based on the supplied compressed RAW data 212. For example, the signature generation unit 1021 generates a hash value from the supplied compressed RAW data 212 and uses the generated hash value as the signature data 213. However, the signature generation unit 1021 can also use a value generated by another algorithm as the signature data 213, as long as the value can uniquely identify the compressed RAW data 212 and is difficult to guess. The signature generation unit 1021 supplies the generated signature data 213 to the output I / F 104.

[0070] The signature generation unit 1021 acquires the sensor information 211 from, for example, the communication and sensor control unit 105 , and further supplies the acquired sensor information 211 to the output I / F 104 .

[0071] The output I / F 104 includes two interfaces 131 and 132, and is capable of outputting two data streams in parallel from these interfaces 131 and 132. MIPI (Mobile Industry Processor Interface) can be applied as the interfaces 131 and 132. The output I / F 104 and the interfaces 131 and 132 constitute an output unit.

[0072] Specifically, the output I / F 104 outputs the RAW data 200 supplied from the data processing unit 1010a as is from the interface 131 (first output terminal).

[0073] Furthermore, the output I / F 104 adds the signature data 213 supplied from the signature generation unit 1021 to the compressed RAW data 212 supplied from the compression processing unit 1020. The output I / F 104 outputs the sensor information 211, the compressed RAW data 212, and the signature data 213 as authentication proof data 210 from the interface 132 (second output terminal). Note that the authentication proof data 210 can also be encrypted using a private key in a public key cryptosystem and output.

[0074] In this way, the sensor 100a according to the first embodiment outputs the RAW data 200 and the authentication proof data 210 from different interfaces 131 and 132. This prevents the output of the RAW data 200 and the authentication proof data 210 from being limited by the frame rate.

[0075] (4-2. Data Volume Compression Method Applicable to the First Embodiment) Next, a method for compressing the amount of data in the compression processing unit 1020 that can be applied to the first embodiment will be described.

[0076] 10 is a schematic diagram illustrating a first compression method of the data volume in the compression processing unit 1020, which is applicable to the first embodiment. In the first compression method, the compression processing unit 1020 calculates an arithmetic average of pixel data for each of a predetermined number of pixels 103 that are provided with color filters of the same color and are adjacent to each other in the arrangement of the pixels 103 in the pixel array 102. By calculating the arithmetic average of the pixel data for the predetermined number of pixels 103, the compression processing unit 1020 combines the predetermined number of pixels 103 into one pixel and generates compressed RAW data 212 in which the data volume of the RAW data 200 is compressed.

[0077] 10, the compression processing unit 1020 calculates the average of pixel data of pixels 103R1, 103R2, 103R3, and 103R4 that are adjacent to each other and that are provided with, for example, red color filters in the Bayer array shown in section (a). The compression processing unit 1020 calculates the average of pixel data of pixels 103R1 to 103R4. add The compression processing unit 1020 performs the same processing on the other pixels 103G and 103B, and generates the two pixels 103G add and pixel 103B add These pixels 103R add and two pixels 103G add and pixel 103B addand are arranged in a Bayer array to generate compressed RAW data 212. The compressed RAW data 212 is data obtained by compressing the data amount of the original RAW data 200 to 1 / 4.

[0078] According to the first compression method, color filters of the same color are provided, and the pixels of the compressed RAW data 212 are generated by calculating the average of pixel data of pixels that are close to each other, thereby compressing the amount of data in the RAW data 200 and reducing noise.

[0079] 11 is a schematic diagram for explaining a second compression method of the data amount in the compression processing unit 1020, which is applicable to the first embodiment. In the second compression method, the compression processing unit 1020 generates compressed RAW data 212 by thinning out the RAW data 200 in pixel units.

[0080] In the example of Fig. 11, the compression processing unit 1020 thins out the RAW data 200 shown in section (a) on a line-by-line basis as shown in section (b). At this time, the compression processing unit 1020 thins out every two lines in accordance with the repetitive pattern in the column direction of the Bayer array. Section (c) of Fig. 11 shows an example in which the thinned rows are filled up to form compressed RAW data 212. In this example, the compressed RAW data 212 is data obtained by compressing the data volume of the original RAW data 200 to half.

[0081] According to this second compression method, no calculation is required when compressing the amount of data in the RAW data 200, thereby reducing the load on the compression processing unit 1020. Furthermore, according to this second compression method, it is also possible to reduce the number of AD conversions in the ADC 108.

[0082] 12 is a schematic diagram illustrating a third data compression method in the compression processing unit 1020, which is applicable to the first embodiment. In the third compression method, the data amount is compressed for each pixel based on a predetermined compression algorithm. More specifically, the compression processing unit 1020 generates compressed RAW data 212 by reducing the number of bits of pixel data for each pixel in the RAW data 200 based on the predetermined compression algorithm. The compressed RAW data 212 is data in which the data amount of the RAW data 200 is compressed by the amount of the reduction in the number of bits of each pixel data in the RAW data 200.

[0083] As an example, assume that the number of bits for each pixel data in the RAW data 200 is 12 bits. Section (a) of Fig. 12 shows an example in which the number of bits for each pixel data is reduced from 12 bits to 8 bits, and section (b) shows an example in which the number of bits is reduced from 12 bits to 6 bits. In the example of section (a), the compressed RAW data 212 is data obtained by compressing the data volume of the original RAW data 200 to 2 / 3. In addition, in the example of section (b), the compressed RAW data 212 is data obtained by compressing the data volume of the original RAW data 200 to 1 / 2.

[0084] There are several possible methods for reducing the number of bits of pixel data. A first method is to delete the lower bits of each pixel data in the RAW data 200. In the example of section (a) in FIG. 12, the lower four bits of the 12-bit pixel data in the RAW data 200 are deleted, resulting in 8-bit pixel data where the 4th bit of the pixel data becomes the 0th bit. In the example of section (b), the lower six bits of the 12-bit pixel data in the RAW data 200 are deleted, resulting in 6-bit pixel data where the 6th bit of the pixel data becomes the 0th bit.

[0085] A second method for reducing the number of bits in pixel data involves performing a gradation compression process on the RAW data 200 and then deleting the lower bits, similar to the first method described above. Gamma correction can be applied as the gradation compression process. While the first method described above loses information in areas with low contrast, gradation compression can compensate for this loss of information.

[0086] A third method for reducing the number of bits of pixel data is to use the continuity of the image. In this third method, for example, the first pixel (such as the first pixel of a line) is used as a reference and the difference in pixel data between adjacent pixels is calculated sequentially according to the pixel arrangement, thereby reducing the number of bits. As this third method, it is possible to apply a compression algorithm specified in MIPI (Mobile Industry Processor Interface).

[0087] The method for reducing the amount of data for each pixel is not limited to the above-mentioned methods 1 to 3. It is also possible to combine the above-mentioned first or second method with the third method.

[0088] The compression ratio of the compressed RAW data 212 can be changed depending on the target of authentication verification. Figures 13A and 13B are schematic diagrams showing an example of changing the compression ratio of the compressed RAW data 212 depending on the target of authentication verification, which is applicable to the first embodiment.

[0089] 13A shows an example in which, as a target of authentication verification, it is determined whether an object 34 included in an image 33 has been deleted or added. In such a case where a large change in the image 33 is to be detected, the compression ratio of the compressed RAW data 212 can be increased. In other words, in this case, the data size of the compressed RAW data 212 can be further reduced.

[0090] 13B shows an example in which the face of a person 36 included in an image 35 is determined as the subject of authentication verification. For example, if it is desired to verify that the face of person 36 is genuine (not tampered with), the image can only be compressed to a size (resolution) that allows verification that the face has not been tampered with. Therefore, in this case, the compression rate of the compressed RAW data 212 is set lower than when deleting or adding the object 34 described above.

[0091] A specific example of changing the compression rate of the compressed RAW data 212 depending on the object of authentication verification will be described using the example of the third data volume compression method described above. When determining whether an object 34 included in an image 33 has been deleted or added as the object of authentication verification, the example shown in section (b) of Fig. 12 can be applied, and when determining the face of a person 36, the example shown in section (a) of Fig. 12 can be applied.

[0092] In the sensor 100a, the compression rate of the compressed RAW data 212 may be fixed, and a level at which tampering can be determined may be presented when authenticating the output image data 230 externally based on the compressed RAW data 212. The level at which tampering can be determined depends on, for example, whether it is guaranteed that there is no major tampering, such as the deletion or addition of an object to the image, or whether it is guaranteed that the face is the same as the original RAW data 200 by facial recognition or the like. For example, it is conceivable that, in the authenticity proof data 210, information indicating the compression rate of the compressed RAW data 212 is included in the sensor information 211.

[0093] 5. Second Embodiment of the Present Disclosure Next, a second embodiment of the present disclosure will be described. In the above-described first embodiment, the RAW data 200 and the authentication proof data 210 are output from different interfaces 131 and 132. In contrast, in the second embodiment, the RAW data 200 and the authentication proof data 210 are output from a single interface. In this case, in the second embodiment, the RAW data 200 and the authentication proof data 210 are output in a time-division manner on a line-by-line basis.

[0094] Fig. 14 is a block diagram showing an example of the configuration of a sensor according to the second embodiment. In Fig. 14, the sensor 100b has one interface 131 for the output I / F 104 to output data. In addition, the sensor 100b has an arbiter 1030 having a line memory 1031 inserted between the signature processing unit 1000b and the output I / F 104.

[0095] 14, the lines of the pixel array 102 are indicated as lines L#1, L#2, .... The data processing units 1010a and 1010b output data for each line L#1, L#2, ... from the ADC 108 of the pixel array unit 101 in line sequence. The data for each line L#1, L#2, ... output from the pixel array unit 101 is supplied to the data processing units 1010a and 1010b, respectively.

[0096] The data processing unit 1010a performs predetermined data processing on the supplied line data and supplies the data to the arbiter 1030. The arbiter 1030 stores the line data supplied from the data processing unit 1010a in a line memory 1031.

[0097] The data processing unit 1010b performs predetermined data processing on the supplied line data and supplies the result to the compression processing unit 1020. The compression processing unit 1020 performs compression processing on the supplied line data in the line direction to compress the amount of data, and supplies the line data with the compressed amount of data to the arbiter 1030 and the signature generation unit 1021. The signature generation unit 1021 generates signature data 213 based on the supplied line data and supplies the generated signature data to the arbiter 1030.

[0098] The arbiter 1030 arbitrates the output timing of the line data based on RAW data supplied from the data processing unit 1010b and stored in the line memory 1031, the line data compressed in the line direction supplied from the compression processing unit 1020, and the signature data supplied from the signature generation unit 1021. The arbiter 1030 outputs the line data based on RAW data stored in the line memory 1031 in line order. At the same time, the arbiter 1030 outputs multiple lines of signature data and compressed line data in accordance with the output timing for each predetermined line of the line data based on RAW data.

[0099] Each data output from the arbiter 1030 is supplied to the output I / F 104 and output from the interface 131 .

[0100] Fig. 15 is a sequence chart showing an example of data output processing according to the second embodiment. From the top, Fig. 15 shows a line synchronization signal related to the output of the ADC 108, line data output from the ADC 108, a line synchronization signal related to the output of the arbiter 1030 (output I / F 104), and each piece of data output from the sensor 100b (arbiter 1030). The synchronization cycle of the line synchronization signal related to the output of the ADC 108 corresponds to the cycle of the horizontal synchronization signal Hsync in the pixel array unit 101.

[0101] Line data L#1, L#2, ... are sequentially output from the ADC 108 for each horizontal synchronization signal Hsync. Each piece of line data L#1, L#2, ... is output in a time shorter than the period of the line synchronization signal related to the output of the ADC 108. For example, line data L#1 output from the ADC 108 is supplied to the arbiter 1030 via the data processing unit 1010a and stored in the line memory 1031. When the next line data L#2 is output from the ADC 108, the arbiter 1030 reads the line data L#1 from the line memory 1031 in accordance with the output line synchronization signal and supplies it to the output I / F 104, and stores the line data L#2 in the line memory 1031.

[0102] When the next line data L#3 is output from the ADC 108, the arbiter 1030 reads out line data L#2 from the line memory 1031 and supplies it to the output I / F 104 in accordance with the output line synchronization signal.

[0103] The compression processing unit 1020 compresses the line data L#3 supplied from the ADC 108 and the line data L#1 already supplied from the ADC 108 in the horizontal direction, and supplies the compressed line data L#1 and L#3 to the arbiter 1030 and the signature generation unit 1021. The signature generation unit 1021 generates signature data 213 for each of the line data L#1 and L#3 based on the compressed and supplied line data L#1 and L#3. The arbiter 1030 supplies the compressed line data L#1 and L#3 supplied from the compression processing unit 1020 and the signature data 213 generated based on the line data L#1 and L#3 supplied from the signature generation unit 1021 to the output I / F 104 as authentication proof data 210 for the line data L#1 and L#3 in accordance with the output line synchronization signal.

[0104] Here, the output line synchronization signal is set so as to output two lines of line data of RAW data, two lines of signature data, and compressed line data during a two-line period of the line synchronization signal related to the output of the ADC 108. In this way, the sensor 100b according to the second embodiment sets the line synchronization signal related to the output of the ADC 108 and the line synchronization signal for output, and the arbiter 1030 arbitrates the output timing of the two lines of line data of RAW data, and the two lines of signature data and compressed line data.

[0105] This allows the sensor 100b according to the second embodiment to output RAW data and authentication proof data from one interface 131. Furthermore, the sensor 100b according to the second embodiment can generate signature data from the same data as the output RAW data without using a frame memory.

[0106] In the configuration of the second embodiment, the output control becomes complicated, and therefore the operation of the sensor 100b may become rate-determining due to the output band.

[0107] 6. Third Embodiment of the Present Disclosure Next, a third embodiment of the present disclosure will be described. The third embodiment of the present disclosure is an example in which a sensor has a frame memory, and this frame memory is used to output RAW data 200 and authentication proof data 210 from a single interface.

[0108] Fig. 16 is a block diagram showing an example of the configuration of a sensor according to the third embodiment. In Fig. 16, the sensor 100c has one interface 131 through which the output I / F 104 outputs data. In addition, the sensor 100c has a frame memory 1040 inserted immediately after the compression processing unit 1020 in the signature processing unit 1000c, and a selector 1050 provided in the output unit of the signature processing unit 1000c. Furthermore, the sensor 100c has a data processing unit 1010 in the signature processing unit 1000c that performs predetermined data processing on the RAW data 200 supplied from the pixel array unit 101, both for the RAW data 200 to be output and for the RAW data 200 to generate the authentication proof data 210.

[0109] 16, RAW data 200 output from the pixel array unit 101 undergoes predetermined data processing in a data processing unit 1010 and is supplied to a selector 1050 and a compression processing unit 1020. The compression processing unit 1020 performs compression processing on the supplied RAW data 200 to reduce the amount of data, thereby generating compressed RAW data 212. The compression processing unit 1020 stores the generated compressed RAW data 212 in a frame memory 1040. The frame memory 1040 only needs to have a capacity large enough to store at least one frame's worth of compressed RAW data 212.

[0110] The compressed RAW data 212 read from the frame memory 1040 is supplied to the selector 1050 and the signature generation unit 1021. The signature generation unit 1021 generates signature data 213 based on the supplied compressed RAW data 212, and supplies the generated signature data 213 to the selector 1050.

[0111] The selector 1050, under the control of the communication / sensor control unit 105, selects the data to be output from the RAW data 200 supplied from the data processing unit 1010, the compressed RAW data 212 supplied from the frame memory 1040, and the signature data 213 supplied from the signature generation unit 1021, and supplies the selected data to the output I / F 104.

[0112] For example, the selector 1050 first selects the RAW data 200 supplied from the data processing unit 1010, and supplies one frame of the RAW data 200 to the output I / F 104. The output I / F 104 outputs the supplied one frame of the RAW data 200 from the interface 131.

[0113] Next, the selector 1050 selects the compressed RAW data 212 supplied from, for example, the frame memory 1040 and supplies it to the output I / F 104, and further supplies the signature data 213 supplied from the signature generation unit 1021 to the output I / F 104. The output I / F 104 compiles the compressed RAW data 212, the signature data 213, and, for example, sensor information 211 acquired from the communication and sensor control unit 105, and outputs the collected data as authentication proof data 210 from the interface 131.

[0114] As described above, the sensor 100c according to the third embodiment requires the frame memory 1040, but the output control is simplified.

[0115] 7. Fourth Embodiment of the Present Disclosure Next, a fourth embodiment of the present disclosure will be described. The fourth embodiment of the present disclosure is an example in which a sensor has a frame memory, and this frame memory is used to output RAW data 200 and authentication proof data 210 from a single interface. The fourth embodiment differs from the above-described third embodiment in that the frame memory is placed before the data processing unit 1010.

[0116] Fig. 17 is a block diagram showing an example of the configuration of a sensor according to the fourth embodiment. In Fig. 17, sensor 100d has one interface 131 for outputting data from output I / F 104, similar to sensor 100c shown in Fig. 16. On the other hand, sensor 100d has frame memory 1041 and selector 1051 provided on the input side of data processing unit 1010 in signature processing unit 1000d.

[0117] The RAW data 200 output from the pixel array unit 101 is supplied to the selector 1051 and stored in the frame memory 1041. The selector 1051, under the control of the communication and sensor control unit 105, selects the RAW data 200 to be output from the RAW data 200 output from the pixel array unit 101 and the RAW data 200 read from the frame memory 1041, and supplies the selected RAW data 200 to the data processing unit 1010. The data processing unit 1010 performs predetermined data processing on the supplied RAW data 200, and supplies the selected RAW data 200 to the selector 1050 and the compression processing unit 1020.

[0118] The compression processing unit 1020 performs compression processing on the supplied RAW data 200 to compress the data volume, and generates compressed RAW data 212. The compression processing unit 1020 supplies the generated compressed RAW data 212 to the selector 1050 and the signature generation unit 1021. The signature generation unit 1021 generates signature data 213 based on the supplied compressed RAW data 212, and supplies the generated signature data 213 to the selector 1050.

[0119] The selector 1050, under the control of the communication / sensor control unit 105, selects the data to be output from the RAW data 200 supplied from the data processing unit 1010, the compressed RAW data 212 supplied from the frame memory 1040, and the signature data 213 supplied from the signature generation unit 1021, and supplies the selected data to the output I / F 104.

[0120] For example, the selector 1050 first selects the RAW data 200 supplied from the data processing unit 1010, and supplies one frame of the RAW data 200 to the output I / F 104. The output I / F 104 outputs the supplied one frame of the RAW data 200 from the interface 131.

[0121] Next, the selector 1050 selects the compressed RAW data 212 supplied from, for example, the frame memory 1040 and supplies it to the output I / F 104, and further supplies the signature data 213 supplied from the signature generation unit 1021 to the output I / F 104. The output I / F 104 compiles the compressed RAW data 212, the signature data 213, and, for example, sensor information 211 acquired from the communication and sensor control unit 105, and outputs the collected data as authentication proof data 210 from the interface 131.

[0122] Here, when the compression processing unit 1020 performs data volume compression processing and the signature generation unit 1021 performs signature data 213 generation processing, the selector 1051 selects the RAW data 200 read from the frame memory 1041 under the control of the communication and sensor control unit 105. In response to the selection by the selector 1051, the selector 1050 selects the output of the compression processing unit 1020 and also selects the output of the signature generation unit 1021 under the control of the communication and sensor control unit 105.

[0123] On the other hand, when the selector 1050 selects the output of the data processing unit 1010 , the selector 1051 selects the output of the pixel array unit 101 under the control of the communication and sensor control unit 105 .

[0124] 17, the signature processing unit 1000d is provided with a frame memory 1041, but this is not limited to this example. For example, if the pixel array unit 101 is provided with a frame memory for other processing, this frame memory may be used as the frame memory 1041. For example, in a pseudo-global shutter configuration, a frame memory is provided for storing pixel data read out at high speed in the pixel array unit 101, and pixel data may be read out from this frame memory over, for example, one frame period. The frame memory in this pseudo-global shutter may be used as the frame memory 1041.

[0125] 8. Fifth Embodiment of the Present Disclosure Next, a fifth embodiment of the present disclosure will be described. The fifth embodiment is an example in which reading of the RAW data 200 for output from the pixel array unit 101 and reading of the RAW data 200 for authentication proof data 210 are performed at different times. In this case, the fifth embodiment is an example in which voltage-holding type pixels are used as each of the pixels 103 included in the pixel array unit 101. Voltage-holding type pixels hold pixel signals generated by exposure, and therefore, pixel signals generated by one exposure can be read multiple times.

[0126] (8-1. Example of pixel configuration) 18 is a circuit diagram showing an example of the configuration of a voltage holding pixel 103VD applicable to Embodiment 5. In FIG. 18, the pixel 103VD includes a pre-stage circuit 510, capacitive elements 521 and 322, a selection circuit 530, a post-stage reset transistor 541, and a post-stage circuit 550.

[0127] The pre-stage circuit 510 includes a photoelectric conversion element 511 , a transfer transistor 512 , an FD (Floating Diffusion) reset transistor 513 , an FD 514 , a pre-stage amplification transistor 515 , and a current source transistor 516 .

[0128] The photoelectric conversion element 511 generates electric charges by photoelectric conversion. The transfer transistor 512 transfers electric charges from the photoelectric conversion element 511 to the FD 514 in accordance with a transfer signal trg from the vertical scanning unit 400.

[0129] The FD reset transistor 513 extracts charge from the FD 514 to initialize it in accordance with an FD reset signal rst from the vertical scanning unit 400. The FD 514 accumulates charge and generates a voltage according to the amount of charge. The pre-amplification transistor 515 amplifies the voltage level of the FD 514 and outputs it to the pre-stage node 520.

[0130] The drains of the FD reset transistor 513 and the pre-amplification transistor 515 are connected to a power supply voltage VDD. The current source transistor 516 is connected to the source of the pre-amplification transistor 515. The current source transistor 516 supplies a current id1 under the control of the vertical scanning unit 400.

[0131] One end of each of the capacitive elements 521 and 522 is commonly connected to the previous-stage node 520 , and the other end of each is connected to the selection circuit 530 .

[0132] The selection circuit 530 includes a selection transistor 531 and a selection transistor 532. The selection transistor 531 receives a selection signal Φ r The selection transistor 532 opens and closes the path between the capacitance element 521 and the subsequent node 540 in response to a selection signal Φ s In accordance with this, the path between the capacitive element 522 and the subsequent node 540 is opened or closed.

[0133] The subsequent-stage reset transistor 541 initializes the level of the subsequent-stage node 540 to a predetermined potential Vreg in accordance with a subsequent-stage reset signal rstb from the vertical scanning unit 400. A potential different from the power supply potential VDD (for example, a potential lower than VDD) is set to the potential Vreg.

[0134] The subsequent circuit 550 includes a subsequent amplifier transistor 551 and a subsequent selection transistor 552. The subsequent amplifier transistor 551 amplifies the level of the subsequent node 540. The subsequent selection transistor 552 outputs the signal having the level amplified by the subsequent amplifier transistor 551 as a pixel signal to the vertical signal line VSL in accordance with a subsequent selection signal selb from the vertical scanning unit 400.

[0135] It should be noted that, for example, nMOS (n-channel Metal Oxide Semiconductor) transistors are used as various transistors (such as the transfer transistor 512) in the pixel 103VD.

[0136] At the start of exposure, the vertical scanning unit 400 supplies a high-level FD reset signal rst and a transfer signal trg to all pixels, thereby initializing the photoelectric conversion elements 511. Hereinafter, this control will be referred to as "PD reset."

[0137] Then, just before the end of exposure, the vertical scanning unit 400 outputs the subsequent reset signal rstb and the selection signal Φ r is set to high level, and a high-level FD reset signal rst is supplied over the pulse period. This initializes the FD 514, and a level corresponding to the level of the FD 514 at that time is held in the capacitive element 521. This control is hereinafter referred to as "FD reset."

[0138] The level of the FD 514 when the FD is reset and the level corresponding to that level (the retention level of the capacitive element 521 and the level of the vertical signal line VSL) will hereinafter be collectively referred to as a "P phase" or a "reset level."

[0139] At the end of exposure, the vertical scanning unit 400 outputs the subsequent reset signal rstb and the selection signal Φ sis set to high level, and a high-level transfer signal trg is supplied over the pulse period. As a result, a signal charge according to the amount of exposure is transferred to the FD 514, and a level according to the level of the FD 514 at that time is held in the capacitive element 522.

[0140] The level of the FD 514 when transferring the signal charge and the level corresponding to that level (the level held by the capacitive element 522 and the level of the vertical signal line VSL) will hereinafter be collectively referred to as the "D phase" or "signal level."

[0141] This type of exposure control, in which exposure starts and ends simultaneously for all pixels, is called a global shutter system. This exposure control causes the front-end circuits 510 of all pixels to sequentially generate reset levels and signal levels. The reset levels are held in capacitance elements 521, and the signal levels are held in capacitance elements 522.

[0142] After the exposure is completed, the vertical scanning unit 400 sequentially selects rows and outputs the reset level and signal level of the selected rows. When outputting the reset level, the vertical scanning unit 400 sets the FD reset signal rst and the subsequent selection signal selb of the selected row to high level, and sets the selection signal Φ r is supplied for a predetermined period of time, whereby the capacitive element 521 is connected to the subsequent node 540, and the reset level is read out.

[0143] After reading out the reset level, the vertical scanning unit 400 supplies a high-level subsequent-stage reset signal rstb for the pulse period while keeping the FD reset signal rst and subsequent-stage selection signal selb of the selected row at a high level. This initializes the level of the subsequent-stage node 540. At this time, both the selection transistor 531 and the selection transistor 532 are in an open state, and the capacitance elements 521 and 522 are disconnected from the subsequent-stage node 540.

[0144] After initializing the subsequent node 540, the vertical scanning unit 400 supplies a high-level selection signal Φs for a predetermined period while keeping the FD reset signal rst and subsequent selection signal selb of the selected row at high level, thereby connecting the capacitive element 522 to the subsequent node 540 and reading out the signal level.

[0145] Through the above-described readout control, the selection circuit 530 for the selected row sequentially performs control to connect the capacitive element 521 to the subsequent node 540, control to disconnect the capacitive elements 521 and 322 from the subsequent node 540, and control to connect the capacitive element 522 to the subsequent node 540. When the capacitive elements 521 and 322 are disconnected from the subsequent node 540, the subsequent reset transistor 541 for the selected row initializes the level of the subsequent node 540. The subsequent circuit 550 for the selected row sequentially reads out the reset level and the signal level from the capacitive elements 521 and 522 via the subsequent node 540 and outputs them to the vertical signal line VSL. A pixel signal can be obtained based on the difference between these signal levels and the reset level.

[0146] In this way, in the voltage holding pixel 103VD, the reset level and signal level are held in the capacitive elements 521 and 522. Therefore, the pixel 103VD can read out the reset level and signal level multiple times from the capacitive elements 521 and 522, and obtain the pixel signals. Note that the pixel signals are generated based on the reset level and signal levels held in the capacitive elements 521 and 522, and therefore can be considered to be held in the pixel 103VD.

[0147] (8-2. Configuration according to the fifth embodiment) Next, a configuration example of a sensor according to the fifth embodiment will be described. Fig. 19 is a block diagram showing the configuration of an example of a sensor according to the fifth embodiment. In Fig. 19, a sensor 100e includes a pixel array unit 101VD and a signature processing unit 1000e. The pixel array unit 101VD includes a pixel array 102VD using the above-mentioned pixel 103VD, and a pixel control unit 107VD for driving the pixel 103VD.

[0148] The RAW data 200 output from the pixel array unit 101VD is input to the signature processing unit 1000e and supplied to the data processing unit 1010. The data processing unit 1010 performs predetermined data processing on the supplied RAW data 200 and supplies the data to the selector 1050 and the compression processing unit 1020.

[0149] The compression processing unit 1020 performs compression processing on the supplied RAW data 200 to compress the data volume, and generates compressed RAW data 212. The compression processing unit 1020 supplies the generated compressed RAW data 212 to the selector 1050 and the signature generation unit 1021. The signature generation unit 1021 generates signature data 213 based on the supplied compressed RAW data 212, and supplies the generated signature data 213 to the selector 1050.

[0150] The selector 1050, under the control of the communication and sensor control unit 105, selects data to be output from the RAW data 200 supplied from the data processing unit 1010, the compressed RAW data 212 supplied from the frame memory 1040, and the signature data 213 supplied from the signature generation unit 1021, and supplies the selected data to the output I / F 104. The output I / F 104 outputs the supplied data from the interface 131.

[0151] Here, the pixel 103VD can read out a pixel signal generated by a single exposure multiple times. However, the quality of the pixel signal read out from the pixel 103VD deteriorates each time it is read out due to noise caused by the switch. Although image quality is not important for the authentication proof data 210, it is possible to reduce noise by, for example, compressing the data volume in the compression processing unit 1020 and calculating the arithmetic mean of the pixel data.

[0152] Taking into account the characteristics of these pixels 103VD, the sensor 100e selects RAW data 200 based on the pixel signals read out first for one exposure using the selector 1050 and outputs it from the interface 131 (1st). Next, the sensor 100e selects compressed RAW data 212, which is obtained by compressing the amount of data in the compression processing unit 1020 for the RAW data 200 based on the pixel signals read out again for that exposure, and signature data 213, which is generated by the signature generation unit 1021 based on the compressed RAW data 212, using the selector 1050, and outputs the selected data as authentication proof data 210 by adding sensor information 211 (2nd).

[0153] As described above, in the fifth embodiment, the RAW data 200 based on the pixel signals first read out from each pixel 103VD for one exposure is output from the interface 131. Next, compressed RAW data 212 and signature data 213 are generated based on pixel signals read out again from each pixel 103VD for that exposure, and the authentication proof data 210 is output. This makes it possible to output the RAW data 200 with high quality, and also to output the authentication proof data 210 based on pixel signals generated again by the same exposure as the RAW data 200.

[0154] Furthermore, since the reset level and signal level of each pixel 103VD are held in the capacitance elements 521 and 522, the entire pixel array 102VD can be regarded as a frame memory, and there is no need to provide a separate frame memory.

[0155] 9. Sixth Embodiment of the Present Disclosure Next, a sixth embodiment of the present disclosure will be described. The sixth embodiment is an example in which two frames of image data are captured consecutively. In this case, for example, RAW data 200 obtained by the first image capture is output from the interface 131. Next, compressed RAW data 212 and signature data 213 are generated based on the RAW data 200 obtained by the second image capture, and output as authentication proof data 210. Assuming that there are no sudden scene changes in the subject, the two consecutively captured images can be considered to be identical, and the authentication proof data 210 based on the second image capture can be used to authenticate the RAW data 200 based on the first image capture.

[0156] Fig. 20 is a block diagram showing an example of the configuration of a sensor according to the sixth embodiment. The sensor 100f shown in Fig. 20 has the same configuration as the sensor 100e shown in Fig. 19, except that the pixel array section 101 uses pixels 103 that are not voltage holding type.

[0157] 20, the sensor 100f outputs RAW data 200 captured in the n-th frame (Frame#n) from the interface 131. Then, the sensor 100f adds sensor information 211 to compressed RAW data 212 based on the RAW data 200 captured in the next (n+1)-th frame, and signature data 213 generated based on the compressed RAW data 212, and outputs the compressed RAW data 212, along with sensor information 211, as authentication proof data 210 from the interface 131.

[0158] However, the present invention is not limited to this example, and the sensor 100f may output the authentication proof data 210 in the n-th frame and output the RAW data 200 in the next (n+1)-th frame.

[0159] As described above, in the sixth embodiment, the sensor 100f separates the imaging for outputting the RAW data 200 from the imaging for generating and outputting the authentication proof data 210. Therefore, even in a configuration in which the RAW data 200 and the authentication proof data 210 are output from a single interface 131, there is no need to provide a frame memory.

[0160] 10. Seventh Embodiment of the Present Disclosure Next, a seventh embodiment of the present disclosure will be described. The seventh embodiment is an example in which the authenticity of output image data 230 is authenticated using the authenticity certification data 210 output from the camera 10 (sensors 100a to 100f) in the first to sixth embodiments described above.

[0161] (10-1. System configuration for authenticating images according to the seventh embodiment) A system configuration for authenticating an image according to a seventh embodiment will be described in brief. FIG. 21 is a schematic diagram illustrating an example of image authentication. Output image data 230 output from a camera 10 to which each embodiment is applied is ultimately authenticated by a person (organization) who publishes the output image data 230, or a person (organization) who makes an evidential judgment based on the output image data 230. This authentication is performed by comparing an image based on the output image data 230 with an image based on the compressed RAW data 212 included in the authentication data 210 associated with the output image data 230 and output from the camera 10.

[0162] The output image data 230 is made public by news media 50 such as a newspaper, television station, or news site. The news media 50 or a third-party organization acquires the output image data 230 and the authentication proof data 210 corresponding to the output image data 230, and makes public the output image data 230 that has been certified as genuine (not tampered with) based on the compressed RAW data 212 included in the authentication proof data 210, for example, as a news image.

[0163] In another example, the output image data 230 is made public to account holders via a social networking service (SNS). The SNS administrator 51 or a third-party organization acquires the output image data 230 and the authentication proof data 210 corresponding to the output image data 230, and posts the output image data 230, which has been certified as genuine (not tampered with) based on the compressed RAW data 212 included in the authentication proof data 210, on the SNS with a guarantee that it is genuine (not tampered with).

[0164] In yet another example, the output image data 230 is used as an evidence image or a certification image by a public institution 52. In this case, the public institution 52 may be a court or a passport-issuing authority (such as the Ministry of Foreign Affairs). The public institution 52 will only recognize, as an official document, an image based on the output image data 230 that is associated with the signature data 213 and that has been certified as authentic (not tampered with).

[0165] FIG. 22 is a schematic diagram illustrating the configuration of a system for authenticating an image according to the seventh embodiment.

[0166] 22, the camera 10 outputs output image data 230 and authentication proof data 210. Of these, compressed RAW data 212 and signature data 213 included in the authentication proof data 210 are transmitted to a cloud computing service 60 via the Internet, for example, and stored on a server within the cloud computing service 60. A news media 50, an SNS administrator 51, or a public institution 52 can access the cloud computing service 60 and obtain the compressed RAW data 212 and signature data 213 stored on the server.

[0167] On the other hand, signature data 213 corresponding to the output image data 230 and association data 214 indicating an association between the output image data 230 and the compressed RAW data 212 corresponding to the output image data 230 are added to the output image data 230, and the resulting data is passed to a news media 50, an SNS administrator 51, or a public institution 52 as authentication proof data 240. At this time, the authentication proof data 240 is linked in an unalterable state to authentication proof data 240 corresponding to other output image data 230 using known technology such as blockchain.

[0168] The news media 50, the SNS administrator 51, or the public institution 52 acquires the desired authentication proof data 240 from each of these linked authentication proof data 240. Based on the association data 214 included in the acquired authentication proof data 240, the news media 50, the SNS administrator 51, or the public institution 52 acquires the compressed RAW data 212 and the signature data 213 corresponding to the authentication proof data 240, which are stored on a server within the cloud computing service 60.

[0169] Based on the signature data 213 obtained from the cloud computing service 60, the news media 50, the SNS administrator 51, or the public institution 52 confirms that the compressed RAW data 212 obtained along with the signature data 213 has not been tampered with.

[0170] 23, the news media 50, the SNS administrator 51, or the public institution 52 compares the compressed RAW data 212, which has been confirmed to be unaltered based on the signature data 213, with the output image data 230 included in the acquired authentication proof data 240, and certifies the authenticity of the output image data 230. For example, the news media 50, the SNS administrator 51, or the public institution 52 calculates the similarity between the compressed RAW data 212 and the output image data 230, and certifies the authenticity of the output image data 230 based on the calculated similarity.

[0171] The news media 50, the SNS administrator 51, or the public institution 52 publishes the output image data 230 that has been certified as genuine (not tampered with) by this authentication, or uses the output image data as an evidence image or proof image.

[0172] (10-2. Image Comparison Processing According to the Seventh Embodiment) Next, a more specific description will be given of the comparison process between the output image data 230 and the compressed RAW data 212 according to the seventh embodiment. There are various possible methods for comparing images, but here, as examples of the image comparison method, a first comparison method based on the edges (contours) of objects included in the images and a second comparison method that also uses color information of the images will be described.

[0173] (Regarding the first comparison method) The first comparison method will be described below. In the first comparison method, when a comparison is performed, first, a process is performed to adjust the size of the image based on the compressed RAW data 212 to the size of the image based on the output image data 230, which is the target of authentication verification.

[0174] For example, when the compressed RAW data 212 is compressed by the first compression method described with reference to Fig. 10, which combines a predetermined number of pixels 103 into one pixel, the size of the image in the vertical and horizontal directions of the compressed RAW data 212 is enlarged using linear interpolation, etc. By this enlargement process in the vertical and horizontal directions, the size of the image in the compressed RAW data 212 is adjusted to the size of the image in the output image data 230.

[0175] 11, the size of the image represented by the compressed RAW data 212 in the vertical direction is enlarged using linear interpolation, etc. By this enlargement process in the vertical direction, the size of the image represented by the compressed RAW data 212 is adjusted to the size of the image represented by the output image data 230.

[0176] On the other hand, if the compressed RAW data 212 has been compressed using the third compression method described with reference to FIG. 12, which reduces the number of bits per pixel, the size of the reference image is the same as the size of the target image, so no size adjustment processing is required.

[0177] FIG. 24 is a diagram for explaining a first comparison method based on the edges (contours) of objects included in an image, which is applicable to the seventh embodiment.

[0178] 24, section (a) schematically shows an example of an image created using the compressed RAW data 212resize after size adjustment as described above. Section (b) shows an example of an image created using the output image data 230. Because the compressed RAW data 212resize has not been subjected to demosaicing, its visual appearance differs from that of the image created using the output image data 230 shown in section (b).

[0179] As shown in sections (a) and (b) of FIG. 24, the image based on the compressed RAW data 212resize and the image based on the output image data 230 contain the same object 70.

[0180] As shown in section (a) of Figure 24, a known edge detection method is used to detect an edge 71a of an object 70 included in an image generated by the compressed RAW data 212resize. A known example of an edge detection method is a method using a first-order differential filter such as a Sobel filter. Similarly, as shown in section (b), an edge 71b of an object 70 included in an image generated by the output image data 230 is detected.

[0181] A feature amount is calculated for each of the edge 71a detected from the image generated by the resized compressed RAW data 212 and the edge 71b detected from the image generated by the output image data 230. Based on the feature amount of the edge 71a and the feature amount of the edge 71b, for example, by calculating the difference between the two, the similarity between the edge 71a and the edge 71b can be calculated. If the calculated similarity is equal to or greater than a threshold, the image generated by the output image data 230 is determined to be authentic (not tampered with).

[0182] (Regarding the second comparison method) The second comparison method will be described. In the second comparison method, when performing comparison, first, demosaic processing is performed on the compressed RAW data 212 to restore color information of the image based on the compressed RAW data 212. The color information of the image based on the compressed RAW data 212 from which this color information has been restored is compared with the color information of the image based on the output image data 230.

[0183] Fig. 25 is a diagram for explaining a second comparison method that is applicable to the seventh embodiment and that also uses color information of the image. In the second comparison method, demosaic processing is performed on the compressed RAW data 212 shown in section (a) of Fig. 25 to restore the color information, and then, as described in the first comparison method, enlargement processing or the like is performed on the image based on the compressed RAW data 212 to match the size of the image based on the output image data 230. Section (b) of Fig. 25 shows an example of an image based on compressed RAW data 212dem obtained by performing demosaic processing and size adjustment processing on the compressed RAW data 212.

[0184] The color information of this compressed RAW data 212dem is compared with the color information of the output image data 230 shown in section (c) of FIG. 25 to determine the similarity between the compressed RAW data 212dem and the output image data 230. For example, feature amounts related to color information are calculated for each of the compressed RAW data 212dem and the output image data 230. Based on the feature amounts of the color information of the compressed RAW data 212dem and the feature amounts of the color information of the output image data 230, for example, by calculating the difference between the two, the similarity between the compressed RAW data 212dem and the output image data 230 can be determined. If the determined similarity is equal to or greater than a threshold, it is determined that the image based on the output image data 230 is authentic (not tampered with).

[0185] It should be noted that in this second comparison method, comparison based on color information and comparison based on the edges of objects in the first comparison method can also be performed in combination.

[0186] Furthermore, both the first and second comparison methods described above are executed by calculations using a processor such as a CPU (Central Processing Unit). This is not limited to this example, and it is also possible to visually compare an image based on the compressed RAW data 212 with an image based on the output image data 230 to verify the authenticity of the output image data 230. In this case, it is preferable to use an image based on the compressed RAW data 212 in which color information has been restored by performing at least demosaic processing on the compressed RAW data 212.

[0187] The effects described in this specification are merely examples and are not limiting, and other effects may also be present.

[0188] The present technology can also be configured as follows. (1) a pixel array unit including a plurality of pixels arranged in a matrix array, each of which generates a pixel signal in response to light received by exposure, and which acquires image data based on each of the pixel signals generated by the plurality of pixels; a compression unit that compresses the amount of the image data to generate compressed image data; a signature generation unit that generates signature data based on the compressed image data; an output unit that outputs the image data and authentication proof data obtained by adding the signature data to the compressed image data; An imaging device comprising: (2) The output unit a first output terminal that outputs the image data; a second output terminal that outputs the authentication proof data; Including, The imaging device according to (1) above. (3) The output unit a line memory that stores the image data in units of lines in the row direction of the matrix array; outputting the image data and the authentication proof data from an output terminal in a time-division manner for each line using the line memory; The imaging device according to (1) above. (4) a frame memory for storing the compressed image data corresponding to at least one frame of the image data; The signature generation unit generating the signature data based on the compressed image data stored in the frame memory; The output unit outputting the image data of the one frame from an output terminal; the signature data generated based on the compressed image data stored in the frame memory is added to the compressed image data, and the authentication data is output from the output terminal; The imaging device according to (1) above. (5) a frame memory that stores the image data of at least one frame acquired by the pixel array unit; The compression section generating the compressed image data based on the image data stored in the frame memory; The output unit outputting the image data acquired by the pixel array unit from an output terminal; the authentication data is generated from the output terminal, and the signature data is generated by the signature generation unit based on the compressed image data generated by the compression unit using the image data stored in the frame memory, and the compressed image data is added to the compressed image data. The imaging device according to (1) above. (6) Each of the plurality of pixels is a voltage holding pixel having a holding unit that holds the pixel signal corresponding to received light, The compression section generating the compressed image data based on the image data according to the pixel signals held in the holding units of the plurality of pixels; The output unit outputting, from an output terminal, the image data based on the pixel signals read out from the holding units of the plurality of pixels; and outputting from the output terminal the authentication proof data in which the signature data generated by the signature generation unit based on the compressed image data generated by the compression unit using the image data based on the pixel signals read out again from the holding unit possessed by each of the plurality of pixels is added to the compressed image data. The imaging device according to (1) above. (7) The output unit outputting the image data based on the pixel signals generated by the first exposure from an output terminal; outputting the image data based on the pixel signals generated by a second exposure subsequent to the first exposure from the output terminal; The imaging device according to (1) above. (8) The pixel array unit a plurality of types of optical filters having different optical characteristics are provided for each of the plurality of pixels according to a predetermined pattern; The compression section compressing the data amount of the image data by adding pixel signals for every predetermined number of pixels among the plurality of pixels that are provided with the optical filter of the corresponding type and that are arranged in close proximity in the array, and combining the predetermined number of pixels into one pixel; The imaging device according to any one of (1) to (7) above. (9) The compression section compressing the data amount of the image data by deleting lower bits of pixel data based on pixel signals of each of the plurality of pixels included in the image data and reducing the number of bits of the pixel data; The imaging device according to any one of (1) to (8) above. (10) The compression section deleting the lower bits of the pixel data that has been subjected to the gradation compression processing; The imaging device according to (9) above. (11) The compression section compressing the data amount of the image data based on image continuity; The imaging device according to any one of (1) to (10) above. (12) The compression section compressing the amount of the image data by thinning out the image data in pixel units; The imaging device according to any one of (1) to (11) above. (13) The compression section thinning out the image data in units of lines in the row direction of the matrix array; The imaging device according to (12) above. (14) The pixel array unit a plurality of types of optical filters having different optical characteristics are provided for each of the plurality of pixels according to a predetermined pattern; The compression section thinning out the pixels in the predetermined pattern in units of lines according to the repetition in the column direction of the matrix array; The imaging device according to (13) above. (15) the pixel array unit, the compression unit, the signature generation unit, and the output unit are integrally configured; The imaging device according to any one of (1) to (14) above. (16) a first chip on which the pixel array unit is disposed; a second chip on which the compression unit, the signature generation unit, and the output unit are arranged and which is bonded to the first chip; It consists of The imaging device according to (15) above. (17) Executed by a processor, an acquiring step of acquiring image data by each of the pixel signals generated by a pixel array unit including a plurality of pixels arranged in a matrix array and each generating a pixel signal in response to received light; a compression step of compressing the amount of the image data to generate compressed image data; a signature generation step of generating signature data based on the compressed image data; an output step of outputting the image data and authentication proof data obtained by adding the signature data to the compressed image data; An imaging method comprising: [Explanation of symbols]

[0189] 10,2000 cameras 50 News Media 51 SNS administrator 52 Public Institutions 60 Cloud Computing Services 70 objects 71a,71b Edge 100,100a,100b,100c,100d,100e,100f,2100 sensors 101,101VD pixel array section 102,102VD pixel array 103,103B,103B add ,103G,103G add ,103R,103R add ,103R1,103R2,103R3,103R4,103VD pixels 104 Output I / F 105 Communication and sensor control unit 108 ADC 120 Image processing unit 131,132 Interface 200 RAW data 210,240 Authentication data 211 Sensor Information 212,212resize,212dem compressed RAW data 213 Signature Data 230,2230 Output image data 1000,1000a,1000b,1000c,1000d,1000e Signature processing unit 1010, 1010a, 1010b Data processing unit 1020 Compression Processing Unit 1021 Signature generation section 1030 Arbitrator 1031 line memory 1040,1041 frame memory 1050,1051 selector

Claims

1. a pixel array unit including a plurality of pixels arranged in a matrix array, each of which generates a pixel signal in response to light received by exposure, and which acquires image data based on each of the pixel signals generated by the plurality of pixels; a compression unit that compresses the amount of the image data to generate compressed image data; a signature generation unit that generates signature data based on the compressed image data; an output unit that outputs the image data and authentication proof data obtained by adding the signature data to the compressed image data; An imaging device comprising:

2. The output unit a first output terminal that outputs the image data; a second output terminal for outputting the authentication proof data; Including, The imaging device according to claim 1 .

3. The output unit a line memory that stores the image data in units of lines in the row direction of the matrix array; outputting the image data and the authentication proof data from an output terminal in a time-division manner for each line using the line memory; The imaging device according to claim 1 .

4. a frame memory for storing the compressed image data corresponding to at least one frame of the image data; The signature generation unit generating the signature data based on the compressed image data stored in the frame memory; The output unit outputting the image data of the one frame from an output terminal; the signature data generated based on the compressed image data stored in the frame memory is added to the compressed image data, and the authentication data is output from the output terminal; The imaging device according to claim 1 .

5. a frame memory configured to store the image data of at least one frame acquired by the pixel array unit; The compression section generating the compressed image data based on the image data stored in the frame memory; The output unit outputting the image data acquired by the pixel array unit from an output terminal; the authentication data is generated from the output terminal, and the signature data is generated by the signature generation unit based on the compressed image data generated by the compression unit using the image data stored in the frame memory, and the compressed image data is added to the compressed image data. The imaging device according to claim 1 .

6. Each of the plurality of pixels is a voltage holding pixel having a holding unit that holds the pixel signal corresponding to received light, The compression section generating the compressed image data based on the image data according to the pixel signals held in the holding units of the plurality of pixels; The output unit outputting, from an output terminal, the image data based on the pixel signals read out from the holding units of the plurality of pixels; and outputting from the output terminal the authentication proof data in which the signature data generated by the signature generation unit based on the compressed image data generated by the compression unit using the image data based on the pixel signals read out again from the holding unit possessed by each of the plurality of pixels is added to the compressed image data. The imaging device according to claim 1 .

7. The output unit outputting the image data based on the pixel signals generated by the first exposure from an output terminal; outputting the image data based on the pixel signals generated by a second exposure subsequent to the first exposure from the output terminal; The imaging device according to claim 1 .

8. The pixel array unit a plurality of types of optical filters having different optical characteristics are provided for each of the plurality of pixels according to a predetermined pattern; The compression section compressing the amount of data of the image data by adding pixel signals for every predetermined number of pixels among the plurality of pixels that are provided with the optical filter of the corresponding type and that are arranged in close proximity in the array, and combining the predetermined number of pixels into one pixel; The imaging device according to claim 1 .

9. The compression section compressing the data amount of the image data by deleting lower bits of pixel data based on pixel signals of each of the plurality of pixels included in the image data and reducing the number of bits of the pixel data; The imaging device according to claim 1 .

10. The compression section deleting the lower bits of the pixel data that has been subjected to the gradation compression processing; The imaging device according to claim 9 .

11. The compression section compressing the data amount of the image data based on image continuity; The imaging device according to claim 1 .

12. The compression section compressing the amount of the image data by thinning out the image data in pixel units; The imaging device according to claim 1 .

13. The compression section thinning out the image data in units of lines in the row direction of the matrix array; The imaging device according to claim 12.

14. The pixel array unit a plurality of types of optical filters having different optical characteristics are provided for each of the plurality of pixels according to a predetermined pattern; The compression section thinning out the pixels in the predetermined pattern in units of lines according to the repetition in the column direction of the matrix array; The imaging device according to claim 13.

15. the pixel array unit, the compression unit, the signature generation unit, and the output unit are integrally configured; The imaging device according to claim 1 .

16. a first chip on which the pixel array unit is disposed; a second chip on which the compression unit, the signature generation unit, and the output unit are arranged and which is bonded to the first chip; It consists of The imaging device according to claim 15.

17. Executed by a processor, an acquiring step of acquiring image data by each of the pixel signals generated by a pixel array unit including a plurality of pixels arranged in a matrix array and each generating a pixel signal in response to received light; a compression step of compressing the amount of the image data to generate compressed image data; a signature generation step of generating signature data based on the compressed image data; an output step of outputting the image data and authentication proof data obtained by adding the signature data to the compressed image data; An imaging method comprising:

Images