Imaging device, information processing device, information processing method, and program
By generating a hash for a portion of the image, such as the focused area, the processing load and time for electronic signatures are reduced, ensuring the authenticity of important image parts is maintained.
Patent Information
- Application Number
- JP2022511806
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2020-03-30
- Filing Date
- 2021-03-16
- Publication Date
- 2024-11-13
- Estimated Expiration
- 2041-03-16
AI Technical Summary
The increasing data volume of captured images in digital cameras leads to a significant processing load for generating hash values and electronic signatures, which can result in delayed signature generation during continuous or moving image shooting.
Generating a hash value for a portion of the captured image, such as the focused area or important regions, and linking it with identification information to suppress the processing load.
This approach reduces the processing time and load associated with generating electronic signatures while ensuring the authenticity of critical image portions is maintained.
Smart Images

Figure 0007582300000001 
Figure 0007582300000002 
Figure 0007582300000003
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an imaging device, an information processing device, an information processing method, and a program, and more particularly to an imaging device, an information processing device, an information processing method, and a program that are capable of suppressing an increase in load. [Background technology]
[0002] Conventionally, a method has been proposed for detecting tampering by converting a captured image, etc., into a hash value in a digital camera or the like and linking an electronic signature using the hash value to the captured image (see, for example, Patent Document 1). [Prior art documents] [Patent documents]
[0003] [Patent Document 1] JP 2008-22372 A Summary of the Invention [Problem to be solved by the invention]
[0004] The present disclosure is intended to make it possible to suppress an increase in load caused by such linking of electronic signatures. [Means for solving the problem]
[0005] The imaging device according to one aspect of the present technology calculates a hash value of a part of a captured image and part identification information for identifying the part. a hash value generation unit that generates a hash value, an electronic signature generation unit that generates an electronic signature including the generated hash value, and A linking unit for linking the captured image and The imaging device includes:
[0006] According to one aspect of the present technology, an information processing method includes: generating a hash value of a part of a captured image and part identification information for identifying the part; generating a digital signature including the generated hash value; and Linked to the captured image Including It is an information processing method.
[0007] A program according to one aspect of the present technology includes: generating a hash value of a part of a captured image and part identification information for identifying the part; a hash value generation unit that generates a hash value, an electronic signature generation unit that generates an electronic signature including the generated hash value, and The program causes the image capturing device to function as a linking unit that links the captured image.
[0008] An information processing device according to another aspect of the present technology includes: an electronic signature decryption unit that decrypts an electronic signature associated with a captured image and obtains a first hash value of a part of the captured image and part identification information for identifying the part; Also linked to the captured image Ta an extraction unit that extracts the portion from the captured image based on the portion identification information; extraction The part and The part identification information Second a hash value generation unit for generating a hash value; The first Hash value and The second and a comparison unit that compares the hash value with the received signal.
[0009] Another aspect of the present technology is an information processing method, decrypting an electronic signature associated with a captured image to obtain a first hash value of a portion of the captured image and portion identification information for identifying the portion; Also linked to the captured image Ta Extracting the portion from the captured image based on the portion identification information To do , the extracted portion and The part identification information Second Generate a hash value To do , The first Hash value and The second Compare with hash value Including It is an information processing method.
[0010] A program according to another aspect of the present technology includes: an electronic signature decryption unit that decrypts an electronic signature associated with a captured image and obtains a first hash value of a part of the captured image and part identification information for identifying the part; and is linked to the captured image. Ta an extraction unit that extracts the portion from the captured image based on the portion identification information; extraction The part and The part identification information Second a hash value generation unit for generating a hash value; The first Hash value and The second This is a program that functions as a comparison unit that compares the hash value.
[0011] In the imaging device, the information processing method, and the program according to one aspect of the present technology, a hash value of a part of a captured image and part identification information for identifying the part is calculated. generating a digital signature including the generated hash value; and Linked to captured images What is done is .
[0012] In another aspect of the present technology, an information processing device, an information processing method, and a program include: Decrypting an electronic signature associated with the captured image to obtain a first hash value of a portion of the captured image and part identification information for identifying that portion; and Also linked to the captured image Ta Based on the part identification information, a part of the captured image is Extracting , the extracted part and Partially specific information Second Hash value and ,the 1. Hash value and Second Hash value and A comparison is made between the . [Brief description of the drawings]
[0013] [Figure 1] FIG. 1 is a diagram illustrating an example of a main configuration of a tampering detection system. [Diagram 2] FIG. 2 is a diagram illustrating an example of information exchanged between devices. [Diagram 3] 1 is a block diagram showing an example of a main configuration of an imaging apparatus; [Figure 4] FIG. 2 is a functional block diagram showing functions realized in the imaging device. [Diagram 5] 11 is a flowchart illustrating an example of the flow of an imaging process. [Figure 6] FIG. 2 is a block diagram showing an example of a main configuration of a verification device, etc. [Figure 7] FIG. 2 is a functional block diagram showing functions realized in the verification device. [Figure 8] 11 is a flowchart illustrating an example of a process flow regarding verification. [Figure 9] FIG. 2 is a functional block diagram showing functions realized in the imaging device. [Figure 10] 11 is a flowchart illustrating an example of the flow of an imaging process. [Figure 11]FIG. 2 is a functional block diagram showing functions realized in the imaging device. [Figure 12] 11 is a flowchart illustrating an example of the flow of an imaging process. [Figure 13] FIG. 2 is a functional block diagram showing functions realized in the verification device. [Figure 14] 11 is a flowchart illustrating an example of a process flow regarding verification. [Figure 15] FIG. 2 is a functional block diagram showing functions realized in the imaging device. [Figure 16] 11 is a flowchart illustrating an example of the flow of an imaging process. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0014] Hereinafter, modes for carrying out the present disclosure (hereinafter referred to as embodiments) will be described in the following order. 1. Generate hash of partial image 2. First embodiment (partial region identification based on focus information) 3. Second embodiment (partial region identification based on image analysis results) 4. Third embodiment (for moving images) 5. Fourth embodiment (control according to imaging mode) 6. Notes
[0015] <1. Generate hash of partial image> <Hash Generation> For example, Patent Document 1 describes a method for detecting falsification by generating a hash of the entire captured image in a digital camera or the like and associating a digital signature using the hash with the captured image. For example, information about the imaging device can also be included in the digital signature.
[0016] However, in recent years, with the improvement of information processing technology, the amount of data of captured images tends to increase. As the amount of data of captured images increases, the load of the process of generating a hash of the entire captured image also tends to increase. Therefore, the processing time for generating the electronic signature increases, and there is a risk that the generation process of the electronic signature cannot keep up, especially when multiple captured images are generated in a short period of time, such as in a continuous shooting mode or a moving image shooting mode.
[0017] Therefore, a hash of a part of a captured image is generated and used to detect falsification. By doing so, it is possible to suppress an increase in the amount of data for which a hash is generated (an image), and therefore an increase in the load associated with generating a digital signature.
[0018] For example, a hash value of a part of a captured image and part identification information for identifying that part may be linked to the captured image. In this way, it is possible to suppress an increase in the load associated with the generation of a digital signature and an increase in the processing time.
[0019] The portion for generating the hash may be any portion of the captured image. For example, a more important portion of the captured image may be the portion. In other words, by identifying an important portion of the captured image, extracting the identified portion from the captured image, generating a hash of the extracted image, and using the hash to generate a digital signature, it is possible to guarantee the authenticity of the important portion of the captured image while suppressing an increase in load.
[0020] The criteria for determining whether or not the captured image is an important part are arbitrary. For example, the part of the captured image that is focused on the subject (also referred to as the focused part) may be determined as the important part. For example, the focused part may be specified using focus information (e.g., depth data consisting of a depth map, distance measurement information, etc.) indicating the focus position of the captured image, and the specified focused part may be extracted to generate a hash. In this way, the authenticity of the focused part of the captured image can be guaranteed while suppressing an increase in load.
[0021] Also, for example, a partial region at a predetermined position of the captured image may be set as this important part. For example, a partial region at a position where an important subject is likely to exist may be set as this important part. For example, a partial region near the center of the captured image may be set as this important part. Also, a partial region near the four corners of the captured image may be set as this important part. Furthermore, a partial region randomly selected from a plurality of partial regions at different positions, such as near the center or near the four corners of the captured image, may be set as this important part. In this way, the authenticity of the partial region at the predetermined position of the captured image can be guaranteed while suppressing an increase in load.
[0022] Also, for example, a portion of the captured image where some pixels have been thinned out may be the important part. For example, an image where any pixels have been thinned out from the captured image at a predetermined rate may be the important part. For example, an image where the pixels of a 4K resolution captured image have been thinned out to HD resolution may be the important part. Also, for example, an image where any pixel column (or pixel row) of the captured image has been thinned out at a predetermined rate may be the important part. In this way, it is possible to guarantee the authenticity of a range substantially similar to the entire captured image while suppressing an increase in load.
[0023] Also, the captured image may be subjected to image analysis to identify an important part. For example, the captured image may be subjected to image analysis to identify a part where an important subject exists, and the identified part may be extracted as an important part to generate a hash. For example, a subject (person) may be detected by image analysis, and an area of the captured image where the person exists may be regarded as an important part. Of course, the subject to be detected is arbitrary and is not limited to a person. For example, the subject to be detected may be a person's face or a part other than the face. It may also be an animal or a plant. It may also be an inorganic object such as a building. In this way, it is possible to guarantee the authenticity of the part of the captured image where the important subject is shown while suppressing an increase in load.
[0024] Furthermore, when the captured image is a moving image, a hash value of a part of the captured image and part identification information for identifying that part may be associated with the captured image only for the I-frame of the moving image. In this way, it is possible to guarantee the authenticity of important parts of I-frames, which have a larger amount of data, while suppressing an increase in the load.
[0025] Furthermore, if the captured image is a moving image, a hash value of a part of the captured image and part identification information for identifying that part may be associated with the captured image only for frames of the moving image with high movement (for example, frames in which the movement between frames (from the previous frame) is greater (higher) than a predetermined threshold). In this way, the authenticity of important parts of more important frames with high movement can be guaranteed while suppressing an increase in the load.
[0026] In addition, when the imaging mode is a continuous shooting mode, a hash value of a part of the captured image and part identification information for identifying that part may be associated with the captured image, and when the imaging mode is not a continuous shooting mode, a hash value of the entire captured image may be associated with the captured image. In this way, an increase in processing time can be suppressed for the continuous shooting mode, which has a short processing time.
[0027] A hash value may be generated using a part of the captured image and part identification information for identifying that part. The generated hash value may be linked to the captured image. Alternatively, a digital signature including the hash value may be generated and linked to the captured image.
[0028] In addition, metadata of the captured image may be updated using part identification information for identifying a part, and the updated metadata may be linked to the captured image. Furthermore, a public key used to generate a digital signature and a certificate for that public key may be associated with the captured image.
[0029] Also, based on a hash value of a part of the captured image and part identification information for identifying that part, which is linked to the captured image, a part may be extracted from the captured image based on the part identification information, a hash value of the extracted part and the part identification information may be generated, and the generated hash value may be compared with the hash value linked to the captured image. In this way, it is possible to suppress an increase in the load associated with verifying a digital signature generated using the hash of a part of the captured image.
[0030] <2. First embodiment> <Tampering detection system> Fig. 1 is a diagram showing a main configuration example of a tamper detection system which is an embodiment of an information processing system to which the present technology is applied. The tamper detection system 100 shown in Fig. 1 is a system for detecting tampering of an image or the like. As shown in Fig. 1, the tamper detection system 100 has, for example, an imaging device 101, a verification device 102, and a certificate authority 103. Note that, although Fig. 1 shows one each of the imaging device 101, the verification device 102, and the certificate authority 103, the number of the imaging device 101, the verification device 102, and the certificate authority 103 constituting the tamper detection system 100 is arbitrary. For example, there may be a plurality of imaging devices 101, the verification device 102, and the certificate authority 103.
[0031] The imaging device 101, the verification device 102, and the certificate authority 103 are connected to each other so that they can communicate with each other, for example, via a network not shown. The imaging device 101 performs processes related to capturing an image of a subject (generation of a captured image), generating a hash of the captured image, and generating a signature to be associated with the captured image. The imaging device 101 also applies for issuance of a certificate to the certificate authority 103, has the certificate issued by the certificate authority 103, and obtains the certificate. Furthermore, the imaging device 101 can send a captured image (photograph) and its metadata to the verification device 102.
[0032] The verification device 102 performs processing related to detection of tampering of captured images generated by the imaging device 101. For example, the verification device 102 can acquire captured images (photographs) and their metadata supplied from the imaging device 101. The verification device 102 can also verify digital signatures.
[0033] The certificate authority 103 can issue a certificate for the captured image. The certificate authority 103 can distribute the certificate authority's certificate and the certificate revocation list to the verification device 102. The verification device 102 can verify the certificate used by the imaging device 101 based on the certificate authority's certificate and the certificate revocation list. In this specification, "linking" of data means "associating" data with each other. Here, the term "associating" means, for example, making it possible to use (link) one piece of data when processing another piece of data. In other words, data associated with each other may be combined into one piece of data, or each piece of data may be individual data. For example, a plurality of pieces of information associated with each other may be transmitted on different transmission paths. Also, for example, a plurality of pieces of information associated with each other may be recorded on different recording media (or different recording areas of the same recording media). This "association" may be a part of the data, not the entire data. For example, an image and information corresponding to the image may be associated with each other in any unit, such as multiple frames, one frame, or a part of a frame. In addition, in this specification, in addition to the above-mentioned "link," terms such as "combine," "multiplex," "append," "integrate," "include," "store," "embed," "insert," and "insert" mean combining multiple things into one, and are one method of "associating" as described above.
[0034] <Data> Fig. 2 is a diagram showing an example of data supplied from the imaging device 101 to the verification device 102. As shown in A of Fig. 2, a captured image 111 is associated with information such as metadata 112, a digital signature 113, and a certificate / public key 114.
[0035] An example of this metadata 112 is shown in Fig. 2B. As shown in Fig. 2B, the metadata 112 includes information such as the camera's serial number, the photographer, the shooting time, the focal length, the aperture value, the shutter speed, and the shooting location. In addition, this metadata 112 also includes extraction area information.
[0036] <Imaging device> Fig. 3 is a diagram showing a main configuration example of an imaging device 101 which is an embodiment of an information processing device to which the present technology is applied. The imaging device 101 shown in Fig. 3 is a computer that installs and executes an application program (software) that performs processing related to imaging (generation of captured image), generation of electronic signature, etc. Here, the computer includes a computer built into dedicated hardware, and a general-purpose personal computer, etc., which can execute various functions by installing various programs. In other words, the imaging device 101 executes an application program to perform processing related to imaging (generation of captured image), generation of electronic signature, etc.
[0037] In the imaging device 101 shown in FIG. 3, a central processing unit (CPU) 201, a read only memory (ROM) 202, and a random access memory (RAM) 203 are connected to each other via a bus 204.
[0038] An input / output interface 210 is also connected to the bus 204. To the input / output interface 210, an input unit 211, an output unit 212, a storage unit 213, a communication unit 214, and a drive 215 are connected.
[0039] The input unit 211 includes, for example, a keyboard, a mouse, a microphone, a touch panel, an input terminal, etc. The output unit 212 includes, for example, a display, a speaker, an output terminal, etc. The storage unit 213 includes, for example, a hard disk, a RAM disk, a non-volatile memory, etc. The communication unit 214 includes, for example, a network interface. The drive 215 drives a removable recording medium 221 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
[0040] Furthermore, an imaging unit 231 and a sensor 232 are further connected to the input / output interface 210 .
[0041] The imaging unit 231 has an optical system such as a lens and an aperture, and an image sensor, captures an image of a subject, and generates a captured image. Note that the imaging unit 231 may further have components other than those described above, such as an image processing unit that performs image processing on the generated captured image, and a memory that stores data of the captured image.
[0042] The sensor 232 has, for example, a distance measuring sensor and measures the distance to the subject. The sensor 232 may generate a depth map or the like.
[0043] In the imaging device 101 configured as above, the CPU 201 performs the above-mentioned series of processes by, for example, loading an application program stored in the storage unit 213 into the RAM 203 via the input / output interface 210 and the bus 204 and executing the program. The RAM 203 also stores data and the like necessary for the CPU 201 to execute various processes as appropriate.
[0044] An application program executed by the imaging device 101 can be applied by being recorded on a removable recording medium 221 such as a package medium, for example. In this case, the application program can be installed in the storage unit 213 via the input / output interface 210 by mounting the removable recording medium 221 on the drive 215.
[0045] The application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, digital satellite broadcasting, etc. In this case, the application program can be received by the communication unit 214 and installed in the storage unit 213.
[0046] Alternatively, this application program may be pre-installed in the ROM 202 or the storage unit 213 .
[0047] Functions realized by executing an application program in the imaging device 101 are shown as functional blocks in Fig. 4. As shown in Fig. 4, the imaging device 101 can have an imaging control unit 251, a partial data extraction unit 252, a metadata update unit 253, a hash generation unit 254, a digital signature generation unit 255, a linking unit 256, and an output control unit 257 by executing an application program.
[0048] The imaging control unit 251 controls the imaging unit 231 to execute processing related to imaging. The partial data extraction unit 252 performs processing related to extraction of partial data of the captured image (data of a partial image of the captured image). The metadata update unit 253 performs processing related to updating metadata information associated with the captured image. The hash generation unit 254 performs processing related to generation of a hash. The digital signature generation unit 255 performs processing related to generation of a digital signature. The linking unit 256 performs processing related to linking the captured image with other data. The output control unit 257 performs processing related to control of data output.
[0049] <Flow of imaging process> An example of the flow of imaging processing executed by the imaging device 101 will be described with reference to the flowchart of FIG.
[0050] When the imaging process is started, in step S101, the imaging control unit 251 controls the imaging unit 231 to image the subject and generate the captured image. The imaging control unit 251 also controls the sensor 232 to measure the distance to the subject and generate focus information (depth data). The imaging control unit 251 then acquires the generated captured image and focus information.
[0051] In step S102, the partial data extraction unit 252 extracts a focused portion of the captured image acquired in step S101 based on the focus information acquired in step S101. In step S103, the metadata update unit 253 includes, in the metadata, extraction region information indicating the region extracted in step S102 (i.e., part specification for specifying a part of the captured image). That is, as shown in B of FIG. 2, "extraction region information" is added to the metadata 112. Then, the metadata thus updated is added to the partial image (focused portion) of the captured image. That is, the metadata and the partial image are linked (associated).
[0052] In step S104, the hash generation unit 254 generates a hash of data combining the partial image extracted in step S102 and the metadata updated in step S103. That is, a hash of the partial image and metadata linked to each other is generated.
[0053] In step S105, the digital signature generating unit 255 encrypts the hash generated in step S104 (the hash of the partial image and the metadata linked to each other) with a private key to generate a digital signature.
[0054] In step S106, the linking unit 256 links (associates) the captured image acquired in step S101, the metadata updated in step S103, the electronic signature generated in step S105, the certificate, and the public key corresponding to the private key used in step S105 to one another.
[0055] In step S107, the output control unit 257 outputs the captured image, the metadata, the digital signature, the certificate, and the public key that are linked (associated) with each other by the process in step S106.
[0056] When the process of step S107 is completed, the imaging process is completed. By performing the imaging process as described above, a digital signature can be generated using a part of the captured image. That is, a hash value of the part of the captured image and part identification information for identifying that part can be linked to the captured image. Therefore, an increase in the load can be suppressed.
[0057] In the above, a part of the captured image is identified based on focus information, and a hash of the part is generated. However, the method of identifying the part is arbitrary and is not limited to the example of focus information. For example, a partial image at a predetermined position of the captured image may be the "part". Also, an image in which some pixels of the captured image are thinned out may be the "part".
[0058] <Verification equipment, etc.> Fig. 6 is a diagram showing an example of the main configuration of a verification device 102 which is an embodiment of an information processing device to which the present technology is applied. The verification device shown in Fig. 6 is a computer that installs and executes an application program (software) that performs processing related to the verification of electronic signatures. Here, the computer includes a computer built into dedicated hardware, and a general-purpose personal computer, for example, that can execute various functions by installing various programs. The verification device 102 executes the application program to perform processing related to the verification of electronic signatures.
[0059] In the verification device 102 shown in FIG. 6, a CPU 301 , a ROM 302 , and a RAM 303 are connected to each other via a bus 304 .
[0060] An input / output interface 310 is also connected to the bus 304. To the input / output interface 310, an input unit 311, an output unit 312, a storage unit 313, a communication unit 314, and a drive 315 are connected.
[0061] The input unit 311 includes, for example, a keyboard, a mouse, a microphone, a touch panel, an input terminal, etc. The output unit 312 includes, for example, a display, a speaker, an output terminal, etc. The storage unit 313 includes, for example, a hard disk, a RAM disk, a non-volatile memory, etc. The communication unit 314 includes, for example, a network interface. The drive 315 drives a removable recording medium 321 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.
[0062] In the verification device 102 configured as above, the CPU 301 performs the above-mentioned series of processes by, for example, loading an application program stored in the storage unit 313 into the RAM 303 via the input / output interface 310 and the bus 304 and executing the program. The RAM 303 also stores data necessary for the CPU 301 to execute various processes as appropriate.
[0063] The application program executed by the verification device 102 can be applied by recording it on a removable recording medium 321 such as a package medium, for example. In this case, the application program can be installed in the storage unit 313 via the input / output interface 310 by mounting the removable recording medium 321 on the drive 315.
[0064] The application program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, digital satellite broadcasting, etc. In this case, the application program can be received by the communication unit 314 and installed in the storage unit 313.
[0065] Alternatively, this application program may be pre-installed in the ROM 302 or the storage unit 313 .
[0066] The certificate authority 103 has a similar configuration to the verification device 102 shown in Fig. 3. That is, the block diagram shown in Fig. 3 can also be used to explain the certificate authority 103.
[0067] Functions realized by executing an application program in verification device 102 are shown as functional blocks in Fig. 7. As shown in Fig. 7, verification device 102 can have an acquisition control unit 351, a certificate verification unit 352, a digital signature decryption unit 353, a partial data extraction unit 354, a hash generation unit 355, a comparison unit 356, and an output control unit 357 by executing the application program.
[0068] The acquisition control unit 351 performs processing related to acquisition of data such as captured images and electronic signatures, for example by controlling the communication unit 314. The certificate verification unit 352 performs processing related to certificate verification. The electronic signature decryption unit 353 performs processing related to decryption of electronic signatures. The partial data extraction unit 354 performs processing related to extraction of partial data. The hash generation unit 355 performs processing related to hash generation. The comparison unit 356 performs processing related to comparison of electronic signatures. The output control unit 357 performs processing related to data output.
[0069] <Verification process flow> Next, an example of the flow of the verification process executed by the verification device 102 and the certificate authority 103 will be described with reference to the flowchart of FIG.
[0070] When the verification process is started, in step S201, the acquisition control unit 351 of the verification device 102 controls the communication unit 314 or the like to acquire the captured image, metadata, electronic signature, certificate, and public key that are linked to one another and are supplied from the imaging device 101. That is, an electronic signature generated using a portion of the captured image (an electronic signature including a hash value of a portion (partial image) of the captured image corresponding to extraction area information of the metadata and part specifying information (i.e. metadata) for specifying the partial image) is acquired.
[0071] In step S202, the certificate validation unit 352 requests the certificate revocation list from the certificate authority 103 via the communication unit 314. In step S221, the certificate authority 103 accepts the request from the verification device 102. Then, based on the request, the certificate authority 103 supplies the certificate revocation list to the verification device 102. In step S203, the acquisition control unit 351 of the verification device 102 acquires the certificate revocation list via the communication unit 314.
[0072] In step S204, the certificate validation unit 352 checks the validity of the certificate by using the certificate revocation list acquired in step S203.
[0073] In step S205, the digital signature decryption unit 353 decrypts the digital signature acquired in step S201 with the public key. That is, a hash value of a partial image of the captured image corresponding to the extraction area information of the metadata and its metadata (partial identification information) is obtained. In step S206, the partial data extraction unit 354 extracts the partial image from the captured image based on the extraction area information of the metadata.
[0074] In step S207, the hash generation unit 355 generates a hash of the extracted partial image and metadata.
[0075] In step S208, the comparison unit 356 compares the hash obtained in the process of step S205 with the hash generated in the process of step S207, and determines whether or not tampering has occurred based on the comparison result.
[0076] In step S209, the output control unit 357 outputs the verification result obtained in step S208. When the process of step S209 ends, the verification process ends.
[0077] By performing the verification process as described above, the verification device 102 can verify the digital signature using the hash of the partial image of the captured image, thereby suppressing an increase in the load.
[0078] <3. Second embodiment> <Identifying partial areas based on image analysis results> It is also possible to perform image analysis on the captured image and identify a "portion" of the captured image for which a hash is to be generated based on the analysis results. For example, image analysis may be performed to identify an area of a person (or face) in the captured image, and the area may be regarded as the above-mentioned "portion," and a hash of the area may be generated.
[0079] <Function block> In this case, functions realized by executing an application program in the imaging device 101 are shown as functional blocks in Fig. 9. As shown in Fig. 9, in this case, the imaging device 101 has an image analysis unit 401 in addition to the functional blocks in Fig. 4. The image analysis unit 401 performs processing related to image analysis of captured images, etc.
[0080] <Flow of imaging process> An example of the flow of the imaging process in this case will be described with reference to the flowchart in Fig. 10. When the imaging process is started, in step S301, the imaging control unit 251 controls the imaging unit 231 to image the subject and generate the captured image. The imaging control unit 251 also controls the sensor 232 to measure the distance to the subject and generate focus information (depth data). Then, the imaging control unit 251 acquires the generated captured image and focus information.
[0081] In step S302, the image analysis unit 401 performs image analysis on the captured image to identify an area in which a person is photographed (a person area). In step S303, the partial data extraction unit 252 extracts the identified person area of the captured image.
[0082] The processes in steps S304 to S308 are executed in the same manner as the processes in steps S103 to S107 in FIG.
[0083] By performing the imaging process as described above, the imaging device 101 can generate a digital signature using a portion of the captured image according to the image analysis result. In other words, it is possible to generate a hash of a more important portion of the captured image and associate it with the captured image. Therefore, it is possible to suppress an increase in the load.
[0084] In the above description, a person region is specified by image analysis. However, the region specified by image analysis is arbitrary and may be other than a person region.
[0085] Moreover, the verification process in this case is the same as that in the first embodiment, so the description thereof will be omitted.
[0086] <4. Third embodiment> <Video Images> The captured image to which the digital signature is associated may be a moving image. In this case, the hash of the partial image may be linked to the captured image only for some frames as described above. For example, the hash of the partial image may be linked to the captured image only for the I frame.
[0087] <Function block> An example of functional blocks showing functions realized by executing an application program in the imaging device 101 in this case is shown in Fig. 11. As shown in Fig. 11, in this case, the imaging device 101 has a reordering buffer 411 and an encoding unit 412 in addition to the functional blocks in Fig. 4. The reordering buffer 411 holds multiple frames of a video to be encoded, and reorders the order of the frames from the playback order to the decoding order. The encoding unit 412 performs processing related to encoding of captured images (video) using a coding method for two-dimensional video, such as AVC (Advanced Video Coding) or HEVC (High Efficiency Video Coding).
[0088] <Flow of imaging process> An example of the flow of imaging processing in this case will be described with reference to the flowchart in Fig. 12. Note that, as an example, a case will be described here where a partial region for generating a hash is set using focus information.
[0089] When the imaging process is started, in step S341, the imaging control unit 251 controls the imaging unit 231 to image the subject and generate the captured image. The imaging control unit 251 also controls the sensor 232 to measure the distance to the subject and generate focus information (depth data). The imaging control unit 251 then acquires the generated captured image and focus information.
[0090] In step S342, the reordering buffer 411 holds a plurality of frame images and reorders the frames from the playback order to the coding order.
[0091] In step S343, the partial data extraction block 252 determines whether or not the processing target frame is an I-frame. If it is determined that the processing target frame is an I-frame, the process proceeds to step S344.
[0092] The processes of steps S344 to S347 are executed in the same manner as the processes of steps S102 to S 105. In step S348, the encoding unit 412 encodes the captured image to be processed and generates encoded data.
[0093] In step S349, the linking unit 256 links the encoded data of the captured image, the metadata, the digital signature, the certificate, and the public key to one another. In step S350, the output control unit 257 outputs these pieces of data.
[0094] When the process of step S350 ends, the process proceeds to step S353. If it is determined in step S343 that the frame to be processed is not an I-frame, the process proceeds to step S351.
[0095] In step S351, the encoding unit 412 encodes the captured image to generate encoded data. In step S352, the output control unit 257 outputs the encoded data. When the process of step S352 ends, the process proceeds to step S353.
[0096] In step S353, the imaging control unit 251 determines whether all frames have been processed. If it is determined that there are unprocessed frames, the process returns to step S341, and the subsequent processes are performed. If it is determined in step S353 that all frames have been processed, the imaging process ends.
[0097] By performing the imaging process as described above, a hash of a part of the captured image can be generated only for the I-frame of the video, and the hash can be used to generate a digital signature, thereby suppressing an increase in the load.
[0098] <Verification device function block> FIG. 13 shows an example of functional blocks of functions realized by executing an application program in the verification device 102 in this case. As shown in FIG. 13, in this case, the verification device 102 has a decoding unit 421 in addition to the functional blocks in FIG. 7. The decoding unit 421 performs processing related to decoding of encoded data of a video. A reordering buffer 411 holds multiple frames of a video to be encoded, and reorders the order of the frames from the playback order to the decoding order. A coding unit 412 performs processing related to encoding of a captured image (video) using a coding method for two-dimensional video, such as AVC (Advanced Video Coding) or HEVC (High Efficiency Video Coding).
[0099] <Verification process flow> Next, an example of the flow of the verification process executed by the verification device 102 and the certificate authority 103 in this case will be described with reference to the flowchart in FIG.
[0100] When the verification process starts, in step S371, the acquisition control unit 351 of the verification device 102 controls the communication unit 314, etc., to acquire the encoded data, metadata, digital signature, certificate, and public key of the captured image that are linked to each other.
[0101] In step S372, the decoding unit 421 decodes the encoded data to generate a frame image.
[0102] In step S373, the decoding unit 421 determines whether or not the processing target frame is an I-frame. If it is determined that the processing target frame is an I-frame, the process proceeds to step S374.
[0103] The processes of steps S374 to S381 are executed in the same manner as the processes of steps S202 to S209 in Fig. 8. The processes of steps S391 and S392 by the certificate authority 103 are executed in the same manner as the processes of steps S221 and S222 in Fig. 8.
[0104] When the process of step S381 ends, the process proceeds to step S382. If it is determined in step S373 that the frame to be processed is not an I-frame, the process proceeds to step S382.
[0105] In step S382, the output control unit 357 determines whether all frames have been processed. If it is determined that there are unprocessed frames, the process returns to step S371, and the subsequent processes are repeated. If it is determined in step S382 that all frames have been processed, the verification process ends.
[0106] By performing the verification process as described above, the verification device 102 can verify the digital signature using the hash of the partial image of the captured image only for the I-frame of the video, thereby suppressing an increase in the load.
[0107] <5. Fourth embodiment> <Control according to imaging mode> The method of generating the electronic signature may be controlled according to the imaging mode. For example, in an imaging mode for capturing moving images or an imaging mode for performing so-called continuous shooting, an electronic signature may be generated using a hash of a partial image as described above, and in an ordinary still image imaging mode, an electronic signature may be generated using a hash of the entire captured image.
[0108] <Function block> An example of functional blocks of functions realized by executing an application program in the imaging device 101 in this case is shown in Fig. 15. As shown in Fig. 15, in this case, the imaging device 101 has an imaging mode control unit 431 in addition to the functional blocks in Fig. 11. The imaging mode control unit 431 performs control related to digital signature generation according to the imaging mode.
[0109] <Flow of imaging process> An example of the flow of the imaging process in this case will be described with reference to the flowchart in Fig. 16. When the imaging process is started, the imaging mode control unit 431 sets an imaging mode in step S401. In step S402, the imaging mode control unit 431 determines whether the imaging mode is a moving image imaging mode for capturing moving images. If it is determined that the imaging mode is the moving image imaging mode, the process proceeds to step S403.
[0110] In step S403, the imaging device 101 performs imaging processing in a moving image imaging mode. That is, the imaging device 101 performs imaging processing similar to that described with reference to the flowchart of Fig. 12. When the processing of step S403 ends, the imaging processing ends.
[0111] If it is determined in step S402 that the mode is not a moving image capturing mode, the process proceeds to step S404. In step S404, the imaging mode control unit 431 determines whether or not the mode is a continuous shooting mode in which still images are captured multiple times in a short period of time (so-called continuous shooting is performed). If it is determined that the mode is a continuous shooting mode, the process proceeds to step S405.
[0112] In step S405, the imaging device 101 performs imaging processing in a continuous shooting mode. That is, the imaging device 101 performs imaging processing similar to that described with reference to the flowcharts in Fig. 5 and Fig. 10, and generates a digital signature using the hash of the partial image. When the processing in step S405 ends, the imaging processing ends.
[0113] If it is determined in step S404 that the continuous shooting mode is not selected, the process proceeds to step S406. In this case, a digital signature is generated using a hash of the entire captured image.
[0114] Therefore, in step S406, the imaging control unit 251 controls the imaging unit 231 to capture an image of the subject and generate a captured image of the subject. Then, the imaging control unit 251 acquires the generated captured image.
[0115] In step S407, the hash generation unit 254 generates a hash of the entire captured image. In step S408, the digital signature generation unit 255 encrypts the hash generated in step S407 with a private key to generate a digital signature.
[0116] In step S409, the linking unit 256 links the acquired captured image, the digital signature, the certificate, and the public key generated in step S408 to one another.
[0117] In step S410, the output control unit 257 outputs the captured image, the digital signature, the certificate, and the public key that are associated with each other by the process in step S409. When the process in step S410 ends, the imaging process ends.
[0118] By performing the imaging process in this manner, it is possible to perform imaging process appropriate for the imaging mode, and therefore it is possible to further suppress an increase in the load.
[0119] <6. Notes> <Hardware> The above-mentioned series of processes can be executed by software (application program) or by hardware.
[0120] <Target of application of this technology> The present technology can be applied to any configuration. For example, the present technology can be implemented as a part of an apparatus, such as a processor as a system LSI (Large Scale Integration), a module using multiple processors, a unit using multiple modules, or a set in which other functions are added to a unit.
[0121] In addition, for example, the present technology can also be applied to a network system composed of multiple devices. For example, the present technology may be implemented as cloud computing in which multiple devices share and cooperate with each other to perform processing via a network. For example, the present technology may be implemented in a cloud service that provides services to any terminal such as a computer, a portable information processing terminal, or an IoT (Internet of Things) device.
[0122] In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all the components are in the same case. Therefore, multiple devices housed in separate cases and connected via a network, and a single device in which multiple modules are housed in a single case, are both systems.
[0123] <Fields and applications where this technology can be applied> Systems, devices, processing units, etc. to which the present technology is applied can be used in any field, such as transportation, medical care, crime prevention, agriculture, livestock farming, mining, beauty, factories, home appliances, weather, and nature monitoring. In addition, the applications are also arbitrary.
[0124] <Other> The embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible without departing from the gist of the present technology.
[0125] For example, the configuration described above as one device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, the configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit). Of course, configurations other than those described above may be added to the configuration of each device (or processing unit). Furthermore, as long as the configuration and operation of the system as a whole are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).
[0126] Also, for example, the above-mentioned program may be executed in any device, as long as the device has the necessary functions (functional blocks, etc.) and can obtain the necessary information.
[0127] Also, for example, each step of one flowchart may be executed by one device, or may be shared and executed by multiple devices. Furthermore, when one step includes multiple processes, the multiple processes may be executed by one device, or may be shared and executed by multiple devices. In other words, multiple processes included in one step can be executed as multiple step processes. Conversely, processes described as multiple steps can be executed collectively as one step.
[0128] Also, for example, the processing of the steps of a program executed by a computer may be executed in chronological order according to the order described in this specification, or may be executed in parallel, or individually at a required timing such as when a call is made. In other words, the processing of each step may be executed in an order different from the order described above, so long as no contradiction occurs. Furthermore, the processing of the steps of this program may be executed in parallel with the processing of another program, or may be executed in combination with the processing of another program.
[0129] Also, for example, a plurality of techniques related to the present technology can be implemented independently and independently, as long as no contradiction occurs. Of course, any of a plurality of the present technologies can be implemented in combination. For example, a part or all of the present technology described in any of the embodiments can be implemented in combination with a part or all of the present technology described in other embodiments. Also, a part or all of any of the above-mentioned present technologies can be implemented in combination with other technologies not described above.
[0130] The present technology can also be configured as follows. (1) a linking unit that links a hash value of a part of a captured image and part identification information for identifying the part to the captured image; An imaging device comprising: (2) The portion is a focused portion of the captured image. The imaging device described in (1). (3) The part is a partial area at a predetermined position of the captured image. The imaging device described in (1). (4) The portion is a portion of the captured image in which some pixels have been thinned out. The imaging device described in (1). (5) The part is a part that is identified based on a result of image analysis of the captured image. The imaging device described in (1). (6) The present invention further includes an extracting unit that extracts the portion from the captured image. An imaging device according to any one of (1) to (5). (7) The extraction unit extracts a focused portion of the captured image based on focus information. The imaging device according to (6). (8) The extraction unit extracts the portion from the captured image based on an image analysis result of the captured image. The imaging device according to (6). (9) A hash value generating unit that generates the hash value by using a part of the captured image and the part identification information, The linking unit links the hash value generated by the hash value generating unit to the captured image. An imaging device according to any one of (1) to (8). (10) A digital signature generating unit that generates a digital signature including the hash value, The linking unit links the digital signature generated by the digital signature generating unit to the captured image. An imaging device according to any one of (1) to (9). (11) An update unit that updates metadata of the captured image by using the partial information, The linking unit links the metadata to the captured image by adding the metadata updated by the update unit to the captured image. The imaging device according to (10). (12) The linking unit links a public key used to generate a digital signature and a certificate of the public key to the captured image. An imaging device according to any one of (1) to (11). (13) The captured image is a moving image, The linking unit links a hash value of a part of the captured image and the part identification information to the captured image only for an I frame of the video. An imaging device according to any one of (1) to (12). (14) The captured image is a moving image, The linking unit links a hash value of a part of the captured image and the part identification information to the captured image only for a frame in which the motion of the moving image is higher than a threshold value. An imaging device according to any one of (1) to (12). (15) The linking unit is In the case of a continuous shooting mode, a hash value of the part of the captured image and the part identification information is associated with the captured image; If the continuous shooting mode is not selected, a hash value of the entire captured image is associated with the captured image. An imaging device according to any one of (1) to (12). (16) A hash value of a part of a captured image and part identification information for identifying the part is associated with the captured image. Information processing methods. (17) A computer, a linking section for linking a hash value of a part of a captured image and part identification information for identifying the part to the captured image; A program that functions as a
[0131] (18) An extracting unit that extracts a portion from a captured image based on part identification information that is linked to the captured image together with a hash value of the part of the captured image and part identification information for identifying the part; a hash value generation unit that generates a hash value of the part extracted by the extraction unit and the part identification information; a comparison unit that compares the hash value generated by the hash value generation unit with the hash value associated with the captured image; An information processing device comprising: (19) Extracting the portion from the captured image based on the portion identification information linked to the captured image together with a hash value of the portion of the captured image and portion identification information for identifying the portion; generating a hash value of the extracted portion and the portion identification information; The generated hash value is compared with the hash value associated with the captured image. Information processing methods. (20) A computer, an extracting unit that extracts a portion from a captured image based on part identification information that is linked to the captured image together with a hash value of the part of the captured image and part identification information for identifying the part; a hash value generation unit that generates a hash value of the part extracted by the extraction unit and the part identification information; a comparison unit that compares the hash value generated by the hash value generation unit with the hash value associated with the captured image; A program that functions as a [Explanation of symbols]
[0132] 100 Tamper detection system, 101 Imaging device, 102 Verification device, 103 Certification authority, 231 Imaging unit, 232 Sensor, 251 Imaging control unit, 252 Partial data extraction unit, 253 Metadata update unit, 254 Hash generation unit, 255 Digital signature generation unit, 256 Linking unit, 257 Output control unit, 351 Acquisition control unit, 352 Certificate verification unit, 353 Digital signature decryption unit, 354 Partial data extraction unit, 355 Hash generation unit, 356 Comparison unit, 357 Output control unit, 401 Image analysis unit, 411 Rearrangement buffer, 412 Encoding unit, 421 Decryption unit, 431 Imaging mode control unit
Claims
1. a hash value generating unit that generates a hash value of a portion of a captured image and portion identification information for identifying the portion; an electronic signature generation unit that generates an electronic signature including the generated hash value; a linking unit that links the generated hash value and the electronic signature to the captured image; An imaging device comprising:
2. The portion is a focused portion of the captured image. The imaging device according to claim 1 .
3. The part is a partial area at a predetermined position of the captured image. The imaging device according to claim 1 .
4. The portion is a portion of the captured image in which some pixels have been thinned out. The imaging device according to claim 1 .
5. The part is a part that is identified based on a result of image analysis of the captured image. The imaging device according to claim 1 .
6. The captured image further includes an extracting unit that extracts the portion from the captured image. The imaging device according to claim 1 .
7. The extraction unit extracts a focused portion of the captured image based on focus information. The imaging device according to claim 6.
8. The extraction unit extracts the portion from the captured image based on an image analysis result of the captured image. The imaging device according to claim 6.
9. Further comprising an update unit that updates metadata of the captured image using the part identification information, The linking unit links the metadata to the captured image by adding the metadata updated by the update unit to the captured image. The imaging device according to claim 1 .
10. The linking unit links a public key used to generate a digital signature and a certificate of the public key to the captured image. The imaging device according to claim 1 .
11. The captured image is a moving image, The linking unit links a hash value of a part of the captured image and the part identification information to the captured image only for an I frame of the moving image. The imaging device according to claim 1 .
12. The captured image is a moving image, The linking unit links a hash value of a part of the captured image and the part identification information to the captured image only for a frame in which the motion of the moving image is higher than a threshold value. The imaging device according to claim 1 .
13. The linking unit is In the case of a continuous shooting mode, the hash value and the electronic signature are linked to the captured image; If the continuous shooting mode is not selected, the hash value of the entire captured image and the electronic signature are associated with the captured image. The imaging device according to claim 1 .
14. Generating a hash value of a portion of a captured image and portion identification information for identifying the portion; generating a digital signature including the generated hash value; Linking the generated hash value and the digital signature to the captured image; An information processing method comprising:
15. A computer comprising: a hash value generating unit that generates a hash value of a portion of a captured image and portion identification information for identifying the portion; an electronic signature generation unit that generates an electronic signature including the generated hash value; A linking unit that links the generated hash value and the electronic signature to the captured image. A program that functions as a
16. An electronic signature decryption unit that decrypts an electronic signature associated with a captured image and obtains a first hash value of a portion of the captured image and part identification information for identifying the portion; an extracting unit that extracts the portion from the captured image based on the portion identification information linked to the captured image together with the electronic signature; a hash value generating unit that generates a second hash value of the extracted portion and the portion specifying information; a comparison unit that compares the first hash value with the second hash value; An information processing device comprising:
17. Decrypting an electronic signature associated with a captured image to obtain a first hash value of a portion of the captured image and part identification information for identifying the portion; extracting the portion from the captured image based on the portion identification information associated with the captured image together with the electronic signature; generating a second hash value of the extracted portion and the portion identifying information; comparing the first hash value with the second hash value; An information processing method comprising:
18. A computer comprising: an electronic signature decryption unit that decrypts an electronic signature associated with a captured image to obtain a first hash value of a portion of the captured image and portion identification information for identifying the portion; an extracting unit that extracts the portion from the captured image based on the portion identification information linked to the captured image together with the electronic signature; a hash value generating unit that generates a second hash value of the extracted portion and the portion specifying information; a comparison unit for comparing the first hash value with the second hash value; A program that functions as a
Citation Information
Patent Citations
Alteration detection information generating apparatus, imaging apparatus, alteration detection information generating method, program, and storage medium
JP2008022372A
Information processing system and information processing method
JP2020022150A
Image capture system and image capture apparatus
WO2015115074A1
Authentication device, authentication system, and authentication method
WO2017022121A1
