Image processing device and method

Abstract

The present disclosure relates to an image processing device and method, with which the authenticity of an image subjected to permitted processing can be guaranteed. The present invention executes: verification of a signature of a pre-processing image; identification of content of processing on the basis of the pre-processing image and a processed image; and determination of whether to guarantee the authenticity of the processed image on the basis of the signature verification result and the identified content of processing. The present invention also uses authenticity determination result display information indicating a determination result of whether the authenticity of the processed image is guaranteed, and generates and displays a display image indicating the determination result thereof. The present disclosure is applicable, for example, to image processing devices and image processing methods.

Description

Image processing device and method

[0001] The present disclosure relates to an image processing device and method, and more particularly to an image processing device and method that can guarantee the authenticity of an image that has been subjected to permissible processing.

[0002] Conventionally, there has been a method that enables tamper detection by adding a digital signature to an image when it is captured (see, for example, Patent Document 1). There has also been a method that enables tracing of an image by leaving a history with a digital signature when the image is generated or edited (see, for example, Non-Patent Document 1). There has also been a method that enables tamper detection of an image and a forgery in which an altered image is projected onto a panel and then photographed (see, for example, Patent Document 2).

[0003] That is, in these tampering detection methods (authenticity determination methods), "authenticity of an image" means "that the target image is identical to its original image (that is, that the original image has not been tampered with)" or "that the image is not obtained by illegal imaging (that is, that so-called trick imaging or the like has not been performed)." In other words, in the above-mentioned tampering detection methods (authenticity determination methods), all cases in which it was detected that some kind of processing had been performed on the original image were determined to be illegal tampering.

[0004] However, image manipulation is a common practice, and not all of it is fraudulent manipulation. For example, in news reports, it is common for images taken at the scene to be manipulated without any malicious intent to make them look better.

[0005] International Publication No. WO 2022 / 137798 International Publication No. WO 2023 / 248807

[0006] https: / / c2pa.org /

[0007] However, with the above-described tampering detection method (authenticity determination method), it is difficult to determine whether the detected alteration is malicious or not. Therefore, even if the alteration is not malicious, the above-described tampering detection method may determine it as unauthorized tampering. Therefore, it is difficult to guarantee the authenticity of an image that has undergone permissible alteration.

[0008] The present disclosure has been made in light of such circumstances, and makes it possible to guarantee the authenticity of an image that has been subjected to permissible processing.

[0009] An image processing device according to one aspect of the present technology is an image processing device that includes a signature verification unit that verifies the signature of an unprocessed image before any processing is applied to the image, a processing identification unit that identifies the content of the processing based on the unprocessed image and a processed image in which the processing has been applied to the pre-processed image, and an authenticity determination unit that determines whether to guarantee the authenticity of the processed image based on the signature verification result and the identified content of the processing.

[0010] An image processing method according to one aspect of the present technology includes verifying a signature of an unprocessed image before processing is applied to the image, identifying the content of the processing based on the unprocessed image and an processed image in which the processing is applied to the pre-processed image, and determining whether to guarantee the authenticity of the processed image based on the signature verification result and the identified content of the processing.

[0011] In an image processing device and method according to one aspect of the present technology, the signature of an unedited image before any editing is applied to the image is verified, the content of the editing is identified based on the unedited image and the edited image obtained by editing the unedited image, and a determination is made as to whether or not the authenticity of the edited image can be guaranteed based on the signature verification result and the identified content of the editing.

[0012] 1 is a diagram illustrating an example of the main configuration of an authenticity determination system. FIG. 2 is a block diagram illustrating an example of the main configuration of an image processing device. FIG. 3 is a diagram illustrating an example of how image transmission occurs. FIG. 4 is a diagram illustrating an example of how an authenticity determination result is output. FIG. 5 is a flowchart illustrating an example of the flow of processing executed in the authenticity determination system. FIG. 6 is a diagram illustrating an example of how image transmission occurs. FIG. 7 is a flowchart illustrating an example of the flow of processing executed in the authenticity determination system. FIG. 8 is a block diagram illustrating an example of the main configuration of an authenticity determination server. FIG. 9 is a flowchart illustrating an example of the flow of authenticity determination processing. FIG. 10 is a flowchart illustrating an example of the flow of processing specification processing. FIG. 11 is a diagram illustrating an example of a display image. FIG. 12 is a flowchart illustrating an example of the flow of authenticity determination processing. FIG. 13 is a flowchart illustrating an example of the flow of processing specification processing. FIG. 14 is a diagram illustrating an example of a display image. FIG. 15 is a flowchart illustrating an example of the flow of authenticity determination processing. FIG. 16 is a flowchart illustrating an example of the flow of processing specification processing. 1 is a diagram showing an example of a display image. FIG. 2 is a flowchart explaining an example of the flow of authenticity determination processing. FIG. 3 is a flowchart explaining an example of the flow of modification specification processing. FIG. 4 is a diagram showing an example of a display image. FIG. 5 is a flowchart explaining an example of the flow of authenticity determination processing. FIG. 6 is a flowchart explaining an example of the flow of modification specification processing. FIG. 7 is a diagram showing an example of a display image. FIG. 8 is a flowchart explaining an example of the flow of authenticity determination processing. FIG. 9 is a flowchart explaining an example of the flow of modification specification processing. FIG. 10 is a diagram showing an example of a display image. FIG. 11 is a block diagram showing an example of the main configuration of an image processing device. FIG. 12 is a diagram showing an example of a GUI. FIG. 13 is a flowchart explaining an example of the flow of processing executed in an image processing system. FIG. 14 is a diagram showing an example of a certification web page.FIG. 1 is a block diagram showing an example of the main configuration of an image processing device; FIG. 2 is a diagram showing an example of a GUI; FIG. 3 is a flowchart explaining an example of the flow of processing executed in an image processing system; FIG. 4 is a diagram showing an example of a certification Web page; and FIG. 5 is a block diagram showing an example of the main configuration of a computer.

[0013] Modes for carrying out the present disclosure (hereinafter referred to as embodiments) will be described below. The description will be made in the following order: 1. Literature, etc. supporting technical content and technical terminology 2. Detection of falsification 3. First embodiment (identification of processing details and authenticity determination based on processing details) 4. Second embodiment (authenticity determination of partial region) 5. Third embodiment (authenticity determination of image synthesis region) 6. Fourth embodiment (authenticity determination of 2D region) 7. Fifth embodiment (verification of processing history) 8. Sixth embodiment (authenticity determination 1 of face region) 9. Seventh embodiment (authenticity determination 2 of face region) 10. Eighth embodiment (authenticity determination of object identification information region) 11. Ninth embodiment (authenticity determination of person identification information region) 12. Tenth embodiment (request for generation of certification web page) 13. Eleventh embodiment (authenticity assurance by a third party) 14. Twelfth embodiment (combination) 15. Supplementary notes

[0014] <1. Literature, etc. supporting technical content and technical terminology> The scope of disclosure of the present technology includes not only the content described in the embodiments, but also the content described in the following patent documents and non-patent documents that were publicly known at the time of filing, as well as the content of other documents referenced in the following patent documents and non-patent documents.

[0015] Patent document 1: (described above) Patent document 2: (described above) Non-patent document 1: (described above)

[0016] In other words, the contents of the above-mentioned patent documents and non-patent documents, as well as the contents of other documents referenced in the above-mentioned patent documents and non-patent documents, are also used as the basis for determining support requirements.

[0017] <2. Tamper Detection> <Tamper Detection Using Digital Signatures> In recent years, advances in science and technology have made it possible to easily generate still images and moving images that are difficult to distinguish from genuine captured images using AI (artificial intelligence). This has led to various social issues, such as so-called fake news. In response to this, methods for detecting tampering in captured images (methods for determining authenticity) have been devised. For example, as described in Patent Literature 1, there is a method that enables tamper detection by adding a digital signature to an image when it is captured. Furthermore, as disclosed in Non-Patent Literature 1, there is a method that leaves a history with a digital signature when an image is created or edited, making the history traceable. Furthermore, as described in Patent Literature 2, there is a method that adds 3D information and a signature to an image, making it possible to detect image tampering and to detect counterfeiting by projecting a tampered image onto a panel and capturing it.

[0018] That is, in these tampering detection methods (authenticity determination methods), "authenticity of an image" means "that the target image is identical to its original image (that is, that the original image has not been tampered with)" or "that the image is not obtained by illegal imaging (that is, that so-called trick imaging or the like has not been performed)." In other words, in the above-mentioned tampering detection methods (authenticity determination methods), all cases in which it was detected that some kind of processing had been performed on the original image were determined to be illegal tampering.

[0019] However, image manipulation is a common practice, and not all of it is fraudulent manipulation. For example, in news reports, it is common for images taken at the scene to be manipulated without any malicious intent to make them look better.

[0020] However, with the above-described tampering detection method (authenticity determination method), it is difficult to determine whether the detected alteration is malicious or not. Therefore, even if the alteration is not malicious, the above-described tampering detection method may determine it as unauthorized tampering. Therefore, it is difficult to guarantee the authenticity of an image that has undergone permissible alteration.

[0021] 3. First Embodiment Identifying the Editing Details and Determining Authenticity Based on the Editing Details Therefore, based on the before-editing image and the after-editing image, the details of the editing applied to the before-editing image are identified, and based on the details of the editing, it is determined whether or not the authenticity of the after-editing image is guaranteed. In other words, it is identified whether or not the editing is permissible.

[0022] In this specification, "authenticity" means that an object is legitimate, that is, that the object is real. For example, "authenticity of an original image" means that the original image is legitimate. Furthermore, "authenticity of an edited image" means that an edited image is identical to a legitimate original image, or that the edited image is an image that has been edited in an acceptable manner with respect to the legitimate original image.

[0023] In addition, in this specification, "processing (or processing)" refers to general processing performed on image data, and includes not only processing that changes the content of an image (processing that involves a visual change) but also processing that modifies data. This "processing that modifies the content of an image" includes, for example, so-called image processing such as image trimming and compositing, image enlargement and reduction, image rotation and deformation, lens aberration correction, color and brightness correction, and white balance adjustment, as well as image replacement (modification of image data). Furthermore, "processing that modifies data" also includes, for example, compression rate changes, format conversion, and metadata tampering. In other words, "processing" includes all processing that makes the processed image data inconsistent with the unprocessed image data. In the following, "processing that modifies the content of an image" will be used as an example of processing. However, the present technology can also be applied to "processing that modifies data" in the same way as the "processing that modifies the content of an image" described below.

[0024] Note that "processing" is also referred to as "editing (or image editing)" or "tampering." An image before processing is also referred to as an "unprocessed image." An image after processing is also referred to as an "processed image."

[0025] Furthermore, in this specification, "permissible processing" refers to processing that is not detected as unauthorized tampering in image tampering detection (image authenticity determination). "Unpermissible processing" refers to processing that is detected as unauthorized tampering in image tampering detection (image authenticity determination). In other words, in the case of the tampering detection method (authenticity determination method) of the present technology, the authenticity of the processed image is guaranteed if "permissible processing" is applied. In contrast, if "unpermissible processing" is applied to the unprocessed image, it is determined that the authenticity of the processed image cannot be guaranteed. "Permissible processing" and "unpermissible processing" may each be any type of processing.

[0026] Furthermore, in this specification, "non-malicious editing" refers to editing that should not be detected as unauthorized tampering in image tampering detection (image authenticity determination). For example, editing that does not substantially change the phenomenon shown in the image (the meaning of the image), such as editing to improve appearance, may be included in "non-malicious editing." For example, cropping to achieve a specific aspect ratio, color correction, lens aberration correction, etc. may be included in "non-malicious editing." In contrast, "malicious editing" refers to editing that should be detected as unauthorized tampering in image tampering detection (image authenticity determination). For example, editing that changes the phenomenon shown in the image (the meaning of the image), such as so-called fake images, may be included in "malicious editing." For example, editing that replaces, erases, or adds objects or people in an image may be included in "malicious editing."

[0027] The criteria for distinguishing between "legitimate editing" and "malicious editing" (which category it is classified as) may be any criteria. For example, the classification may be determined based on the type of editing, the scale of the editing, the target of the editing, the number of editing operations, the impact on the meaning of the image, and the like. For example, cutting and pasting may be determined to be "malicious editing," and color correction may be determined to be "legitimate editing." Editing that erases a large figure in a captured image to portray a false event may be determined to be "malicious editing," while editing that erases a small figure in a captured image to improve the design may be determined to be "legitimate editing." The criteria for distinguishing between "legitimate editing" and "malicious editing" (which category it is classified as) may be predetermined or may vary depending on the situation. For example, even if the editing is identical, editing by the photographer may be determined to be "legitimate editing," while editing by another user may be determined to be "malicious editing." Furthermore, the classification result may vary depending on any conditions, such as the time or device used to perform the editing. The criteria may also be subjective and determined by the user or system that determines authenticity.

[0028] In this specification, "malicious processing" is also referred to as "malicious tampering," "illegal tampering," etc. In addition, "non-malicious processing" is also referred to as "non-malicious tampering," etc.

[0029] As mentioned above, "acceptable editing" and "unacceptable editing" can be any type of editing, but in the following, as an example, we will explain that "non-malicious editing" is "acceptable editing" and "malicious editing" is "unacceptable editing."

[0030] <Authenticity Determination System> Fig. 1 is a diagram showing an example of the main configuration of an authenticity determination system, which is an embodiment of an image processing system to which the present technology is applied. The authenticity determination system 100 shown in Fig. 1 executes processing related to determining the authenticity of an image. As shown in Fig. 1, this authenticity determination system 100 includes an imaging device 101, a file conversion device 102, an image processing device 103, an authenticity determination server 104, a Web server 105, a terminal device 106, and a network 110. Each device from the imaging device 101 to the terminal device 106 is connected to the network 110 so as to be able to communicate with each other.

[0031] The network 110 is a communication network that serves as a communication medium between devices. The network 110 may be a wired communication network, a wireless communication network, or both. For example, the network 110 may be a wired local area network (LAN), a wireless LAN, a public telephone line network, a wide area communication network for wireless mobile devices such as a 4G line or a 5G line, the Internet, or a combination thereof. The network 110 may be a single communication network or multiple communication networks. For example, the network 110 may be partially or entirely composed of communication cables of a predetermined standard, such as a USB (Universal Serial Bus) (registered trademark) cable or an HDMI (High-Definition Multimedia Interface) (registered trademark) cable.

[0032] That is, each of the devices from the imaging device 101 to the terminal device 106 has a communication function and is connected to be able to communicate with each other via the network 110. Note that each device may have a wired communication function, a wireless communication function, or both.

[0033] The imaging device 101 performs processing related to capturing an image of a subject, i.e., generating a captured image (image file). For example, the imaging device 101 may capture an image of a subject and generate a captured image. The imaging device 101 may generate an image file that stores the captured image, etc. The imaging device 101 may generate a tamper detection signature and store it in the image file. The imaging device 101 may supply the image file to another device via the network 110 or a recording medium (not shown).

[0034] The file conversion device 102 performs processing related to format conversion of an image file. For example, the file conversion device 102 may acquire an image file from another device via the network 110 or a recording medium (not shown). The file conversion device 102 may convert the format of the acquired image file from a first format to a second format different from the first format. The file conversion device 102 may supply the converted image file to the other device via the network 110 or a recording medium (not shown).

[0035] The image processing device 103 performs processing related to image processing. For example, the image processing device 103 may acquire an image file from another device via the network 110 or a recording medium (not shown). The image processing device 103 may perform processing on image data stored in the acquired image file. The image processing device 103 may provide an image file storing an edited image to another device via the network 110 or a recording medium (not shown). The image processing device 103 may also acquire authenticity determination result display information provided from another device via the network 110 or a recording medium (not shown). The authenticity determination result display information is information for displaying the authenticity determination result and is information for generating a determination result display image that shows the determination result. For example, the image processing device 103 may acquire authenticity determination result display information provided from the authenticity determination server 104. The image processing device 103 may also access a uniform resource locator (URL) provided by the web server 105 and acquire a certification web page published at the URL as the authenticity determination result display information. The certification web page is a web page that includes authenticity determination result display information. For example, the image processing device 103 may generate a determination result display image based on the authenticity determination result display information acquired from the authenticity determination server 104 and display it on a display device, etc. Alternatively, the image processing device 103 may generate a determination result display image based on a certification web page acquired from the web server 105 and display it on a display device, etc.

[0036] The authenticity determination server 104 executes processes related to authenticity determination. For example, the authenticity determination server 104 may acquire an image file from another device via the network 110 or a recording medium (not shown). The authenticity determination server 104 may determine the authenticity of an edited image stored in the acquired image file and generate authenticity determination result display information. The authenticity determination server 104 may provide the authenticity determination result display information to another device via the network 110 or a recording medium (not shown). For example, the authenticity determination server 104 may generate a certification web page as the authenticity determination result display information and provide it to the web server 105.

[0037] The web server 105 executes processing related to a certification web page, which is an example of authenticity determination result display information. For example, the web server 105 may acquire a certification web page provided as authenticity determination result display information from another device (e.g., the authenticity determination server 104) via the network 110 or a recording medium (not shown). The web server 105 may publish the certification web page at a predetermined uniform resource locator (URL) so that it can be referenced from other devices.

[0038] The terminal device 106 executes processing related to viewing the certification web page. For example, the terminal device 106 may access a URL provided by the web server 105 and obtain the certification web page published at that URL as authenticity determination result display information. The terminal device 106 may generate a determination result display image including the contents of the certification web page and display the determination result display image on a display device. This allows the user of the terminal device 106 to view information related to the authenticity determination result provided as the certification web page.

[0039] Although FIG. 1 illustrates the authenticity determination system 100 as including one of each device, from the imaging device 101 to the terminal device 106, the authenticity determination system 100 may include multiple imaging devices 101. Similarly, the authenticity determination system 100 may include multiple file conversion devices 102. Similarly, the authenticity determination system 100 may include multiple image processing devices 103. Similarly, the authenticity determination system 100 may include multiple authenticity determination servers 104. Similarly, the authenticity determination system 100 may include multiple web servers 105. Similarly, the authenticity determination system 100 may include multiple terminal devices 106. The number of devices, from the imaging device 101 to the terminal device 106, included in the authenticity determination system 100 may be the same as or different from the other devices.

[0040] Furthermore, each of the above-described devices from the imaging device 101 to the terminal device 106 may be configured as a single device or multiple devices. Furthermore, the authenticity determination server 104 and the web server 105 may be implemented as cloud computing (i.e., a cloud server) in which multiple devices share and collaborate over a network. Furthermore, the authenticity determination server 104 and the web server 105 may be configured as terminal devices, or the imaging device 101, file conversion device 102, image processing device 103, and terminal device 106 may be configured as servers. Furthermore, among the devices from the imaging device 101 to the terminal device 106 described as different devices in FIG. 1 , any two or more devices may be configured as a single device. In other words, the functions of any two or more devices from the imaging device 101 to the terminal device 106 may be implemented in a single device. Furthermore, some of the devices from the imaging device 101 to the terminal device 106 described above may be omitted. Furthermore, the authenticity determination system 100 may further include devices other than the above-described devices from the imaging device 101 to the terminal device 106 .

[0041] <Image Processing Device> Fig. 2 is a block diagram showing an example of the main configuration of the image processing device 103 in Fig. 1. As shown in Fig. 2, the image processing device 103 has an image acquisition unit 131, an image processing unit 132, an authenticity determination request unit 133, and an authenticity determination result display unit 134.

[0042] The image acquisition unit 131 executes processing related to image acquisition. For example, the image acquisition unit 131 may acquire an image file supplied from another device via the network 110 or a recording medium (not shown). The image acquisition unit 131 may supply the acquired image file to the image processing unit 132.

[0043] The image processing unit 132 performs processing related to image processing. For example, the image processing unit 132 may acquire an image file supplied from the image acquisition unit 131. For example, the image processing unit 132 may acquire an image file including an unprocessed image to be processed. This unprocessed image may be an original image, which is an image in a generated state (unprocessed), or an image obtained by performing some processing on the original image. The image processing unit 132 may perform processing on the image file. In other words, the image processing unit 132 may process the unprocessed image to generate a processed image. The image processing unit 132 may supply the unprocessed image and the processed image to the authenticity determination request unit 133. Note that the unprocessed image and the processed image may be supplied to the authenticity determination request unit 133 in a state stored in a single image file, or may be supplied to the authenticity determination request unit 133 in a state stored in different image files.

[0044] The authenticity determination request unit 133 executes processing related to a request for authenticity determination of an image. For example, the authenticity determination request unit 133 may acquire an unedited image and an edited image supplied from the image processing unit 132. As described above, the unedited image and the edited image may be stored in a single image file, or may be stored in different image files. The authenticity determination request unit 133 may request an authenticity determination for the edited image by supplying the acquired unedited image and edited image to the authenticity determination server 104 via the network 110 or a recording medium (not shown). In this case, the unedited image and the edited image may be supplied to the authenticity determination server 104 in a state stored in a single image file, or may be supplied to the authenticity determination server 104 in a state stored in different image files.

[0045] The authenticity determination result display unit 134 executes processing related to displaying the authenticity determination result of the image. For example, the authenticity determination result display unit 134 may acquire authenticity determination result display information provided as a response to the request via the network 110 or a recording medium (not shown). That is, the authenticity determination result display unit 134 may acquire authenticity determination result display information indicating the authenticity determination result of the processed image. This authenticity determination result display information may be provided from the authenticity determination server 104 or from another device. For example, the authenticity determination result display unit 134 may access a URL provided by the web server 105 and acquire a certification web page published at that URL as the authenticity determination result display information. The authenticity determination result display unit 134 generates a determination result display image based on the acquired authenticity determination result display information and displays it on a display device. This allows the user of the image processing device 103 to confirm the requested authenticity determination result. Therefore, the authenticity determination result display unit 134 is also referred to as a display processing unit.

[0046] <Image Transmission Example 1> FIG. 3 shows an example of image transmission during the process of determining the authenticity of an image in the above-described authenticity determination system 100. In the example of FIG. 3, the imaging device 101 generates a digitally signed image file 141 and supplies it to the file conversion device 102. The digitally signed image file 141 shown in FIG. 3 is an image file that stores a main image and its digital signature. As shown in FIG. 3, the digitally signed image file 141 may store an SOI (Start of Image), APP1, APP11, an original image, and a screenshot. The SOI is a start marker indicating the start of a JPEG (Joint Photographic Experts Group) file. APP1 and APP11 are application data set by an application. For example, APP1 may store Exif (Exchangeable Image File Format) information. APP11 may store a tamper-detection signature (Multi hash for each area and signature). The original image is stored as the main image of this digitally signed image file 141. A screennail is a reduced image of a main image (original image). The image size of a screennail can be any size as long as it is smaller than the main image, but it is generally set to a size larger than a reduced image called a thumbnail.

[0047] The file conversion device 102 converts the file format of the digitally signed image file 141 to generate a history-preserving format image file 142. The file conversion device 102 then supplies the generated history-preserving format image file 142 to the image processing device 103. The history-preserving format image file 142 is a file format that can preserve the history of processing from the original image. For example, the history-preserving format image file 142 may be in a file format that complies with the C2PA standard described in Non-Patent Document 1. For example, this history-preserving format image file 142 may include a metadata (C2PA meta) area and a vendor extension area, and the above-mentioned SOI, APP1, APP11, and screencap may be stored in this vendor extension area. Note that in the history-preserving format image file 142, the original image is stored as the main image.

[0048] The image processing device 103 regards the main image of the acquired history keeping format image file 142 as an unprocessed image and processes the unprocessed image to generate an processed image. The image processing device 103 then supplies the history keeping format image file 143, which stores the processed image as the main image, to the authenticity determination server 104, thereby requesting a determination of the authenticity of the processed image. The history keeping format image file 143 has the same file format as the history keeping format image file 142. In other words, the history keeping format image file 143 includes a digital signature of the original image and information regarding the processing history from the original image to the processed image. In the case of the history keeping format image file 143, the processed image is stored as the main image. Information regarding the processing by the image processing device 103 is also stored in the history keeping format image file 143.

[0049] The authenticity determination server 104 acquires the pre-edited image and the post-edited image from the acquired history-retaining format image file 143. The authenticity determination server 104 also determines the authenticity of the pre-edited image based on the digital signature (information related to the history of editing) stored in the history-retaining format image file 143. The authenticity determination server 104 uses the pre-edited image and the post-edited image to identify the details of the editing applied to the pre-edited image (i.e., the editing performed when generating the post-edited image from the pre-edited image; the difference between the post-edited image and the pre-edited image). The authenticity determination server 104 then determines the authenticity of the post-edited image based on the result of the determination of the authenticity of the pre-edited image and the identified details of the editing.

[0050] The image processing device 103 may store the unprocessed image and the processed image in different image files and supply them to the authenticity determination server 104 .

[0051] <Example of Determination Result Output> Fig. 4 is a diagram showing an example of how authenticity determination result display information is output. As shown in Fig. 4, the authenticity determination server 104 may generate authenticity determination result display information and, as a response to a request for authenticity determination, supply the authenticity determination result display information to the image processing device 103 that has made the request. In this case, the image processing device 103 acquires the authenticity determination result display information and generates and displays a determination result display image based on the authenticity determination result display information.

[0052] 4, the authenticity determination server 104 may generate a certification web page as authenticity determination result display information and provide the certification web page to the web server 105. The web server 105 makes the certification web page publicly available at a predetermined URL.

[0053] <Processing Flow 1> An example of the processing flow executed in the authenticity determination system 100 in the example of FIGS. 3 and 4 will be described with reference to the flowchart of FIG.

[0054] That is, in step S111, the imaging device 101 captures an image of a subject to generate a captured image (original image) and stores it in the digitally signed image file 141. In step S112, the imaging device 101 supplies the digitally signed image file 141 to the file conversion device 102.

[0055] In step S121, the file conversion device 102 acquires the digitally signed image file 141. In step S122, the file conversion device 102 converts the file format of the digitally signed image file 141 to generate a history retention format image file 142. In step S123, the file conversion device 102 supplies the history retention format image file 142 to the image processing device 103.

[0056] In step S131, the image processing device 103 acquires the history retaining format image file 142. In step S132, the image processing device 103 processes the main image of the history retaining format image file 142 as an unprocessed image to generate an processed image. In step S133, the image processing device 103 supplies the history retaining format image file 143, which stores the processed image as the main image, to the authenticity determination server 104, thereby requesting a determination of the authenticity of the processed image.

[0057] In step S141, the authenticity determination server 104 acquires the history retention format image file 143 (i.e., the request for authenticity determination). In step S142, the authenticity determination server 104 executes an authenticity determination process using the history retention format image file 143 and determines the authenticity of the processed image. In step S143, the authenticity determination server 104 outputs authenticity determination result display information generated by the authenticity determination process. For example, the authenticity determination server 104 may provide the authenticity determination result display information to the image processing device 103 that made the request in response to the authenticity determination request. The authenticity determination server 104 may also provide a certification web page to the web server 105 as the authenticity determination result display information.

[0058] In step S134, the image processing device 103 receives the response (i.e., authenticity determination result display information). In step S135, the image processing device 103 generates and displays a determination result display image based on the authenticity determination result display information.

[0059] In step S151, the web server 105 acquires the certification web page (i.e., authenticity determination result display information). In step S152, the web server 105 publishes the certification web page at a specified URL. In this way, the terminal device 106 can access the URL to acquire the certification web page, and generate and display a determination result display image based on the acquired certification web page.

[0060] Each device of the authenticity determination system 100 may execute each of the processes described above.

[0061] <Image Transmission Example 2> The imaging device 101 may generate a history keeping format image file 142 instead of the digitally signed image file 141. In this case, the file conversion device 102 may be omitted. FIG. 6 shows another example of image transmission in the process up to the determination of the authenticity of the image in this case. In the example of FIG. 6, the imaging device 101 generates the history keeping format image file 142 and supplies it to the image processing device 103. In other words, the image processing device 103 obtains the history keeping format image file 142 supplied from the imaging device 101. The subsequent process is the same as in the case of FIG. 3. In this case, the output of the authenticity determination result display information is also performed in the same manner as in the example of FIG. 4.

[0062] <Processing Flow 2> An example of the processing flow executed in the authenticity determination system 100 in the examples of FIGS. 4 and 6 will be described with reference to the flowchart of FIG.

[0063] In this case, in step S211, the imaging device 101 captures an image of a subject to generate a captured image (original image) and stores it in the history retention format image file 142. In step S212, the imaging device 101 supplies the history retention format image file 142 to the image processing device 103.

[0064] In step S231, the image processing device 103 acquires the history retaining format image file 142. In step S232, the image processing device 103 processes the main image of the history retaining format image file 142 as an unprocessed image to generate an processed image. In step S233, the image processing device 103 supplies the history retaining format image file 143, which stores the processed image as the main image, to the authenticity determination server 104, thereby requesting a determination of the authenticity of the processed image.

[0065] In step S241, the authenticity determination server 104 acquires the history retention format image file 143 (i.e., the request for authenticity determination). In step S242, the authenticity determination server 104 executes an authenticity determination process using the history retention format image file 143 and determines the authenticity of the processed image. In step S243, the authenticity determination server 104 outputs authenticity determination result display information generated by the authenticity determination process. For example, the authenticity determination server 104 may provide the authenticity determination result display information to the image processing device 103 that made the request in response to the authenticity determination request. The authenticity determination server 104 may also provide a certification web page to the web server 105 as the authenticity determination result display information.

[0066] In step S234, the image processing device 103 receives the response (i.e., authenticity determination result display information). In step S235, the image processing device 103 generates and displays a determination result display image based on the authenticity determination result display information.

[0067] In step S251, the Web server 105 acquires the certification Web page (i.e., authenticity determination result display information). In step S252, the Web server 105 publishes the certification Web page at a specified URL. In this way, the terminal device 106 can access the URL to acquire the certification Web page, and generate and display a determination result display image based on the acquired certification Web page.

[0068] Each device of the authenticity determination system 100 may execute each of the processes described above.

[0069] <Image Transmission Example 3> The image processing device 103 may also process a digitally signed image file instead of a history-retaining format image file. That is, the image processing device 103 may store the main image of the digitally signed image file as the unprocessed image and the processed image in the digitally signed image file. In this case, the file conversion device 102 may be omitted. In this case, an example of image transmission in the process up to the determination of image authenticity is shown in FIG. 8. In the example of FIG. 8, the imaging device 101 generates a digitally signed image file 141 and supplies it to the image processing device 103.

[0070] The image processing device 103 acquires the digitally signed image file 141. The image processing device 103 uses the main image of the acquired digitally signed image file 141 as an unedited image, and processes the unedited image to generate an edited image. The image processing device 103 generates a digitally signed image file 141' that stores the edited image as the main image. In other words, the image processing device 103 stores the edited image in an image file different from the unedited image. The image processing device 103 supplies both the digitally signed image file 141 and the generated digitally signed image file 141' to the authenticity determination server 104, requesting a determination of the authenticity of the edited image.

[0071] When the image processing device 103 performs processing on an original image by processing the image as an unprocessed image, image files with digital signatures for the number of times the processing has been performed are supplied to the image processing device 103. In other words, image files with digital signatures for the number of times the processing has been performed, from the original image to the processed image, are supplied to the authenticity determination server 104.

[0072] The authenticity determination server 104 acquires the digitally signed image file 141 and the digitally signed image file 141'. The authenticity determination server 104 acquires the unedited image and the edited image stored in those files. The authenticity determination server 104 determines the authenticity of the unedited image based on the digital signatures stored in those files. The authenticity determination server 104 uses the unedited image and the edited image to identify the details of the edit applied to the unedited image (i.e., the edit performed when generating the edited image from the unedited image; the difference between the edited image and the unedited image). The authenticity determination server 104 then determines the authenticity of the edited image based on the determination result of the authenticity of the unedited image and the identified details of the edit. The subsequent processing is the same as in the case of FIG. 3. In this case, the output of the authenticity determination result display information is also performed in the same manner as in the example of FIG. 4.

[0073] <Processing Flow 3> An example of the processing flow executed in the authenticity determination system 100 in the examples of FIGS. 4 and 8 will be described with reference to the flowchart of FIG.

[0074] In this case, in step S311, the imaging device 101 captures an image of a subject to generate a captured image (original image) and stores it in the digitally signed image file 141. In step S312, the imaging device 101 supplies the digitally signed image file 141 to the image processing device 103.

[0075] In step S331, the image processing device 103 acquires the digitally signed image file 141. In step S332, the image processing device 103 processes the main image of the digitally signed image file 141 as an unprocessed image, generates a processed image, and stores the processed image in the digitally signed image file 141'. In step S333, the image processing device 103 supplies the digitally signed image file 141 and the digitally signed image file 141' to the authenticity determination server 104, thereby requesting that the authenticity of the processed image be determined.

[0076] In step S341, the authenticity determination server 104 acquires the digitally signed image file 141 and the digitally signed image file 141' (i.e., a request for authenticity determination). In step S342, the authenticity determination server 104 executes an authenticity determination process using the digitally signed image file 141 and the digitally signed image file 141' to determine the authenticity of the processed image. In step S343, the authenticity determination server 104 outputs authenticity determination result display information generated by the authenticity determination process. For example, the authenticity determination server 104 may provide the authenticity determination result display information to the image processing device 103 that made the request in response to the authenticity determination request. The authenticity determination server 104 may also provide a certification web page to the web server 105 as the authenticity determination result display information.

[0077] In step S334, the image processing device 103 receives the response (i.e., authenticity determination result display information). In step S335, the image processing device 103 generates and displays a determination result display image based on the authenticity determination result display information.

[0078] In step S351, the Web server 105 acquires the certification Web page (i.e., the authenticity determination result display information). In step S352, the Web server 105 publishes the certification Web page at a predetermined URL. In this way, the terminal device 106 can access the URL to acquire the certification Web page, and generate and display a determination result display image based on the acquired certification Web page.

[0079] Each device of the authenticity determination system 100 may execute each of the processes described above.

[0080] <Identifying the editing content and determining authenticity based on the editing content> In any of the examples shown in Figures 3, 6, and 8, the authenticity determination server 104 identifies the editing content applied to the pre-edited image based on the pre-edited image and the post-edited image, and determines whether to guarantee the authenticity of the post-edited image based on the editing content.

[0081] For example, a first image processing device includes a signature verification unit that verifies the signature of an unprocessed image before any processing is applied to the image, a processing identification unit that identifies the content of the processing based on the unprocessed image and a processed image obtained by processing the pre-processed image, and an authenticity determination unit that determines whether to guarantee the authenticity of the processed image based on the signature verification result and the identified content of the processing.

[0082] For example, an image processing method is applied in which a first image processing device verifies the signature of an unprocessed image before any processing is applied to the image, identifies the content of the processing based on the unprocessed image and an processed image obtained by processing the pre-processed image, and determines whether or not to guarantee the authenticity of the processed image based on the signature verification result and the identified content of the processing.

[0083] In this way, the first image processing device can guarantee the authenticity of an image that has undergone acceptable manipulation.

[0084] <Display of authenticity determination result> In addition, in any of the examples of Figures 3, 6, and 8, the image processing device 103 (or the terminal device 106) displays the determination result as to whether or not the authenticity of the processed image executed as described above can be guaranteed.

[0085] For example, the second image processing device is provided with a display processing unit that generates a display image showing the judgment result using authenticity judgment result display information that indicates the judgment result as to whether or not the authenticity of the processed image is guaranteed, and displays the display image.

[0086] For example, an image processing method is applied in which a first image processing device generates a display image showing the judgment result using authenticity judgment result display information that indicates the judgment result as to whether or not the authenticity of the processed image is guaranteed, and displays the display image.

[0087] The processed image is an image obtained by processing the unprocessed image.

[0088] In this way, the second image processing device can notify that the authenticity of the image that has been subjected to permissible processing has been guaranteed.

[0089] <Authenticity Determination Server> Fig. 10 is a block diagram showing an example of the main configuration of the authenticity determination server 104 in Fig. 1. As shown in Fig. 10, the authenticity determination server 104 has an image acquisition unit 211, a signature verification unit 212, a manipulation identification unit 213, an authenticity determination unit 214, and an authenticity determination result display information output unit 215.

[0090] The image acquisition unit 211 executes processing related to image acquisition. For example, the image acquisition unit 211 may acquire an image file supplied from another device via the network 110 or a recording medium (not shown). The image acquisition unit 211 may acquire the pre-edited image and the post-edited image stored in the image file. Note that the pre-edited image and the post-edited image may be stored in different image files. The image acquisition unit 211 may supply the acquired pre-edited image and the post-edited image to the signature verification unit 212 together with the image file, etc.

[0091] The signature verification unit 212 performs processing related to the verification of electronic signatures. For example, the signature verification unit 212 may acquire an unedited image, an edited image, and an image file supplied from the image acquisition unit 211. For example, the signature verification unit 212 may determine the authenticity of the unedited image by verifying the electronic signature stored in the image file. That is, the signature verification unit 212 may verify the signature of the unedited image before the image is edited. For example, if no tampering is detected by verifying the electronic signature, the signature verification unit 212 may determine that the authenticity of the unedited image is guaranteed. Alternatively, if tampering is detected by verifying the electronic signature, the signature verification unit 212 may determine that the authenticity of the unedited image is not guaranteed. The signature verification unit 212 may supply the signature verification result (the determination result of the authenticity of the unedited image) to the editing identification unit 213 together with the unedited image, the edited image, the image file, etc.

[0092] The edit specifying unit 213 executes processing related to specifying the details of edits applied to the before-edit image (the difference between the edited image and the before-edit image). For example, the edit specifying unit 213 may acquire the signature verification result (the result of determining the authenticity of the before-edit image), the before-edit image, the after-edit image, and the image file supplied from the signature verification unit 212. The edit specifying unit 213 may specify the details of the edits using the before-edit image and the after-edit image. That is, the edit specifying unit 213 may specify the details of the edits (what kind of edits have been performed) based on the before-edit image and the after-edit image obtained by applying edits to the before-edit image. Any method may be used to specify the details of the edits. Furthermore, the specified details may be anything. For example, they may be the type of edit performed or the values ​​of parameters applied in the edits. Furthermore, any number of edits may be specified, and a single edit or multiple edits may be specified. The processing identification unit 213 may supply information indicating the content of the identified processing to the authenticity determination unit 214 along with the signature verification result (the determination result of the authenticity of the unprocessed image), the unprocessed image, the processed image, the image file, etc.

[0093] The authenticity determination unit 214 executes processing related to authenticity determination. For example, the authenticity determination unit 214 may acquire information indicating the details of the processing, a signature verification result (determination result of the authenticity of the before-processing image), the before-processing image, the after-processing image, and an image file, supplied from the processing specification unit 213. The authenticity determination unit 214 may determine whether to guarantee the authenticity of the after-processing image based on the signature verification result (determination result of the authenticity of the before-processing image) and the specified details of the processing.

[0094] For example, the authenticity determination unit 214 may determine that the authenticity of the edited image is guaranteed if the signature verification result guarantees the authenticity of the before-edited image and the editing of the before-edited image is identified as permissible editing. Furthermore, the authenticity determination unit 214 may determine that the authenticity of the edited image is not guaranteed if the signature verification result does not guarantee the authenticity of the before-edited image. Furthermore, the authenticity determination unit 214 may determine that the authenticity of the edited image is not guaranteed if the editing of the before-edited image is identified as permissible editing.

[0095] It should be noted that the "contents of processing" may include (the values ​​of) parameters applied in the processing. For example, the authenticity determination unit 214 may determine whether to guarantee the authenticity of the processed image based on whether the values ​​of the parameters applied in the processing are at an acceptable level. Furthermore, the determination result is not limited to a binary value of whether or not the authenticity is guaranteed, but may be multivalued. For example, the authenticity determination unit 214 may divide the accuracy (certainty) of the authenticity guarantee into three or more levels and derive the level (also referred to as the authenticity guarantee level) as the determination result. In other words, ambiguity may be added to the guarantee of authenticity.

[0096] The criteria for this determination may be predetermined. Furthermore, the criteria may be set or changeable as appropriate. Furthermore, the criteria for this determination may be a common criterion that is independent of the image, device, etc. Furthermore, the criteria for this determination may be a criterion set in the device that executes the authenticity determination (for example, a criterion set by the user of the device). Furthermore, the criteria for this determination may be a criterion set in the device that requests the authenticity determination (for example, a criterion set by the user of the device).

[0097] The authenticity determination unit 214 may supply such a determination result to the authenticity determination result display information output unit 215 .

[0098] The authenticity determination result display information output unit 215 executes processing related to the output of authenticity determination result display information. For example, the authenticity determination result display information output unit 215 may acquire the authenticity determination result of the processed image supplied from the authenticity determination unit 214. Based on the determination result, the authenticity determination result display information output unit 215 may generate authenticity determination result display information indicating the determination result of whether or not the authenticity of the processed image is guaranteed. The authenticity determination result display information output unit 215 may supply (output) the generated authenticity determination result display information to another device. For example, the authenticity determination result display information output unit 215 may supply the generated authenticity determination result display information to the image processing device 103 or may supply a certification web page to the web server 105. Note that the authenticity determination result display information may be displayed on the authenticity determination server 104 without being supplied to another device.

[0099] The authenticity determination result display information may include any information related to the display of the authenticity determination result. For example, the authenticity determination result display information may specify the content to be displayed in the determination result display image. For example, the authenticity determination result display information may specify that the processing content be displayed in the determination result display image. Furthermore, information indicating the processing content to be displayed (e.g., the type of processing, applied parameter values, etc.) may be specified. Furthermore, the displayed content and design may be different between cases where authenticity is guaranteed and cases where it is not. For example, settings such as color, shape, size, thickness, position, emphasis / de-emphasis (prominent / inconspicuous), display / hide, etc. may be different between cases where authenticity is guaranteed and cases where it is not. Furthermore, such settings may be different for each authenticity assurance level.

[0100] With this configuration, the authenticity determination server 104 can guarantee the authenticity of images that have undergone acceptably edited processing. For example, when providing a service that guarantees the authenticity of images, if it is not possible to guarantee the authenticity of images that have undergone acceptably edited processing, as in the conventional method, there is a risk that any editing will not be permitted in order to guarantee authenticity, which could reduce the practicality and convenience of the service. In contrast, by applying the present technology, the authenticity determination server 104 can guarantee the authenticity of images that have undergone acceptably edited processing. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a reduction in the practicality and convenience of such services.

[0101] <Flow of Authenticity Determination Process> An example of the flow of the authenticity determination process executed by the authenticity determination server 104 will be described with reference to the flowchart of FIG.

[0102] When the authenticity determination process starts, the image acquisition unit 211 acquires an image file in step S401, and acquires the unedited image and the edited image stored in the image file.

[0103] In step S402, the signature verification unit 212 verifies the signature of the unedited image stored in the image file.

[0104] In step S403, the processing specifying unit 213 executes processing specifying processing, and specifies processing to be performed on the before-processing image using the before-processing image and the after-processing image.

[0105] In step S404, the authenticity determination unit 214 determines the authenticity of the edited image based on the identified details of the edit.

[0106] In step S405, the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result, and outputs it to another device.

[0107] When the process of step S405 is completed, the authenticity determination process ends.

[0108] <Flow of Processing Specification Process> Next, an example of the flow of the processing specification process executed in step S403 of FIG. 11 will be described with reference to the flowchart of FIG.

[0109] When the processing specification process is started, the processing specification unit 213 determines whether or not angle of view processing, which is processing for changing the angle of view, is performed in step S421. Note that any method may be used to determine whether or not angle of view processing is performed.

[0110] In step S422, the processing specifying unit 213 determines whether or not brightness processing, which is processing for changing the brightness of the image, is performed. Note that any method may be used to determine whether or not brightness processing is performed.

[0111] In step S423, the processing specifying unit 213 determines whether or not color processing, which is processing for changing the color of the image, is performed. Note that any method may be used to determine whether or not color processing is performed.

[0112] In step S424, the processing specifying unit 213 determines whether or not an object addition / deletion processing has been performed, which is processing to add an object to an image or to delete an object from an image. Note that any method may be used to determine whether or not an object addition / deletion processing has been performed.

[0113] When the process of step S424 ends, the processing specification process ends, and the process returns to FIG.

[0114] The content of the processing identified in this processing identification process may be any processing and is not limited to the example of Fig. 12. In other words, in the example of Fig. 12, the presence or absence of processing such as angle of view processing, brightness processing, color processing, and object addition / deletion processing is detected, but the presence or absence of processing other than these examples may also be detected. Furthermore, the value of a parameter applied in the processing may also be specified.

[0115] By performing each process as described above, the authenticity determination server 104 can guarantee the authenticity of images that have undergone acceptably edited processing. For example, when providing a service that guarantees the authenticity of images, if it is not possible to guarantee the authenticity of images that have undergone acceptably edited processing, as in the conventional method, there is a risk that any editing will not be permitted in order to guarantee authenticity, which could reduce the practicality and convenience of the service. In contrast, by applying the present technology, the authenticity determination server 104 can guarantee the authenticity of images that have undergone acceptably edited processing. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a reduction in the practicality and convenience of such services.

[0116] <Display Image Example> In this case, the determination result display image may include information indicating the determination result of whether or not the authenticity of the processed image is guaranteed. In other words, the authenticity determination result display information in this case may include information for generating a determination result display image indicating the determination result of whether or not the authenticity of the processed image is guaranteed. For example, in the image processing device 103, the authenticity determination result display unit 134 uses the authenticity determination result display information indicating the determination result of whether or not the authenticity of the processed image is guaranteed to generate a display image indicating the determination result and display it on a display device.

[0117] In this way, the image processing device 103 can notify that the authenticity of an image that has been processed to an acceptable level is guaranteed. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0118] The determination result display image 230 shown in FIG. 13 is an example of the determination result display image in this case. As shown in FIG. 13, the determination result display image 230 includes information indicating the determination result of whether or not the authenticity of the edited image is guaranteed. Note that whether or not the authenticity of the edited image is guaranteed may be expressed in any way in the determination result display image 230. For example, information about the edit may be displayed only when authenticity is guaranteed. In other words, only information about permissible edits may be included in the determination result display image. In other words, the authenticity determination result display information may include information for generating a determination result display image that includes only information about permissible edits. For example, in the image processing device 103, the authenticity determination result display unit 134 may generate a determination result display image that includes only information about permissible edits. This makes it easy to identify that the authenticity of the edited image is guaranteed (that the edits are permissible).

[0119] Furthermore, information about the processing may be displayed only when authenticity is not guaranteed. In other words, only information about unacceptable processing may be included in the determination result display image 230. In other words, the authenticity determination result display information may include information for generating a determination result display image that includes only information about unacceptable processing. For example, in the image processing device 103, the authenticity determination result display unit 134 may generate a determination result display image that includes only information about unacceptable processing. In this way, it is possible to easily identify that the authenticity of the processed image is not guaranteed (that the processing is unacceptable).

[0120] Furthermore, the determination result display image 230 may be displayed differently depending on whether authenticity is guaranteed or not. For example, the color, shape, size, thickness, position, emphasis / non-emphasis (prominent / inconspicuous), and other settings may be different for each case. That is, the determination result display image 230 may include "information regarding permissible editing" and "information regarding unacceptable editing," which are displayed differently. In other words, the authenticity determination result display information may include both "information regarding permissible editing" and "information regarding unacceptable editing," and may include information for generating a determination result display image that displays the information differently. For example, in the image processing device 103, the authenticity determination result display unit 134 may generate the determination result display image 230 so that the display content changes depending on whether the authenticity of the edited image is guaranteed and whether the authenticity of the edited image is not guaranteed. This makes it easy to identify whether the authenticity of the edited image is guaranteed (whether the editing is permissible or not).

[0121] As shown in FIG. 13 , the determination result display image 230 may include an area 231 in which the original image is displayed. That is, the determination result display image may include the unedited image. In other words, the authenticity determination result display information may include information for generating a determination result display image that includes the unedited image. For example, in the image processing device 103, the authenticity determination result display unit 134 may generate a determination result display image that further includes the unedited image (e.g., area 231). Furthermore, the determination result display image 230 may include an area 232 in which the edited image is displayed. That is, the edited image may be included in the determination result display image. In other words, the authenticity determination result display information may include information for generating a determination result display image that includes the edited image. For example, in the image processing device 103, the authenticity determination result display unit 134 may generate a determination result display image that further includes the edited image (e.g., area 232). Furthermore, the determination result display image 230 may include a detection edit list 233 that displays information indicating the details of the edit. That is, information indicating the details of the processing may be included in the determination result display image. In other words, the authenticity determination result display information may include information for generating a determination result display image including information indicating the details of the processing. For example, in the image processing device 103, the authenticity determination result display unit 134 may generate a determination result display image that further includes information indicating the details of the processing (e.g., the detection processing list 233).

[0122] Any information may be displayed in the detected edit list 233. For example, as shown in FIG. 13 , the detected edit list 233 may display the type of edit, such as trimming or white balance, and its parameter value, such as 20% or 10%. The detected edit list 233 may also display information about permissible edits, information about unpermissible edits, or both. The information about permissible edits and the information about unpermissible edits may be displayed in different designs.

[0123] <4. Second embodiment> <Determination of authenticity of partial region> Note that, when applying the present technology described in the first embodiment, the content of the processing applied to a partial region of the pre-processed image may be identified based on the pre-processed image and the post-processed image, and based on the content of the processing, it may be determined whether or not to guarantee the authenticity of that partial region of the post-processed image. That is, the authenticity may be determined for a partial region of the post-processed image. In other words, a local authenticity determination may be performed.

[0124] In this specification, a partial region to be processed is also referred to as a processing target region, and a partial region to be subjected to authenticity determination is also referred to as an authenticity determination target region.

[0125] The configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as that in the example ( FIG. 10 ) described in the first embodiment.

[0126] However, the processing specification unit 213 may specify the processing target area (position, size, shape, etc.). The processing target area may be any area as long as it is a partial area relative to the entire area of ​​the image, and its position, size, and shape are each arbitrary. Furthermore, any method may be used to specify the processing target area (range). For example, the processing target area may be specified using coordinates, or may be specified in predetermined block units. Furthermore, the processing specification unit 213 may specify the processing content for the processing target area. If there are multiple processing target areas, the processing specification unit 213 may specify the processing content for each processing target area.

[0127] Furthermore, the authenticity determination unit 214 may treat such a processing target area as an authenticity determination target area and determine the authenticity of the authenticity determination target area based on the processing details of the authenticity determination target area. In other words, the authenticity determination unit 214 may determine whether or not to guarantee the authenticity of the processing target area, which is a partial area to which processing of the processed image is applied. Note that, if there are multiple authenticity determination target areas (processing target areas), the authenticity determination unit 214 may determine the authenticity of each of those areas. Even when determining the authenticity of such partial areas, the authenticity determination unit 214 may determine whether or not to guarantee the authenticity, or may determine the authenticity guarantee level.

[0128] The criteria for authenticity determination are the same as those described in the first embodiment, but the criteria may be set independently for each authenticity determination target area.

[0129] In addition, the authenticity determination result display information may display the authenticity determination result for the authenticity determination target area. If there are multiple authenticity determination target areas (processing target areas), the authenticity determination result may be displayed for each of the areas.

[0130] The authenticity determination unit 214 may also perform both the authenticity determination for the entire region of the image as in the example of the first embodiment and the authenticity determination for a partial region of the image.

[0131] With this configuration, the authenticity determination server 104 can guarantee the authenticity of a partial area of ​​an image that has been subjected to allowable processing. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0132] <Flow of Authenticity Determination Process> An example of the flow of the authenticity determination process in the second embodiment will be described with reference to the flowchart of FIG.

[0133] When the authenticity determination process is started, the image acquisition unit 211 acquires an image file and acquires the unedited image and the edited image stored in the image file in step S441. In step S442, the signature verification unit 212 verifies the signature of the unedited image stored in the image file.

[0134] In step S443, the modification specifying unit 213 executes a modification specifying process and specifies modification of the modification target region using the pre-modification image and the post-modification image.

[0135] In step S444, the authenticity determination unit 214 determines the authenticity of the authenticity determination target area of ​​the processed image based on the identified content of the processing.

[0136] In step S445, the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result, and outputs it to another device.

[0137] When the process of step S445 is completed, the authenticity determination process ends.

[0138] <Flow of Processing Specification Process> Next, an example of the flow of the processing specification process executed in step S443 of FIG. 14 will be described with reference to the flowchart of FIG.

[0139] When the processing specification process is started, the processing specification unit 213 executes the processes of steps S461 to S464 in the same manner as the processes of steps S421 to S424 (FIG. 12).

[0140] In step S465, the processing specifying unit 213 specifies the processing target area to which processing has been applied.

[0141] When the process of step S465 ends, the processing specification process ends, and the process returns to FIG.

[0142] In this case, too, the content of the processing specified in the processing specification process may be any processing, and the value of a parameter to be applied in the processing may be specified.

[0143] By performing the above-described processes, the authenticity determination server 104 can guarantee the authenticity of a partial area of ​​an image that has undergone acceptable processing. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0144] <Display image example> In this case, the determination result display image may include information indicating the processed image and a processing target area, which is a partial area of ​​the processed image to be processed. Furthermore, the determination result display image may further include information indicating the content of the processing performed on the processing target area of ​​the processed image.

[0145] In other words, the authenticity determination result display information in this case may include information for generating a determination result display image that includes the processed image and information indicating the processing target area, which is a partial area of ​​the processed image to be processed. Also, the authenticity determination result display information may include information for generating a determination result display image that further includes information indicating the content of the processing applied to the processing target area of ​​the processed image.

[0146] For example, suppose the image processing device 103 displays a judgment result display image. In this case, the authenticity determination result display unit 134 may generate a display image including the processed image and information indicating a processing target area, which is a partial area of ​​the processed image to be processed. Furthermore, the authenticity determination result display unit 134 may generate the display image further including information indicating the content of processing applied to the processing target area of ​​the processed image.

[0147] The determination result display image 240 shown in Fig. 16 is an example of the determination result display image in this case. As shown in Fig. 16, this determination result display image 240 may be provided with an area 241 showing the processed image and the processing target area. In the example of Fig. 16, the processing target area is indicated by a diagonal line pattern. Furthermore, the determination result display image 240 may be provided with a detection processing list 242 showing the content of processing applied to the processing target area of ​​the processed image.

[0148] By displaying such a determination result display image, the image processing device 103 can notify that the authenticity of a partial area of ​​an image that has been subjected to allowable processing is guaranteed. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0149] The detection processing list 242 may also display the type of processing and the parameter values ​​applied to that processing. Furthermore, the detection processing list 242 may display information indicating the content of processing for the entire area and information indicating the content of processing for the partial area. In other words, the information indicating the content of processing may be displayed categorized into processing for the entire area and processing for the partial area. The information indicating the content of processing for the partial area may be displayed categorized by the area to be processed, or by the content of processing. Furthermore, the information indicating the content of processing for the partial area may be associated with the area to be processed shown in the area 241.

[0150] 5. Third Embodiment Determining Authenticity of Image Composition Area When applying the present technology described in the second embodiment, an image composition area, which is a partial area where images are combined, may be identified based on an unprocessed image and an processed image, and the authenticity of the image composition area may be determined to be an area where authenticity is not guaranteed.

[0151] In this specification, an image to be composited with a processing target image is also referred to as a compositing target image. The compositing target image may be any image. For example, the compositing target image may include characters or marks such as a logo or a caption. The compositing target image may also include an image different from the processing target image, such as a wipe image. The compositing target image may also include a duplicate image of a partial region of the processing target image. The compositing target image may also include a cut-out image cut out from a partial region of the processing target image.

[0152] In this specification, the process of combining a target image with a target image is also referred to as image composition. The target area where the image composition is performed is also referred to as an image composition area. The target image after image composition (i.e., the processed image obtained by image composition) is also referred to as a composite image.

[0153] The configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as that in the example ( FIG. 10 ) described in the first embodiment.

[0154] However, the processing specification unit 213 may specify (the position, size, shape, etc.) an image synthesis area, which is an area to be processed where image synthesis is performed. The position, size, and shape of the image synthesis area are each arbitrary. Furthermore, any method may be used to specify (the range of) the image synthesis area. For example, the image synthesis area may be specified using coordinates, or may be specified in predetermined block units. Furthermore, the processing specification unit 213 may specify the image synthesis area using any method.

[0155] Furthermore, the authenticity determination unit 214 may treat such an image synthesis area as an authenticity determination target area and determine that the authenticity determination target area is an area for which authenticity is not guaranteed. In other words, the authenticity determination unit 214 may determine that the authenticity of an image synthesis area, which is a partial area where image synthesis of the processed image is performed, is not guaranteed. Note that, if there are multiple authenticity determination target areas (image synthesis areas), the authenticity determination unit 214 may determine that the authenticity of each of those areas is not guaranteed.

[0156] The authenticity determination unit 214 may perform both the authenticity determination for the entire image area as in the example of the first embodiment and the authenticity determination for this image synthesis area.

[0157] With this configuration, the authenticity determination server 104 can choose not to guarantee the authenticity of the image composite area of ​​the image. Therefore, for example, it is possible to choose not to guarantee the authenticity of only the portion where a logo mark or text caption is composited. In other words, the authenticity determination server 104 can separately determine the authenticity of other areas. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0158] <Flow of Authenticity Determination Process> An example of the flow of the authenticity determination process in the third embodiment will be described with reference to the flowchart of FIG.

[0159] When the authenticity determination process is started, the image acquisition unit 211 acquires an image file and acquires the unedited image and the edited image stored in the image file in step S481. In step S482, the signature verification unit 212 verifies the signature of the unedited image stored in the image file.

[0160] In step S483, the modification specifying unit 213 executes a modification specifying process and specifies modification of the modification target region using the pre-modification image and the post-modification image.

[0161] In step S484, the authenticity determination unit 214 determines that the image synthesis area of ​​the processed image is an area for which authenticity is not guaranteed.

[0162] In step S485, the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination, based on the identified details of the processing.

[0163] In step S486, the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result, and outputs it to another device.

[0164] When the process of step S486 is completed, the authenticity determination process ends.

[0165] <Flow of Processing Specification Process> Next, an example of the flow of the processing specification process executed in step S483 of FIG. 17 will be described with reference to the flowchart of FIG.

[0166] When the processing specification process is started, the processing specification unit 213 executes the processes of steps S501 to S504 in the same manner as the processes of steps S421 to S424 (FIG. 12).

[0167] In step S505, the processing specifying unit 213 determines whether or not images are to be combined. Note that any method may be used to determine whether or not images are to be combined.

[0168] In step S506, the processing specifying unit 213 specifies the image synthesis area where the image synthesis has been performed.

[0169] In step S507, the processing specifying unit 213 specifies other processing target areas that have been processed.

[0170] When the process of step S507 ends, the processing specification process ends, and the process returns to FIG.

[0171] In this case, too, the content of the processing specified in the processing specification process may be any processing, and the value of a parameter to be applied in the processing may be specified.

[0172] By performing each process as described above, the authenticity determination server 104 can choose not to guarantee the authenticity of the image composite area of ​​the image. Therefore, for example, it is possible to choose not to guarantee the authenticity of only the portion where a logo mark or text caption is composited. In other words, the authenticity determination server 104 can separately determine the authenticity of other areas. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0173] <Display Image Example> In this case, the determination result display image may include information indicating the processed image and an image synthesis area, which is a partial area where the processed image is to be synthesized. The determination result display image may further include information indicating the content of the image synthesis performed in the image synthesis area of ​​the processed image.

[0174] In other words, the authenticity determination result display information in this case may include information for generating a determination result display image that includes the processed image and information indicating an image synthesis area, which is a partial area where image synthesis of the processed image is performed. Also, the authenticity determination result display information may include information for generating a determination result display image that further includes information indicating the content of image synthesis performed in the image synthesis area of ​​the processed image.

[0175] For example, suppose the image processing device 103 displays a judgment result display image. In this case, the authenticity determination result display unit 134 may generate a display image including the processed image and information indicating an image synthesis area, which is a partial area where the processed image is to be image-synthesized. The authenticity determination result display unit 134 may also generate a display image further including information indicating the content of the image synthesis applied to the image synthesis area of ​​the processed image.

[0176] A determination result display image 250 shown in Fig. 19 is an example of the determination result display image in this case. As shown in Fig. 19, this determination result display image 250 may be provided with an area 251 showing the processed image and the image synthesis area. In the example of Fig. 19, the image synthesis area is indicated by a diagonal line pattern. Furthermore, the determination result display image 250 may be provided with a detection processing list 252 showing the content of image synthesis applied to the image synthesis area of ​​the processed image.

[0177] By displaying such a determination result display image, the image processing device 103 can notify that the authenticity of the image composite area of ​​the image cannot be guaranteed. Therefore, for example, it is possible to not guarantee the authenticity of only the portion where a logo mark or text caption is composited. In other words, the authenticity of other areas can be determined separately. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0178] Note that this detection processing list 252 may also display the type of processing (e.g., type of image synthesis) and parameter values ​​applied to that processing (e.g., image synthesis). Furthermore, this detection processing list 252 may display information indicating the content of processing applied to the entire area and information indicating the content of image synthesis in the image synthesis area. In other words, the information indicating the content of processing may be classified and displayed as processing applied to the entire area and processing applied to a partial area (e.g., image synthesis area). The information indicating the content of image synthesis applied to the image synthesis area may be classified and displayed for each image synthesis area, or may be classified and displayed for each content of image synthesis. Furthermore, the information indicating the content of image synthesis applied to the image synthesis area may be associated with the image synthesis area shown in area 251.

[0179] <6. Fourth Embodiment> <Determining Authenticity of 2D Area> When applying the present technology described in the second embodiment, a 2D area, which is a partial area formed by a plane, may be identified based on an unprocessed image and an processed image, and the 2D area may be determined to be an area for which authenticity is not guaranteed. Generally, a 2D area formed by a plane is easier to process than a portion formed by a 3D-shaped object (also referred to as a 3D area). Therefore, malicious processing (unacceptable processing) is generally more likely to be applied to a 2D area than to other areas. Therefore, the 2D area may be determined to be an area for which authenticity is not guaranteed.

[0180] The configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as that in the example ( FIG. 10 ) described in the first embodiment.

[0181] However, the processing specification unit 213 may specify (the position, size, shape, etc.) a 2D area, which is a partial area configured on a plane. The position, size, and shape of the 2D area are each arbitrary. Furthermore, any method may be used to specify (the range of) the 2D area. For example, the 2D area may be specified using coordinates, or may be specified in predetermined block units. Furthermore, the processing specification unit 213 may specify the 2D area using any method.

[0182] Furthermore, the authenticity determination unit 214 may set such a 2D region as an authenticity determination target region and determine that the authenticity determination target region is a region for which authenticity is not guaranteed. In other words, the authenticity determination unit 214 may determine that the authenticity of a 2D region that is a partial region formed by a plane of the processed image is not guaranteed. Note that, if there are multiple authenticity determination target regions (2D regions), the authenticity determination unit 214 may determine that the authenticity of each of those regions is not guaranteed.

[0183] The authenticity determination unit 214 may perform both the authenticity determination for the entire region of the image as in the example of the first embodiment and the authenticity determination for this 2D region.

[0184] With this configuration, the authenticity determination server 104 can choose not to guarantee the authenticity of a 2D region of an image. Therefore, for example, it is possible to choose not to guarantee the authenticity of only that 2D region. In other words, the authenticity determination server 104 can separately determine the authenticity of other regions. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0185] <Flow of Authenticity Determination Process> An example of the flow of the authenticity determination process in the fourth embodiment will be described with reference to the flowchart of FIG.

[0186] When the authenticity determination process is started, the image acquisition unit 211 acquires an image file and acquires the unedited image and the edited image stored in the image file in step S521. In step S522, the signature verification unit 212 verifies the signature of the unedited image stored in the image file.

[0187] In step S523, the processing specification unit 213 executes processing specification processing, and specifies processing of the processing target region using the pre-processing image and the post-processing image.

[0188] In step S524, the authenticity determination unit 214 determines that the 2D region of the processed image is a region for which authenticity is not guaranteed.

[0189] In step S525, the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination, based on the identified details of the processing.

[0190] In step S526, the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result, and outputs it to another device.

[0191] When the process of step S526 is completed, the authenticity determination process ends.

[0192] <Flow of Processing Specification Process> Next, an example of the flow of the processing specification process executed in step S523 of FIG. 20 will be described with reference to the flowchart of FIG.

[0193] When the processing specification process is started, the processing specification unit 213 executes the processes of steps S541 to S544 in the same manner as the processes of steps S421 to S424 (FIG. 12).

[0194] In step S545, the processing specifying unit 213 specifies a 2D region. Any method for specifying this 2D region may be used.

[0195] In step S546, the processing specifying unit 213 specifies other processing target areas that have been processed.

[0196] When the process of step S546 ends, the process specification process ends, and the process returns to FIG.

[0197] In this case, too, the content of the processing specified in the processing specification process may be any processing, and the value of a parameter to be applied in the processing may be specified.

[0198] By performing each process as described above, the authenticity determination server 104 can avoid verifying the authenticity of the 2D region of the image. In other words, the authenticity determination server 104 can separately verify the authenticity of other regions. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0199] <Display image example> In this case, the determination result display image may include information indicating the processed image and a 2D area that is a partial area configured on the plane of the processed image. In other words, the authenticity determination result display information in this case may include information for generating a determination result display image that includes the processed image and information indicating the 2D area that is a partial area configured on the plane of the processed image.

[0200] For example, suppose that the image processing device 103 displays a judgment result display image. In this case, the authenticity judgment result display unit 134 may generate a display image including the processed image and information indicating a 2D region, which is a partial region formed on a plane of the processed image.

[0201] The determination result display image 260 shown in Fig. 22 is an example of the determination result display image in this case. As shown in Fig. 22, the determination result display image 260 may include an area 261 showing the processed image and the 2D area. In the example of Fig. 22, the 2D area is indicated by a diagonal line pattern. The determination result display image 260 may also include a detected processing list 262 showing the details of the processing applied to the 2D area of ​​the processed image.

[0202] By displaying such a determination result display image, the image processing device 103 can notify the user that the authenticity of the 2D area of ​​the image is not guaranteed. In other words, the authenticity of other areas can be determined separately. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0203] The detection processing list 262 may also display the type of processing and the parameter values ​​applied to the processing. The detection processing list 262 may also display information indicating the content of processing applied to the entire area and information indicating the content of processing applied to the 2D area. In other words, the information indicating the content of processing may be displayed after being classified into processing applied to the entire area and processing applied to the partial area. The information indicating the content of image synthesis applied to the 2D area may be displayed after being classified for each 2D area, or may be displayed after being classified for each processing type. The information indicating the content of processing applied to the 2D area may also be associated with the 2D area displayed in the area 261.

[0204] 7. Fifth Embodiment Verification of Editing History When applying the present technology described in the second embodiment, the details of the edit applied to a partial region of the before-edit image may be identified based on the before-edit image and the after-edit image, and it may be determined whether the details of the edit correspond to the edit history information added to the before-edit image. In other words, it may be determined whether authenticity is guaranteed based on whether the edit actually applied to the edit target region matches the details of the edit history information. When there are multiple edited image regions, this verification of the edit history may be performed for each of the edited image regions.

[0205] The configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as that in the example ( FIG. 10 ) described in the first embodiment.

[0206] However, the processing specification unit 213 may specify the processing target area (position, size, shape, etc.). The processing target area may be any area as long as it is a partial area relative to the entire area of ​​the image, and its position, size, and shape are each arbitrary. Furthermore, any method may be used to specify the processing target area (range). For example, the processing target area may be specified using coordinates, or may be specified in predetermined block units. Furthermore, the processing specification unit 213 may specify the processing content for the processing target area. If there are multiple processing target areas, the processing specification unit 213 may specify the processing content for each processing target area.

[0207] Furthermore, the authenticity determination unit 214 may treat such a processing target area as an authenticity determination target area and determine the authenticity of the authenticity determination target area based on the processing details, processing history, etc., of the authenticity determination target area. For example, the authenticity determination unit 214 may determine whether to guarantee authenticity depending on whether the processing details of the authenticity determination target area match the processing history. In other words, the authenticity determination unit 214 may determine that the authenticity of the processing target area of ​​the processed image is guaranteed if the processing details of the processing target area between the original image and the pre-processing image correspond to the processing history information added to the pre-processing image. Furthermore, the authenticity determination unit 214 may determine that the authenticity of the processing target area of ​​the processed image is not guaranteed if the processing details of the processing target area between the original image and the pre-processing image do not correspond to the processing history information.

[0208] The authenticity determination unit 214 may derive the authenticity assurance level based on the degree of match between the processing content and the processing history.

[0209] The criteria for authenticity determination are the same as those described in the first embodiment, but the criteria may be set independently for each authenticity determination target area.

[0210] In addition, the authenticity determination result display information may display the authenticity determination result for the authenticity determination target area. If there are multiple authenticity determination target areas (processing target areas), the authenticity determination result may be displayed for each of the areas.

[0211] The authenticity determination unit 214 may also perform both the authenticity determination for the entire region of the image as in the example of the first embodiment and the authenticity determination for a partial region of the image.

[0212] With this configuration, the authenticity determination server 104 can guarantee the authenticity of a partial area of ​​an image that has undergone acceptable processing. Furthermore, the details of the processing can be confirmed based on the historical data. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0213] <Flow of Authenticity Determination Process> An example of the flow of the authenticity determination process in the fifth embodiment will be described with reference to the flowchart of FIG.

[0214] When the authenticity determination process is started, the image acquisition unit 211 acquires an image file and acquires the unedited image and the edited image stored in the image file in step S561. In step S562, the signature verification unit 212 verifies the signature of the unedited image stored in the image file.

[0215] In step S563, the modification specifying unit 213 executes a modification specifying process and specifies modification of the modification target region using the pre-modification image and the post-modification image.

[0216] In step S564, the authenticity determination unit 214 determines the authenticity of the authenticity determination target area of ​​the processed image based on the identified content of the processing.

[0217] In step S565, the authenticity determination unit 214 determines the authenticity of the authenticity determination target area of ​​the edited image based on the matching state between the edit history and the edit content.

[0218] In step S566, the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result, and outputs it to another device.

[0219] When the process of step S566 is completed, the authenticity determination process ends.

[0220] <Flow of Processing Specification Process> Next, an example of the flow of the processing specification process executed in step S563 of FIG. 23 will be described with reference to the flowchart of FIG.

[0221] When the processing specification process is started, the processing specification unit 213 executes the processes of steps S581 to S584 in the same manner as the processes of steps S421 to S424 (FIG. 12).

[0222] In step S585, the processing specifying unit 213 specifies the processing target area to which processing has been applied.

[0223] In step S586, the processing specifying unit 213 determines whether the specified processing content matches the processing history.

[0224] When the process of step S586 ends, the processing specification process ends, and the process returns to FIG.

[0225] In this case, too, the content of the processing specified in the processing specification process may be any processing, and the value of a parameter to be applied in the processing may be specified.

[0226] By performing each process as described above, the authenticity determination server 104 can guarantee the authenticity of a partial area of ​​an image that has undergone acceptable processing. Furthermore, the details of the processing can be confirmed based on the historical data. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0227] <Display image example> In this case, the determination result display image may include information indicating the details of the processing and processing history information added to the processed image as metadata. Furthermore, this information may be information about the processing target area. If there are multiple processing target areas, this information may be information for each processing target area.

[0228] In other words, the authenticity determination result display information in this case may include information for generating a determination result display image that includes information indicating the content of the processing and processing history information added as metadata to the processed image.

[0229] For example, suppose that the image processing device 103 displays a judgment result display image. In this case, the authenticity determination result display unit 134 may generate a display image including information indicating the details of the processing and processing history information added as metadata to the processed image.

[0230] The determination result display image 270 shown in FIG. 25 illustrates an example of the determination result display image in this case. As shown in FIG. 25, the determination result display image 270 may include a detection processing list 273 that displays information indicating the processing content and processing history information added to the processed image as metadata. The determination result display image 270 may also include an area 271 in which the original image is displayed. That is, the pre-processing image may be included in the determination result display image. In other words, the authenticity determination result display information may include information for generating a determination result display image that includes the pre-processing image. For example, in the image processing device 103, the authenticity determination result display unit 134 may generate a determination result display image that further includes the pre-processing image (e.g., area 271). The determination result display image 270 may also include an area 272 in which the processed image is displayed. That is, the processed image may be included in the determination result display image. In other words, the authenticity determination result display information may include information for generating a determination result display image that includes the processed image. For example, in the image processing device 103, the authenticity determination result display unit 134 may generate a determination result display image that further includes the processed image (for example, the area 272).

[0231] By displaying such a judgment result display image, the image processing device 103 can notify the matching status (whether or not there is a match, or the degree of match) between the processing content and the processing history, or the authenticity judgment result according to the matching status. Therefore, it is possible to prevent unnecessary strictness in the requirements for authenticity judgment in services that guarantee the authenticity of images. Therefore, it is possible to prevent a decrease in the practicality and convenience of such services.

[0232] The detection processing list 273 may also display the type of processing and the parameter values ​​applied to the processing. Furthermore, the detection processing list 273 may display information indicating the content of processing for the entire area and information indicating the content of processing for the partial area. In other words, the information indicating the content of processing may be displayed categorized into processing for the entire area and processing for the partial area. The information indicating the content of processing for the partial area may be displayed categorized by the area to be processed, or by the content of processing. Furthermore, the information indicating the content of processing for the partial area may be associated with the area to be processed.

[0233] <8. Sixth embodiment> <Determination 1 of authenticity of face area> When applying the present technology described in the second embodiment, a face area, which is a partial area including a person's face and is set as an area to be processed, may be detected in the processed image, and it may be determined whether or not the authenticity of the face area is guaranteed depending on whether or not the processing is a "change due to health condition, etc."

[0234] In this specification, the area of ​​a person's head, including the face, in an image is also referred to as the face area. It is not uncommon for face areas to be modified to improve their appearance. Such modifications generally do not substantially change the events depicted in the image (the meaning of the image), and so can be considered "non-malicious modifications." Therefore, even when such modifications are performed, authenticity may be guaranteed. In other words, if the modification to the face area is "changes due to health status, etc.", it may be determined that authenticity is guaranteed, whereas if the modification to the face area is other modifications, it may be determined that authenticity is not guaranteed.

[0235] This "change due to health condition, etc." may include, for example, processing to correct rough skin, processing to correct facial expressions due to lack of sleep, etc., processing to suppress or exaggerate sunburn, etc., and processing to change hair color, shape, amount, etc. In contrast, other processing may include, for example, processing to change the facial contours or bone structure, face replacement (processing to synthesize the face of another person), etc.

[0236] The configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as that in the example ( FIG. 10 ) described in the first embodiment.

[0237] However, the processing specification unit 213 may specify a face region (position, size, shape, etc.) to be the processing target region. The position, size, and shape of the face region are each arbitrary. Furthermore, any method may be used to specify the face region (range). For example, the face region may be specified using coordinates, or may be specified in predetermined block units. Furthermore, the processing specification unit 213 may specify a face region using any method.

[0238] Furthermore, the authenticity determination unit 214 may treat such a face region as an authenticity determination target region, and determine whether or not to guarantee authenticity based on whether or not the processing of the face region is a "change due to health condition, etc." For example, the authenticity determination unit 214 may determine that the authenticity of the face region in the processed image is guaranteed if the processing of the face region, which is a partial region including a person's face, is due to a change due to the person's health condition, etc. Furthermore, the authenticity determination unit 214 may determine that the authenticity of the face region in the processed image is not guaranteed if the processing of the face region is not due to a change due to the person's health condition, etc. Note that when there are multiple authenticity determination target regions (face regions), the authenticity determination unit 214 may determine whether or not to guarantee authenticity for each of the regions.

[0239] The authenticity determination unit 214 may perform both the authenticity determination for the entire image area as in the example of the first embodiment and the authenticity determination for the face area.

[0240] With this configuration, the authenticity determination server 104 can determine the authenticity of the facial region of an image based on unique criteria suited to that facial region. In other words, the authenticity determination server 104 can determine the authenticity of other regions by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria more appropriate to the content of the region to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.

[0241] <Flow of Authenticity Determination Process> An example of the flow of the authenticity determination process in the fourth embodiment will be described with reference to the flowchart of FIG.

[0242] When the authenticity determination process starts, in step S601, the image acquisition unit 211 acquires an image file and acquires the unedited image and the edited image stored in the image file. In step S602, the signature verification unit 212 verifies the signature of the unedited image stored in the image file. In step S603, the edit specification unit 213 executes an edit specification process and specifies the edit of the edit target area using the unedited image and the edited image.

[0243] In step S604, the authenticity determination unit 214 determines the authenticity of the face area of ​​the processed image based on whether or not there is a change due to a health condition or the like.

[0244] In step S605, the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination, based on the identified details of the processing.

[0245] In step S606, the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result, and outputs it to another device.

[0246] When the process of step S606 is completed, the authenticity determination process ends.

[0247] <Flow of Processing Specification Process> Next, an example of the flow of the processing specification process executed in step S603 of FIG. 26 will be described with reference to the flowchart of FIG.

[0248] When the processing specification process is started, the processing specification unit 213 executes the processes of steps S621 to S624 in the same manner as the processes of steps S421 to S424 (FIG. 12).

[0249] In step S625, the processing specifying unit 213 specifies a processing target region.

[0250] In step S626, the processing specifying unit 213 specifies the face area and determines whether the change is due to a health condition.

[0251] When the process of step S626 ends, the processing specification process ends, and the process returns to FIG.

[0252] In this case, too, the content of the processing specified in the processing specification process may be any processing, and the value of a parameter to be applied in the processing may be specified.

[0253] By performing each process as described above, the authenticity determination server 104 can determine the authenticity of the facial region of an image based on unique criteria suited to that facial region. In other words, the authenticity determination server 104 can determine the authenticity of other regions by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the content of the region to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.

[0254] <Display Image Example> In this case, the determination result display image may include the processed image and information indicating a face area, which is a partial area including a person's face, included in the processed image. The determination result display image may further include information indicating the content of the processing applied to the face area.

[0255] In other words, the authenticity determination result display information in this case may include information for generating a determination result display image including a processed image and information indicating a facial area included in the processed image. Also, the authenticity determination result display information may include information for generating a determination result display image further including information indicating the content of processing applied to the facial area.

[0256] For example, suppose the image processing device 103 displays a judgment result display image. In this case, the authenticity determination result display unit 134 may generate a display image including the processed image and information indicating a face area, which is a partial area including the face of a person in the processed image. Furthermore, the authenticity determination result display unit 134 may generate a display image further including information indicating the content of processing applied to the face area of ​​the processed image.

[0257] A determination result display image 280 shown in Fig. 28 shows an example of the determination result display image in this case. As shown in Fig. 28, the determination result display image 280 may be provided with an area 281 showing the processed image and the face area. In the example of Fig. 28, the face area is shown with a diagonal line pattern. Furthermore, the determination result display image 280 may be provided with a detection processing list 282 showing the content of processing applied to the face area.

[0258] By displaying such a determination result display image, the image processing device 103 can notify the result of the determination of the authenticity of the facial area of ​​the image, which is determined based on unique determination criteria suitable for the facial area. In other words, the image processing device 103 can notify the result of the determination of the authenticity of other areas, which is determined by applying different determination criteria. Therefore, the image processing device 103 can notify the result of the determination of the authenticity, which is determined by applying more appropriate determination criteria to the content of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.

[0259] The detection processing list 282 may also show the type of processing and the parameter values ​​applied to the processing. Furthermore, the information indicating the details of processing applied to the face area may be displayed categorized for each face area, or may be displayed categorized for each type of processing. Furthermore, the information indicating the details of processing applied to the face area may be associated with the face area shown in the area 281.

[0260] 9. Seventh Embodiment Authenticity Determination 2 of Facial Region Note that, when the present technology described in the second embodiment is applied, it may be determined whether or not the authenticity of the facial region of the processed image is guaranteed depending on whether the processing is “within a range that is easily socially understandable.” In other words, if the processing on the facial region is “within a range that is easily socially understandable,” it may be determined that the authenticity is guaranteed, and if the processing on the facial region is other processing, it may be determined that the authenticity is not guaranteed.

[0261] In this specification, "socially understandable editing" may include, for example, applying makeup to a person's facial area. In contrast, other editing may include, for example, editing that changes the facial contours or bone structure, or face replacement (synthesizing the face of another person). It is not uncommon for facial areas to be edited to improve appearance, similar to applying makeup. Since such editing generally does not substantially change the phenomenon depicted by the image (the meaning of the image), it can also be considered "non-malicious editing." Therefore, even when such editing is performed, authenticity may be guaranteed.

[0262] The configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as that in the example ( FIG. 10 ) described in the first embodiment.

[0263] However, the processing specification unit 213 may specify a face region (position, size, shape, etc.) to be the processing target region. The position, size, and shape of the face region are each arbitrary. Furthermore, any method may be used to specify the face region (range). For example, the face region may be specified using coordinates, or may be specified in predetermined block units. Furthermore, the processing specification unit 213 may specify a face region using any method.

[0264] Furthermore, the authenticity determination unit 214 may set such a face region as an authenticity determination target region, and determine whether or not to guarantee authenticity based on whether or not the processing of the face region is "within a socially understandable range." For example, the authenticity determination unit 214 may determine that the authenticity of the face region in the processed image is guaranteed if the processing of the face region, which is a partial region including a person's face, is within a socially understandable range. Furthermore, the authenticity determination unit 214 may determine that the authenticity of the face region in the processed image is not guaranteed if the processing of the face region is not within a socially understandable range. Note that, when there are multiple authenticity determination target regions (face regions), the authenticity determination unit 214 may determine whether or not to guarantee authenticity for each of the regions.

[0265] The authenticity determination unit 214 may perform both the authenticity determination for the entire image area as in the example of the first embodiment and the authenticity determination for the face area.

[0266] With this configuration, the authenticity determination server 104 can determine the authenticity of the facial region of an image based on unique criteria suited to that facial region. In other words, the authenticity determination server 104 can determine the authenticity of other regions by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria more appropriate to the content of the region to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.

[0267] <Flow of Authenticity Determination Process> An example of the flow of the authenticity determination process in the fourth embodiment will be described with reference to the flowchart of FIG.

[0268] When the authenticity determination process starts, the image acquisition unit 211 acquires an image file in step S641 and acquires the before-edited image and the after-edited image stored in the image file. In step S642, the signature verification unit 212 verifies the signature of the before-edited image stored in the image file. In step S643, the modification specification unit 213 executes a modification specification process and specifies the modification of the region to be modified using the before-edited image and the after-edited image.

[0269] In step S644, the authenticity determination unit 214 determines the authenticity of the face area of ​​the edited image based on whether or not the editing is within a range that is socially understandable.

[0270] In step S645, the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination, based on the identified details of the processing.

[0271] In step S646, the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result, and outputs it to another device.

[0272] When the process of step S646 is completed, the authenticity determination process ends.

[0273] <Flow of Processing Specification Process> Next, an example of the flow of the processing specification process executed in step S643 of FIG. 29 will be described with reference to the flowchart of FIG.

[0274] When the processing specification process is started, the processing specification unit 213 executes the processes of steps S661 to S664 in the same manner as the processes of steps S421 to S424 (FIG. 12).

[0275] In step S665, the processing specifying unit 213 specifies a processing target region.

[0276] In step S666, the processing specifying unit 213 specifies the face area and determines whether the processing is within a range that is socially understandable.

[0277] When the process of step S666 ends, the processing specification process ends, and the process returns to FIG.

[0278] In this case, too, the content of the processing specified in the processing specification process may be any processing, and the value of a parameter to be applied in the processing may be specified.

[0279] By performing each process as described above, the authenticity determination server 104 can determine the authenticity of the facial region of an image based on unique criteria suited to that facial region. In other words, the authenticity determination server 104 can determine the authenticity of other regions by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the content of the region to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.

[0280] <Display Image Example> In this case, the determination result display image may include the processed image and information indicating a face area, which is a partial area including a person's face, included in the processed image. The determination result display image may further include information indicating the content of the processing applied to the face area.

[0281] In other words, the authenticity determination result display information in this case may include information for generating a determination result display image including a processed image and information indicating a facial area included in the processed image. Also, the authenticity determination result display information may include information for generating a determination result display image further including information indicating the content of processing applied to the facial area.

[0282] For example, suppose the image processing device 103 displays a judgment result display image. In this case, the authenticity determination result display unit 134 may generate a display image including the processed image and information indicating a face area, which is a partial area including the face of a person in the processed image. Furthermore, the authenticity determination result display unit 134 may generate a display image further including information indicating the content of processing applied to the face area of ​​the processed image.

[0283] A determination result display image 290 shown in Fig. 31 is an example of the determination result display image in this case. As shown in Fig. 31, the determination result display image 290 may be provided with an area 291 showing the processed image and the face area. In the example of Fig. 31, the face area is shown with a diagonal line pattern. The determination result display image 290 may also be provided with a detection processing list 292 showing the content of processing applied to the face area.

[0284] By displaying such a determination result display image, the image processing device 103 can notify the result of the determination of the authenticity of the facial area of ​​the image, which is determined based on unique determination criteria suitable for the facial area. In other words, the image processing device 103 can notify the result of the determination of the authenticity of other areas, which is determined by applying different determination criteria. Therefore, the image processing device 103 can notify the result of the determination of the authenticity, which is determined by applying more appropriate determination criteria to the content of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.

[0285] The detection processing list 292 may also show the type of processing and the parameter values ​​applied to the processing. Furthermore, the information indicating the details of processing applied to the face area may be displayed by classifying the information for each face area, or by the type of processing. Furthermore, the information indicating the details of processing applied to the face area may be associated with the face area shown in the area 291.

[0286] <10. Eighth embodiment> <Determining authenticity of object identification information area> When applying the present technology described in the second embodiment, an object identification information area, which is a partial area including object identification information and is set as the area to be processed, may be detected in the processed image, and it may be determined whether or not the authenticity of the object identification information area is guaranteed depending on whether the processing is "processing that does not involve a change in the object identification information."

[0287] In this specification, identification information for identifying an object is also referred to as object identification information. For example, the object identification information may include a vehicle license plate. Furthermore, an area in a target image that includes the object identification information is also referred to as an object identification information area.

[0288] Using a vehicle license plate as an example of object identification information, "processing involving a change in object identification information" refers to processing that changes the vehicle number or the like printed on the "vehicle license plate." Because object identification information is meaningful information, changing this information can be said to change the events depicted in the image. In other words, "processing involving a change in object identification information" can also be called "malicious processing." In contrast, in the case of "processing that does not involve a change in object identification information," the object identification information does not change, so it can be said that the events depicted in the image do not generally change. In other words, "processing that does not involve a change in object identification information" can also be called "non-malicious processing." Therefore, even when such "processing that does not involve a change in object identification information" is performed, authenticity may be guaranteed.

[0289] Note that "processing that does not involve a change in object identification information" may include, for example, image processing such as changing color or brightness, adjusting sharpness or white balance.

[0290] The configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as that in the example ( FIG. 10 ) described in the first embodiment.

[0291] However, the processing specification unit 213 may specify (the position, size, shape, etc.) of the object identification information area to be the processing target area. The position, size, and shape of the object identification information area are each arbitrary. Furthermore, any method may be used to specify (the range of) the object identification information area. For example, the object identification information area may be specified using coordinates, or may be specified in predetermined block units. Furthermore, the processing specification unit 213 may specify the object identification information area using any method.

[0292] Furthermore, the authenticity determination unit 214 may treat such an object identification information region as an authenticity determination target region, and determine whether or not authenticity is guaranteed based on whether the processing of the object identification information region is "processing that does not involve a change in the object identification information." For example, the authenticity determination unit 214 may determine that the authenticity of the object identification information region of the processed image is guaranteed if the processing of the object identification information region, which is a partial region including object identification information, is processing that does not involve a change in the object identification information. Furthermore, the authenticity determination unit 214 may determine that the authenticity of the object identification information region of the processed image is not guaranteed if the processing of the object identification information region is processing that involves a change in the object identification information.

[0293] The authenticity determination unit 214 may perform both the authenticity determination for the entire region of the image as in the example of the first embodiment and the authenticity determination for this object identification information region.

[0294] With this configuration, the authenticity determination server 104 can determine the authenticity of the object identification information region of an image based on unique criteria suited to that object identification information region. In other words, the authenticity determination server 104 can determine the authenticity of other regions by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria more appropriate to the content of the region to be processed. Therefore, unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images can be further suppressed. Therefore, a reduction in the practicality and convenience of such services can be further suppressed.

[0295] <Flow of Authenticity Determination Process> An example of the flow of the authenticity determination process in the fourth embodiment will be described with reference to the flowchart of FIG.

[0296] When the authenticity determination process starts, in step S681, the image acquisition unit 211 acquires an image file and acquires the before-edited image and the after-edited image stored in the image file. In step S682, the signature verification unit 212 verifies the signature of the before-edited image stored in the image file. In step S683, the modification specification unit 213 executes a modification specification process and specifies the modification of the region to be modified using the before-edited image and the after-edited image.

[0297] In step S684, the authenticity determination unit 214 determines the authenticity of the object identification information area of ​​the processed image based on whether the processing does not involve a change in the object identification information.

[0298] In step S685, the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination, based on the identified details of the processing.

[0299] In step S686, the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result, and outputs it to another device.

[0300] When the process of step S686 is completed, the authenticity determination process ends.

[0301] <Flow of Processing Specification Process> Next, an example of the flow of the processing specification process executed in step S683 of FIG. 32 will be described with reference to the flowchart of FIG.

[0302] When the processing specification process is started, the processing specification unit 213 executes the processes of steps S701 to S704 in the same manner as the processes of steps S421 to S424 (FIG. 12).

[0303] In step S705, the processing specifying unit 213 specifies a processing target region.

[0304] In step S706, the processing specifying unit 213 specifies the object identification information area and determines whether the processing does not involve a change in the object identification information.

[0305] When the process of step S706 ends, the processing specification process ends, and the process returns to FIG.

[0306] In this case, too, the content of the processing specified in the processing specification process may be any processing, and the value of a parameter to be applied in the processing may be specified.

[0307] By performing each process as described above, the authenticity determination server 104 can determine the authenticity of the object identification information region of an image based on unique criteria suited to that object identification information region. In other words, the authenticity determination server 104 can determine the authenticity of other regions by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria that are more appropriate for the content of the region to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.

[0308] <Display Image Example> In this case, the determination result display image may include the processed image and information indicating an object identification information region that is a partial region of the processed image that includes object identification information. The determination result display image may further include information indicating the content of the processing applied to the object identification information region.

[0309] In other words, the authenticity determination result display information in this case may include information for generating a determination result display image that includes the processed image and information indicating the object identification information area included in the processed image. Also, the authenticity determination result display information may include information for generating a determination result display image that further includes information indicating the content of the processing applied to the object identification information area.

[0310] For example, suppose the image processing device 103 displays a judgment result display image. In this case, the authenticity determination result display unit 134 may generate a display image including the processed image and information indicating an object identification information region, which is a partial region including object identification information of the processed image. Furthermore, the authenticity determination result display unit 134 may generate a display image further including information indicating the content of processing applied to the object identification information region of the processed image.

[0311] The determination result display image 310 shown in Fig. 34 is an example of the determination result display image in this case. As shown in Fig. 34, the determination result display image 310 may be provided with an area 311 showing the processed image and the object identification information area. In the example of Fig. 34, the object identification information area is indicated by a diagonal line pattern. Furthermore, the determination result display image 310 may be provided with a detection processing list 312 showing the content of processing applied to the object identification information area.

[0312] By displaying such a determination result display image, the image processing device 103 can notify the result of the determination of the authenticity of the object identification information area of ​​the image, which is determined based on unique criteria suitable for the object identification information area. In other words, the image processing device 103 can notify the result of the determination of the authenticity of other areas, which is determined by applying different criteria. Therefore, the image processing device 103 can notify the result of the determination of the authenticity, which is determined by applying criteria more appropriate for the content of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.

[0313] The detection processing list 312 may also include the type of processing and the parameter values ​​applied to the processing. Information indicating the details of processing applied to the object identification information area may be displayed categorized for each object identification information area or for each type of processing. Information indicating the details of processing applied to the object identification information area may be associated with the object identification information area shown in area 311.

[0314] <11. Ninth embodiment> <Determining authenticity of personal identification information area> When applying the present technology described in the second embodiment, a personal identification information area, which is a partial area including personal identification information and is set as an area to be processed, may be detected in a processed image, and it may be determined whether or not the authenticity of the personal identification information area is guaranteed depending on whether or not the processing is "processing that does not involve a change in the personal identification information."

[0315] In this specification, identification information for identifying a person is also referred to as personal identification information. For example, the personal identification information may include the person's identification card. Furthermore, an area in the target image that includes the personal identification information is also referred to as a personal identification information area.

[0316] Using an ID card as an example of personal identification information, "processing involving changes to personal identification information" refers to processing that changes the name, identification number, etc., of an individual written on the "ID card." Because personal identification information is meaningful information, changing this information can be said to change the events depicted in the image. In other words, "processing involving changes to personal identification information" can also be said to be "malicious processing." In contrast, in the case of "processing that does not involve changes to personal identification information," the personal identification information does not change, so it can be said that the events depicted in the image do not generally change. In other words, "processing that does not involve changes to personal identification information" can also be said to be "non-malicious processing." Therefore, even when such "processing that does not involve changes to personal identification information" is performed, authenticity may be guaranteed.

[0317] Note that "processing that does not change personal identification information" may include, for example, image processing such as changing color or brightness, adjusting sharpness or white balance.

[0318] The configuration and processing flow of the authenticity determination system 100 in this case are the same as those in the example described in the first embodiment. Also, the configuration of the authenticity determination server 104 in this case is the same as that in the example ( FIG. 10 ) described in the first embodiment.

[0319] However, the processing specification unit 213 may specify (the position, size, shape, etc.) of a personal identification information area to be the processing target area. The position, size, and shape of the personal identification information area are each arbitrary. Furthermore, any method may be used to specify (the range of) the personal identification information area. For example, the personal identification information area may be specified using coordinates, or may be specified in predetermined block units. Furthermore, the processing specification unit 213 may specify the personal identification information area using any method.

[0320] Furthermore, the authenticity determination unit 214 may treat such a personal identification information region as an authenticity determination target region, and determine whether or not authenticity is guaranteed based on whether the processing of the personal identification information region is "processing that does not involve a change in the personal identification information." For example, the authenticity determination unit 214 may determine that the authenticity of the personal identification information region of the processed image is guaranteed if the processing of the personal identification information region, which is a partial region including personal identification information, is processing that does not involve a change in the personal identification information. Furthermore, the authenticity determination unit 214 may determine that the authenticity of the personal identification information region of the processed image is not guaranteed if the processing of the personal identification information region is processing that involves a change in the personal identification information.

[0321] The authenticity determination unit 214 may perform both the authenticity determination for the entire image area as in the example of the first embodiment and the authenticity determination for this personal identification information area.

[0322] With this configuration, the authenticity determination server 104 can determine the authenticity of the personal identification information area of ​​an image based on unique criteria suited to that personal identification information area. In other words, the authenticity determination server 104 can determine the authenticity of other areas by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria more appropriate to the content of the area to be processed. Therefore, unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images can be further suppressed. Therefore, a reduction in the practicality and convenience of such services can be further suppressed.

[0323] <Flow of Authenticity Determination Process> An example of the flow of the authenticity determination process in the fourth embodiment will be described with reference to the flowchart of FIG.

[0324] When the authenticity determination process starts, the image acquisition unit 211 acquires an image file in step S721 and acquires the unedited image and the edited image stored in the image file. In step S722, the signature verification unit 212 verifies the signature of the unedited image stored in the image file. In step S723, the edit specification unit 213 executes an edit specification process and specifies the edit of the edit target area using the unedited image and the edited image.

[0325] In step S724, the authenticity determination unit 214 determines the authenticity of the personal identification information area of ​​the processed image based on whether the processing does not involve a change in the personal identification information.

[0326] In step S725, the authenticity determination unit 214 determines the authenticity of other areas of the processed image that are subject to authenticity determination, based on the identified details of the processing.

[0327] In step S726, the authenticity determination result display information output unit 215 generates authenticity determination result display information based on the determination result, and outputs it to another device.

[0328] When the process of step S726 is completed, the authenticity determination process ends.

[0329] <Flow of Processing Specification Process> Next, an example of the flow of the processing specification process executed in step S723 of FIG. 35 will be described with reference to the flowchart of FIG.

[0330] When the processing specification process is started, the processing specification unit 213 executes the processes of steps S741 to S744 in the same manner as the processes of steps S421 to S424 (FIG. 12).

[0331] In step S745, the processing specifying unit 213 specifies a processing target region.

[0332] In step S746, the processing specifying unit 213 specifies the personal identification information area and determines whether the processing does not involve a change in the personal identification information.

[0333] When the process of step S746 ends, the processing specification process ends, and the process returns to FIG.

[0334] In this case, too, the content of the processing specified in the processing specification process may be any processing, and the value of a parameter to be applied in the processing may be specified.

[0335] By performing each process as described above, the authenticity determination server 104 can determine the authenticity of the personal identification information area of ​​the image based on unique criteria suited to that personal identification information area. In other words, the authenticity determination server 104 can determine the authenticity of other areas by applying different criteria. Therefore, the authenticity determination server 104 can determine the authenticity by applying criteria more appropriate to the content of the area to be processed. Therefore, unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images can be further suppressed. Therefore, a reduction in the practicality and convenience of such services can be further suppressed.

[0336] <Display Image Example> In this case, the determination result display image may include the processed image and information indicating a personal identification information area, which is a partial area including personal identification information, included in the processed image. The determination result display image may further include information indicating the content of the processing applied to the personal identification information area.

[0337] In other words, the authenticity determination result display information in this case may include information for generating a determination result display image that includes the processed image and information indicating the personal identification information area included in the processed image. Also, the authenticity determination result display information may include information for generating a determination result display image that further includes information indicating the content of the processing applied to the personal identification information area.

[0338] For example, suppose the image processing device 103 displays a judgment result display image. In this case, the authenticity determination result display unit 134 may generate a display image including the processed image and information indicating a personal identification information area, which is a partial area of ​​the processed image that includes personal identification information. Furthermore, the authenticity determination result display unit 134 may generate a display image that further includes information indicating the content of the processing applied to the personal identification information area of ​​the processed image.

[0339] A determination result display image 320 shown in Fig. 37 shows an example of the determination result display image in this case. As shown in Fig. 37, the determination result display image 320 may be provided with an area 321 showing the processed image and the personal identification information area. In the example of Fig. 37, the personal identification information area is indicated by a diagonal line pattern. Furthermore, the determination result display image 320 may be provided with a detection processing list 322 showing the content of processing applied to the personal identification information area.

[0340] By displaying such a determination result display image, the image processing device 103 can notify the result of the determination of the authenticity of the personal identification information area of ​​the image, which is determined based on unique criteria suitable for the personal identification information area. In other words, the image processing device 103 can notify the result of the determination of the authenticity of other areas, which is determined by applying different criteria. Therefore, the image processing device 103 can notify the result of the determination of the authenticity, which is determined by applying criteria more appropriate for the content of the area to be processed. Therefore, it is possible to further prevent unnecessary strictness in the requirements for authenticity determination in services that guarantee the authenticity of images. Therefore, it is possible to further prevent a decrease in the practicality and convenience of such services.

[0341] The detection processing list 322 may also show the type of processing and the parameter values ​​applied to the processing. Information indicating the details of processing applied to the personal identification information area may be displayed categorized for each personal identification information area, or may be displayed categorized for each type of processing. Information indicating the details of processing applied to the personal identification information area may be associated with the personal identification information area shown in area 321.

[0342] 12. Tenth Embodiment Request for Generation of Certification Web Page When the present technology described in the second embodiment is applied, the authenticity determination result display information may be made public as a certification Web page. Furthermore, the original image may be hidden in the certification Web page.

[0343] This certification Web page is made public at a predetermined URL by Web server 105. The image processing device 103 may instruct the generation of this URL. In this case, the image processing device 103 has a configuration as shown in Fig. 38. That is, the image processing device 103 has a certification Web page processing unit 331 in addition to the configuration described with reference to Fig. 2.

[0344] The certification web page processing unit 331 executes processing related to a request for generating a certification web page. For example, the certification web page processing unit 331 requests the authenticity determination server 104 to generate a certification web page. The certification web page processing unit 331 makes this request based on, for example, a user instruction. For example, the certification web page processing unit 331 may display a GUI screen 340 such as that shown in FIG. 39 on a display device and accept a URL generation instruction from the user on this GUI screen 340.

[0345] As shown in FIG. 39 , the GUI screen 340 has a GUI button 343 for accepting user instructions. In the example of FIG. 39 , this GUI button 343 is labeled "Button for generating a URL for public display of the determination result," indicating that it is a GUI button for accepting an instruction to generate a URL for publishing a certification web page. For example, when a user presses this GUI button 343, the certification web page processing unit 331 accepts the user instruction. Based on the instruction, the certification web page processing unit 331 requests the authenticity determination server 104 to generate a URL for publishing the certification web page.

[0346] The GUI screen 340 also has a URL display field 344, which displays the "public display URL of the determination result" generated based on the request. This display allows the user to understand the URL where the certification web page will be made public.

[0347] The GUI screen 340 may also be provided with an area 342 in which the processed image to be judged for authenticity is displayed, and an area 341 in which the unprocessed image corresponding to the processed image is displayed.

[0348] <Processing Flow> In this case, an example of the processing flow executed in the authenticity determination system 100 will be described with reference to the flowchart of FIG.

[0349] In step S761, the image processing device 103 (certification Web page processing unit 331) displays the GUI screen 340 shown in Fig. 39 and accepts an instruction to generate a URL. Upon accepting the instruction to generate a URL, in step S762, the image processing device 103 (certification Web page processing unit 331) requests the authenticity determination server 104 to generate the URL.

[0350] When the authenticity determination server 104 (authenticity determination result display information output unit 215) receives the request in step S771, it requests the Web server 105 to generate the URL in step S772.

[0351] Upon receiving the request in step S781, the Web server 105 generates a URL for publishing the certification Web page in step S782. The Web server 105 then supplies the generated URL to the authenticity determination server 104 in step S783.

[0352] When the authenticity determination server 104 (authenticity determination result display information output unit 215) acquires the URL in step S773, it supplies the URL to the image processing device 103 in step S774.

[0353] When the image processing device 103 (certification Web page processing unit 331) acquires the URL in step S763, it displays the URL in the URL display field 344 of the GUI screen 340 in step S764.

[0354] Furthermore, when the authenticity of the processed image is determined, the authenticity determination server 104 (authenticity determination result display information output unit 215) generates, in step S775, a certification Web page to be made public at a predetermined URL (the URL generated in the processing of step S782) as authenticity determination result display information showing the determination result. In step S776, the authenticity determination server 104 (authenticity determination result display information output unit 215) supplies (outputs) the generated certification Web page to the Web server 105.

[0355] In step S784, the Web server 105 acquires the certification Web page, and in step S785, the Web server 105 publishes the acquired Web page at a predetermined URL (the URL generated in the processing of step S782).

[0356] This allows the certification web page (i.e., authenticity determination result display information) to be acquired from any terminal device, such as the image processing device 103 or the terminal device 106. That is, the authenticity determination result can be viewed on any device. In other words, in this case, the authenticity determination result display information is a certification web page showing the determination result. The authenticity determination result display unit 134 then uses the acquired certification web page to generate and display a determination result display image. This improves the practicality and convenience of the service that guarantees the authenticity of images.

[0357] FIG. 41 is a diagram showing an example of the display of a certification web page. For example, the certification web page may be displayed in a configuration similar to that of display screen 351 shown in FIG. 41A. This display screen 351 displays the URL, the unedited image (original image), the edited image, the analysis results, a list of detection results, and the like. The certification web page may also be displayed in a configuration similar to that of display screen 352 shown in FIG. 41B. As in this display screen 352, the unedited image (original image) may be hidden. In other words, the authenticity determination server 104 (authenticity determination result display information output unit 215) may generate a certification web page that does not include the original image.

[0358] 13. Eleventh Embodiment Authentication Guarantee by a Third Party When applying the present technology described in the second embodiment, the authenticity of the processed image may be guaranteed by someone other than (a user or administrator of) the authenticity determination server 104. For example, a person in a position of sufficient credibility, such as a news organization or an organization responsible for image distribution, may guarantee the authenticity of the processed image.

[0359] For example, as a use case, when an image distribution agency distributes captured images that it manages (captured images used in news reports, etc.), it may process the captured images and use the authenticity determination service provided by the authenticity determination system 100 (authenticity determination server 104) to ensure the authenticity of the processed captured images.

[0360] In such a case, for example, even if the amount of processing on the captured image is large and the authenticity determination system 100 (authenticity determination server 104) cannot determine that the authenticity can be guaranteed, the image distribution responsible organization that processed the captured image can naturally guarantee the authenticity of the processed image.

[0361] Of course, generally speaking, the reliability of a guarantee from the party who edited the captured image is not high. However, if the guarantee is from a sufficiently trusted party, such as the image distribution responsible organization mentioned above, a certain degree of reliability can be obtained. In other words, for example, if the authenticity of the captured image to be distributed is guaranteed by the image distribution responsible organization on a certification web page, the user receiving the captured image can have a certain degree of confidence that the captured image is legitimate.

[0362] In particular, for a captured image in which the authenticity is guaranteed in the first processing target area but not in the second processing target area, if the image distribution responsible organization guarantees the authenticity of the second processing target area, the authenticity of the captured image as a whole is guaranteed jointly by the authenticity determination system 100 (authenticity determination server 104) and the image distribution responsible organization. In such a case, the authenticity can be guaranteed with a sufficiently high degree of reliability.

[0363] In this way, when the image processing device 103 (or its user, etc.) guarantees authenticity, the image processing device 103 has a configuration such as that shown in Fig. 42. That is, in this case, the image processing device 103 has an authenticity determination unit 361 in addition to the configuration described with reference to Fig. 2.

[0364] The authenticity determination unit 361 executes processing related to authenticity determination of the processed image. For example, the authenticity determination unit 361 may notify the authenticity determination server 104 that the authenticity of the processed image is guaranteed. For example, the authenticity determination unit 361 may issue this notification based on a user instruction. For example, the authenticity determination unit 361 may display a GUI screen 370 such as that shown in FIG. 43 on a display device and receive an instruction to guarantee authenticity from the user on this GUI screen 370.

[0365] As shown in Fig. 43, the GUI screen 370 has a GUI button 373 for accepting a user instruction. In the example of Fig. 43, this GUI button 373 is labeled "Authenticity Guarantee Button," indicating that it is a GUI button for accepting an instruction to guarantee authenticity. For example, when a user presses this GUI button 373, the authenticity determination unit 361 accepts the user instruction. Based on the instruction, the authenticity determination unit 361 notifies the authenticity determination server 104 that the authenticity of the processed image is guaranteed.

[0366] Furthermore, the GUI screen 370 may be provided with an area 372 in which the processed image to be judged for authenticity is displayed, and an area 371 in which the unprocessed image corresponding to the processed image is displayed.

[0367] <Processing Flow> In this case, an example of the processing flow executed in the authenticity determination system 100 will be described with reference to the flowchart of FIG.

[0368] In step S811, the image processing device 103 (authenticity determination unit 361) displays the GUI screen 370 of Fig. 43 and accepts an instruction to verify authenticity. Upon accepting the instruction to verify authenticity, the image processing device 103 (authenticity determination unit 361) notifies the authenticity determination server 104 of the acceptance in step S812.

[0369] Upon receiving the notification in step S821, the authenticity determination server 104 (authenticity determination result display information output unit 215) generates a certification Web page to be published at a predetermined URL as authenticity determination result display information in step S822. This certification Web page stores information about the image processing device 103 (or its user) as the guarantor of the authenticity of the processed image. In step S823, the authenticity determination server 104 (authenticity determination result display information output unit 215) supplies (outputs) the generated certification Web page to the Web server 105.

[0370] That is, the authenticity determination server 104 (authenticity determination result display information output unit 215) generates and outputs authenticity determination result display information including information about the external authenticity guarantor. Also, the authenticity determination server 104 (authenticity determination result display information output unit 215) generates and outputs authenticity determination result display information including information about the external authenticity guarantor based on a request from the external authenticity guarantor.

[0371] The Web server 105 acquires the certification Web page in step S831. The Web server 105 then publishes the acquired Web page at a predetermined URL (the URL generated in the processing of step S782) in step S832. This allows the certification Web page (i.e., authenticity determination result display information) to be acquired from any terminal device, such as the image processing device 103 or the terminal device 106. For example, the authenticity determination result display unit 134 generates and displays a determination result display image including information indicating the guarantor who guarantees the authenticity of the processed image. In other words, the authenticity determination result can be viewed on any device. This improves the practicality and convenience of the service that guarantees the authenticity of images.

[0372] FIG. 45 is a diagram showing an example of the display of a certification web page. For example, the certification web page may be displayed in a configuration similar to that of display screen 380 shown in FIG. 45. In this display screen 380, a URL, an unedited image (original image), an edited image, analysis results, a list of detection results, and the like are displayed. Furthermore, this display screen 380 displays information about the guarantor who guarantees the authenticity of the edited image. In the example of FIG. 45, multiple guarantors are shown, such as "Guarantor A" and "Guarantor B." In other words, authenticity can be guaranteed not only by the owner of the authenticity determination system 100 (authenticity determination server 104) (such as a provider of an authenticity determination service), but also by other parties.

[0373] For example, as described above, the authenticity of the processed image may be guaranteed by (the user of) the image processing device 103. The user of the image processing device 103 may be, for example, an image distribution responsible organization that distributes the processed image. In this case, guarantees can be made by multiple guarantors, as shown in FIG. 45. Therefore, guarantees can be made under the joint responsibility of, for example, the owner of the authenticity determination system 100 (authenticity determination server 104) (the provider of the authenticity determination service, etc.) and the image distribution responsible organization.

[0374] This makes it possible to improve the practicality and convenience of the service that guarantees the authenticity of images.

[0375] 14. Twelfth Embodiment Combination The present technology described in each of the above-described embodiments may be applied in combination with any two or more of them. Furthermore, the present technology described in each of the above-described embodiments may be applied in combination with other technologies not described above.

[0376] <15. Supplementary Notes> <Others> The above-described examples (methods) of the present technology may be applied in appropriate combination with other examples (other methods) as long as no contradiction occurs. Furthermore, the above-described examples of the present technology may be applied in combination with other technologies other than those described above.

[0377] <Computer> The above-described series of processes can be executed by hardware or software. When the series of processes is executed by software, the programs that make up the software are installed on a computer. Here, the term "computer" includes computers built into dedicated hardware, and general-purpose personal computers, etc., that can execute various functions by installing various programs.

[0378] FIG. 46 is a block diagram showing an example of the hardware configuration of a computer that executes the above-described series of processes by a program.

[0379] In a computer 900 shown in FIG. 46, a CPU (Central Processing Unit) 901, a ROM (Read Only Memory) 902, and a RAM (Random Access Memory) 903 are interconnected via a bus 904.

[0380] An input / output interface 910 is also connected to the bus 904. To the input / output interface 910, an input unit 911, an output unit 912, a storage unit 913, a communication unit 914, and a drive 915 are connected.

[0381] The input unit 911 includes, for example, a keyboard, a mouse, a microphone, a touch panel, and an input terminal. The output unit 912 includes, for example, a display, a speaker, and an output terminal. The storage unit 913 includes, for example, a hard disk, a RAM disk, and a non-volatile memory. The communication unit 914 includes, for example, a network interface. The drive 915 drives removable media 921 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory.

[0382] In a computer configured as described above, the CPU 901 performs the above-described series of processes by, for example, loading a program stored in the storage unit 913 into the RAM 903 via the input / output interface 910 and the bus 904 and executing the program. The RAM 903 also stores data necessary for the CPU 901 to execute various processes as appropriate.

[0383] The program executed by the computer can be applied by recording it on, for example, a removable medium 921 such as a package medium. In this case, the program can be installed in the storage unit 913 via the input / output interface 910 by inserting the removable medium 921 into the drive 915.

[0384] This program can also be provided via a wired or wireless transmission medium such as a local area network, the Internet, digital satellite broadcasting, etc. In this case, the program can be received by the communication unit 914 and installed in the storage unit 913.

[0385] Alternatively, this program can be installed in advance in the ROM 902 or the storage unit 913 .

[0386] <Applicable Targets of the Present Technology> The present technology can be applied to any encoding / decoding method.

[0387] Furthermore, the present technology can be applied to any configuration, for example, various electronic devices.

[0388] Furthermore, for example, the present technology can also be implemented as part of an apparatus, such as a processor (e.g., a video processor) as a system LSI (Large Scale Integration), a module using multiple processors (e.g., a video module), a unit using multiple modules (e.g., a video unit), or a set in which other functions are added to a unit (e.g., a video set).

[0389] Furthermore, for example, the present technology can also be applied to a network system configured with multiple devices. For example, the present technology may be implemented as cloud computing in which multiple devices share and collaborate on processing via a network. For example, the present technology may be implemented in a cloud service that provides image (video)-related services to any terminal, such as a computer, an AV (Audio Visual) device, a portable information processing terminal, or an IoT (Internet of Things) device.

[0390] In this specification, a system refers to a collection of multiple components (devices, modules (components), etc.), regardless of whether all of the components are housed in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device housed in a single housing with multiple modules, are both systems.

[0391] <Fields and uses to which this technology can be applied> Systems, devices, processing units, etc. to which this technology is applied can be used in any field, for example, transportation, medical care, crime prevention, agriculture, livestock farming, mining, beauty, factories, home appliances, weather, nature monitoring, etc. In addition, the uses thereof are also arbitrary.

[0392] For example, the present technology can be applied to systems and devices used to provide viewing content, etc. Furthermore, for example, the present technology can also be applied to systems and devices used for transportation, such as monitoring traffic conditions and controlling automatic driving. Furthermore, for example, the present technology can also be applied to systems and devices used for security. Furthermore, for example, the present technology can also be applied to systems and devices used for automatic control of machines, etc. Furthermore, for example, the present technology can also be applied to systems and devices used for agriculture and livestock farming. Furthermore, for example, the present technology can also be applied to systems and devices used to monitor natural conditions, such as volcanoes, forests, and oceans, and wildlife. Furthermore, for example, the present technology can also be applied to systems and devices used for sports.

[0393] <Others> In this specification, a "flag" refers to information for identifying multiple states, and includes not only information used to identify two states, true (1) or false (0), but also information capable of identifying three or more states. Therefore, the value that this "flag" can take may be, for example, two values, 1 / 0, or three or more values. That is, the number of bits constituting this "flag" is arbitrary, and may be one bit or multiple bits. Furthermore, identification information (including flags) can be included not only in a bitstream, but also in a bitstream that includes differential information of the identification information relative to certain reference information. Therefore, in this specification, "flag" and "identification information" encompass not only the information itself, but also differential information relative to the reference information.

[0394] Furthermore, various types of information (e.g., metadata) related to captured images may be transmitted or recorded in any form as long as they are associated with the captured images. Here, the term "associate" means, for example, that one piece of data can be used (linked) when processing the other piece of data. That is, pieces of associated data may be combined into one piece of data or may be separate pieces of data. For example, information associated with encoded data (image) may be transmitted over a transmission path separate from that of the encoded data (image). Furthermore, for example, information associated with encoded data (image) may be recorded on a recording medium separate from that of the encoded data (image) (or on a different recording area of ​​the same recording medium). Note that this "association" may refer to only a portion of the data, rather than the entire data. For example, an image and information corresponding to that image may be associated with each other in any unit, such as multiple frames, one frame, or a portion of a frame.

[0395] In this specification, terms such as "composite," "multiplex," "add," "integrate," "include," "store," "embed," "insert," and the like refer to combining multiple items into one, such as combining encoded data and metadata into one piece of data, and refer to one method of "associating" as described above.

[0396] Furthermore, the embodiments of the present technology are not limited to the above-described embodiments, and various modifications are possible within the scope of the gist of the present technology.

[0397] For example, a configuration described as one device (or processing unit) may be divided and configured as multiple devices (or processing units). Conversely, configurations described above as multiple devices (or processing units) may be combined and configured as one device (or processing unit). Of course, configurations other than those described above may be added to the configuration of each device (or each processing unit). Furthermore, as long as the configuration and operation of the entire system are substantially the same, part of the configuration of one device (or processing unit) may be included in the configuration of another device (or other processing unit).

[0398] Furthermore, for example, the above-described program may be executed in any device, as long as the device has the necessary functions (functional blocks, etc.) and is able to obtain the necessary information.

[0399] Also, for example, each step of a single flowchart may be executed by a single device, or may be shared and executed by multiple devices. Furthermore, when a single step includes multiple processes, the multiple processes may be executed by a single device, or may be shared and executed by multiple devices. In other words, multiple processes included in a single step can be executed as multiple step processes. Conversely, processes described as multiple steps can be executed collectively as a single step.

[0400] For example, the steps of a program executed by a computer may be executed in chronological order in the order described herein, or may be executed in parallel or individually at the required timing, such as when a call is made. In other words, as long as no contradiction occurs, the steps may be executed in an order different from the order described above. Furthermore, the steps of this program may be executed in parallel with the processing of another program, or may be executed in combination with the processing of another program.

[0401] Furthermore, for example, multiple technologies related to the present technology can be implemented independently and independently, as long as no contradiction occurs. Of course, any multiple technologies can also be implemented in combination. For example, part or all of the present technology described in any embodiment can be implemented in combination with part or all of the present technology described in another embodiment. Furthermore, part or all of any of the above-described present technologies can be implemented in combination with other technologies not described above.

[0402] The present technology may also be configured as follows. (1) An image processing device comprising: a signature verification unit that verifies a signature of an unedited image before any editing is applied to the image; an editing identification unit that identifies the content of the editing based on the pre-edited image and an edited image obtained by applying the editing to the pre-edited image; and an authenticity determination unit that determines whether to guarantee the authenticity of the edited image based on the signature verification result and the identified content of the editing. (2) The authenticity determination unit determines to guarantee the authenticity of the edited image if the verification result guarantees the authenticity of the pre-edited image and identifies the editing as permissible editing, and determines not to guarantee the authenticity of the edited image if the verification result does not guarantee the authenticity of the pre-edited image or identifies the editing as unpermissible editing. (3) The image processing device according to (2), further comprising: an authenticity determination result display information output unit that generates and outputs authenticity determination result display information indicating the determination result of whether to guarantee the authenticity of the edited image. (4) The image processing device according to (3), wherein the authenticity determination unit determines whether to guarantee the authenticity of a processing target region, which is a partial region of the processed image where the processing is performed. (5) The image processing device according to (4), wherein the authenticity determination unit determines not to guarantee the authenticity of an image synthesis region, which is a partial region of the processed image where image synthesis is performed. (6) The image processing device according to (4) or (5), wherein the authenticity determination unit determines not to guarantee the authenticity of a 2D region, which is a partial region formed by a plane of the processed image. (7) The image processing device according to any of (4) to (6), wherein the authenticity determination unit determines to guarantee the authenticity of the processing target region of the processed image if the content of the processing of the processing target region between the original image and the pre-processing image corresponds to processing history information added to the pre-processing image, and determines not to guarantee the authenticity of the processing target region of the processed image if the content of the processing of the processing target region between the original image and the pre-processing image does not correspond to the processing history information.(8) The image processing device according to any one of (4) to (7), wherein the authenticity determination unit determines that the authenticity of the face region of the processed image is guaranteed if the processing of a face region, which is a partial region including a face part of a person, is a change due to the person's health condition, etc., and determines that the authenticity of the face region of the processed image is not guaranteed if the processing of the face region is not a change due to the person's health condition, etc. (9) The image processing device according to (8), wherein the change due to the person's health condition, etc. includes processing to correct rough skin, processing to correct facial expressions due to lack of sleep, etc., processing to suppress or exaggerate sunburn, etc., or processing to change hair color, shape, volume, etc. (10) The image processing device according to any of (4) to (9), wherein the authenticity determination unit determines that the authenticity of the face region of the processed image is guaranteed if the processing of a face region, which is a partial region including a person's face, is within a socially understandable range, and determines that the authenticity of the face region of the processed image is not guaranteed if the processing of the face region is not within the socially understandable range. (11) The image processing device according to (10), wherein the processing within a socially understandable range includes changes made by makeup on the person. (12) The image processing device according to any of (4) to (11), wherein the authenticity determination unit determines that the authenticity of the object identification information region of the processed image is guaranteed if the processing of an object identification information region, which is a partial region including object identification information, is processing that does not involve a change in the object identification information, and determines that the authenticity of the object identification information region of the processed image is not guaranteed if the processing of the object identification information region involves a change in the object identification information. (13) The image processing device according to (12), wherein the object identification information includes a license plate of a vehicle. (14) The image processing device according to any one of (4) to (13), wherein the authenticity determination unit determines that authenticity of the personal identification information area of ​​the processed image is guaranteed when the processing of the personal identification information area that is a partial area including personal identification information is processing that does not involve a change in the personal identification information, and determines that authenticity of the personal identification information area of ​​the processed image is not guaranteed when the processing of the personal identification information area is processing that involves a change in the personal identification information.(15) The image processing device according to (14), wherein the personal identification information includes an identification card. (16) The image processing device according to any one of (3) to (15), wherein the authenticity determination result display information output unit generates and outputs a certification web page to be made public at a predetermined URL as the authenticity determination result display information. (17) The image processing device according to (16), wherein the authenticity determination result display information output unit generates the certification web page that does not include an original image. (18) The image processing device according to any one of (3) to (17), wherein the authenticity determination result display information output unit generates and outputs authenticity determination result display information including information about an external authenticity guarantor. (19) The image processing device according to (18), wherein the authenticity determination result display information output unit generates and outputs authenticity determination result display information including information about the external authenticity guarantor based on a request from the external authenticity guarantor. (20) The image processing device according to (1), wherein the authenticity determination unit determines whether to guarantee the authenticity of the edited image based on a determination criterion set by a user. (21) An image processing method including: verifying a signature of an unedited image before any editing is applied to an image; specifying the details of the editing based on the unedited image and an edited image obtained by applying the editing to the preedited image; and determining whether to guarantee the authenticity of the edited image based on a result of the signature verification and the specified details of the editing.

[0403] (31) An image processing device comprising: a display processing unit that generates and displays a display image indicating a determination result using authenticity determination result display information that indicates a determination result of whether or not the authenticity of an edited image is guaranteed, wherein the edited image is an image obtained by applying processing to an unedited image. (32) The image processing device according to (31), wherein the display processing unit generates the display image so that display content changes depending on whether the authenticity of the edited image is guaranteed and whether the authenticity of the edited image is not guaranteed. (33) The image processing device according to (32), wherein the display processing unit generates the display image further including information indicating the content of the processing. (34) The image processing device according to (33), wherein the display processing unit generates the display image further including the edited image. (35) The image processing device according to (34), wherein the display processing unit generates the display image further including the unedited image. (36) The image processing device according to any one of (32) to (35), wherein the display processing unit generates the display image including the processed image and information indicating a processing target area, which is a partial area of ​​the processed image to which the processing is to be applied. (37) The image processing device according to (36), wherein the display processing unit generates the display image further including information indicating the content of the processing applied to the processing target area of ​​the processed image. (38) The image processing device according to any one of (32) to (37), wherein the display processing unit generates the display image including the processed image and information indicating an image synthesis area, which is a partial area to which image synthesis of the processed images is to be applied. (39) The image processing device according to (38), wherein the display processing unit generates the display image further including information indicating the content of the image synthesis applied to the image synthesis area of ​​the processed image. (40) The image processing device according to any one of (32) to (39), wherein the display processing unit generates the display image including the processed image and information indicating a 2D area, which is a partial area formed by a plane of the processed image. (41) The image processing device according to any one of (32) to (40), wherein the display processing unit generates the display image including information indicating the content of the processing and history information of the processing added to the processed image as metadata.(42) The image processing device according to any one of (32) to (41), wherein the display processing unit generates the display image including the processed image and information indicating a face region which is a partial region including a face portion of a person in the processed image. (43) The image processing device according to (42), wherein the display processing unit generates the display image further including information indicating the content of the processing applied to the face region of the processed image. (44) The image processing device according to any one of (32) to (43), wherein the display processing unit generates the display image including the processed image and information indicating an object identification information region which is a partial region including object identification information of the processed image. (45) The image processing device according to (44), wherein the display processing unit generates the display image further including information indicating the content of the processing applied to the object identification information region of the processed image. (46) The image processing device according to any one of (32) to (45), wherein the display processing unit generates the display image including the processed image and information indicating a person identification information region which is a partial region including person identification information of the processed image. (47) The image processing device according to (46), wherein the display processing unit generates the display image further including information indicating the content of the processing applied to the personal identification information area of ​​the processed image. (48) The image processing device according to any of (31) to (47), wherein the authenticity determination result display information is a certification Web page indicating the determination result, and the display processing unit is configured to generate and display the display image using the acquired certification Web page. (49) The image processing device according to any of (31) to (48), wherein the display processing unit generates and displays the display image including information indicating a guarantor who guarantees the authenticity of the processed image. (50) An image processing method, comprising generating and displaying a display image indicating the determination result using authenticity determination result display information indicating the determination result of whether or not to guarantee the authenticity of the processed image, and wherein the processed image is an image obtained by processing the pre-processing image.

[0404] 100 Authenticity determination system, 101 Imaging device, 102 File conversion device, 103 Image processing device, 104 Authenticity determination server, 105 Web server, 106 Terminal device, 110 Network, 131 Image acquisition unit, 132 Image processing unit, 133 Authenticity determination request unit, 134 Authenticity determination result display unit, 211 Image acquisition unit, 212 Signature verification unit, 213 Processing identification unit, 214 Authenticity determination unit, 215 Authenticity determination result display information output unit, 331 Certification Web page processing unit, 361 Authenticity determination unit, 900 Computer

Claims

1. An image processing device comprising: a signature verification unit that verifies the signature of an unprocessed image before any processing is applied to the image; a processing identification unit that identifies the content of the processing based on the unprocessed image and a processed image obtained by applying the processing to the pre-processed image; and an authenticity determination unit that determines whether or not to guarantee the authenticity of the processed image based on the signature verification result and the identified content of the processing.

2. The image processing device of claim 1, wherein the authenticity determination unit determines that the authenticity of the edited image is guaranteed if the verification result guarantees the authenticity of the unedited image and the editing is identified as permissible editing, and determines that the authenticity of the edited image is not guaranteed if the verification result does not guarantee the authenticity of the unedited image or if the editing is identified as permissible editing.

3. The image processing device according to claim 2, further comprising an authenticity determination result display information output unit that generates and outputs authenticity determination result display information indicating the determination result as to whether or not the authenticity of the processed image is guaranteed.

4. The image processing device according to claim 3, wherein the authenticity determination unit determines whether or not to guarantee the authenticity of a processing target area, which is a partial area of ​​the processed image to which the processing is applied.

5. The image processing device according to claim 4, wherein the authenticity determination unit determines that the authenticity of an image synthesis area, which is a partial area where image synthesis of the processed image is performed, cannot be guaranteed.

6. The image processing device according to claim 4, wherein the authenticity determination unit determines that the authenticity of a 2D region that is a partial region formed by a plane of the processed image cannot be guaranteed.

7. The image processing device according to claim 4, wherein the authenticity determination unit determines that the authenticity of the processing target area of ​​the processed image is guaranteed if the content of the processing of the processing target area between the original image and the pre-processing image corresponds to the processing history information added to the pre-processing image, and determines that the authenticity of the processing target area of ​​the processed image is not guaranteed if the content of the processing of the processing target area between the original image and the pre-processing image does not correspond to the processing history information.

8. The image processing device according to claim 4, wherein the authenticity determination unit determines that the authenticity of the face area of ​​the processed image is guaranteed if the processing of the face area, which is a partial area including a person's face, is a change due to the person's health condition, etc., and determines that the authenticity of the face area of ​​the processed image is not guaranteed if the processing of the face area is not a change due to the person's health condition, etc.

9. The image processing device according to claim 8, wherein the changes due to the person's health condition, etc. include processing to correct rough skin, processing to correct facial expressions due to lack of sleep, etc., processing to suppress or exaggerate sunburn, etc., or processing to change the color, shape, volume, etc. of hair.

10. The image processing device according to claim 4, wherein the authenticity determination unit determines that the authenticity of the face area of ​​the processed image is guaranteed if the processing of the face area, which is a partial area including a person's face, is within a range that is socially easy to understand, and determines that the authenticity of the face area of ​​the processed image is not guaranteed if the processing of the face area is not within the range that is socially easy to understand.

11. The image processing device according to claim 10, wherein the processing that is within a range that is easily socially understandable includes changes to the person through makeup.

12. The image processing device according to claim 4, wherein the authenticity determination unit determines that the authenticity of the object identification information area of ​​the processed image is guaranteed if the processing of the object identification information area, which is a partial area containing object identification information, is processing that does not involve a change in the object identification information, and determines that the authenticity of the object identification information area of ​​the processed image is not guaranteed if the processing of the object identification information area is processing that involves a change in the object identification information.

13. The image processing device according to claim 12, wherein the object identification information includes a vehicle license plate number.

14. The image processing device according to claim 4, wherein the authenticity determination unit determines that the authenticity of the personal identification information area of ​​the processed image is guaranteed if the processing of the personal identification information area, which is a partial area containing personal identification information, is processing that does not involve a change in the personal identification information, and determines that the authenticity of the personal identification information area of ​​the processed image is not guaranteed if the processing of the personal identification information area is processing that involves a change in the personal identification information.

15. The image processing device according to claim 14, wherein the personal identification information includes an identification card.

16. The image processing device according to claim 3, wherein the authenticity determination result display information output unit generates and outputs a certification Web page to be made public at a specified URL as the authenticity determination result display information.

17. The image processing device according to claim 16, wherein the authenticity determination result display information output unit generates the certification Web page that does not include an original image.

18. The image processing device according to claim 3, wherein the authenticity determination result display information output unit generates and outputs authenticity determination result display information including information on an external authenticity guarantor.

19. The image processing device according to claim 18, wherein the authenticity determination result display information output unit generates and outputs authenticity determination result display information including information about the external authenticity guarantor based on a request from the external authenticity guarantor.

20. The image processing device according to claim 1, wherein the authenticity determination unit determines whether or not to guarantee the authenticity of the processed image based on a determination criterion set by a user.

21. An image processing method comprising: verifying a signature of an unprocessed image before any processing is applied to the image; identifying the content of the processing based on the unprocessed image and a processed image in which the processing has been applied to the pre-processed image; and determining whether or not to guarantee the authenticity of the processed image based on the signature verification result and the identified content of the processing.