System and program for assessing validity of digital work

Abstract

Provided are a digital work validity assessment system and a program for assessing the validity of a digital work of digital art on a network or SNS contribution image data.　When a contributor terminal 3 makes a contribution / creation on an SNS site 2, work data pertaining to the contribution / creation, index image data including a thumbnail image of the work data and a hash value of the work data, and a hash value of the index image data are exported to a digital work validity assessment server 1, and, in a state where the work data and associated image data, in which access information including an access destination to the digital work validity assessment server 1 and information pertaining to the hash value of the index image data is incorporated in the index image data, are uploaded to the SNS site 2, the digital work validity assessment server 1 assesses the validity of the contributed / created work data from the associated image data.

Description

Digital artwork legitimacy verification system and program

[0001] The present invention relates to a system for determining the legitimacy of digital works on a network, and more particularly to a system and program for determining the legitimacy of digital works on a network that can easily determine the legitimacy of digital works such as image data, painting data, music data, and document data that have been resized and had metadata removed on social networking services (SNS).

[0002] [Conventional Technology] While there have been technologies to determine whether an image has been tampered with using the hash value of the image data, images posted to SNS (Social Networking Service) are resized and metadata is removed by the operating site, so the hash value of the image data at the time of shooting changes, making it impossible to determine tampering using the hash value.

[0003] Furthermore, while some digital art works such as paintings and music on the network incorporate copyright notices to protect their copyright, general users other than the creator of the work have not been able to determine the legitimacy of the digital work.

[0004] [Related technologies] Related prior art includes Japanese Patent No. 6762057, "Video and Image Content Posting Management System for SNS" (Patent Document 1), and Japanese Patent No. 7427310, "Information Terminal and Program" (Patent Document 2).

[0005] Patent Document 1 shows that a content posting management system uses blockchain technology to ensure the authenticity of content and provides resistance to data tampering.

[0006] Patent Document 2 describes an information terminal that can easily verify that exported image data or audio data is the original image or audio. Note that Patent Document 2 is a patent held by an affiliate of the applicant.

[0007] Patent No. 6762057 Patent No. 7427310

[0008] As described above for the conventional technology, digital works such as image data posted on social media are resized and metadata is removed by the operating site before posting, which presents a problem in that it is not easy to determine the authenticity of an image using the hash value of the image data at the time of shooting.

[0009] Furthermore, there was a problem in that it was difficult to easily determine the legitimacy of digital works of digital art provided via the network—whether they were legitimately created by the author or illegally altered or plagiarized by someone.

[0010] Furthermore, Patent Documents 1 and 2 do not describe a configuration for determining whether or not an image posted to an SNS is a genuine image, even if the image data has been resized and its metadata removed during posting.

[0011] This invention has been made in view of the above circumstances, and aims to provide a system and program for determining the legitimacy of digital works on a network, which allows ordinary users to easily determine the legitimacy of digital works by attaching index image data, which includes access information to a site for determining the legitimacy of digital works, to image data posted on social networking services or digital works of digital art on a network, and by displaying legitimate digital works through access from said access information.

[0012] To solve the problems of the above-mentioned conventional example, the present invention provides a digital work legitimacy determination system having a digital work legitimacy determination server that determines the legitimacy of work data provided from a creator terminal to a network site. When the work data is provided from the creator terminal to the site, the provided work data, an index image data including a thumbnail image of the work data and a hash value of the work data, and the hash value of the index image data are exported to and stored on the digital work legitimacy determination server. When the work data and accompanying image data, in which access information including the access destination to the digital work legitimacy determination server and the hash value of the index image data is embedded in the index image data, are uploaded to the site, the digital work legitimacy determination server is accessed by a user terminal from the access information of the accompanying image data, and when the hash value of the index image data is input, the server searches for the hash value of the exported index image data corresponding to the input hash value. If the hash value does not exist, the system determines that the work data provided to the site is not legitimacy. If the hash value exists, the system displays the corresponding exported work data to the user terminal.

[0013] In the above-mentioned digital work authenticity determination system, the access information includes a launch button for a search viewer application instead of an access destination for the digital work authenticity server. When this launch button is selected, the search viewer application is launched on the user's terminal, which obtains information on the hash value of the index image data and provides it to the digital work authenticity server to search for the hash value of the exported index image data.

[0014] In the present invention, the authenticity determination system for the above-mentioned digital artwork is configured such that the artwork data and accompanying image data are stored within a frame, or the accompanying image data is stored within the artwork data, and then uploaded to the site.

[0015] The present invention relates to a digital artwork authenticity determination system in which, when the digital artwork authenticity determination server receives artwork data provided to a site corresponding to the exported artwork data displayed on the user terminal from the user terminal, it compares the exported artwork data with the received artwork data and determines that they are "true" if they are found to be the same, and "false" if they are found to be the same, and notifies the user terminal of the authenticity of the image data provided to the site.

[0016] The present invention is a program that operates on a creator terminal that provides artwork data to a network site, and causes the creator terminal to export the provided artwork data, an index image data including a thumbnail image of the artwork data and a hash value of the artwork data, and the hash value of the index image data to a digital artwork legitimacy determination server, and to upload the artwork data and accompanying image data in which access information including the access destination to the digital artwork legitimacy determination server and the hash value of the index image data is embedded in the index image data, to the site.

[0017] The present invention provides a program that causes the creator's terminal to upload the work data and accompanying image data to the site, either by storing them within a frame, or by storing the accompanying image data within the work data.

[0018] In the present invention, the access information in the above program includes information describing the verification method.

[0019] The present invention relates to a program that operates on a digital artwork legitimacy determination server that determines the legitimacy of artwork data provided to a network site. The digital artwork legitimacy determination server stores artwork data exported from the creator's terminal, an index image data including a thumbnail image of the artwork data and a hash value of the artwork data, and the hash value of the index image data in its storage unit. When the hash value of the index image data of the artwork data provided to the site by access from a user terminal is input, the program searches the storage unit to see if the artwork data corresponding to the hash value exists. If the hash value does not exist, the program determines that the artwork data provided to the site is not legitimacy. If the hash value exists, the program displays the corresponding exported artwork data to the user terminal.

[0020] In the program described above, the digital artwork authenticity determination server, upon receiving artwork data provided to a site corresponding to the exported artwork data displayed on the user terminal from the user terminal, compares the exported artwork data with the received artwork data. If they are deemed identical, it determines "true," and if they are not deemed identical, it determines "false," and then notifies the user terminal of the authenticity of the artwork data provided to the site.

[0021] The present invention is a program that operates on a creator terminal that provides artwork data to a network site, and causes the creator terminal to export the artwork data generated by the provided AI, index image data including a thumbnail image of the artwork data and a hash value of the artwork data, the hash value of the index image data, and the hash value of a string in a file that records the process by which the AI ​​generated the artwork data to a digital artwork legitimacy determination server, and to upload the artwork data and accompanying image data in which access information including the access destination to the digital artwork legitimacy determination server, the hash value of the index image data, and the hash value of the string is embedded in the index image data to the site.

[0022] The present invention provides a program that causes the creator's terminal to upload the work data and accompanying image data to the site, either by storing them within a frame, or by storing the accompanying image data within the work data.

[0023] The present invention relates to a program that operates on a digital artwork legitimacy determination server that determines the legitimacy of artwork data provided to a network site. The digital artwork legitimacy determination server stores in its memory the following: AI-generated artwork data exported from the creator's terminal, index image data including a thumbnail image of the artwork data and a hash value of the artwork data, the hash value of the index image data, and the hash value of a string in a file that records the process by which the AI ​​generated the artwork data. When the hash value of the index image data and the hash value of the string of the artwork data provided to the site by access from a user terminal are input, the program searches in the memory to see if the artwork data corresponding to the hash value of the index image data exists. If the hash value of the index image data does not exist, the program determines that the artwork data provided to the site is not legitimacy. If the hash value of the index image data does exist, the program displays the corresponding exported artwork data to the user terminal, searches in the memory to see if the hash value of the string exists. If the hash value of the string does not exist, the program determines that the artwork data provided to the site was not generated by AI.

[0024] The present invention relates to a program that operates on a server of a network site to determine the legitimacy of artwork data provided to the site. The program causes the server to store artwork data exported from the creator's terminal, an index image data including a thumbnail image of the artwork data and a hash value of the artwork data, and the hash value of the index image data in its storage unit. For the artwork data provided to the site, the program searches whether the artwork data corresponding to the hash value exists in the storage unit based on the access information, which includes the access destination of the server uploaded from the creator's terminal and the hash value of the index image data, embedded in the index image data. If the hash value does not exist, the program determines that the artwork data provided to the site is not legitimacy; if the hash value exists, the program determines that the artwork data provided to the site is legitimacy.

[0025] According to the present invention, a digital work legitimacy determination system has a digital work legitimacy determination server that determines the legitimacy of work data provided from a creator terminal to a network site. When the work data is provided from the creator terminal to the site, the provided work data, an index image data including a thumbnail image of the work data and a hash value of the work data, and the hash value of the index image data are exported to and stored on the digital work legitimacy determination server. When the work data and accompanying image data, which includes access information including the access destination to the digital work legitimacy determination server and information on the hash value of the index image data, are uploaded to the site, the digital work legitimacy determination server is accessed by a user terminal from the access information of the accompanying image data, and when the hash value of the index image data is input, the server searches for the hash value of the exported index image data corresponding to the input hash value. If the hash value does not exist, the system determines that the work data provided to the site is not legitimacy. If the hash value exists, the system displays the corresponding exported work data on the user terminal. This has the effect of allowing users of user terminals to easily recognize the legitimacy of the work data.

[0026] This is a schematic diagram of the system's configuration. This is a block diagram of the poster's terminal configuration. This is a diagram showing an example of the index display. This is a diagram showing an example of the hash list display. This is a diagram showing an example of the hash value file of the index image display. This is a diagram showing the storage image within the digital work legitimacy judgment server. This is a schematic diagram showing the export and upload processes. This is a flowchart showing the verification process. This is a diagram showing the storage image of application example 1 within the digital work legitimacy judgment server. This is a diagram showing the storage image of application example 2 within the digital work legitimacy judgment server. This is a schematic diagram of the screen for posting to SNS using this system.

[0027] Embodiments of the present invention will be described with reference to the drawings. [Summary of Embodiments] The digital artwork legitimacy determination system (this system) according to an embodiment of the present invention has a digital artwork legitimacy determination server that determines the legitimacy of digital artworks such as image data posted to an SNS from a poster terminal such as a smartphone or digital art on a network. When a post is made to an SNS from a poster terminal or when digital art is created, the posted / created digital artwork data, an index image data including a thumbnail image of the digital artwork data and the hash value of the digital artwork data, and the hash value of the index image data are exported to and stored on the digital artwork legitimacy determination server. Access information (2D code or When an attached image data (such as a URL) is embedded in the index image data, and the data is uploaded to SNS or the work is created, the digital work legitimacy determination server is accessed by the user's terminal from the access information of the attached image data. When the hash value of the index image data is entered, the server searches for the hash value of the exported index image data that corresponds to the entered hash value. If the hash value does not exist, the server determines that the posted or created digital work data is not legitimacy. If the hash value exists, the server displays the corresponding exported digital work data on the user's terminal. The user can then determine the legitimacy by comparing the displayed digital work data with the posted or created digital work data.

[0028] [This system: Figure 1] This system will be explained with reference to Figure 1. Figure 1 is a schematic diagram of the system's configuration. As shown in Figure 1, this system consists of a digital work legitimacy judgment server 1, an SNS site 2, a creator terminal (poster terminal) 3, a user terminal 4, and a network 5.

[0029] The SNS site 2 has a plurality of services, but the description is given on one site for simplicity of explanation. Further, the poster terminal 3 captures an image by using a tamper-proof application (the present application) provided by the operating company of the digital work validity determination server 1. In addition to image data for SNS posting, the digital work includes work data of digital art described later, and the present application has a role of certifying the copyright of digital art.

[0030] [Digital Work Validity Determination Server 1] As shown in FIG. 1, the digital work validity determination server 1 includes a control unit 11, a storage unit 12, and an interface unit 13, and the control unit 11 operates a processing program stored in the storage unit 12 to execute the function realizing means described below. The function realizing means includes export processing from the poster terminal 3, authenticity determination processing (verification processing) for posted image data (digital work data) from the user terminal 4, and the like.

[0031] [Export Processing] When the poster terminal 3 posts image data captured by the tamper-proof application to the SNS site 2, the digital work validity determination server 1 exports, from the poster terminal 3, the captured image data, index image data including a thumbnail image of the image data and a hash value of the image data ("index" described later), and a hash value of the index ("allhash" described later), and stores the exported data in the storage unit 12. When storing the data in the storage unit 12, the digital work validity determination server 1 may store received data with the value of allhash as a file name.

[0032] [Processing to determine the authenticity of submitted image data (verification process)] When the user terminal 4 requests the digital work authenticity determination server 1 to determine the authenticity of submitted image data, the user terminal 4 reads the access information (2D code or URL [Uniform Resource Locator]) embedded in the index image data (index) from the attached image data, and the server moves to the verification site of the digital work authenticity determination server 1. When the allhash value is entered from the allhash input screen (input field), the server searches whether the entered allhash value has been exported and exists (is stored) in the storage unit 12. Access information will be explained below using a 2D code.

[0033] Furthermore, the digital work legitimacy determination server 1 determines that the submitted image data (submitted image data) has been tampered with (is not legitimacy) if the input allhash value does not exist in the storage unit 12. If the input allhash value exists in the storage unit 12, it reads the corresponding exported image data from the storage unit 12 and displays it on the user terminal 4. The user terminal 4 can determine the authenticity (legality) of the submitted image data by comparing the exported image data provided by the digital work legitimacy determination server 1 with the submitted image data.

[0034] Furthermore, the digital work legitimacy determination server 1 receives input of submitted image data corresponding to the image data displayed on the user terminal 4, determines whether the image data stored in the storage unit 12 is identical to the submitted image data, and if they are determined to be identical, the image data is determined to be "true" (legal), and if they are not determined to be identical, the image data is determined to be "false" (not legitimate), and the determination result is displayed on the user terminal 4. The degree of identity is determined by calculating the similarity between the two image data, but the similarity may also be determined using AI (Artificial Intelligence).

[0035] Furthermore, when the verification site is accessed via the two-dimensional code of the attached image data, and the input allhash value already exists in the storage unit 12, there is a high possibility that the posted image data has not been tampered with. This processing is for the user terminal 4 to confirm that the posted image data is "authentic".

[0036] [SNS site 2] There are various types of SNS sites 2, and as described in the related art, posted image data is resized and metadata is removed therefrom. In the present system, attached image data is added to posted image data, and the user terminal 4 accesses the verification site via the two-dimensional code included in the attached image data, thereby enabling easy recognition of the authenticity of the posted image data.

[0037] [User terminal 4] The user terminal 4 is a smartphone, a tablet, a notebook PC, or the like, and is configured to, for image data posted to the SNS site 2, access the digital work authenticity determination server 1 of the verification site to confirm the authenticity of the posted image data. Processing performed by the user terminal 4 will be described later.

[0038] [Poster terminal 3: Fig. 2] The poster terminal (creator terminal) 3 corresponds to the information terminal described in Patent Document 2, and is used for capturing images via a tamper-proof application (present application); the upload destination of the captured image is the SNS site 2, and the export destination is the digital work authenticity determination server 1. First, the poster terminal 3 on which the present application operates will be described with reference to Fig. 2. Fig. 2 is a configuration block diagram of the poster terminal.

[0039] The poster terminal 3 comprises a control unit 31, a storage unit 32, a display unit 33, a camera 34, a microphone 35, and a communication unit 36. The application installed in the storage unit 32 operates on the control unit 31 to realize various functions. The poster terminal 3 is assumed to be a smartphone, tablet, notebook PC, or digital camera equipped with a camera 34. Although it is called the poster terminal 3 to mainly explain posting to social media, it may be called the creator terminal 3 when creating and uploading digital art works. The storage unit 32 of the poster terminal 3 stores the application and is also stored in conjunction with an application on the device (software for creating digital art works), or the application may be incorporated into the software for creating digital art works.

[0040] The control unit 31 is a microprocessor that launches the application and executes various processes described later. The storage unit 32 stores the application's program, as well as image data of captured still images or videos, text data of the hash value list, and hash value list image data obtained by converting the list screen into an image.

[0041] The display unit 33 displays the captured image data, hash value list screen data (text data of the hash value list), hash value list image data, and album thumbnail image data. The camera 34 captures still images and videos and stores them in the storage unit 32. This application works in conjunction with a camera application that operates the camera 34. This application may also have the functions of a camera application.

[0042] The microphone 35 receives audio input, and the captured audio data is stored in the storage unit 32. The communication unit 36 ​​is for connecting the submitter terminal 3 to the network, and it is possible to store (export) image data to cloud storage (digital work legitimacy judgment server 1).

[0043] [Means for Implementing Functions] The means for implementing functions performed by the program of this application will be described below. The means for implementing functions in this application described below include a shooting means, a recording means, a first hash value calculation means, an index generation means, a second hash value calculation means, an export means, etc.

[0044] In this application, which operates on the control unit 31, a hash value list is generated for writing hash values. In addition, an album folder is created using a file manager or similar to store still image and video image data (including audio data).

[0045] When image data captured by the camera 34 using the application's shooting means is stored in the album folder, the first hash value calculation means simultaneously calculates the hash value of the image data. Similarly, when audio data recorded by the microphone 35 using the application's recording means is stored in the album folder, the first hash value calculation means simultaneously calculates the hash value of the audio data. The file name of the image data or audio data may be changed to the calculated hash value. Alternatively, the calculated hash value may be written to the memo field in the file properties of the image data or other file.

[0046] The first hash value calculation means registers the hash values ​​of the captured image data in chronological order to a generated hash value list, based on the date and time of capture (hash value generation date and time). This hash value list is called the "hash list (HashList)". In the case of recorded audio data, the hash value of the audio data is similarly registered to the hash list based on the date and time of recording (hash value generation date and time). Therefore, the hash list contains a mixture of hash values ​​for both image data and audio data.

[0047] [Index: Figure 3] The index generation means then generates a hash value list screen that lists thumbnail images of the captured images and their hash values. This hash value list screen is called the "index". The index will now be explained with reference to Figure 3. Figure 3 shows an example of how the index is displayed.

[0048] As shown in Figure 3, the index displays a list of thumbnail images of the captured images on the left and hash values ​​on the right. If audio data is included, a thumbnail image of the audio (for example, a predetermined monochrome image) and its hash value will be inserted.

[0049] [Hash List: Figure 4] The first display means can also display a hash list. The hash list will be explained with reference to Figure 4. Figure 4 is a diagram showing an example of a hash list display. As shown in Figure 4, the hash list stores the hash values ​​that have been generated so far in chronological order. A hash value is added each time a hash value is calculated. Additions can be made to the hash list, but it cannot be tampered with or deleted.

[0050] Furthermore, when the hash list is uploaded to SNS site 2, and again when it is exported to the digital work authenticity verification server 1, additional hash values ​​are added. These added hash values ​​are shown in the last part of Figure 4. The export process will be described later.

[0051] Then, when an instruction is received to upload the images in the album folder to SNS site 2, the export means uploads the images in the album folder to SNS site 2 and exports them to the digital work legitimacy judgment server 1.

[0052] During this export process, the second hash value calculation means calculates a hash value for the index shown in Figure 3 as a single image data, and records the hash value (the hash value of the index image) in the hash list. The hash value of the index image may be displayed in a different color to distinguish it from the hash values ​​of still or video image data (including audio data).

[0053] [Index Image Hash Value (allhash) File: Figure 5] The second hash value calculation means outputs only the hash value of the index image to a file. This file is called the "Index Image Hash Value (allhash) File". The Index Image Hash Value File will be explained with reference to Figure 5. Figure 5 is a diagram showing an example of the display of the Index Image Hash Value File. When the allhash file is displayed, the hash value of the index image is displayed as shown in Figure 5.

[0054] [Storage image within Digital Work Authenticity Determination Server 1: Figure 6] The export means stores image data, index, and allhash in the export destination folder. However, the export means does not store HashList. The name of the export destination folder is the hash value of allhash.

[0055] The case where the export destination is the Digital Work Authenticity Determination Server 1 will be explained with reference to Figure 6. Figure 6 is a diagram showing the storage image within the Digital Work Authenticity Determination Server. As shown in Figure 6, the Digital Work Authenticity Determination Server 1 exports and stores multiple captured image data, an index, and an allhash.

[0056] [Export and Upload Processes: Figure 7] Next, the export process to the digital artwork legitimacy judgment server 1 and the upload process to the SNS site 2 using the export means will be explained with reference to Figure 7. Figure 7 is a schematic diagram showing the export and upload processes.

[0057] Furthermore, the export method performs the upload process to SNS site 2 and the export process to the digital work legitimacy judgment server 1 simultaneously and in parallel. Specifically, the export process may be performed first and then the upload process, or the upload process may be performed first and then the export process.

[0058] As shown in Figure 7, the export method involves performing the above export process on the Digital Work Authenticity Verification Server 1 when posting an image to the SNS site 2. The SNS site 2 then uploads the posted image data and an accompanying image data with a 2D code embedded in the index as a set. Because this application has a tamper-proof function, the exported digital works are legitimate. Here, the 2D code contains information about the URL (Uniform Resource Locator) accessed by the Digital Work Authenticity Verification Server 1, the hash value of allhash, and an explanation of the verification method.

[0059] [Verification Process: Figure 8] Next, the process of verifying the authenticity of image data posted to SNS site 2 by the user terminal 4 will be explained with reference to Figure 8. Figure 8 is a flowchart showing the verification process. The user terminal 4 can determine the authenticity of any image data (posted image data) posted to SNS site 2 if an attached image data with a 2D code embedded in the index is present. Specifically, when the user terminal 4 reads the 2D code of the attached image data, an explanation of the authenticity determination (verification method) is displayed, along with the URL to access the digital work authenticity determination server 1 and the allhash value (hash value of the index).

[0060] To read the 2D code displayed on the user terminal 4 screen, the user must save the screen displaying the 2D code as image data using a screenshot, and then use a 2D code reading application to read the saved image data. Alternatively, image data posted on an SNS site can be saved to the album in the user terminal 4's memory using the save button, and the 2D code in the saved image data can be read by long-pressing it. Furthermore, the 2D code can also be read by taking a picture of it with the camera of another device, such as a smartphone.

[0061] The user terminal 4 accesses the digital work authenticity determination server 1 from the URL to be accessed and enters the value of allhash in the hash value input field. The digital work authenticity determination server 1 then searches for the file name using the value of allhash (S1), as shown in Figure 8, and determines whether the file name exists or not (S2). If the result of the determination is that the file name does not exist (No), the posted image is determined to be "fake" (possibly modified) (S3).

[0062] If the determination process S2 indicates that a file name exists (Yes), the digital work legitimacy determination server 1 displays the image data within the file on the user terminal 4 (S4). By referring to the image data displayed on the user terminal 4, the user can determine whether the submitted image data has been modified.

[0063] Furthermore, the digital work authenticity determination server 1 may optionally determine whether the image data provided to the user terminal 4 and the posted image data are identical. Specifically, the provided image data is accompanied by an attached URL for accessing a site that performs identity determination. When the user terminal 4 accesses this site, selects posted image data from the SNS site 2, and sends it to the site, the digital work authenticity determination server 1 uses artificial intelligence (AI) or the like to calculate the similarity (identity) between the received posted image data and the provided image data. If the similarity is above a certain threshold, it is determined to be identical; if it is below that threshold, it is determined to be not identical (it has been modified).

[0064] The digital artwork authenticity determination server 1 displays the result of the identity determination to the user terminal 4. This allows users to easily determine the authenticity of the submitted image data, that is, whether the image is unaltered or altered.

[0065] [Application Example 1: Verification of AI-Generated Images: Figure 9] Next, we will explain Application Example 1, which verifies whether or not image data generated by an AI using the technology of this system was generated by an AI. Figure 9 shows the storage image of Application Example 1 within the digital artwork legitimacy judgment server. If the submitted image data was generated by an AI, the submitter terminal 3 creates a file (AI generation process file) that records the process by which the image data was generated by the AI. This file is in JSON (JavaScript Object Notation) format.

[0066] Then, the poster terminal 3 calculates the hash value of the string in the AI ​​generation process file (AI generation process hash value). Furthermore, as shown in Figure 9, the poster terminal 3 exports the image data generated by the AI ​​to be posted (AI-generated image data), the index image data including the thumbnail image of that image data and the hash value of that image data, the hash value of the index image data, and the AI ​​generation process hash value to the digital work legitimacy judgment server 1. Note that the AI ​​generation process hash value is stored so as to be added to the hash value of the index image data.

[0067] Furthermore, the poster's terminal 3 uploads (posts) the AI-generated image data, the URL to access the digital artwork legitimacy judgment server 1, the hash value of the index image data, and the attached image data in which a 2D code containing information about the AI ​​generation process hash value is embedded in the index image data, to the SNS site 2.

[0068] The digital work legitimacy determination server 1 stores in the storage unit 12 the AI-generated image data exported from the submitter terminal 3, the index image data including the thumbnail image of the image data and the hash value of the image data, the hash value of the index image data, and the AI ​​generation process hash value.

[0069] Then, the user terminal 4 accesses the digital artwork legitimacy determination server 1 from the 2D code of the attached image data on the SNS site 2, and inputs the hash value of the index image data of the AI-generated image data and the AI ​​generation process hash value.

[0070] The digital work authenticity determination server 1 then searches the storage unit 12 to see if image data corresponding to the hash value of the index image data input from the user terminal 4 exists. If the hash value of the index image data does not exist, the server determines that the image data posted to the SNS site 2 has been tampered with.

[0071] Furthermore, the digital work legitimacy determination server 1 searches the storage unit 12 to see if an AI generation process hash value corresponding to the AI ​​generation process hash value input from the user terminal 4 exists. If the AI ​​generation process hash value does not exist, it determines that the image data posted to the SNS site 2 was not generated by AI.

[0072] Furthermore, if the digital artwork legitimacy determination server 1 finds that image data corresponding to the hash value of the index image data input from the user terminal 4 exists in the storage unit 12, it will output the corresponding exported AI-generated image data to the user terminal 4.

[0073] Furthermore, the digital artwork legitimacy determination server 1 determines that the image data posted to the SNS site 2 was generated by AI if an AI generation process hash value corresponding to the AI ​​generation process hash value input from the user terminal 4 exists in the storage unit 12.

[0074] In one application example of this system, AI-generated image data posted to SNS site 2 can be easily determined and verified as to whether or not it was generated by AI, using the hash value of the string in the AI ​​process file. Based on this verification, the image exported from the poster's terminal 3 will be considered an AI-generated and therefore valid image.

[0075] [Application Example 2: Verification of Digital Artwork: Figure 10] Next, we will explain Application Example 2, which verifies whether or not digital artwork data was created by the creator (copyright verification) using the technology of this system. Figure 10 is a diagram showing the storage image of Application Example 2 in the digital artwork legitimacy determination server. Here, digital artwork data may be part or all of the data of photographs, videos, audio, paintings, music, text, etc., or a combination of such data.

[0076] Furthermore, in Application Example 2, the poster's terminal 3 has an application installed for creating digital art data (artwork data) (artwork creation application), and the aforementioned application for tamper prevention is incorporated into that artwork creation application. The artwork creation application and this application may be separate applications that work together, or the two applications may be integrated into one.

[0077] Art creation apps create an album to save artwork data upon startup. The album can also be created when saving artwork data. Furthermore, the app calculates the hash value of the artwork data at various points during creation, such as when the creator saves the artwork, or at arbitrary or automatically scheduled intervals. The calculated hash value is registered in a hash list, and the artwork data for which the hash value was calculated is also stored in the album. Digital art creation software may also have a history function to record the artwork history; when an artwork is completed, the history function can be used to calculate the hash value of the artwork data during creation and register it in the hash list.

[0078] This application generates thumbnail images of the artwork data stored in the album, generates index image data (Index) containing the thumbnail images and the hash value of the artwork data, and stores the Index in the album.

[0079] Furthermore, as shown in Figure 10, the application on the poster's terminal 3 exports the artwork data created with the artwork creation application, the thumbnail image of the artwork data, the index image data (Index) containing the hash value of the artwork data, and the hash value (allhash) of the index image data to the digital artwork legitimacy determination server 1.

[0080] Figure 10 shows an image of how the draft artwork data, line drawing artwork data, colored artwork data, finished artwork data, and index image data (Index) and the hash value of the index image data (allhash) are stored in the storage unit 12 of the digital artwork legitimacy determination server 1.

[0081] Furthermore, the poster's terminal 3 uploads (posts) the artwork data, the URL to access the digital artwork legitimacy judgment server 1, and the accompanying image data, which has a 2D code embedded in the index image data containing the hash value information of the index image data, to the SNS site 2.

[0082] This application allows users to upload artwork data and accompanying image data to SNS site (platform) 2, as well as to NFT (Non-Fungible Token) marketplaces, flea market app platforms, various cloud services, etc., or to provide them as email attachments. In this case, the legitimacy of the artwork data will be verified by the digital artwork legitimacy verification server 1.

[0083] Alternatively, instead of exporting to the Digital Work Authenticity Verification Server 1, the data may be exported to the platform's management server or the email management server. In this case, the management server is provided with the work data, index image data (Index), and the hash value of the index image data (allhash) through the export of this application, and the application provides the management server with the work data and accompanying image data for verification that it has provided to the platform.

[0084] As a result, the management server can determine the legitimacy of the artwork data if the artwork data exported from the poster terminal 3 via this application, the index image data (Index), and the hash value (allhash) of the index image data are present. When a user terminal 4 requests a determination of legitimacy for artwork data posted to SNS, etc., the user terminal 4 accesses a verification file from the 2D code of the attached image data, and the management server searches that file for the hash value (allhash) of the index image of the artwork data, and can determine the legitimacy of the artwork data based on its presence or absence. In other words, the verification process that the user terminal 4 previously performed on the digital artwork legitimacy determination server 1 in this system is now performed within the management server.

[0085] Furthermore, this application includes an import function that imports artwork data from the management server via API (Application Programming Interface) permission. The import function retrieves artwork data from the management server into this application on the contributor's terminal 3, calculates the hash value of the artwork data, registers the hash value in the hash list, stores the artwork data in the album, generates a thumbnail image of the artwork data, and stores an index image data (Index) containing the thumbnail image and hash value in the album.

[0086] When this application re-exports imported artwork data to the management server, it exports the artwork data, an index image data (Index) containing the thumbnail image of that artwork data and its hash value, and the hash value (allhash) of the index image data. The import function adds legitimacy to the artwork data stored on the management server, and the re-export allows the management server to verify the legitimacy of the artwork data.

[0087] When the work is exported to the Digital Work Validity Determination Server 1, the Digital Work Validity Determination Server 1 stores the work data exported from the contributor terminal 3, the thumbnail image of the work data, the index image data (Index) containing the hash value of the work data, and the hash value (allhash) of the index image data in the storage unit 12.

[0088] Then, the user terminal 4 accesses the digital artwork authenticity determination server 1, for example, from the 2D code of the accompanying image data corresponding to the artwork data on SNS site 2, obtains the hash value of the index image data of the artwork data, and enters it into the input screen (input field) of the accessed destination.

[0089] The digital artwork legitimacy determination server 1 then searches the storage unit 12 to see if artwork data corresponding to the hash value of the index image data input from the user terminal 4 exists. If the hash value of the index image data does not exist, the server determines that the artwork data posted to the SNS site 2 was not legitimately created by the creator (i.e., lacks legitimacy) and displays this information on the user terminal 4.

[0090] Furthermore, if the digital artwork legitimacy determination server 1 finds that artwork data corresponding to the hash value of the index image data input from the user terminal 4 exists in the storage unit 12, it determines that the corresponding exported artwork data was legitimately created by the creator (is legitimacy) and displays it on the user terminal 4.

[0091] Application Example 2 of this system allows for easy determination of whether artwork data posted on SNS site 2 was legitimately created by the creator, thereby verifying copyright. In particular, it can prove that multiple artwork data files in progress were legitimately created by the creator, including the order of creation, and have not been tampered with.

[0092] Furthermore, if artwork is exported from the art creation app to the platform's management server via this app, the platform's management server can verify the authenticity of the artwork data, thus guaranteeing its legitimacy.

[0093] In this system and application examples 1 and 2, a hash value is calculated for each artwork data, added to a hash list for registration, an index image data (index) is generated, and the hash value (allhash) of the index is calculated. However, in the case of consecutive artworks, the hash value of the artwork data may be added to the hash value of the next artwork data to form a hash chain, the hash value of the final artwork data (final hash value) may be registered in the hash list, and an index including the thumbnail image of the artwork data and the final hash value may be generated.

[0094] By using the method for determining the authenticity of the work data in this system, it is possible to fact-check news photographs. In other words, it becomes possible to fact-check photographs and video data submitted to news organizations from the contributor's terminal 3 during disasters, etc.

[0095] [Application Example 3: Integration of artwork data and accompanying image data: Figure 11] Application Example 3 of this system will be explained with reference to Figure 11. Figure 11 is a schematic diagram of the SNS posting screen using this system. Figure 11(a) is an example in which artwork data and accompanying image data are displayed together, Figure 11(b) is an example in which artwork data and accompanying image data are stored and displayed together within a frame, and Figure 11(c) is an example in which accompanying image data is stored and displayed within the artwork data.

[0096] In this system, in application examples 1 and 2, as shown in Figure 11(a), when artwork data is posted to social media, etc., the artwork data and accompanying image data are displayed together. Although they are displayed together, the artwork data and accompanying image data are separate data.

[0097] Here, the artwork data is data that is part or all of the following: photographs, videos, audio, paintings, music, text, etc., or a combination thereof. The attached image data is image data in which access information, including the access destination to the digital artwork authenticity determination server 1 and the hash value of the index image data (including the thumbnail image of the artwork data and the hash value of the artwork data), is incorporated into the index image data.

[0098] In contrast, in Application Example 3, as shown in Figure 11(b), the artwork data and accompanying image data are integrated into a single frame. Specifically, the artwork data (photograph data) is displayed prominently within the frame, while the accompanying image data, which includes a thumbnail image of the artwork data, an index image data containing the hash value of the artwork data, and access information for a 2D code, is displayed at the bottom of the frame, thus integrating the artwork data and accompanying image data within the frame.

[0099] In Application Example 3, when uploading artwork data from the creator's device (poster's device) to an SNS site, this application generates a frame and stores the artwork data and accompanying image data within that frame before uploading. Alternatively, instead of storing the artwork data and accompanying image data within a frame, the accompanying image data may be overlaid and stored within the artwork data, as shown in Figure 11(c).

[0100] As shown in Application Example 3, by storing the artwork data and accompanying image data within a frame, or by storing the accompanying image data within the artwork data and integrating them, when a third party reposts, the artwork data and accompanying image data will not be separated, eliminating the need to repost the artwork data and accompanying image data separately. This makes reposting easier and also facilitates the verification of the authenticity of the artwork data.

[0101] [Application Example 4: Use of Search Viewer] In the verification process of submitted image data, the user terminal 4 was to access the digital artwork legitimacy judgment server 1 via a URL and paste the copied allhash value into the hash value input field. However, to simplify this process, a search viewer application can also be used.

[0102] The search viewer application is provided by the digital artwork authenticity judgment server 1 or its management company. It is downloaded and installed on the user terminal 4 in advance, and during the verification process, instead of displaying the URL of the accessed item, a button to launch the search viewer application is displayed. In other words, when the user terminal 4 reads the 2D code attached to the image data of the posted image data, the explanation of the authenticity judgment, the button to launch the search viewer application, and the allhash value (the hash value of the index) are displayed.

[0103] Then, when the user terminal 4 selects the launch button for the search viewer app, the search viewer app is launched and the displayed allhash value is pasted into the search field of the search viewer app.

[0104] Next, when a search is performed using the search viewer app, the value of allhash is sent to the digital work legitimacy determination server 1. The digital work legitimacy determination server 1 then starts searching for filenames using the value of allhash and determines whether the filenames exist or not. The subsequent processing is as described above.

[0105] [Application Example 5: Use of OTS (Open Timestamps)] OTS is a distributed timestamp service that uses distributed ledger technology such as blockchain to prove that specific data existed at a specific time. When exporting image data of a digital work to the digital work authenticity judgment server 1, a hash value is generated by combining the hash value of the image data and the hash value of the index, stored in a folder, and sent to OTS. A timestamp is then added to the hash value of the folder. The time information of the timestamp may be stored in a file named after the value of allhash, making it possible to prove the time of storage.

[0106] [Application Example 6: SNS Platform Processing] The SNS platform on which users upload posted image data may also perform export and verification processing of the digital works. In this case, before the posted image data is uploaded to the SNS platform and displayed, the SNS platform may perform export and verification processing of the current image data of the posted image data, and display the posted image data and the verification results. The verification results will be displayed along with the posted image data, such as "unprocessed image," "unprocessed image," "processed image," or "processed image," relative to the current image data.

[0107] [Verification Model] This section describes a cryptographic verification model for ensuring the authenticity of digital images. First, the definitions and overall conditions are as follows: Hash function: H(x) Thumbnail generation function: Thumbnail(a) Merkle unification function: M(h1, h2) = H(h1∥h2) SNS compressed set: CompressSet(a) QR code generation function: QR(x) Instant camera frame generation function: Frame(a) SNS i) AI verification assistance function (in the cloud): AI_Assist(a,a SNS ) → score Timestamp function (Open Timestamps): OTS(x)

[0108] [Capture / Starting Phase] The current image a is acquired at capture time t0. ha is the authenticity anchor. ha = H(a)

[0109] [Export and Concatenation Phase] First, an index is generated. i = {Thumbnail(a)t0, ha} ih = H(i)

[0110] During export, the hash value of the current image and the hash value of the index are combined to generate a hash value integration function. bundle = H(ha∥ih)

[0111] The workflow is fixed to create a single hash value from two hash values, ha and ih.export = M(ha, ih), and an equivalent definition can be given. R export = H bundle

[0112] [Timestamp Phase] Generate a timestamp function. OTS file = OTS(H bundle ) and perform verification. Validate(H bundle , OTS file ) = True at T pub Therefore, {a, i} existed before timestamp T pub .

[0113] [Cloud Folder Storage Phase] Generate a cloud folder name. FolderName = ih The storage structure is as follows. CloudSet(i) = {a, i, ha, ih, H bundle , OTS file} Therefore, Path = / ih / , and the case of direct search from a two-dimensional code is as follows. Search(QR(ih))⇒FolderName = ih

[0114] [SNS Posting Phase] In SNS posting, the structure is a compressed image. a SNS ∈CompressSet(a) The instant camera structure is as follows. InstantCamera = Frame(a SNS , i) {QR(ih), i} is embedded in the margin, and the following posting package is created. Post = {InstantCamera, a SNS , I, QR(ih)}

[0115] [AI Confirmation Assistance Phase in Cloud] In the digital work validity judgment server 1 (cloud), AI confirmation assistance is performed. AI_Assist(a, a SNS )→score If score is 100, the feature amounts of the images match, and if score is 0, they do not match.

[0116] [Final Theorem] In authenticity verification, submitted image data is authentic if all of the following conditions are met: Original data invariance: H(a) = ha, Index invariance: H(i) = ih, Folder identity: FolderName = ih, Unified hash match: H(ha∥ih) = H bundle , QR consistency: QR(ih) SNS =ih, structural continuity: M(ha,ih)=R export , temporal determinism: Validate(H bundle ,OTS file ) = True, derived consistency: a SNS ∈CompressSet(a), AI-assisted consistency: AI_Assist(a, a SNS ) > 100.

[0117]

[0118] If the conditions of the above theorem are met, then SNS posted image a SNS This mathematically and temporally confirms that the derived image is legitimately and unalteredly generated from the authentic original image a that existed prior to the specified time. Furthermore, for detailed fact-checking, the determination can be proven by hash calculation (verification) of the artwork data and index image data displayed and output from the digital artwork authenticity determination server 1.

[0119] [Effects of the Embodiment] According to this system, there is a digital work legitimacy determination server 1 that determines the legitimacy of work data posted or created on an SNS from a poster terminal 3 such as a smartphone. When a work is posted or created from the poster terminal 3 to the SNS site 2, the work data to be posted or created, an index image data including a thumbnail image of the work data and the hash value of the work data, and the hash value of the index image data are exported to and stored on the digital work legitimacy determination server 1. Access information (2D code or URL) including the work data, the access destination to the digital work legitimacy determination server 1, and the hash value of the index image data is incorporated into the index image data. When the attached image data is uploaded to or created on SNS site 2, the digital work legitimacy determination server 1 is accessed by the user terminal 4 from the access information of the attached image data, and when the hash value of the index image data is entered, the server searches for the hash value of the exported index image data corresponding to the entered hash value. If the hash value does not exist, the server determines that the posted or created work data is not legitimacy. If the hash value exists, the server displays the corresponding work data on the user terminal 4. This allows the user to determine the authenticity of the work by comparing the displayed work data with the posted or created work data.

[0120] The present invention is suitable for a system and program for determining the legitimacy of digital works on a network, which attaches index image data containing access information to a site for determining the legitimacy of digital works to image data posted on social networking services or digital works of digital art on a network, and displays the legitimate digital work by accessing the said access information to determine the legitimacy of the digital work.

[0121] 1…Digital work legitimacy judgment server, 2…SNS site, 3…Creator terminal (poster terminal), 4…User terminal, 5…Network, 11…Control unit, 12…Storage unit, 13…Interface unit, 31…Control unit, 32…Storage unit, 33…Display unit, 34…Camera, 35…Microphone, 36…Communication unit

Claims

1. A digital work legitimacy determination system having a digital work legitimacy determination server that determines the legitimacy of work data provided to a network site from a creator terminal, wherein when the work data is provided from the creator terminal to the site, the provided work data, an index image data including a thumbnail image of the work data and a hash value of the work data, and the hash value of the index image data are exported to and stored on the digital work legitimacy determination server, and the work data and an attached image data in which access information including the access destination of the digital work legitimacy determination server and information on the hash value of the index image data are incorporated into the index image data are uploaded to the site, the digital work legitimacy determination server is accessed by a user terminal from the access information of the attached image data, and when the hash value of the index image data is input, it searches for the hash value of the exported index image data corresponding to the input hash value, and if the hash value does not exist, it determines that the work data provided to the site is not legitimacy, and if the hash value exists, it displays the corresponding exported work data to the user terminal.

2. The digital work legitimacy determination system according to claim 1, wherein the access information includes a launch button for a search viewer application instead of an access destination for the digital work legitimacy server, and when the launch button is selected, the search viewer application is launched on the user terminal, obtains information on the hash value of the index image data, provides it to the digital work legitimacy server, and causes the server to search for the hash value of the exported index image data.

3. The digital artwork authenticity determination system according to claim 1 or 2, wherein the artwork data and the accompanying image data are stored within a frame, or the accompanying image data is stored within the artwork data and uploaded to the site.

4. The digital work authenticity determination system according to claim 1 or 2, wherein the digital work authenticity determination server, upon receiving work data provided to the site corresponding to the exported work data displayed on the user terminal from the user terminal, compares the exported work data and the received work data, determines that they are "true" if they are deemed to be the same, and determines that they are "false" if they are not deemed to be the same, and notifies the user terminal of the authenticity of the image data provided to the site.

5. A program that operates on a creator terminal that provides artwork data to a network site, the program causing the creator terminal to export the provided artwork data, an index image data including a thumbnail image of the artwork data and a hash value of the artwork data, and the hash value of the index image data to a digital artwork legitimacy determination server, and to upload the artwork data and accompanying image data in which access information including the access destination to the digital artwork legitimacy determination server and the hash value of the index image data is embedded in the index image data, to the site.

6. The program according to claim 5, which causes the creator terminal to upload the work data and the accompanying image data to the site, with the accompanying image data stored within the work data.

7. The program according to claim 5 or 6, wherein the access information includes information describing the verification method.

8. A program that operates on a digital work legitimacy determination server that determines the legitimacy of work data provided to a network site, wherein the digital work legitimacy determination server stores work data exported from the creator's terminal, an index image data including a thumbnail image of the work data and the hash value of the work data, and the hash value of the index image data in a storage unit, and when the hash value of the index image data of the work data provided to the site by access from a user terminal is input, the program searches whether the work data corresponding to the hash value exists in the storage unit, determines that the work data provided to the site is not legitimacy if the hash value does not exist, and if the hash value exists, the program functions to display the corresponding exported work data to the user terminal.

9. The program according to claim 8, which causes the digital work authenticity determination server to function such that when it receives work data provided to the site corresponding to the exported work data displayed on the user terminal from the user terminal, it compares the exported work data with the received work data, determines that they are the same as "true" if they are not the same as "false" if they are not the same, and notifies the user terminal of the authenticity of the work data provided to the site.

10. A program that operates on a creator terminal that provides artwork data to a network site, the program causing the creator terminal to export the artwork data generated by the provided AI, index image data including a thumbnail image of the artwork data and a hash value of the artwork data, the hash value of the index image data and a hash value of a string in a file recording the process by which the AI ​​generated the artwork data, to a digital artwork legitimacy determination server, and to upload the artwork data and accompanying image data in which access information including the access destination to the digital artwork legitimacy determination server, the hash value of the index image data and the hash value of the string is incorporated into the index image data, to the site.

11. The program according to claim 10, which causes the creator terminal to upload the work data and the accompanying image data to the site, with the accompanying image data stored within the work data.

12. A program that operates on a digital work legitimacy determination server that determines the legitimacy of work data provided to a network site, wherein the digital work legitimacy determination server stores in a memory the following: AI-generated work data exported from the creator terminal, index image data including a thumbnail image of the work data and the hash value of the work data, the hash value of the index image data, and the hash value of a string in a file recording the process by which the AI ​​generated the work data; when the hash value of the index image data and the hash value of the string of the work data provided to the site are input by access from a user terminal, the program searches whether the work data corresponding to the hash value of the index image data exists in the memory, and if the hash value of the index image data does not exist, it determines that the work data provided to the site is not legitimacy; if the hash value of the index image data exists, it displays the corresponding exported work data to the user terminal, searches whether the hash value of the string exists in the memory, and if the hash value of the string does not exist, it determines that the work data provided to the site was not generated by AI.

13. A program that operates on a server of a network site to determine the legitimacy of artwork data provided to the site, wherein the server stores artwork data exported from the creator's terminal, an index image data including a thumbnail image of the artwork data and a hash value of the artwork data, and the hash value of the index image data in a storage unit, and for the artwork data provided to the site, searches whether the artwork data corresponding to the hash value exists in the storage unit based on the access information uploaded from the creator's terminal to the server and the hash value of the index image data embedded in the index image data, and determines that the artwork data provided to the site is not legitimacy if the hash value does not exist, and determines that the artwork data provided to the site is legitimacy if the hash value exists.

Images