Digital work evidence storage method and system and computer storage medium

Abstract

The invention provides a digital work evidence storage method and system and a computer storage medium. The digital work evidence storage method comprises the steps that in response to an evidence storage instruction sent by a target user logging in a target account, screen recording is carried out on a display interface of an application end in the drawing process, collection operation is carried out on drawing data of an equipment end, and the equipment end is connected with the application end; in response to a drawing ending instruction of the target user, generating a drawing process video and generating a handwriting restoration video according to the collected drawing data; uploading a first handwritten electronic signature file generated after painting is finished to a server; under the condition that the server side verifies the first handwritten electronic signature file, the storage instruction sent by the server side is responded, and the evidence storage file is encrypted and then stored in the application side, so that the problem that the digital works are difficult to confirm and authenticate in the prior art is solved.

Description

TECHNICAL FIELD

[0001] The present application relates to the field of digital painting, and in particular to a digital work evidence storage method and system and a computer storage medium. BACKGROUND

[0002] Digital art is an artistic form of processing, storing, correcting and creating presentation of original data such as text, audio and video through electronic devices. As a core branch of digital art, digital work is formed by relying on digital tools such as device end (for example, digitizer) and drawing software in the creation process.

[0003] The digitalization of digital works poses a serious challenge to copyright protection: digital works can be infinitely propagated at low cost through screen capture, file copying and other means, and the copies have no physical difference from the original. The digital painting system in the related art does not store evidence of the drawing process of the digital work creator, and the originality of the digital work cannot be determined when infringement is judged. Only the publication time of the digital work on a public platform can be used to determine the right, resulting in the problem of difficulty in determining the right and evidence of digital works.

[0004] Therefore, the related art has the problem of difficulty in determining the right and evidence of digital works. SUMMARY

[0005] To solve the above technical problems, the present application provides a digital work evidence storage method, system and computer storage medium.

[0006] To solve the above technical problems, the present application provides a digital work evidence storage method applied to an application end, which comprises: in response to a storage instruction issued by a target user who logs in a target account, recording a display interface of the application end and collecting drawing data of a device end in a drawing process, wherein the device end is connected to the application end;

[0007] In response to an end-drawing instruction of the target user, generating a drawing process video and a handwriting restoration video according to the collected drawing data;

[0008] Uploading a first handwritten electronic signature file generated after the end-drawing to a server;

[0009] In the case that the first handwritten electronic signature file is verified by the server, in response to a storage instruction sent by the server, encrypting and storing an evidence file in the application end, wherein the evidence file comprises the drawing process video, the handwriting restoration video and a digital work obtained in the drawing process.

[0010] The first handwritten electronic signature file generated after the end of drawing is uploaded to a server, including:

[0011] The first signature instruction is sent to the target user;

[0012] The first handwritten electronic signature file is generated according to the handwritten data of the target user on the device side, wherein the handwritten data includes at least one of the following: pen stroke trajectory, pen stroke pressure, pen stroke moving speed, pen stroke hovering data, and pen inclination angle during signature;

[0013] The first handwritten electronic signature file is uploaded to the server, wherein the server is configured to call a target handwriting model corresponding to the target account to verify the first handwritten electronic signature file.

[0014] The digital work notarization method further includes:

[0015] When the target user registers the target account, the training handwritten data set is obtained in response to the target user handwriting electronic signature on the digital board multiple times;

[0016] The training handwritten electronic signature file set is generated according to the training handwritten data set;

[0017] The training handwritten electronic signature file set is uploaded to the server, wherein the server is configured to train the target handwriting model according to the training handwritten electronic signature set.

[0018] The notarization file is encrypted and stored in the application end, including:

[0019] The first encryption key generated by the application end is obtained, and the notarization file is encrypted based on the first encryption key to obtain an encrypted notarization file;

[0020] The encrypted notarization file is stored in the application end;

[0021] The first encryption key is uploaded to the server, and the first encryption key is encrypted and stored by the public key of the server;

[0022] The encryption key is deleted in the application end;

[0023] And / or, the drawing data of the device end is collected, including:

[0024] A plurality of frames of encrypted data sent by the device end are obtained, wherein each frame of encrypted data includes original encrypted data and key encrypted data;

[0025] decrypt the key encryption data in each frame of encrypted data using the private key of the application end to obtain a symmetric encryption key corresponding to each frame of encrypted data and a random number;

[0026] encrypt the original encryption data in each frame of encrypted data based on the random number and the symmetric encryption key to obtain original collection data corresponding to each frame of encrypted data;

[0027] rearrange the original collection data corresponding to all frames of encrypted data to obtain the drawing data.

[0028] After the evidence storage file is stored in the application end after being encrypted, the digital work evidence storage method further comprises;

[0029] obtain a hash feature corresponding to the evidence storage file;

[0030] generate an integrity signature corresponding to the hash feature according to the private key of the application end;

[0031] pack the hash feature, the integrity signature and a time stamp and upload them to a block chain;

[0032] receive an evidence storage result returned by the block chain;

[0033] and / or,

[0034] in response to an evidence collection instruction of the target user, send a second signature instruction to the target user, obtain a second handwritten electronic signature file generated after the second signature instruction is sent and uploaded to the service end, and in the case that the second handwritten electronic signature file is verified by the service end, export the evidence storage file from the application end.

[0035] To solve the above technical problems, the present application provides a digital work evidence storage method applied to a service end, which comprises:

[0036] receive a first handwritten electronic signature file generated and uploaded by a target user after ending drawing in an application end;

[0037] verify the first handwritten electronic signature file by calling a target handwriting model corresponding to the target user;

[0038] in the case of verification, send a storage instruction to the application end;

[0039] receive an evidence storage file sent by the application end in response to the storage instruction, and save the evidence storage file to the service end, wherein the evidence storage file comprises a drawing process video, a handwriting restoration video and a digital work obtained in the drawing process.

[0040] The digital work evidence storage method further comprises the following steps after the evidence storage file is stored in the server:

[0041] generating target verification information corresponding to the evidence storage file;

[0042] issuing the target verification information to the application end to bind the target user and the target verification information in the application end.

[0043] The digital work evidence storage method further comprises the following steps:

[0044] receiving a forensic instruction carrying verification information sent by the application end;

[0045] verifying the verification information carried by the forensic instruction and the verification information stored in the server;

[0046] sending a signature instruction to the application end in the case of verification passing;

[0047] receiving a second handwritten electronic signature file generated by the application end in response to the signature instruction;

[0048] verifying the second handwritten electronic signature file by calling the target handwriting model;

[0049] in the case of verification passing of the second handwritten electronic signature file in the server, sending the evidence storage file to the application end, so that the target user views the evidence storage file in the application end.

[0050] To solve the above technical problems, the present application provides a digital work evidence storage system, which comprises an application end, a server and a device end;

[0051] The device end is used for generating drawing data in real time according to the drawing operation of a target user in the device end, and sending the drawing data to the application end;

[0052] The application end responds to the evidence storage instruction issued by the target user who logs in a target account, and performs screen recording on the display interface of the application end and collects the drawing data of the device end in the drawing process; and in response to the end-drawing instruction of the target user, generates a drawing process video and a handwriting restoration video according to the collected drawing data; and uploads a first handwritten electronic signature file generated after the end-drawing to the server;

[0053] The server verifies the first handwritten electronic signature file, and in the case of verification, sends a storage instruction to the application end, so that the application end stores the evidence file after encryption according to the storage instruction, wherein the evidence file includes the drawing process video, the handwriting restoration video, and the digital work obtained in the drawing process.

[0054] To solve the above technical problems, the present application also provides a computer storage medium for storing program data, which is used to realize the digital work evidence storage method.

[0055] Compared with the prior art, the beneficial effects of the present application are: in the embodiment of the present application, during the drawing process of the target user, the drawing process is stored in real time through synchronous collection of screen recording and device end data, avoiding disputes after the fact, and the drawing process recorded through the drawing process video and the trajectory restoration video is strong evidence to prove the originality of the digital work, realizing one-key storage during the creation process, and through the verification of the handwritten electronic signature during the storage, the consistency of the creation subject and the signature subject is ensured through the biological feature comparison corresponding to the signature, multi-dimensional data collection plus handwritten electronic signature feature verification, ensuring the authenticity, integrity and security of the drawing storage, so that the digital work can be quickly confirmed. The preservation of the evidence file is beneficial to the user's copyright claim, effectively solving the industry pain points of difficult digital work confirmation and difficult evidence confirmation. BRIEF DESCRIPTION OF DRAWINGS

[0056] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the drawings needed in the embodiment description will be briefly introduced. Obviously, the drawings in the following description are only some embodiments of the present application, and other drawings can be obtained by those skilled in the art without creative labor.

[0057] Among them:

[0058] Figure 1 is a flowchart of the first embodiment of the digital work evidence storage method provided by the present application;

[0059] Figure 2 is a flowchart of logging in to a target account in an embodiment provided by the present application;

[0060] Figure 3 is a framework diagram of an embodiment of the digital work evidence storage system provided by the present application;

[0061] Figure 4 is a flowchart of registering a target account in an embodiment provided by the present application;

[0062] Figure 5 is a flowchart of a painting process evidence collection in an embodiment provided by the present application;

[0063] Figure 6 is a flowchart of a painting process evidence collection in an embodiment provided by the present application;

[0064] Figure 7 is a flowchart of a digital work evidence collection method in an embodiment provided by the present application;

[0065] Figure 8 is a structural diagram of a digital work evidence collection device in an embodiment provided by the present application;

[0066] Figure 9 is a structural diagram of a computer storage medium in an embodiment provided by the present application. DETAILED DESCRIPTION

[0067] The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application. Obviously, the described embodiments are only a part of the embodiments of the present application, rather than all the embodiments of the present application. Based on the embodiments in the present application, all other embodiments obtained by those skilled in the art without creative work fall within the scope of protection of the present application.

[0068] The terms "first", "second", "third", "fourth" and the like (if any) in the specification and claims of the present application and the above drawings are used to distinguish similar objects, and do not necessarily indicate a specific order or a chronological sequence. It should be understood that the data thus used can be interchanged under appropriate circumstances, so that the embodiments of the present application described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "include" and "have" and any variations thereof are intended to cover non-exclusive inclusion, for example, a process, method, system, product or device including a series of steps or units does not necessarily have to be limited to those steps or units clearly listed, but can include other steps or units not clearly listed or inherent to these processes, methods, products or devices.

[0069] Please continue to see Figure 1 , Figure 1 is a flowchart of a digital work evidence collection method in an embodiment provided by the present application.

[0070] As shown in Figure 1 , the digital work evidence collection method is applied to an application end, and the specific steps are as follows:

[0071] Step S11: In response to a storage instruction issued by a target user who logs in a target account, screen recording is performed on a display interface of the application end during the drawing process, and drawing data of the device end is collected, wherein the device end is connected with the application end.

[0072] In the embodiments of the present application, the storage operation is performed only when the login account is required, therefore, the target user needs to log in the target corresponding to the user before storing the drawing process, please refer to Figure 2 , Figure 2 is a flowchart of logging in a target account in an embodiment provided by the present application, as shown in Figure 2 When logging in a target account, the user starts the login process on the application end to begin login, and can select two login modes of account password or mobile phone number. If the account password login mode is selected, the target user inputs the account and password, and the application end sends a login request to the service end. The service end first checks whether the account is registered. If the account is not registered, the service end returns “account not registered” to the application end. If the account is registered, the service end further checks whether the password is correct, that is, whether the input password is consistent with the set password. If the password is not correct, the service end returns “account or password error” to the application end. If the password is correct, the service end generates a token (a digital credential for identity verification and authorization) and returns it to the application end. The application end prompts “login success”. If the mobile phone number login mode is selected, the target user inputs the mobile phone number, and the application end sends a login request to the service end. The service end checks whether the mobile phone number is registered. If the mobile phone number is not registered, the service end returns “mobile phone number not registered” to the application end. If the mobile phone number is registered, the service end sends a verification code to the mobile phone number. After receiving the verification code, the target user inputs the verification code on the application end. The application end sends the verification code to the service end for verification. If the verification code is incorrect, the service end returns “verification code error” to the application end, and the target user needs to input the verification code again. If the verification code is correct, the service end generates a token (a digital credential for identity verification and authorization) and returns it to the application end. The application end prompts “login success”. The verification logic of the service end on the account, password or mobile phone number, and verification code ensures the accuracy and security of login.

[0073] Step S12: In response to an end drawing instruction of the target user, a drawing process video is generated, and a handwriting restoration video is generated according to the collected drawing data.

[0074] Step S13: The first handwritten electronic signature file generated after the end of drawing is uploaded to the service end.

[0075] Step S14: In the case that the first handwritten electronic signature file is verified by the service end, in response to a storage instruction sent by the service end, the storage file is encrypted and stored in the application end, wherein the storage file includes the drawing process video, the handwriting restoration video, and a digital work obtained in the drawing process.

[0076] In the embodiments of the present application, the digital work evidence storage method is applied to a digital work evidence storage system, please refer to Figure 3 , for details. Figure 3 is a schematic diagram of the framework of an embodiment of the digital work evidence storage system provided by the present application.

[0077] As shown in Figure 3 , the digital work evidence storage system of the present application includes a device end, an application end, and a server end.

[0078] The device end is used to generate drawing data in real time according to the drawing operation of the target user on the device end, and send the drawing data to the application end.

[0079] The device end is used as a drawing input device, which uses high-sensitivity electromagnetic induction technology to accurately capture various stroke operation data (i.e. drawing data) of the brush on the device end, such as pressure, inclination and position information of the brush relative to the device end. The device end is connected to the application end device (such as a computer, a tablet computer) through an interface or a Bluetooth interface to realize real-time transmission of drawing data.

[0080] The device end includes a digitizing tablet, a digital pen and a driving software, the driving software is used to drive the digital pen to perform various operations on the drawing tablet, and the digitizing tablet is used to realize the function of collecting handwriting data of the digital pen on the digitizing tablet and store device information.

[0081] The application end is the developed application software, i.e. digital work copyright protection application, which is installed in the application end device. The application software displays the corresponding generated digital work in the display interface of the application end device according to the stroke operation data.

[0082] The application end includes various functions such as personal center, real-name authentication, drawing process screen recording, handwriting data collection and processing, generation of handwriting restoration video in the drawing process, storage task management, storage file management, and handwritten electronic signature modeling and verification.

[0083] The target user is a digital work creator. The target user needs to log in to the target account corresponding to the user on the application end. When the drawing starts, the target user issues a storage evidence instruction by clicking the storage evidence component on the application end or the storage evidence trigger button on the device end. The application end starts the storage evidence operation when the target user starts drawing, including: recording the display interface during drawing, generating a drawing process video after drawing ends, and collecting the drawing data of the device end during drawing, and generating a handwriting restoration video according to all the drawing data during drawing. That is, the application end responds to the storage evidence instruction issued by the target user who logs in to the target account, and records the display interface of the application end and collects the drawing data of the device end during drawing. In response to the end-drawing instruction of the target user, a drawing process video is generated and a handwriting restoration video is generated according to the collected drawing data.

[0084] The application end packages the drawing process video, the handwriting restoration video, and the digital work obtained in this drawing process to form a storage evidence file, that is, the storage evidence file includes the drawing process video, the handwriting restoration video, and the digital work obtained in the drawing process.

[0085] The service end is a digital work copyright protection service platform. The service end provides account management services, real-name authentication services, handwritten electronic signature modeling services, file encryption / decryption services, and handwritten electronic signature verification services.

[0086] After saving the storage evidence file, if there is a copyright dispute over the digital work in the future, the storage evidence file can be used to verify the right and the evidence.

[0087] After the drawing is finished, the creator of the digital work is verified before the storage evidence file is saved, to ensure that the creator is the user associated with the target account. The application end account and the user are one-to-one correspondence. For users who create using others' accounts, no storage evidence is provided.

[0088] Verification is completed through a handwritten electronic signature file. Specifically, after the drawing is finished, the target user will perform a handwritten electronic signature on the device end. The application end will generate a first signature file and send the first signature file to the service end. For example, the system pops up a signature confirmation window, that is, the application end sends a first signature instruction to the target user, prompting the target user to perform a handwritten electronic signature in a specified area on the device end. The target user performs a handwritten electronic signature on the device end. The device end collects at least one of the following data during the signature process: pen stroke trajectory, pen stroke pressure, pen stroke moving speed, pen stroke hovering data, and inclination angle, to form handwritten data. The handwritten data is transmitted to the application end. The application end generates a first handwritten electronic signature file according to the handwritten data.

[0089] The first handwritten electronic signature file is uploaded to the server, and the server verifies the first handwritten electronic signature. Whether the creator is a user associated with the target account is determined according to the first handwritten electronic signature.

[0090] In the embodiment, since the writing habit of each person is controlled by muscle memory and nervous system and has individual specificity, the pen touch trajectory, pen touch pressure, pen touch moving speed, pen touch hovering data, and inclination angle are digital representations of individual biological characteristics of the target user. Although the pen touch trajectory and pressure data may fluctuate slightly when the same person signs at different times, the overall pattern (such as the peak position of the pressure curve and the periodicity of the speed change) is consistent. This dynamic stability is a key basis for biological feature verification during the signing process. The biological characteristics are represented by at least one of the following digital signals: pen touch trajectory, pen touch pressure, pen touch moving speed, pen touch hovering data, and inclination angle. The verification of the biological characteristics during the signature verification improves the accuracy of the signature verification.

[0091] Specifically, the server verifies the first handwritten electronic signature file by calling the target handwriting model corresponding to the target account deployed on the server. The target handwriting model is trained by the target user when registering the target account.

[0092] When the target user registers the target account, the target user performs multiple handwritten electronic signature operations on the device side. The application side constructs handwritten data corresponding to the multiple handwritten electronic signature operations into a training handwritten data set in response to the multiple handwritten electronic signature operations. The training handwritten data set is obtained, and a training handwritten electronic signature file set is generated according to the training handwritten data set. The training handwritten electronic signature set is uploaded from the application side to the server. The server trains the model according to the training handwritten electronic signature set to obtain the target handwriting model.

[0093] Please refer to Figure 4 , Figure 4 is a flowchart of registering a target account in an embodiment provided by the present application, as shown in Figure 4As shown, the user starts the registration process on the application end, i.e., begins registration, first inputs a user-defined account and password, the application end checks the validity of the account and password, if the account and password validity check fails, returns "invalid account or password" to the application end, and resets the account and password; if the account and password validity check passes, sends the account and password to the service end, the service end checks the account for duplication, if the duplication check fails, returns "account duplication" to the application end, the target user inputs a new account and password, if the duplication check passes, the target user inputs a mobile phone number on the application end to bind the mobile phone number, the application end sends the mobile phone number to the service end, the service end verifies the mobile phone number, if the mobile phone number verification fails, returns "binding failure" to the application end and inputs a new mobile phone number, if the mobile phone number verification passes, enters the real-name authentication link, the target user inputs real-name information on the application end, the application end sends the real-name information to the service end, and the service end checks the real-name information, the service end calls a third-party real-name authentication service to verify the real-name information when checking the real-name information, if the real-name information check fails, returns "binding failure" to the application end and re-enters the real-name information.

[0094] After the real-name information check passes, the handwritten electronic signature is entered. When entering the handwritten electronic signature, the user needs to perform the handwritten electronic signature operation multiple times (such as 5 times) on the device end, clicks next to re-enter the handwritten electronic signature after each entry, until 5 times of recording are completed, the application end generates a training handwritten electronic signature file set according to the collected handwritten electronic signature data (i.e., a training handwritten data set), the application end sends the training handwritten electronic signature file set to the service end for modeling, if the modeling fails, re-enters, and if the modeling succeeds, returns "registration completed" to the application end.

[0095] The entire process of the target user registering the target account is realized through the interaction between the application end and the service end, combined with the third-party real-name authentication service, and the account uniqueness, mobile phone number validity, real-name information authenticity, and handwritten electronic signature accuracy are checked in multiple dimensions to ensure the safety of the registered account and lay a reliable identity foundation for subsequent digital work evidence storage and other operations. In the registration process, each step of the check and data processing is closely connected, from the account password setting to the final registration completion, and is closely linked to ensure the standardization of user registration and the security of the system. For example, the account duplication check prevents the occurrence of duplicate accounts, the mobile phone number verification ensures the validity of the user's contact information, the real-name information verification improves the credibility of the information with the help of the third-party service, and the handwritten electronic signature modeling provides data support for subsequent handwritten electronic signature verification and other operations. These links jointly build a rigorous registration system, making the identity authentication of the user in the digital work evidence storage system more reliable, and providing a strong guarantee for the stable operation and data security of the entire system.

[0096] After the server verifies the first electronic signature file, the application end encrypts the evidence file according to the encryption key and stores the encrypted evidence file in the application end.

[0097] Specifically, the application end encrypts the evidence file by using the first encryption key generated by the application end when encrypting, that is, obtaining the first encryption key generated by the application end, encrypting the evidence file based on the first encryption key, and obtaining an encrypted evidence file, wherein the first encryption key is a key randomly generated based on a symmetric encryption algorithm.

[0098] The encrypted evidence file is stored in the application end, and the first encryption key is sent to the server for encrypted storage, and the first encryption key of the application end is deleted, that is, the encrypted evidence file and the server are stored in different ends to ensure the security of the evidence file.

[0099] The first encryption key is encrypted by the public key of the server, so only the private key of the server can decrypt the first encryption key. When the evidence file is exported, the server sends the first encryption key to the application end after decrypting the first encryption key by the private key. The application end can decrypt the encrypted evidence file to obtain the evidence file after receiving the first encryption key.

[0100] Optionally, the drawing data of the device end is collected, including: obtaining a plurality of frames of encrypted data sent by the device end, wherein each frame of encrypted data includes original encrypted data and key encrypted data; using the private key of the application end to respectively decrypt the key encrypted data in each frame of encrypted data to obtain a symmetric encryption key corresponding to each frame of encrypted data and a random number; encrypting the original encrypted data in each frame of encrypted data based on the random number and the symmetric encryption key to obtain original collected data corresponding to each frame of encrypted data; and rearranging the original collected data corresponding to all frames of encrypted data to obtain the drawing data.

[0101] In this embodiment, in the initialization stage of establishing a communication connection between the device end and the application end, the symmetric encryption key negotiated by the asymmetric encryption algorithm is encrypted using the public key of the application end built-in device end, and only the application end can decrypt the symmetric encryption key by using the private key of the application end, so as to realize end-to-end encryption protection of the data link.

[0102] The device end collects the original collected data generated by the handwriting pen every predetermined time, including coordinates, pressure values and time stamps and other parameters, and constructs a structured data frame, each data frame containing a unique frame ID and a sampling time stamp, which is used for subsequent data decoding and sorting processing.

[0103] The device end generates a unique random number for each data frame, so that the cipher text is prevented from being repeated in the encryption algorithm, and the anti-replay attack capability is enhanced. Each random number cannot be repeated with the random number previously used in the same session.

[0104] The device end performs symmetric encryption on the data frame content through the negotiated symmetric encryption key and the random number corresponding to the current frame, to generate original encrypted data. An authentication tag can also be included in the encryption process to ensure the integrity and non-tampering of the cipher text during transmission.

[0105] The device end sends the original encrypted data and key encrypted data, i.e., encrypted data, to the application end. After receiving the encrypted data, the application end uses the application end private key to decrypt the key encrypted data to obtain the symmetric encryption key and the random number corresponding to each data frame. The original encrypted data is decrypted according to the symmetric encryption key and the random number to obtain the original collected data. The original collected data is sequentially rearranged according to the time sequence of the data frames to ensure the integrity and correctness of the handwriting track. The rearranged original handwriting data will be used for real-time track rendering and signature verification.

[0106] Please refer to Figure 5 , Figure 5 is a flowchart of the drawing process evidence provided in an embodiment of the present application, as Figure 5 shown:

[0107] The target user starts the drawing evidence recording process in the application end. First, the target user clicks “Start Evidence Recording” in the application end. The application end checks whether it is in an abnormal state (such as device connection, software running account login, etc.). If it is not in an abnormal state, it enters the evidence recording stage, i.e., starts evidence recording. After the target user enters the evidence file name, the application end performs drawing process data collection and drawing process screen recording, i.e., obtains the model information of the device end through the driver program and records it, and simultaneously collects the running data of the device (such as pen touch pressure, pen touch track, etc.) in real time, and performs real-time screen recording on the drawing process displayed on the display interface. During the drawing process, the application end continuously collects drawing data (including the coordinates, pressure, and timestamp of each stroke), to ensure the accuracy of track restoration. When the target user finishes drawing and clicks “Complete Evidence Recording”, the application end stops the evidence recording operation and generates two types of files: one is the screen recording video of the drawing process (i.e., the drawing process video, which contains interface operation and timestamp), and the other is the track restoration video generated based on the data collected from the device end (which removes interface elements and only displays pen touch tracks, and may have a risk of lag due to large data volume), as well as the digital work obtained in the drawing process.

[0108] Next, the application end imports the source file of the digital work, and the application end generates an evidence file by combining the digital work with the drawing process video and the handwriting restoration video. The target user enters a handwritten electronic signature on the device end, and the application end packs the handwritten data (including stroke trajectory, stroke pressure, and / or stroke movement speed, etc.) into a first handwritten electronic signature file and uploads it to the server end. The server end verifies the signature based on biological characteristics. If the verification fails (such as signature forgery or data tampering), the server end returns an “electronic signature verification failure” message, and the user needs to re-enter the handwritten electronic signature. After the verification is passed, the application end packs the following data into an evidence file: the handwritten electronic signature electronic file (including vector signature data and biological characteristic information); the work file (source file and preview picture); the drawing process video (including interface operation screen recording); the trajectory restoration video (pure stroke trajectory animation demonstration); and the drawing process data file (original stroke coordinates, pressure, timestamp, etc.). The device data file (device model, firmware version, connection time, etc.).

[0109] The application end encrypts the evidence file (the encryption key can be associated with the user account and the device fingerprint), and stores the encrypted evidence file on the application end, completing the evidence storage.

[0110] The entire process ensures the authenticity, integrity, and security of the drawing evidence through multi-dimensional data collection (device information, stroke trajectory, interface operation), biological characteristic verification (handwritten electronic signature), and encrypted storage. In addition, the preservation of the trajectory restoration video and the original data file provides a digital fingerprint for the work traceability. Even if the work is tampered with, the original data can still be used to reconstruct the creation process, effectively supporting copyright claims.

[0111] Optionally, after storing the encrypted evidence file on the application end, the hash feature corresponding to the evidence file is obtained.

[0112] An integrity signature corresponding to the hash feature is generated according to the private key of the application end.

[0113] The hash feature, the integrity signature, and the timestamp are packed and uploaded to the blockchain.

[0114] The evidence result returned by the blockchain is received.

[0115] In this embodiment, the digital work is authenticated, and the authentication information is disclosed to all third parties and the public. The disclosed authentication information includes the hash feature, timestamp, integrity signature, blockchain link, and verification interface corresponding to the evidence file of the digital work.

[0116] The hash feature can be a hash value, which is obtained by using a hash algorithm to hash the evidence file after the evidence file is generated, and is a unique digital fingerprint of the evidence file; the timestamp is an authentication time corresponding to the digital work, which can be accurate to milliseconds; the integrity signature is obtained by signing the hash feature using a private key of the digital copyright platform application end, and is used to verify the source (identity) and integrity of the data, while ensuring that the data cannot be forged or tampered with; the application end packs and uploads the hash feature, the integrity signature and the timestamp to the blockchain to realize on-chain evidence storage, and the blockchain returns an evidence storage result to the application end and provides verification data to the application end, which includes a blockchain browser link, an evidence PDF or a verification two-dimensional code, etc.

[0117] All third parties and the public can verify the digital work in the blockchain, for example, uploading the evidence file to a verification page; opening the blockchain browser link to check whether the hash feature of the uploaded evidence file is the hash feature saved in the blockchain; and verifying the integrity signature using the public key, the original evidence is not included in the blockchain, only lightweight data such as hash features and integrity signatures are included for right confirmation and verification.

[0118] The application end can realize full-process traceability through user operation logs, on-chain receipt numbers, access behaviors, etc., and provide regular backup of the evidence file and original anti-tamper mechanism to ensure safe storage and integrity of the evidence file.

[0119] Optionally, after the encrypted evidence file is stored in the application end, if the target user needs to take evidence, the target user can click “evidence taking” in the display interface to issue an evidence taking instruction, and the application end will issue a second signature instruction to the target user after receiving the evidence taking instruction, prompting the target user to perform handwritten electronic signature in a specified area through the device end, and the target user performs handwritten electronic signature on the device end. The device end collects the pen stroke trajectory, pen stroke pressure, and / or pen stroke moving speed during the signature process to form handwritten data, which is transmitted to the application end, and the application end generates a second handwritten electronic signature file according to the handwritten data.

[0120] The application end uploads the second handwritten electronic signature file to the server, and in the case that the second handwritten electronic signature file is verified by the server, the evidence file is exported from the application end, for example, downloaded to the device where the application end software is installed.

[0121] Please refer to Figure 6 , Figure 6 is a flowchart of the drawing process evidence taking in an embodiment provided by the present application, as shown in Figure 6As shown, when the evidence storage file is stored in the application end, after the target user enters the evidence storage file management interface of the evidence storage center, the target user selects the evidence storage file, and the user can preview the content of the evidence storage file, including the drawing process video and the trajectory restoration video. When previewing, the user can control the video playback through the player controls (play, pause, fast forward, drag the progress bar, etc.), and the application end responds to the operation in real time to ensure smooth viewing of the drawing details.

[0122] When the user clicks "forensics", the application end first triggers the handwriting electronic signature verification process. By calling the driver of the device end (such as the device end), the current handwriting electronic signature data of the user is collected, and the application end generates a second handwriting electronic signature file according to the handwriting electronic signature data and uploads it to the service end for biological feature verification (including pressure curve, trajectory path, signature habit, etc.) in the handwriting electronic signature. If the handwriting verification fails, the service end returns "re-signature" to the application end; after the handwriting electronic signature verification is passed, the evidence storage file decryption process is started. During the decryption process, the application end uses the key generated by the user account password, device fingerprint, or the decryption key issued by the service end to decrypt the locally stored encrypted evidence storage file. After successful decryption, the application end generates an exportable evidence file.

[0123] In this embodiment, the target user extracts "drawing process screen recording, trajectory restoration, original data" by decrypting the evidence storage file, forms a unique evidence chain, and quickly provides evidence in infringement disputes. Through the closed-loop evidence storage and evidence collection system, the system realizes the full life cycle traceability of digital work creation, from "creation evidence storage" to "management preview" to "right protection evidence collection", and builds a technology-driven copyright protection ecosystem, effectively solving the industry pain points of "easy to copy, difficult to prove, and difficult to collect evidence" of digital art.

[0124] The target handwriting model in the embodiment of the application includes at least one of the following: a handwriting aggregation time sequence recognition model (StrokeFormer model), a multi-scale convolutional neural network model, and a multi-modal fusion architecture model.

[0125] Among them, based on the Transformer (deep learning model) architecture, the handwriting time sequence data (such as the time sequence of pressure and coordinates) is modeled. Through the multi-layer self-attention mechanism (Multi-HeadAttention), the long-distance dependency relationship of handwriting (such as writing order and stroke connection) is captured, and the problem of gradient disappearance in long sequence modeling is solved.

[0126] The multi-scale convolutional neural network model extracts multi-scale features by using convolution kernels of different sizes (11x16, 5x24, etc.), and then integrates them through a fusion layer to generate multi-dimensional representations at the pixel level, stroke level and global level. The robustness of the handwritten electronic signature is enhanced, the feature is completed through multi-scale, the detail sensitivity of image recognition is improved, and the information of key handwriting is avoided to be lost in the process of down-sampling due to the sparsity of the handwritten electronic signature image.

[0127] The multi-modal fusion architecture model uses signature image modalities and signature trajectory temporal modalities for signature verification. The multi-modal fusion architecture model uses dual modalities for parallel processing.

[0128] The image branch extracts visual features of the signature (such as stroke thickness, tilt angle); the temporal branch processes the temporal data of the handwriting (such as pressure-time curve, coordinate-time curve), and the dual-branch features are deeply fused through a space-time alignment module to learn the correlation between the image and the time sequence and realize the complementary advantages of multi-modal information. The limitations of a single modality are solved, and the verification accuracy in complex scenarios is improved.

[0129] In the embodiments of the present application, during the drawing process of the target user, the drawing process is recorded in real time through the synchronous collection of screen recording and device data, avoiding disputes after the fact. The drawing process is recorded through the drawing process video and trajectory restoration video, which is a powerful evidence to prove the originality of the digital work. In addition, the verification of the handwritten electronic signature is carried out during the recording, and the biological feature comparison of the signature ensures that the creation subject and the signature subject are consistent. Multi-dimensional data collection and handwritten electronic signature feature verification ensure the authenticity, integrity and security of the drawing recording. The preservation of the recording file is beneficial to the user's copyright claim, effectively solving the industry pain points of digital work right confirmation and evidence right confirmation.

[0130] Please continue to refer to Figure 7 , Figure 7 is a flowchart of the first embodiment of the digital work recording method provided by the present application.

[0131] As Figure 7 shown, the digital work recording method is applied to a server, and the specific steps are as follows:

[0132] Step S21: receiving a first handwritten electronic signature file generated and uploaded by an application end after a target user finishes drawing;

[0133] Step S22: calling a target handwriting model corresponding to the target user to verify the first handwritten electronic signature file;

[0134] Step S23: if the verification is passed, sending a storage instruction to the application end;

[0135] Step S24: receiving the evidence file sent by the application end in response to the storage instruction, and saving the evidence file to the service end, wherein the evidence file comprises a drawing process video, a handwriting restoration video, and a digital work obtained in the drawing process.

[0136] The second embodiment and the first embodiment are the same in that the application end generates the drawing process video and the handwriting restoration video, and details are not repeated here.

[0137] In the second embodiment, the creator of the digital work is verified after the target user finishes drawing, and the verification is completed by means of a handwritten electronic signature file. After finishing drawing, the target user performs handwritten electronic signature on the device end, the application end generates a first signature file, and sends the first signature file to the service end. The service end verifies the first handwritten electronic signature file by calling a corresponding target handwriting model, and the verification manner is the same as that in the first embodiment, and details are not repeated here.

[0138] The difference between the second embodiment and the first embodiment is that the evidence file is stored in different locations when the handwritten electronic signature verification is passed. In the first embodiment, the evidence file is stored in the application end, while in the second embodiment, the evidence file is stored in the service end.

[0139] Based on the above difference, after the handwritten electronic signature verification is passed, the service end sends a storage instruction to the application end, the storage instruction is used to instruct to store the evidence file to the service end, the application end sends the evidence file to the service end after receiving the storage instruction, and the service end saves the evidence file to the service end.

[0140] After saving the evidence file to the service end, the digital work evidence storage method further comprises: generating target verification information corresponding to the evidence file; and sending the target verification information to the application end to bind the target user and the target verification information in the application end.

[0141] Specifically, the service end generates a unique target verification information after saving the evidence file, binds the target verification information and the evidence file, saves them in the service end, and sends them to the application end, and binds the target verification information and the target user in the application end.

[0142] The target verification information can be identity verification information, used to verify the identity of the user; the target verification information can also be a digital certificate issued for the digital work, for example, a copyright number issued by the service end for the digital work; and the target verification information can also be a hash value, used to check the data integrity of the evidence file.

[0143] When the target user needs to export the evidence file for forensics, the server needs to verify the verification information sent by the target user. The server verifies whether the verification sequence code sent by the target user is the verification information stored by the server and associated with the target user. If yes, the identity information of the target user is preliminarily authenticated, and the target user is further verified by handwriting electronic signature. The server sends a signature instruction to the application end, and the target user performs handwriting electronic signature on the device end in response to the signature instruction. The handwriting data in this process is uploaded to the application end to generate a second handwriting electronic signature file on the application end and sent to the server. The server calls the target handwriting model for verification, and sends the evidence file to the application end to realize the export of the evidence file in the case of verification.

[0144] When the server stores, the evidence file is encrypted and stored. The public key of the server is used for encryption, and only the server can complete decryption by using the private key of the server. The server sends after decryption. The encrypted evidence file of the server is still stored in the server and cannot be tampered with.

[0145] In this embodiment, storing the evidence file in the server effectively reduces the storage pressure of the application end.

[0146] Further, the above-mentioned server can be hardware or software. When the server is hardware, it can be implemented as a distributed server cluster composed of multiple servers, or as a single server. When the server is software, it can be implemented as multiple software or software modules, such as software or software modules for providing a distributed server, or as a single software or software module, which is not specifically limited here.

[0147] To implement the above-mentioned digital work evidence method, the present application also provides a digital work evidence device, please refer to Figure 8 , Figure 8 is a structural schematic diagram of an embodiment of the digital work evidence device provided by the present application.

[0148] The digital work evidence device 400 of the embodiment includes a processor 41, a memory 42, an input / output device 43, and a bus 44.

[0149] The processor 41, the memory 42, and the input / output device 43 are respectively connected with the bus 44. The memory 42 stores program data, and the processor 41 is used to execute the program data to realize the digital work evidence method described in the above-mentioned embodiments.

[0150] In the embodiments of the present application, the processor 41 can also be referred to as a CPU (Central Processing Unit). The processor 41 can be an integrated circuit chip having a processing capability of signals. The processor 41 can also be a general-purpose processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The general-purpose processor can be a microprocessor or the processor 41 can also be any conventional processor or the like.

[0151] The present application also provides a computer storage medium, please continue to refer to Figure 9 , Figure 9 FIG. 6 is a structural schematic diagram of an embodiment of a computer storage medium provided by the present application. The computer storage medium 600 stores a computer program 61. When the computer program 61 is executed by a processor, the digital work evidence method of the above-mentioned embodiments is implemented.

[0152] When the embodiments of the present application are implemented in the form of software functional units and sold or used as independent products, they can be stored in a computer readable storage medium. Based on this understanding, the technical solutions of the present application or the whole or part of the technical solutions that make essential contributions to the prior art can be embodied in the form of a software product. The computer software product is stored in a storage medium and includes a number of instructions for causing a computer device (which can be a personal computer, a server, or a network device, etc.) or a processor to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, and various media that can store program codes.

[0153] The above only describes the embodiments of the present application, and does not limit the patent scope of the present application. Any equivalent structure or equivalent process transformation based on the content of the specification and drawings, or direct or indirect application in other related technical fields, are also included in the patent protection scope of the present application.

Claims

1. A digital work evidence storage method, characterized in that, The digital work evidence storage method applied to an application end comprises: In response to an evidence storage instruction issued by a target user who logs in a target account, a display interface of the application end is screen-recorded and drawing data of a device end is collected during a drawing process, wherein the device end is connected with the application end; In response to an end-drawing instruction of the target user, a drawing process video is generated and a handwriting restoration video is generated according to the collected drawing data; A first handwritten electronic signature file generated after the drawing is ended is uploaded to a server end; In a case where the first handwritten electronic signature file is verified by the server end, in response to a storage instruction sent by the server end, an evidence storage file is encrypted and stored in the application end, wherein the evidence storage file comprises the drawing process video, the handwriting restoration video and a digital work obtained in the drawing process.

2. The digital work evidence storage method of claim 1, wherein the first handwritten electronic signature file generated after the drawing is ended is uploaded to the server end comprises: a first signature instruction is issued to the target user; the first handwritten electronic signature file is generated according to handwritten data of the target user on the device end, wherein the handwritten data comprises at least one of the following: pen stroke trajectory, pen stroke pressure, pen stroke moving speed, pen stroke hovering data and pen inclination angle during a signature process; the first handwritten electronic signature file is uploaded to the server end, wherein the server end is configured to verify the first handwritten electronic signature file by calling a target handwriting model corresponding to the target account.

3. The digital work evidence storage method of claim 2, wherein the digital work evidence storage method further comprises: when the target user registers the target account, in response to the target user handwriting electronic signatures on a digital board multiple times, a training handwritten data set is obtained; a training handwritten electronic signature file set is generated according to the training handwritten data set; the training handwritten electronic signature file set is uploaded to the server end, wherein the server end is configured to train the target handwriting model according to the training handwritten electronic signature set.

4. The method of claim 1, wherein, the evidence storage file is encrypted and stored in the application end, comprising: a first encryption key generated by the application end is obtained, the evidence storage file is encrypted based on the first encryption key to obtain an encrypted evidence storage file; the encrypted evidence storage file is stored in the application end; the first encryption key is uploaded to the server end and is encrypted and stored by a public key of the server end; the first encryption key is deleted in the application end; and / or the drawing data of the device end is collected, comprising: encrypted data sent by the device end is obtained, wherein the encrypted data comprises original encrypted data and key encrypted data; the key encrypted data in the encrypted data is decrypted by using a private key of the application end to obtain a symmetric encryption key corresponding to the encrypted data and a random number; the original encrypted data in the encrypted data is decrypted based on the random number and the symmetric encryption key to obtain original collection data corresponding to the encrypted data; The original acquisition data is rearranged to obtain the drawing data.

5. The digital work evidence storage method of claim 1, wherein, After the evidence storage file is stored in the application end after being encrypted, the digital work evidence storage method further comprises: obtaining a hash feature corresponding to the evidence storage file; generating an integrity signature corresponding to the hash feature according to the private key of the application end; packaging and uploading the hash feature, the integrity signature, and a timestamp to a block chain; receiving an evidence storage result returned by the block chain; and / or, in response to an evidence collection instruction of the target user, issuing a second signature instruction to the target user; obtaining a second handwritten electronic signature file generated after the second signature instruction is issued and uploading the second handwritten electronic signature file to the service end; and in the case that the second handwritten electronic signature file is verified by the service end, exporting the evidence storage file from the application end.

6. A digital work archiving method, characterized by, The digital work evidence storage method applied to the service end comprises: receiving a first handwritten electronic signature file generated and uploaded by the application end after the target user finishes drawing; calling a target handwriting model corresponding to the target user to verify the first handwritten electronic signature file; in the case that the verification is passed, sending a storage instruction to the application end; receiving an evidence storage file sent by the application end in response to the storage instruction, and saving the evidence storage file to the service end, wherein the evidence storage file comprises a drawing process video, a handwriting restoration video, and a digital work obtained in the drawing process.

7. The digital work evidence storage method of claim 6, wherein, after the evidence storage file is saved to the service end, the digital work evidence storage method further comprises: generating target verification information corresponding to the evidence storage file; downloading the target verification information to the application end to bind the target user and the target verification information in the application end.

8. The digital work evidence storage method of claim 6, wherein, the digital work evidence storage method further comprises: receiving an evidence collection instruction sent by the application end and carrying verification information; verifying the verification information carried by the evidence collection instruction and the verification information stored in the service end; in the case that the verification is passed, sending a signature instruction to the application end; receiving a second handwritten electronic signature file generated by the application end in response to the signature instruction; calling the target handwriting model to verify the second handwritten electronic signature file; in the case that the second handwritten electronic signature file is verified by the service end, sending the evidence storage file to the application end, so that the target user views the evidence storage file in the application end.

9. A digital work evidence system, characterized by, The digital work evidence storage system comprises an application end, a service end, and a device end; The device end is configured to generate drawing data in real time according to a drawing operation of a target user on the device end, and send the drawing data to the application end; The application end is configured to, in response to an evidence storage instruction issued by a target user who logs in a target account, perform a screen recording on a display interface of the application end and an acquisition operation on drawing data of the device end during drawing. generate a painting process video and a handwriting restoration video according to the collected painting data in response to an end painting instruction of the target user; upload a first handwritten electronic signature file generated after the end of painting to a server; the server verifies the first handwritten electronic signature file, and sends a storage instruction to the application end in the case of verification passing, so that the application end stores an evidence file after encryption in the application end according to the storage instruction, wherein the evidence file includes the painting process video, the handwriting restoration video and a digital work obtained in the painting process.

10. A computer storage medium, characterized in that, The computer storage medium is used to store program data, which is executed by a computer to realize the digital work evidence method according to any one of claims 1-8.

Images