Certificate reserving method for digital work creation process and computer program product

Abstract

The invention discloses a certificate reserving method for a digital work creation process and a computer program product. The certificate reserving method is realized based on a certificate reserving system, the certificate reserving system relates to terminal equipment, a server and a timestamp authentication system, the certificate reserving method is applied to the terminal equipment, and the method comprises the following steps: when a terminal user uses a generative AI tool to create a digital work, the terminal equipment displays a certificate reserving interface on a screen, establishing an end-to-end data transmission channel between the terminal device and the server; the certificate reserving interface comprises part or all of the following windows: a user behavior recording window, a creation information recording window, a time information recording window and a work preview window; in the certificate leaving process, a video stream containing a certificate leaving interface of a terminal screen is obtained in real time and encrypted, and the encrypted video stream is sent to a server through a data transmission channel, so that the server initiates a timestamp authentication process to a timestamp authentication system after decrypting and verifying the video stream. Therefore, the evidence-remaining video and the timestamp certificate of the creation process are generated.

Description

Technical Field

[0001] The present application relates to the field of data processing technology, and in particular to a method for preserving evidence of the creation process of digital works and a computer program product. Background Art

[0002] Artificial intelligence models are bringing increasingly convenient services to users. For example, a growing number of AI models can assist users in generating creative content. A specific example is generative AI models. Users simply provide instructions based on their personal creative inspiration and conception, and quickly produce works that express their thoughts and emotions. This demonstrates that using AI models in the creative process not only improves efficiency but also enables everyone to participate in artistic creation, expanding people's means of expression.

[0003] With the increasing prevalence of auxiliary tools, the ownership, legality, and provability of generated content have also received increasing attention. Traditional copyright protection systems are primarily focused on scenarios involving direct human creation. Physical information such as manuscripts, sketches, and editing traces can be used to prove the identity of the creator and their original contribution to the work. However, when creating with auxiliary tools, creators often do not directly draw or modify images. Instead, they interact with AI models through information such as prompts and parameters to generate the results. This AI-based creation model renders traditional proof methods based on physical information ineffective, making it even more difficult to determine the ownership of the results based solely on the work itself.

[0004] In actual applications, users need to provide sufficient and credible evidence to prove their original contribution to the generated results when claiming the ownership or related rights of the creative works. However, there is currently a lack of credible solutions for collecting and recording users' creative behaviors and the process of work generation. This makes it difficult for creators to provide evidence and has unclear ownership when users claim their creative works. Therefore, there is an urgent need to build a new creative process evidence retention solution to provide a reliable basis for determination of ownership, copyright claims, and judicial decisions. Summary of the Invention

[0005] In view of this, an embodiment of the present application provides a method for preserving evidence of the digital work creation process and a computer program product for solving at least one technical problem.

[0006] The embodiment of the present application provides a method for recording the creation process of a digital work, including: the evidence retention method is implemented based on an evidence retention system, the evidence retention system involves a terminal device, a server and a timestamp authentication system, the terminal device is equipped with a generative AI tool, the evidence retention method is applied to the terminal device, and the method includes: when a terminal user uses the generative AI tool to create a digital work, in response to receiving an evidence retention instruction, the terminal device displays a evidence retention interface on the screen, and establishes an end-to-end data transmission channel between the terminal device and the server; wherein the evidence retention interface includes some or all of the following windows: a user behavior recording window, a creation information recording window, a time information recording window, and a work preview window; in the process of retaining evidence of the user's creation process, multiple windows are displayed in a linked manner, and in the user behavior recording window Display user behavior information collected by the camera, including at least facial information and hand information; in the creation information recording window, display the creation instructions input by the user to the generative AI tool; in the time information recording window, display the time stamp added to the user behavior information, and / or display the time stamp added to the creation instructions input by the user to the generative AI tool; in the work preview window, display the work generated by the generative AI tool during the creation process; in the process of recording evidence, obtain the video stream containing the evidence interface of the terminal screen in real time, encrypt it, and send the encrypted video stream to the server through the data transmission channel, so that the server decrypts and verifies the video stream and then initiates the timestamp authentication process to the timestamp authentication system to generate an evidence video and a timestamp certificate of the creation process.

[0007] Optionally, according to an embodiment of the present application, the method also includes: identifying the creation instructions input by the user, extracting instruction keywords from the creation instructions, and determining the category of each instruction keyword, wherein the category of the instruction keyword includes at least any one of prompt words, style parameters, composition settings, detail adjustments, or reference materials; based on the input time sequence of the creation instructions, displaying the instruction keywords and the category information of the instruction keywords to form an instruction evolution record of the creation content; and displaying the instruction evolution record through the first predetermined position of the creation information recording window.

[0008] Optionally, according to an embodiment of the present application, in the process of displaying the work in the work preview window, the method also includes: performing image recognition on the work displayed in the work preview window, and determining the image area in the work that matches the instruction keyword; in the work preview window, based on the matching relationship between the instruction keyword and the image area, superimposing and displaying the instruction keyword and the category information of the instruction keyword at the corresponding position of the image area, so as to indicate the user's creative intention through the instruction keyword.

[0009] Optionally, according to an embodiment of the present application, the method also includes: extracting process data of the generative AI tool for generating creative content; extracting part or all of the following information in the process data: semantic vectors corresponding to the creative instructions, attention information used to represent the correspondence between each keyword in the creative instructions and the generated image area, data records used to represent the mapping relationship between the pixel area in the image and the creative instruction keywords, and prompt word evolution path data formed based on multiple creative instruction modifications; and displaying the information extracted from the process data in a second predetermined position in the creative information recording window.

[0010] Optionally, according to an embodiment of the present application, the server sends an encrypted video stream so that the server decrypts and verifies the video stream and then initiates a timestamp authentication process to the timestamp authentication system, including: generating a local evidence recording video based on the video stream of the evidence interface, and calculating a first hash value corresponding to the local evidence recording video; sending the first hash value to the server so that the server decrypts the encrypted evidence interface video stream, and generates a server-side evidence recording video based on the decrypted evidence interface video stream, and calculates a second hash value corresponding to the server-side evidence recording video; performing an integrity check on the evidence recording video based on the first hash value and the second hash value, and initiating a default timestamp authentication process after the integrity check passes.

[0011] Optionally, according to an embodiment of the present application, the method also includes: detecting the permissions required to generate a video of the creation process, wherein the required permissions include the camera's video capture permission, the terminal device's permission to capture screen display information, and the terminal device's permission to capture audio; if the required permissions do not meet the permission requirements, displaying auxiliary reference information for enabling permissions to assist the user in enabling the permissions required to generate the video of the creation process; and displaying the evidence interface after the required permissions meet the permission requirements.

[0012] Optionally, according to an embodiment of the present application, the end-to-end data transmission channel between the terminal device and the server is established based on the WebRTC communication interface.

[0013] Optionally, according to an embodiment of the present application, the video and timestamp certificate of the creation process are stored in the blockchain system.

[0014] An embodiment of the present application provides an electronic device, which includes a processor and a memory storing computer program instructions; when the processor executes the computer program instructions, the steps of the method described above are implemented.

[0015] An embodiment of the present application provides a computer-readable storage medium having computer program instructions stored thereon. When the computer program instructions are executed by a processor, the steps of the method described above are implemented.

[0016] An embodiment of the present application provides a computer program product, which includes computer program instructions. When the computer program instructions are executed by a processor, the steps of the method described above are implemented.

[0017] Using the embodiments of the present application, creators can conveniently record the creative process and generate a video and timestamp certificate of the creative process. During the creative process of a user using a terminal device, the record interface displayed on the terminal device screen can integrate multiple display windows. Creative behavior information, creative instructions, and time stamps can all be presented synchronously in different windows, enabling the linkage display of multiple display windows, intuitively reflecting the linkage relationship between the creative process and the creative content, and enhancing the interpretability of the creative content of the record interface. At the same time, the displayed content in the record interface is encrypted and transmitted to the server based on the end-to-end data transmission between the terminal device and the server to ensure the security of the transmission process and reduce the risk of tampering and leakage. The server can decrypt and verify the received video stream in real time, and after verification, automatically initiate a timestamp authentication process to the timestamp authentication system to generate a video and timestamp certificate of the creative process. Based on the record process provided by the embodiments of the present application, the creator's creative work can obtain authoritative time authentication, and the creator does not need to leave the creative environment throughout the process. The operation is simple, making it more convenient to prove the creator's creative process. BRIEF DESCRIPTION OF THE DRAWINGS

[0018] In order to more clearly illustrate the technical solutions of the embodiments of the present application, the following briefly introduces the drawings in the embodiments of the present application.

[0019] Figure 1 It is a schematic diagram of the system architecture of an embodiment of the present application.

[0020] Figure 2 A flow chart showing a method for preserving evidence of the digital work creation process according to an embodiment of the present application is shown.

[0021] Figure 3 Another flowchart of the method for preserving evidence of the digital work creation process according to an embodiment of the present application is shown.

[0022] Figure 4 This is a schematic diagram of an evidence retention interface in an embodiment of the present application.

[0023] Figure 5 This is a schematic diagram of an electronic device used to implement the method of preserving evidence of the digital work creation process in an embodiment of the present application. DETAILED DESCRIPTION

[0024] The principles and spirit of the present application will be described below with reference to several exemplary embodiments. It should be understood that the purpose of providing these embodiments is to make the principles and spirit of the present application clearer and more thorough, so that those skilled in the art can better understand and implement the principles and spirit of the present application. The exemplary embodiments provided herein are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments herein, all other embodiments obtained by those of ordinary skill in the art without creative work are within the scope of protection of this application. In this article, terms such as first, second, and third are only used to distinguish one entity (or operation) from another entity (or operation), and are not intended to require or imply any order or association between these entities (or operations).

[0025] It should be noted that the acquisition, storage, use, and processing of data in the embodiments of this application comply with the relevant provisions of national laws and regulations.

[0026] The embodiments of the present application relate to terminal devices and / or servers. Those skilled in the art will appreciate that the embodiments of the present application may be implemented as a system, apparatus, device, method, computer-readable storage medium, or computer program product. Therefore, the present disclosure may be implemented in at least one of the following forms: entirely in hardware, entirely in software, or a combination of hardware and software.

[0027] According to the implementation method of this application, this application requests protection for a method for preserving evidence of the digital work creation process and a computer program product. Figure 1 A schematic diagram of a system architecture of an embodiment of the present application is shown. Figure 1 As shown, the system includes a terminal device 102, a server 104 and a timestamp authentication system 106. The terminal device 102 may include at least one of the following: a smart phone, a tablet computer, a laptop computer, a desktop computer, a smart TV, various wearable devices, an augmented reality AR device, a virtual reality VR device, and the like. The terminal device 102 is equipped with a generative AI tool, which can be implemented by installing an application such as a client or a browser. Users can use the generative AI tool to create content. During the creation process, a proof interface can be displayed on the screen of the terminal device 102. Multiple display windows can be integrated in the proof interface. Creation behavior information, creation instructions, time stamps and other information can be synchronously presented in different windows, realizing the linkage display of multiple display windows, so as to intuitively reflect the linkage relationship between the creation process and the creation content, thereby enhancing the interpretability of the creation content of the proof interface.

[0028] In multiple display windows, the user behavior record window records the user's participation in creation, which can record specific creative behaviors such as creative inspiration or creative conception; the instructions input by the user to the generative AI tool displayed in the creation information record window make the creation instructions traceable, which helps to identify the user's intellectual contribution and original expression in the generation of works; at the same time, the time stamps displayed in the time information record window realize the time stamping of user behavior information and creation instructions respectively, so that the entire creation chain has a traceable and verifiable temporal relationship, and also provides a strong time basis for subsequent ownership identification; the content of the work generated by the generative AI tool is displayed in the work preview window, so that the user input and the content of the work are intuitively and visually linked, which clearly presents the actual impact of the user input on the generation result, and improves the convenience of proving the correspondence between the creative intention and the work.

[0029] An end-to-end data transmission channel can be established between the terminal device 102 and the server 104. After encryption, the display content in the evidence interface can be sent to the server 104 through the data transmission channel to ensure the security of data transmission. In an embodiment of the present application, the server 104 performs decryption verification based on the received video stream, and initiates a timestamp authentication process to the timestamp authentication system 106 to generate an evidence video and a timestamp certificate of the creative process. Optionally, the server 104 can return its authentication result to the terminal device 102, so that the creator's creative work can obtain authoritative time authentication. The creator does not need to leave the creative environment during the entire evidence process and the operation is simple, thereby achieving effective evidence of the user's creative behavior and the work generation process, and providing a reliable basis for judgment for scenarios such as ownership identification, copyright claims and judicial judgments.

[0030] The following is an introduction to the method of recording evidence of the digital work creation process in conjunction with the embodiments of the present application. Figure 2 and Figure 3 The process diagram shown.

[0031] Step 201: When a terminal user uses a generative AI tool to create a digital work, in response to receiving a record instruction, the terminal device displays a record interface on the screen, and establishes an end-to-end data transmission channel between the terminal device and the server; wherein, the record interface includes some or all of the following windows: user behavior record window, creation information record window, time information record window, and work preview window.

[0032] Step 201a, in the process of recording the user's creative process, multiple windows are linked to display, and the user behavior information collected by the camera is displayed in the user behavior record window, including at least facial information and hand information.

[0033] Step 201b: Display the creation instructions input by the user to the generative AI tool in the creation information record window.

[0034] Step 201c: In the time information recording window, the time stamp added to the user behavior information and / or the time stamp added to the creation instructions input by the user to the generative AI tool are displayed.

[0035] Step 201d: Display the work generated by the generative AI tool during the creation process in the work preview window.

[0036] Step 202: During the evidence retention process, the video stream of the terminal screen containing the evidence retention interface is obtained in real time and encrypted, and the encrypted video stream is sent to the server through the data transmission channel, so that the server decrypts and verifies the video stream and then initiates a timestamp authentication process to the timestamp authentication system to generate an evidence video and a timestamp certificate of the creation process.

[0037] Specifically, regarding the above-mentioned step 201, when the terminal user uses the generative AI tool to create a digital work, the terminal device responds to the user-triggered evidence-keeping instruction, displays a proof-keeping interface on the terminal screen, and simultaneously starts the creation process recording process to generate a proof-keeping video.

[0038] The record interface can be a multi-window interface, with multiple windows not blocking each other. The multiple windows within the record interface can specifically include display windows such as a user behavior record window, a creation information record window, a time information record window, and a work preview window. Multiple windows can concurrently display multiple dimensions of creative process data, including user behavior information, creative input content, generated results, and time information, so that the record video comprehensively reflects the active participation and actual contribution of the end user throughout the entire creative process.

[0039] While the terminal device displays the evidence retention interface, the terminal device establishes an end-to-end data transmission channel with the server based on a predetermined secure communication protocol to facilitate the transmission of the encrypted video stream of the evidence retention interface.

[0040] Specifically, refer to Figure 3 As shown, the specific evidence-keeping process of the entire creative process involves steps 201a to 201d.

[0041] In some embodiments, the user's facial features and hand information during the creative process are continuously collected through a camera, and these creative behavior information are displayed in a user behavior record window to dynamically record the user's creative behavior, thereby comprehensively recording the user's subjective participation behavior in the generative AI-based creative process.

[0042] For example, facial information includes, but is not limited to, the user's facial orientation, expression changes, and gaze direction. This information can reflect the user's attention state and emotional changes during the generative AI creation process. Hand information includes, but is not limited to, gestures, typing, clicking, dragging, and other operational actions. It can record behavioral information such as body movements to reflect the user's actual interaction with the terminal device and the creative status.

[0043] Optionally, in the process of collecting user creative behavior, facial image and hand image data can be captured, and the captured facial image and hand image data can be bound to time information respectively to record the relationship between behavior and time.

[0044] In some embodiments, the creation information recording window can display the creation instructions input by the user into the generative AI tool in real time. The user's creation instructions can be input via keyboard input, touch input, voice input, or image data upload. Optionally, different input methods can be displayed in different models to distinguish the creation instructions input by the user.

[0045] For example, when the creation instruction includes content inputted by a keyboard or touch device, the inputted content can be displayed in a text format in the creation information recording window. When the creation instruction includes content inputted by a user using voice, the voice content can be converted into text, and the text can be displayed in the creation information recording window, wherein the original audio data corresponding to the voice content can be fused with the evidence retention interface based on the collected time information to generate a video stream of the evidence retention interface. When the creation instruction includes image data, the image data can be displayed directly. Optionally, a text description or instruction information related to the image data can be displayed next to the image data to facilitate marking the association between the image data and the creation process.

[0046] Based on the creation information recording window, user instructions are traceable, and creation instructions, as important data in the creation process, can also be conveniently recorded and saved.

[0047] In some embodiments, the time information recording window can display time stamps related to the creation process in real time, including time records of user behavior information and creation instructions.

[0048] For example, when the camera captures a user's facial information or hand movements, a timestamp can be added to each frame of captured image data, thereby marking the time information corresponding to each behavior information. In the time information recording window, the time information corresponding to each behavior information can be displayed synchronously with the user behavior information displayed in the user behavior recording window.

[0049] When users enter or modify creative instructions through the creation information recording window, they can add a timestamp to each input, thereby marking the time information corresponding to each instruction. In the time information recording window, the time information corresponding to each instruction can be displayed synchronously with the instruction content in the creation information recording window. As a result, every time a creative instruction is entered, modified, or submitted, it will be accurately recorded, ensuring a clear temporal connection between the instruction and the corresponding generated result.

[0050] Optionally, the time tag includes a window tag and time information. Different window tags may correspond to different time information. For example, the window tag corresponding to the user behavior recording window corresponds to a time information of "hour: minute: second", and the window tag corresponding to the creation information recording window corresponds to a time information of "hour: minute: second".

[0051] In addition, the time information recording window can also display the timestamps corresponding to other windows during the user's creation process for easy comparison and verification.

[0052] In the embodiments of the present application, by recording the time information of each action and the time information of each instruction, a clear temporal relationship between the creation action and the corresponding generated result can be effectively recorded. Furthermore, the time information displayed in the time information recording window, after being recorded in real time, is synchronized with the video stream and stored as part of the video evidence, providing reliable time evidence for subsequent timestamp authentication, ownership determination, and other related events.

[0053] In some embodiments, the work preview window can display the work generated by the generative AI tool during the creation process in real time. On the one hand, the user can intuitively view the change process of the generated work, which provides convenience for the user to adjust the creation instructions and optimize the generated content. On the other hand, when the user enters the creation instructions or adjusts the creation parameters in other windows, the work preview window displays the creation results through instant updates to prove the correlation between the input instructions and the generated work.

[0054] It should be noted that the execution order corresponding to 201a to 201d is not specifically limited.

[0055] In the process of recording evidence, step 202 is involved, in which the recording interface displayed on the terminal device screen is converted into a video stream in real time, so that various inputs, interactive operations, input of creation instructions, display of generated results, time stamps and other information of the user in the creation process can be fully recorded.

[0056] For each video stream of the evidence interface, a symmetric encryption algorithm, such as AES-256, or an asymmetric encryption algorithm can be used for encryption to ensure the security of the video stream during transmission and reduce the risk of data tampering and leakage during transmission.

[0057] The encrypted video stream is transmitted to the server through a secure data transmission channel.

[0058] Optionally, the end-to-end data transmission channel between the terminal device and the server may be established based on a WebRTC communication interface, or may be established based on a Real-Time Messaging Protocol (RTMP) or WebSocket.

[0059] After receiving the encrypted video stream, the server decrypts and verifies it. Once decryption and verification are successful, a video documenting the creation process is generated based on the decrypted video stream. Simultaneously, the server initiates a timestamp authentication request to the timestamp authentication system to ensure that the time the video stream was generated cannot be tampered with. The timestamp authentication system generates a unique timestamp certificate for the documented video through an impartial third-party authentication process, thereby verifying the user's originality and ownership of the content. This third party can be a third-party digital certificate authority (CA), which provides a digital certificate and digitally signs the documented creation process to confirm ownership.

[0060] In an embodiment of the present application, the video that has been timestamped and authenticated can be stored together with the timestamp certificate, providing strong evidentiary support for subsequent copyright claims, identification of creative ownership, etc.

[0061] In some embodiments of the present application, an encrypted video stream is sent to a server so that the server decrypts and verifies the video stream and then initiates a timestamp authentication process to the timestamp authentication system. Specifically, the following steps may be included: generating a local evidence recording video based on the video stream of the evidence interface, and calculating a first hash value corresponding to the local evidence recording video; sending the first hash value to the server so that the server decrypts the encrypted evidence interface video stream, and generates a server-side evidence recording video based on the decrypted evidence interface video stream, and calculates a second hash value corresponding to the server-side evidence recording video; performing an integrity check on the evidence recording video based on the first hash value and the second hash value, and initiating a default timestamp authentication process after the integrity check passes.

[0062] By calculating hash values for the locally generated evidence recording video and the video restored on the server side, and performing hash comparison verification, the integrity of the evidence data of the creation process is verified in multiple processing links such as collection, encryption, transmission, decryption and reconstruction. This reduces the risk of the lecture data being tampered with, replaced or forged during transmission, and ensures the authenticity and credibility of the evidence video.

[0063] On the premise that the hash value is consistent and the data integrity check is passed, a legally binding timestamp certificate is generated based on the timestamp authentication process to calibrate the actual time of the creation process.

[0064] In some embodiments of the present application, the video and timestamp certificate of the creation process are stored in the blockchain system to ensure the security of the video and timestamp certificate.

[0065] In some embodiments of the present application, in order to ensure that the evidence video can be recorded smoothly, the terminal device can first detect whether it has obtained the permission required for recording the video in response to receiving the evidence instruction, and after obtaining the permission, display the evidence interface. Specifically, the following steps can be included: detecting the permission required to generate the evidence video of the creation process, wherein the required permissions include the video acquisition permission of the camera, the permission of the terminal device to acquire screen display information, and the permission of the terminal device to acquire audio; if the required permissions do not meet the permission requirements, displaying auxiliary reference information for enabling permissions to assist the user in enabling the permissions required to generate the evidence video; and displaying the evidence interface after the required permissions meet the permission requirements.

[0066] For example, the terminal device displays the application interface of the evidence recording system, and the user can issue an instruction to record evidence by clicking the "Create Evidence" control. If it is detected that the user does not have permission to capture screen display information and terminal device audio, a pop-up window will be displayed to explain in detail the authorization process and user operation instructions for obtaining camera video capture permission, terminal device screen display information capture permission, and terminal device audio capture permission to ensure that the evidence video can be recorded smoothly.

[0067] In some embodiments of the present application, in order to better reflect the user's creative ideas in the recorded video, the instruction evolution record can also be displayed in chronological order in the creation information record window. Specifically, the following steps are included: identifying the creation instructions input by the user, extracting instruction keywords from the creation instructions, and determining the category of each instruction keyword, wherein the category of instruction keywords includes at least any one of prompt words, style parameters, composition settings, detail adjustments, or reference materials; based on the input time sequence of the creation instructions, displaying instruction keywords and instruction keyword category information to form an instruction evolution record of the creation content; and displaying the instruction evolution record through the first predetermined position of the creation information record window.

[0068] Specifically, the terminal device can perform semantic recognition and structural analysis on the creation instructions, extract multiple instruction keywords, and classify each instruction keyword. The instruction keyword category includes at least one of prompt words, style parameters, composition settings, detail adjustments, or reference materials.

[0069] Prompt words such as "sunrise", "city streets" and other information can reflect the user's creative conception framework based on the prompt words.

[0070] Style parameters such as "oil painting style" and "futurism" can reflect the user's aesthetic preferences based on style parameters.

[0071] Composition settings such as "center" and "top view" reflect the layout of objects and the position of the focus, and can reflect the creative process of the work.

[0072] Detail adjustments such as "highlights" and "edge clarity" can reflect the user's optimization ideas for the work during the creative process.

[0073] Reference materials, such as uploaded image data, can directly prove the user's control over the content of the creative work. The image data can be a static image, a dynamic image, or a video, and there is no specific limitation here.

[0074] After extracting and categorizing command keywords, the command keywords and their categories are sorted chronologically to generate a command evolution record. A preset display area can be set in the creation information record window to display the command evolution record. It is understood that the specific display content corresponding to the command evolution record in the first display area will be updated each time the user adds or modifies a creation command.

[0075] Based on the embodiment of the present application, by displaying the instruction evolution record, not only can the user conveniently view all the keywords, instruction types and evolution paths that they have entered during the creative process, but it also provides a basis for subsequent judgment of the relationship between the creative intention and the generated work. It can also display the changing trajectory of the user's creative ideas throughout the creative process in the evidence interface, so as to provide strong evidence of the creative process.

[0076] In some embodiments of the present application, since the work contains visual content that reflects the user's subjective creative intention, these contents can directly or indirectly reflect the user's guidance and control of the creative process. Based on this, in the process of displaying the work in the work preview window, the method can also include the following steps: performing image recognition on the work displayed in the work preview window, and determining the image area in the work that matches the instruction keyword; in the work preview window, based on the matching relationship between the instruction keyword and the image area, superimposing the instruction keyword and the category information of the instruction keyword at the corresponding position of the image area, so as to indicate the user's creative intention through the instruction keyword.

[0077] Specifically, while the terminal device displays the artwork generated by the generative AI tool in the artwork preview window, it also performs image recognition on the artwork displayed in the artwork preview window. This image recognition process can identify characteristic features within the image, such as image regions corresponding to characteristic features such as people, buildings, backgrounds, animals, and color regions. Image regions based on characteristic features can reflect the user's subjective intent and aesthetic judgment during the creative process.

[0078] By matching these image regions with the instruction keywords input by the user during the creation process, the image regions corresponding to the instruction keywords in the generated work are found.

[0079] If a match is determined between an image area and a command keyword input by the user, the command keyword and its corresponding category information, such as prompt words, style parameters, composition settings, detail adjustments, or reference material type labels, are displayed as a layer overlay at the corresponding position in the image area. Optionally, the overlay display can be in the form of a transparent label, border annotation, or pop-up bubble. The specific display style can be set according to the actual display conditions of the interface. It should be noted that the command keyword and corresponding category information displayed in the work preview window are not part of the work.

[0080] Based on the embodiments of this application, users can conveniently understand the correspondence between the content of each region in the generated image and the creative instructions in the work preview window, which can help users determine whether the creative result meets the expected creative intent. At the same time, the superimposed instruction keywords and category tags serve as structured creative process data, which can assist in determining the ownership of the work and enhance the interpretability of the creative intent.

[0081] In some embodiments of the present application, in order to further improve the association between creative intent and the work, the method may also include the following steps: extracting process data of the generative AI tool to generate creative content; extracting part or all of the following information in the process data: semantic vectors corresponding to the creative instructions, attention information used to represent the correspondence between each keyword in the creative instruction and the generated image area, data records used to represent the mapping relationship between the pixel area in the image and the creative instruction keywords, and prompt word evolution path data formed based on multiple creative instruction modifications; and displaying the information extracted from the process data in a second predetermined position in the creative information recording window.

[0082] Specifically, the process data generated when a generative AI tool generates creative content refers to the data that the generative AI tool converts into semantic vectors after receiving the creative instructions, and performs reasoning and calculations based on the semantic vectors.

[0083] In the process data, the semantic vectors are displayed to reflect the semantics of the creative instructions, as well as their syntactic structure and contextual dependency information. Attention information can indicate the correspondence between each keyword in the creative instruction and the generated image region. For example, by clearly mapping the word "shrub" to the shrub portion of the image, each region of the generated creative content can find the corresponding proof information of the creative process.

[0084] The prompt word evolution path data can reflect the modules, paths, and generation sequences activated by generative AI tools during the reasoning and calculation process.

[0085] After extracting the process data, visually displaying it in a second predetermined location within the creation information recording window allows users to intuitively understand the technical role of each instruction in the generation process and the impact of the corresponding generation area. Furthermore, since process data demonstrates that the reasoning and calculations of generative AI tools are controlled by the user's subjective creative intent, and the creation information recording window serves as part of the evidence-keeping interface, the evidence-keeping video can also include process data as important proof of the user's participation in the creation.

[0086] In order to more clearly introduce the method of preserving evidence of the digital work creation process, another specific embodiment is introduced below.

[0087] Specifically, creators can use terminal devices equipped with a browser that supports WebRTC. After the user performs security authentication and logs into the evidence retention system based on pre-registered account information, the terminal device can display the evidence retention system interface, which can include creation evidence controls and historical creation content.

[0088] In response to the user-triggered recording instruction, the terminal device displays a recording interface on the terminal screen and simultaneously initiates the recording process of the creation process. The terminal device can automatically check the camera's video capture permissions, screen display information capture permissions, and audio capture permissions to ensure that the recording video can be successfully recorded. During the permission check process, the terminal device can also detect the camera's capture angle to ensure that the user's face and hands are fully captured.

[0089] After determining that the required permissions meet the permission requirements, the evidence retention interface 400 is displayed, for example, in combination with Figure 4 As shown, the evidence interface includes a user behavior record window 410, a creation information record window 420, a time information record window 430, and a work preview window 440, and each window is displayed in linkage.

[0090] The user behavior record window displays the user's facial expressions and gestures collected in real time by the camera, providing characteristic data of user behavior for property rights confirmation.

[0091] Based on the creative information recording window, the user's creative ideas can be recorded in detail.

[0092] Specifically, the creation information recording window may receive creation instructions input by the user through the input box 421 , and the creation instructions may be instructions created by the user himself, for example, the key ideas of the user during the creation process.

[0093] The creation instructions can also be templates provided by generative AI tools, which can include animation elements and scene layouts, such as a kitten image template. During the creation process, users can enter their creation instructions directly in the work preview window 440. For example, they can personalize the animal image in the template, including but not limited to color, size, and movement. They can also drag and drop image content and adjust parameters directly in the preview window. The entire creation process is displayed in the record interface.

[0094] In the case where the creative content is a video, the creative instructions may include instructions for adding animation effects to the animation elements, such as walking, jumping, etc.

[0095] When creating video content, the creation instructions can also include audio data. Users can provide their own audio data or use audio data provided by generative AI tools, without specific restrictions. Based on this, the creation instructions can also include instructions for adjusting volume and pitch to enhance user creation convenience.

[0096] Creation instructions can also include adding or removing scene elements, such as trees, clouds, etc., and adjusting the layout and background color of the scene.

[0097] During the creative process, users can also perform voice input. For example, if the content is a video, they can directly speak the dialogue or narration to add dubbing for the animation elements.

[0098] During the creative process, users may express their creative intentions or sources of inspiration through language. While recording the user's voice, the terminal device can also use voice recognition technology to convert the user's voice into text in real time as a creative instruction, which is displayed in the creative information recording window.

[0099] The above-mentioned creation instructions can be combined with the time information of the instruction input to generate an instruction evolution record, and the instruction evolution record can be displayed in the first predetermined position 422 of the creation information record window.

[0100] In the time information recording window, the time stamps added to the user behavior information and the time stamps added to the creation instructions input by the user to the generative AI tool can be displayed. For example, the time information corresponding to the creation instructions input by the user using the generative AI tool can be displayed synchronously with the instruction content in the creation information recording window. At the same time, the data fingerprint corresponding to the creation instruction is generated and bound to the time information corresponding to the instruction. As a result, each input, modification or submission of the creation instruction will be recorded in detail, ensuring that the instruction and the corresponding generation result have a clear temporal association, and reducing the risk of the creation instruction being tampered with.

[0101] For the content displayed in the work preview window, image recognition can be performed, and the instruction keywords and category information of the instruction keywords can be superimposed and displayed. The instruction keywords can not only indicate the user's creative intention, but also serve as marking information for specific creative elements or inspirations.

[0102] During the creative process, the terminal device continuously obtains the content displayed in the user interface to ensure that the entire creative process and the creative results generated by the creative process can be fully recorded.

[0103] The terminal device uses WebRTC to capture the display content and audio data of the evidence interface in real time and transmits it to the backend server for real-time hash calculation until the creation is completed, ensuring data security and user privacy. After the server completes the hash calculation, it can automatically apply for timestamp authentication. After timestamp authentication is completed, the hash value and timestamp information are uploaded to the blockchain, ensuring the data's immutability and traceability.

[0104] In some embodiments, after the video is stored and timestamped, a certificate of ownership can be generated. This certificate can include a hash value, timestamp authentication information, and blockchain evidence. Optionally, the certificate of ownership can be sent to the user in PDF format to facilitate user understanding of the recorded information and provide reliable evidence for future copyright disputes.

[0105] Corresponding to the method embodiments of the present application, the present application also provides a device for preserving evidence of the digital work creation process. The device for preserving evidence of the digital work creation process may correspond to the execution entity of the method for preserving evidence of the digital work creation process provided in the embodiments of the present application. The specific details of the operation and / or function of each module / unit of the device for preserving evidence of the digital work creation process can be found in the description of the corresponding parts of the method for preserving evidence of the digital work creation process provided in the embodiments of the present application. For the sake of brevity, they will not be repeated here.

[0106] The electronic device in the embodiment of the present application can be a user terminal device, a server, other computing devices, or a cloud server. Figure 5A schematic diagram of the hardware structure of an electronic device according to an embodiment of the present application is shown. The electronic device may include a processor 501 and a memory 502 storing computer program instructions. When the processor 501 executes the computer program instructions, the process or function of any of the above-mentioned embodiments is implemented.

[0107] Specifically, processor 501 may include a central processing unit (CPU) or an application-specific integrated circuit (ASIC), or may be configured to implement one or more integrated circuits of the embodiments of the present application. Memory 502 may include a large-capacity memory for data or instructions. For example, memory 502 may be at least one of the following: a hard disk drive (HDD), read-only memory (ROM), random access memory (RAM), a floppy disk drive, flash memory, an optical disk, a magneto-optical disk, magnetic tape, a universal serial bus (USB) drive, or other physical / tangible memory storage device. For another example, memory 502 may include removable or non-removable (or fixed) media. For another example, memory 502 may be internal or external to the integrated gateway disaster recovery device. Memory 502 may be non-volatile solid-state memory. In other words, memory 502 typically includes a tangible (non-transitory) computer-readable storage medium (such as a memory device) encoded with computer-executable instructions, and when the software is executed (e.g., by one or more processors), the operations described in the methods of the embodiments of the present application may be performed. The processor 501 implements the process or function of any of the methods in the above embodiments by reading and executing computer program instructions stored in the memory 502.

[0108] In one example, Figure 5The electronic device shown may also include a communication interface 503 and a bus 510. The processor 501, memory 502, and communication interface 503 are connected via bus 510 and communicate with each other. The communication interface 503 is primarily used to enable communication between the various modules, devices, units, and / or equipment in the embodiments of the present application. Bus 510, which may comprise hardware, software, or both, couples the components of the online data traffic metering device. For example, the bus may include at least one of the following: an Accelerated Graphics Port (AGP) or other graphics bus, an Enhanced Industrial Standard Architecture (EISA) bus, a Front Side Bus (FSB), a HyperTransport (HT) interconnect, an Industrial Standard Architecture (ISA) bus, an InfiniBand interconnect, a Low Pin Count (LPC) bus, a memory bus, a Micro Channel Architecture (MCA) bus, a Peripheral Component Interconnect (PCI) bus, a PCI-Express (PCI-X) bus, a Serial Advanced Technology Attachment (SATA) bus, a Video Electronics Standards Association Local Bus (VLB) bus, or other suitable buses. Bus 510 may include one or more buses. Although the embodiments of the present application describe or illustrate a specific bus, the embodiments of the present application may consider any suitable bus or interconnection method.

[0109] In combination with the method in the above embodiments, an embodiment of the present application also provides a computer-readable storage medium, which stores computer program instructions. When the computer program instructions are executed by a processor, they implement the process or function of any method in the above embodiments.

[0110] In addition, an embodiment of the present application further provides a computer program product, which stores computer program instructions. When the computer program instructions are executed by a processor, the process or function of any one of the methods in the above embodiments is implemented.

[0111] The flowcharts and / or block diagrams of the methods, devices, systems and computer program products of the embodiments of the present application are described above by way of example, and various aspects thereof are described. It should be understood that each box in the flowchart and / or block diagram or a combination thereof may be implemented by computer program instructions, or may be implemented by dedicated hardware that performs a specified function or action, or may be implemented by a combination of dedicated hardware and computer instructions. For example, these computer program instructions may be provided to a processor of a general-purpose computer, a special-purpose computer or other programmable data processing device to form a machine that enables these instructions executed by such a processor to enable the implementation of the functions / actions specified in each box in the flowchart and / or block diagram or a combination thereof. Such a processor may be a general-purpose processor, a special-purpose processor, a special application processor or a field programmable logic circuit.

[0112] The functional blocks shown in the structural block diagrams of the embodiments of the present application can be implemented as hardware, software, firmware, or a combination thereof. When implemented in hardware, they can be, for example, electronic circuits, application-specific integrated circuits (ASICs), appropriate firmware, plug-ins, function cards, etc.; when implemented in software, they are programs or code segments used to perform the required tasks. The programs or code segments can be stored in a memory or transmitted over a transmission medium or communication link via a data signal carried in a carrier wave. The code segments can be downloaded via a computer network such as the Internet or an intranet.

[0113] It should be noted that the present application is not limited to the specific configurations and processes described above or shown in the figures. The above is only a specific implementation method of the present application. Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working process of the described system, device, module or unit can refer to the corresponding process in the method embodiment without further description. It should be understood that the scope of protection of the present application is not limited to this. Any technician familiar with the technical field can think of various equivalent modifications or replacements within the technical scope disclosed in this application, and these modifications or replacements should be included in the scope of protection of the present application.

Claims

1. A method for preserving evidence of the creation process of a digital work, characterized in that: The evidence retention method is implemented based on an evidence retention system. The evidence retention system involves a terminal device, a server, and a timestamp authentication system. The terminal device is equipped with a generative AI tool. The evidence retention method is applied to the terminal device and includes: When a terminal user creates a digital work using a generative AI tool, in response to receiving a record keeping instruction, the terminal device displays a record keeping interface on the screen, establishing an end-to-end data transmission channel between the terminal device and the server; wherein the record keeping interface includes some or all of the following windows: a user behavior record window, a creation information record window, a time information record window, and a work preview window; In the process of recording the user's creative process, multiple windows are linked to display, and the user behavior information collected by the camera is displayed in the user behavior record window, including at least facial information and hand information; In the creation information recording window, the creation instructions input by the user to the generative AI tool are displayed; In the time information recording window, displaying the time stamp added to the user behavior information and / or displaying the time stamp added to the creation instruction input by the user to the generative AI tool; In the work preview window, the work generated by the generative AI tool during the creation process is displayed; During the evidence retention process, the video stream containing the evidence retention interface of the terminal screen is obtained in real time and encrypted, and the encrypted video stream is sent to the server through the data transmission channel, so that the server decrypts and verifies the video stream and then initiates a timestamp authentication process to the timestamp authentication system to generate an evidence video and a timestamp certificate of the creation process.

2. The method according to claim 1, characterized in that The method further comprises: Identifying a creative instruction input by a user, extracting instruction keywords from the creative instruction, and determining a category of each instruction keyword, wherein the category of the instruction keyword includes at least any one of prompt words, style parameters, composition settings, detail adjustments, or reference materials; Based on the input time sequence of the creation instructions, the instruction keywords and the category information of the instruction keywords are displayed to form an instruction evolution record of the creation content; The instruction evolution record is displayed through the first predetermined position of the creation information record window.

3. The method according to claim 2, characterized in that During the process of displaying the work in the work preview window, the method further includes: Perform image recognition on the work displayed in the work preview window to determine the image area in the work that matches the command keyword; In the work preview window, according to the matching relationship between the instruction keyword and the image area, the instruction keyword and the category information of the instruction keyword are superimposed and displayed at the corresponding position of the image area, so as to indicate the user's creative intention through the instruction keyword.

4. The method according to claim 2, characterized in that The method further comprises: Extracting process data of a generative AI tool in generating the creative content; Extracting some or all of the following information from the process data: semantic vectors corresponding to the creative instructions, attention information representing the correspondence between keywords in the creative instructions and regions of the generated image, data records representing the mapping relationship between pixel regions in the image and keywords in the creative instructions, and prompt word evolution path data formed based on multiple creative instruction modifications; The information extracted from the process data is displayed at a second predetermined position of the creation information recording window.

5. The method according to claim 1, wherein The step of sending the encrypted video stream to the server so that the server decrypts and verifies the video stream and then initiates a timestamp authentication process to the timestamp authentication system includes: Generate a local evidence record video based on the video stream of the evidence record interface, and calculate a first hash value corresponding to the local evidence record video; Sending the first hash value to the server, so that the server decrypts the encrypted evidence interface video stream, generates a server-side evidence recording video based on the decrypted evidence interface video stream, and calculates a corresponding second hash value of the server-side evidence recording video; An integrity check is performed on the recorded video according to the first hash value and the second hash value, and a default timestamp authentication process is initiated after the integrity check passes.

6. The method according to claim 1, characterized in that The method further comprises: Detecting the permissions required to generate a video of the creative process, wherein the required permissions include the camera's video capture permission, the terminal device's permission to capture screen display information, and the terminal device's permission to capture audio; If the required permissions do not meet the permission requirements, display auxiliary reference information for enabling permissions to assist the user in enabling the permissions required to generate the evidence video; The evidence retention interface is displayed after the required permissions meet the permission requirements.

7. The method according to claim 1, characterized in that The end-to-end data transmission channel between the terminal device and the server is established based on the WebRTC communication interface.

8. The method according to claim 1, characterized in that The video and timestamp certificate of the creation process are stored in the blockchain system.

9. An electronic device, characterized in that: The electronic device comprises: a processor and a memory storing computer program instructions; and when the electronic device executes the computer program instructions, the method according to any one of claims 1 to 8 is implemented.

10. A computer program product, characterized in that The method comprises computer program instructions, which implement the method according to any one of claims 1 to 8 when executed by a processor.

Images