system

Abstract

We provide the system. [Solution] A means for generating original NFTs based on a company's brand and campaign content, A means for recording the generated NFT using distributed ledger technology and generating its token ID, A means by which companies send and distribute generated NFTs to campaign participants via digital wallets, etc. A means of providing benefits or services to NFT owners when they meet certain conditions, When NFTs distributed on the primary market are traded between users, a means of recording the transaction history and providing benefits to the new owner is required. A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a persona chatbot control method performed by at least one processor, the method including steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In conventional campaigns and sales promotion measures, points and physical gifts are the mainstream, but they lack scarcity value and uniqueness, so the appeal to customers tends to decrease. Also, the means to maximize the effects of benefits and services provided by companies have been limited. It is necessary to solve these problems and provide an attractive method for both companies and customers.

Means for Solving the Problems

[0005] This invention relates to a system that includes means for automatically generating original NFTs using a generation AI model and registering those NFTs on a blockchain, means for distributing the generated NFTs as campaign rewards for companies, means for granting rewards to NFT owners, and means for promoting the secondary market for NFTs. This system enables companies to offer unique rewards with scarcity value, thereby improving customer loyalty and maximizing the effectiveness of those rewards.

[0006] "Generating methods" refer to AI models and algorithms used to generate original NFTs based on a company's brand and campaign content.

[0007] "Methods for registering on the blockchain" refers to the technology used to record generated NFTs using distributed ledger technology and to generate their token IDs.

[0008] "Means of distribution" refers to the technology used by companies to send and distribute generated NFTs to campaign participants via digital wallets or similar means.

[0009] "Means of granting benefits" refers to a system that provides benefits or services to NFT owners when they meet certain conditions.

[0010] "Means to promote secondary trading" refers to technologies that record the transaction history when NFTs distributed in the primary market are traded among users, and that provide benefits to new owners.

[0011] "Entering campaign information" refers to the process of entering detailed information about a campaign being conducted by a company.

[0012] "Users who own generated NFTs" refers to consumers who participated in the campaign and own NFTs distributed by companies. [Brief explanation of the drawing]

[0013] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] This is a sequence diagram showing the processing flow of the data processing system in Example 2, which incorporates an emotion engine. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2, which combines an emotion engine. [Modes for carrying out the invention]

[0014] Hereinafter, an example of an embodiment of the system according to the technology of the present disclosure will be described with reference to the accompanying drawings.

[0015] First, the terms used in the following description will be explained.

[0016] In the following embodiments, the numbered processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0017] In the following embodiments, the numbered RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0018] In the following embodiments, the numbered storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0019] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0020] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0021] [First Embodiment]

[0022] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0023] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0024] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0025] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0026] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0027] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0028] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0029] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0030] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0031] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0032] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0033] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0034] The present invention is a system that includes means for generating, means for registering on a blockchain, means for distributing, means for granting benefits, and means for facilitating secondary trading. The processing of the program of this system will be described in detail in natural language below.

[0035] User registration process

[0036] 1. Enter user information

[0037] User actions: To participate in the campaign, users must enter their name, email address, and digital wallet address on a dedicated website.

[0038] 2. Sending data

[0039] Terminal action: Send the entered user data to the server.

[0040] 3. Saving registration information

[0041] Server action: The received user data is saved to the database, and a registration confirmation email is sent to the user.

[0042] NFT generation request process

[0043] 1. Enter campaign information

[0044] Corporate actions: Companies enter necessary information such as the campaign name, theme, and brand logo, and request NFT generation.

[0045] 2. Input to the Generative AI Model

[0046] Server actions: Provide campaign information to the AI ​​model that generates it, and process it to generate the original NFT.

[0047] 3. NFT creation and blockchain registration

[0048] Generative AI model's actions: It generates original NFTs based on the input campaign information and returns the generated NFT data to the server.

[0049] Server actions: Register the generated NFT on the blockchain and obtain the token ID. Then, assign the token ID to the company and notify them.

[0050] NFT distribution process

[0051] 1. Select User Information

[0052] Company actions: Companies select users to distribute NFTs to from a list of campaign participants.

[0053] 2. Sending the Token ID

[0054] Server action: Send the token ID to the selected user's digital wallet address.

[0055] 3. Record of distribution history

[0056] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[0057] Reward Granting Process

[0058] 1. Application for benefits

[0059] User actions: Users log in to the campaign site, display the NFTs they own, and apply for the reward.

[0060] 2. Ownership confirmation

[0061] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[0062] 3. Granting of benefits

[0063] Server action: Grant reward information to the user's account and display instructions on how to use the reward.

[0064] Secondary distribution promotion process

[0065] 1. NFT trading

[0066] User actions: Users trade their NFTs on online marketplaces. This information is recorded on the blockchain.

[0067] 2. Record of transaction history

[0068] Server action: Retrieve transaction history from the blockchain and record it in the database.

[0069] 3. Verification of the new owner

[0070] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[0071] For example, if company A conducts a "summer campaign," company A inputs campaign information and brand logo into a server. Based on this, a generation AI model generates an original NFT and registers it on the blockchain. The registered NFT is distributed to campaign participants, who can receive their rewards along with their application. Furthermore, users can trade the NFT on an online marketplace, and new owners can also receive rewards, thus continuously maintaining the value and appeal of the NFT.

[0072] The following describes the processing flow.

[0073] Step 1:

[0074] User actions: Users must access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[0075] Step 2:

[0076] Terminal action: Send the entered information to the server.

[0077] Step 3:

[0078] Server action: Save the received user information to the database.

[0079] Step 4:

[0080] Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[0081] Step 5:

[0082] Company actions: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[0083] Step 6:

[0084] Terminal action: Send the entered campaign information to the server.

[0085] Step 7:

[0086] Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[0087] Step 8:

[0088] Generative AI model's actions: It generates an original NFT based on the provided campaign information and returns the generated NFT data to the server.

[0089] Step 9:

[0090] Server action: Register the generated NFT on the blockchain and obtain the token ID.

[0091] Step 10:

[0092] Server action: Assign the acquired token ID to the company's account and notify the company.

[0093] Step 11:

[0094] Company actions: Companies select a list of target users to distribute NFTs to campaign participants.

[0095] Step 12:

[0096] Server action: Send the token ID to the selected user's digital wallet address.

[0097] Step 13:

[0098] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[0099] Step 14:

[0100] User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[0101] Step 15:

[0102] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[0103] Step 16:

[0104] Server action: Grant reward information to the user's account and display details and instructions on how to use the reward.

[0105] Step 17:

[0106] User actions: Users trade their NFTs on online marketplaces and record the transactions on the blockchain.

[0107] Step 18:

[0108] Server action: Retrieve transaction history from the blockchain and record it in the database.

[0109] Step 19:

[0110] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[0111] (Example 1)

[0112] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0113] Traditional NFT systems struggled to efficiently manage campaign information and consistently oversee everything from user registration to NFT generation and distribution, reward granting, and facilitating secondary market share. Furthermore, the lack of a mechanism to grant rewards to generated NFTs and ensure those rewards carried over into secondary market share meant that the full value of NFTs was not being realized. This resulted in decreased user engagement and a weakened effectiveness of campaigns conducted by companies and organizations.

[0114] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0115] In this invention, the server includes means for inputting user information, means for transmitting the inputted user information, means for storing the transmitted user information, means for inputting campaign information, means for transmitting the campaign information to a generation AI model and generating an NFT, means for registering the generated NFT on the blockchain, means for distributing the generated NFT, means for granting benefits to users who own the generated NFT, and means for recording secondary transactions and granting benefits to new owners. This realizes a system that can centrally manage everything from user registration to NFT generation, distribution, benefit granting, and secondary transactions, making it possible to improve user engagement and maximize the effectiveness of campaigns for companies and organizations.

[0116] "Means for entering user information" refers to the means by which users enter their personal information, digital wallet addresses, etc., into a dedicated input form.

[0117] "Means for transmitting entered user information" refers to the means for sending information entered by a user to a server.

[0118] "Means for storing transmitted user information" refers to the means by which the server stores the received user information in a database.

[0119] "Means for entering campaign information" refers to the means by which companies and organizations enter information related to their campaigns (such as name, theme, and brand logo).

[0120] "Means for sending campaign information to a generation AI model and generating an NFT" refers to a means by which a server provides campaign information to a generation AI model and generates an original NFT.

[0121] "Methods for registering generated NFTs on the blockchain" refers to methods for recording generated NFTs on the blockchain as notarization.

[0122] "Means of distributing generated NFTs" refers to the means by which a company or organization distributes NFTs it has generated to specific users.

[0123] "Means of granting benefits to users who own generated NFTs" refers to the means by which users who own NFTs can receive benefits related to the campaign.

[0124] "Means of recording secondary transactions and providing benefits to new owners" refers to a means of recording information about new owners after NFTs have been traded on the secondary market, and providing benefits to those owners as well.

[0125] Modes for carrying out the invention

[0126] This invention is a system that consistently manages user information registration, campaign information input, NFT generation, distribution, reward granting, and secondary distribution. The program processing of this system will be described step by step.

[0127] User information registration

[0128] Users access a dedicated website and use a form to enter personal information such as their name, email address, and digital wallet address. This input form is created using HTML5 and validated on the client side using JavaScript. The entered data is sent to the server in JSON format using encrypted communication (SSL / TLS).

[0129] The server executes a PHP script to save the received user data to the MariaDB database. Once registration is complete, a confirmation email is sent to the user via the SMTP server.

[0130] Enter campaign information

[0131] Company and organization representatives log in to a dedicated management screen and enter information such as the campaign name, theme, and brand logo. The input form is subject to validation rules, and the information is checked accordingly.

[0132] Once campaign information is entered, the server uses a Python script to send a prompt to a generative AI model (e.g., GPT-3). This generative AI model generates an NFT based on the entered campaign information. An example of a specific prompt message is shown below:

[0133] "Please create an original NFT for our summer campaign. The theme is 'Summer Scenery,' and please use your brand logo."

[0134] NFT generation and registration

[0135] The generative AI model generates digital art based on campaign information and returns the data to the server in BASE64 format. The server registers this data on the Ethereum blockchain and obtains a token ID. This token ID is associated with the company's account and notified to the relevant person.

[0136] Distribution of NFTs

[0137] Company or organization representatives view a list of campaign participants from an administration screen and select specific users to receive NFTs. The server creates a transaction to send the token ID to the selected user's digital wallet address and sends it to the blockchain. The distribution history is recorded in a database, and reward information is added to the user's account.

[0138] Benefits

[0139] Users log in to the campaign website, display the NFTs they own, and apply for the reward. The server retrieves the NFT information from the user's digital wallet and verifies ownership. After that, the reward information is added to the user's account, and instructions on how to use it are displayed.

[0140] Management of the secondary market

[0141] Users can trade their NFTs on online marketplaces (such as OpenSea). The server uses blockchain APIs to retrieve transaction history and record it in a database. New owners are also granted or updated with bonus information.

[0142] This system allows for the consistent management of the entire process, from user information registration to NFT generation, distribution, reward granting, and secondary market management, thereby improving user engagement. It functions as a comprehensive solution to maximize the effectiveness of campaigns conducted by companies and organizations.

[0143] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0144] Step 1: Enter user information

[0145] Users access a dedicated website and enter personal information such as their name, email address, and digital wallet address. This input form is created using HTML5, and validation is performed using JavaScript.

[0146] input:

[0147] name

[0148] email address

[0149] Digital wallet address

[0150] output:

[0151] User data in JSON format

[0152] Specific actions:

[0153] The user opens a web browser, enters the required information, and clicks the "Submit" button.

[0154] Step 2: Send

[0155] The terminal converts the entered user data into JSON format and sends it to the server using the HTTPS protocol. Encrypted communication (SSL / TLS) is used during this process.

[0156] input:

[0157] User data in JSON format

[0158] output:

[0159] HTTPS request to the server

[0160] Specific actions:

[0161] The user's input information is encoded in JSON format by the device, and an HTTPS request is sent to the server.

[0162] Step 3: Save registration information

[0163] The server saves the received user data to the MariaDB database. A PHP script performs database operations and, upon success, sends a registration confirmation email using the SMTP server.

[0164] input:

[0165] User data in JSON format

[0166] output:

[0167] Adding records to the database

[0168] Sending a registration confirmation email

[0169] Specific actions:

[0170] The server inserts the received user data into the database, and a confirmation email is sent via a PHP script.

[0171] Step 4: Enter campaign information

[0172] Company representatives log in to a dedicated management screen and enter information such as the campaign name, theme, and brand logo. Form validation rules are then applied.

[0173] input:

[0174] Campaign Name

[0175] theme

[0176] Brand logo

[0177] output:

[0178] Campaign information in JSON format

[0179] Specific actions:

[0180] The company representative opens the backend management screen, enters the necessary campaign information, and clicks the "Request" button.

[0181] Step 5: Input into the Generative AI Model

[0182] The server uses a Python script to send the input campaign information as a prompt to a generating AI model (such as GPT-3), requesting it to generate an original NFT.

[0183] input:

[0184] Campaign information in JSON format

[0185] output:

[0186] Digital art data (BASE64 format) generated based on this.

[0187] Specific actions:

[0188] The server sends campaign information as a prompt to the generation AI model. Example prompt: "Generate an original NFT for our summer campaign. The theme is 'Summer Scenery,' and please use the brand logo."

[0189] Step 6: NFT creation and blockchain registration

[0190] The generation AI model generates original digital art data based on campaign information and sends it back to the server in BASE64 format. The digital art data is registered on the Ethereum blockchain, and a token ID is generated.

[0191] input:

[0192] Digital art data in BASE64 format

[0193] output:

[0194] Token ID

[0195] Specific actions:

[0196] The server registers the digital art data received from the generating AI model on the blockchain via a smart contract, obtains a token ID, and notifies the company.

[0197] Step 7: Select User Information

[0198] The company representative displays the campaign participant list from the management screen and selects the users to whom the NFTs will be distributed.

[0199] input:

[0200] List of campaign participants

[0201] output:

[0202] User data eligible for NFT distribution

[0203] Specific actions:

[0204] The company representative selects a specific user from the participant list and clicks the distribution button.

[0205] Step 8: Sending the Token ID

[0206] The server sends the token ID to the selected user's digital wallet address. A smart contract is used to transfer ownership of the token.

[0207] input:

[0208] User's digital wallet address

[0209] Token ID

[0210] output:

[0211] Transaction approval

[0212] Specific actions:

[0213] The server generates a transaction and sends the token ID to the user's digital wallet address.

[0214] Step 9: Recording the distribution history

[0215] The server records the distribution history of NFTs in a database and assigns reward information to the user's account.

[0216] input:

[0217] Transaction information

[0218] output:

[0219] Recording of distribution history in the database

[0220] Bonus information is provided.

[0221] Specific actions:

[0222] The server saves the distribution history to a database and adds the reward information to the user's account.

[0223] Step 10: Apply for benefits

[0224] Users log in to the campaign website, display the NFTs they own, and apply for the rewards.

[0225] input:

[0226] User account information

[0227] output:

[0228] Application for benefits

[0229] Specific actions:

[0230] Users log in to the campaign website, view a list of their owned NFTs, and click the reward application button.

[0231] Step 11: Ownership Verification

[0232] The server retrieves NFT information from the user's digital wallet and verifies ownership.

[0233] input:

[0234] User's digital wallet address

[0235] output:

[0236] Ownership confirmation result

[0237] Specific actions:

[0238] The server uses the Ethereum API to check the user's digital wallet and verify ownership.

[0239] Step 12: Granting of benefits

[0240] The server assigns the reward information to the user's account and displays instructions on how to use the reward.

[0241] input:

[0242] Ownership confirmation result

[0243] output:

[0244] Benefit Usage Information

[0245] Specific actions:

[0246] The server adds the reward information to the user's account and displays instructions on how to use the reward on the dashboard.

[0247] Step 13: NFT Transaction

[0248] Users trade their NFTs on an online marketplace, and this information is recorded on the blockchain.

[0249] input:

[0250] User NFTs

[0251] output:

[0252] Transaction records

[0253] Specific actions:

[0254] Users sell NFTs on the marketplace, and the transaction data is recorded on the blockchain.

[0255] Step 14: Recording Transaction History

[0256] The server retrieves transaction history from the blockchain and records it in a database.

[0257] input:

[0258] Transaction records

[0259] output:

[0260] Recording to the database

[0261] Specific actions:

[0262] The server uses the Ethereum REST API to retrieve transaction history and save it to a database.

[0263] Step 15: New Owner Verification

[0264] The server verifies the new owner's NFT information and grants or updates the benefits to that owner.

[0265] input:

[0266] New owner's wallet information

[0267] output:

[0268] Updated bonus information

[0269] Specific actions:

[0270] The server verifies the new owner's wallet data and grants or updates reward information.

[0271] (Application Example 1)

[0272] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0273] Traditional virtual stores lacked mechanisms to ensure users continuously enjoyed the benefits and value they received when purchasing products. Furthermore, the scope of available benefits was often limited, sometimes leading to low user engagement. This made long-term customer retention and transaction promotion a challenge for virtual stores.

[0274] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0275] In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting rewards, means for facilitating secondary trading, means for users to acquire NFTs when purchasing goods in a virtual store, means for users to receive rewards using the acquired NFTs, and means for users to trade the acquired NFTs with other users. This makes it possible for users to receive rewards while utilizing NFTs obtained through product purchases, and to continue to enjoy value by trading NFTs.

[0276] "Generation method" refers to a function for creating original NFTs based on information specified by users or companies.

[0277] "Methods for registering on the blockchain" refers to the function of recording the information of a generated NFT on the blockchain in a tamper-proof manner.

[0278] The "distribution means" is a function for transmitting the generated NFT to the digital wallet of a specified user.

[0279] The "means for granting privileges" is a function for providing specific services or items based on the NFTs owned by users.

[0280] The "means for promoting secondary circulation" is a function for a user to trade the NFTs they own with other users and record the transaction history on the blockchain.

[0281] The "means for a user to obtain an NFT when purchasing a product in a virtual store" is a function for automatically generating and obtaining an NFT when a user purchases a product in a virtual store.

[0282] The "means for a user to receive a privilege using the acquired NFT" is a function for a user to exchange a specific privilege by utilizing the acquired NFT.

[0283] The "means for a user to trade the acquired NFT with other users" is a function for a user to exchange the NFTs they own with other users and transfer the ownership.

[0284] This invention is a system for granting privileges and conducting transactions using NFTs (non-fungible tokens) to enhance user engagement in virtual stores. The processing of the program of this system will be specifically described below.

[0285] The server uses hardware and software including the following main functions. The hardware used includes a web server, a database server, a blockchain node, etc., and the software used includes Flask (a web framework), a generative AI model (such as GPT-3 and DALL-E), and a blockchain library (such as Ethereum and Hyperledger).

[0286] First, when a user purchases a product within an application, they register using the address of the digital wallet. The registration information is saved in the database by the server. At this time, based on the information input into the generative AI model, an original NFT is generated. For example, when a user purchases a "summer limited item", by providing that information as a prompt to the AI, the corresponding NFT is generated. The prompt text is in the following format.

[0287] Example of prompt text:

[0288] Campaign name: Summer Special Campaign

[0289] Theme: Summer memories

[0290] Brand logo: https: / / example.com / logo.png

[0291] User ID: 12345

[0292] Product ID: xyz678

[0293] The generated NFT is registered on the blockchain for anti-tampering and proof of ownership. Next, the generated NFT is sent to the user's digital wallet. The user can receive benefits using that NFT. For example, by participating in a campaign, they can obtain limited items or discount coupons.

[0294] Furthermore, the user can trade the acquired NFT with other users. The information of the traded NFT is recorded on the blockchain, and the new owner can also receive benefits in the same way. As a result, the value of the NFT is continuously maintained, and engagement within the virtual store improves.

[0295] As a concrete example, suppose user A purchases a limited-edition summer item in a virtual store and receives an NFT as a result of the purchase. Using this NFT, user A can receive a special discount. Subsequently, user A can transfer the NFT to their friend, user B, who can then enjoy the same benefits. This promotes interaction between users and continuously maintains the value and interest of the NFT.

[0296] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0297] Step 1:

[0298] When a user purchases a product, they enter their digital wallet address within the virtual store application and send the purchase information to the server.

[0299] Input: User's digital wallet address, product ID, purchase information

[0300] Output: Purchase information sent to the server

[0301] Specific operation: When a user selects a product and clicks the purchase button, the purchase information is sent to the server via the application.

[0302] Step 2:

[0303] The server saves the received purchase information to a database and verifies the purchase details to create prompts for the AI ​​model.

[0304] Input: Purchase information sent to the server

[0305] Output: Purchase information stored in the database, prompts for the generated AI model.

[0306] Specific operation: The server analyzes the purchase information, extracts the campaign name, theme, brand logo, user ID, product ID, etc., and provides the prompt text to the AI model for generating NFTs.

[0307] Step 3:

[0308] The server inputs the prompt text into the AI model for generating NFTs to generate original NFTs.

[0309] Input: Prompt text

[0310] Output: Generated NFT data

[0311] Specific operation: The AI model for generating NFTs analyzes the prompt text, generates original NFTs based on it, and returns the data to the server.

[0312] Step 4:

[0313] The server receives the generated NFT data and registers it on the blockchain.

[0314] Input: Generated NFT data

[0315] Output: Token ID on the blockchain

[0316] Specific operation: The server communicates with the blockchain node and records the NFT data as a transaction on the blockchain. When the registration is completed, a token ID is generated and returned to the server.

[0317] Step 5:

[0318] The server sends the obtained token ID to the user's digital wallet address to distribute the NFT.

[0319] Input: Token ID, user's digital wallet address

[0320] Output: NFTs registered in the user's digital wallet

[0321] Specific operation: The server assigns the token ID to the user's digital wallet address and distributes the NFT.

[0322] Step 6:

[0323] Users can use the acquired NFT to receive rewards within the application.

[0324] Input: NFTs registered in the user's digital wallet

[0325] Output: Benefits (e.g., discount coupons, limited-edition items)

[0326] Specific operation: When a user requests a reward within the application, the server verifies the wallet address and grants the reward.

[0327] Step 7:

[0328] Users can trade acquired NFTs with other users.

[0329] Input: Digital wallet address of the user trading the NFT, transaction information

[0330] Output: NFT registered to a new owner, transaction history

[0331] Specific operation: Users list their NFTs on an online marketplace, and once a transaction is completed, the server records the transaction information on the blockchain and transfers the NFT to the new owner's wallet.

[0332] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0333] The present invention is a system that includes means for generating, means for registering on a blockchain, means for distributing, means for granting benefits, means for facilitating secondary trading, and an emotion engine for recognizing user emotions. The processing of the program of this system is described in detail in natural language below.

[0334] User registration process

[0335] 1. User Action: Users access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[0336] 2. Terminal action: Send the entered information to the server.

[0337] 3. Server action: Save the received user information to the database.

[0338] 4. Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[0339] NFT generation request process

[0340] 1. Company Action: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[0341] 2. Terminal action: Send the entered campaign information to the server.

[0342] 3. Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[0343] 4. Measures taken by the generation AI model: Based on the provided campaign information, it generates an original NFT and returns the generated NFT data to the server.

[0344] 5. Server actions: Register the generated NFT on the blockchain and obtain the token ID.

[0345] 6. Server action: Assign the acquired token ID to the company's account and notify the company.

[0346] Emotion recognition process

[0347] 1. User actions: Users express their emotions through a webcam and microphone on the campaign site.

[0348] 2. Terminal actions: The acquired video and audio data is sent to the server.

[0349] 3. Server actions: The received data is input into the emotion engine to analyze the user's emotions.

[0350] 4. Emotion Engine Measures: Generate data to adjust the design and content of the NFT based on the user's emotions, and return it to the server.

[0351] NFT distribution process

[0352] 1. Company actions: Companies select a list of target users in order to distribute NFTs to campaign participants.

[0353] 2. Server action: Send the token ID to the selected user's digital wallet address.

[0354] 3. Server measures: Record the distribution history in the database and assign the reward information to the user's account.

[0355] Reward Granting Process

[0356] 1. User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[0357] 2. Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[0358] 3. Server action: The server will assign the reward information to the user's account and display the details of the reward and how to use it.

[0359] 4. Server measures: Based on the analysis results from the emotion engine, additional benefits corresponding to the user's emotions will be provided.

[0360] Secondary distribution promotion process

[0361] 1. User actions: Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[0362] 2. Server measures: Retrieve transaction history from the blockchain and record it in the database.

[0363] 3. Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[0364] As a concrete example, if company B conducts a "Spring Campaign," company B inputs campaign information and brand logo into a server. Based on this, a generation AI model generates an original NFT and registers it on the blockchain. Users express their emotions on the campaign website, and these emotions are analyzed by an emotion engine. Based on the analysis results, customized NFTs are distributed. Users can use these NFTs to apply for rewards and receive additional rewards tailored to their emotions. NFTs are traded on an online marketplace, and rewards are provided to new owners along with the transaction history.

[0365] This system allows companies to develop unique campaigns that incorporate user emotions, thereby increasing customer engagement and loyalty.

[0366] The following describes the processing flow.

[0367] Step 1:

[0368] User actions: Users must access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[0369] Step 2:

[0370] Terminal action: Send the entered information to the server.

[0371] Step 3:

[0372] Server action: Save the received user information to the database.

[0373] Step 4:

[0374] Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[0375] Step 5:

[0376] Company actions: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[0377] Step 6:

[0378] Terminal action: Send the entered campaign information to the server.

[0379] Step 7:

[0380] Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[0381] Step 8:

[0382] Generative AI model's actions: It generates an original NFT based on the provided campaign information and returns the generated NFT data to the server.

[0383] Step 9:

[0384] Server action: Register the generated NFT on the blockchain and obtain the token ID.

[0385] Step 10:

[0386] Server action: Assign the acquired token ID to the company's account and notify the company.

[0387] Step 11:

[0388] Company actions: Companies select a list of target users to distribute NFTs to campaign participants.

[0389] Step 12:

[0390] Server action: Send the token ID to the selected user's digital wallet address.

[0391] Step 13:

[0392] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[0393] Step 14:

[0394] User actions: Users will use a webcam and microphone on the campaign site to express emotions.

[0395] Step 15:

[0396] Terminal action: Send the acquired video and audio data to the server.

[0397] Step 16:

[0398] Server action: The received data is input into the emotion engine to analyze the user's emotions.

[0399] Step 17:

[0400] Emotion Engine Action: Based on the user's emotion analysis results, the system generates data to adjust the design and content of the NFT and returns it to the server.

[0401] Step 18:

[0402] Server action: Re-register the adjusted NFT data on the blockchain and obtain the updated token ID.

[0403] Step 19:

[0404] Server action: Send the updated NFT to the user's digital wallet.

[0405] Step 20:

[0406] User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[0407] Step 20:

[0408] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[0409] Step 21:

[0410] Server action: Grant reward information to the user's account and display details and instructions on how to use the reward.

[0411] Step 22:

[0412] Server action: Based on the sentiment analysis results, provide additional special benefits that correspond to the user's emotions.

[0413] Step 23:

[0414] User actions: Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[0415] Step 24:

[0416] Server action: Retrieve transaction history from the blockchain and record it in the database.

[0417] Step 25:

[0418] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[0419] (Example 2)

[0420] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0421] Traditional campaign systems lacked a mechanism to incorporate user emotions, generate digital content based on that emotion, and then reward users accordingly. This made it difficult to improve user engagement and provide personalized experiences. Furthermore, smoothly facilitating the secondary market for generated digital content (NFTs) and properly managing transaction information were also challenges.

[0422] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0423] In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting rewards, means for facilitating secondary trading, means for performing sentiment analysis, and means for adjusting the digital content based on the sentiment analysis results. This makes it possible to generate unique digital content (NFTs) that incorporate the user's emotions and to provide rewards that correspond to the user's emotions. Furthermore, it enables the smooth promotion of secondary trading and management of transaction information.

[0424] "Generation means" refers to a function that automatically creates digital content (NFTs) based on information entered by users or companies.

[0425] "Methods for registering on the blockchain" refers to the function of writing ownership information of generated digital content onto the blockchain and obtaining a token ID.

[0426] "Means of distribution" refers to the function of transmitting generated digital content to users or participants and transferring ownership.

[0427] "Means of providing benefits" refers to functions that offer campaign benefits or additional rewards to users who own digital content.

[0428] "Means to promote secondary distribution" refer to functions that support the re-trading of generated digital content on online marketplaces and manage transaction information on the blockchain.

[0429] "Means for performing emotion analysis" refers to a function that analyzes the user's video and audio data to recognize their emotions and utilize the results.

[0430] "Means for adjusting digital content based on sentiment analysis results" refers to a function for optimizing the design and content of digital content based on the user's emotions obtained through sentiment analysis.

[0431] This invention relates to a system that generates and distributes digital content (NFTs) based on user sentiment analysis results and appropriately grants benefits related to them. This system mainly consists of three elements: a server, a terminal, and a user.

[0432] First, the user accesses the campaign website. They enter the required information, such as their name, email address, and digital wallet address, into a web form on the site and submit it. This information is sent from the device to the server and stored in the server's database. After saving the data, the server sends a registration confirmation email to the user.

[0433] When a company requests NFT generation, the company representative enters campaign information (campaign name, theme, brand logo, etc.) through the management screen. This information is sent from the terminal to the server, and the server sends a request to the generation AI model based on the received information. The generation AI model generates an NFT based on the campaign information and returns the data to the server. The server registers the generated NFT on the blockchain and obtains a token ID. The obtained token ID is assigned to the company's account and the company is notified.

[0434] Next, in the user emotion analysis process, users express their emotions using a webcam and microphone on the campaign website. This video and audio data is sent from the device to the server, which inputs it into the emotion analysis engine for analysis. Based on the analysis results, the NFT is adjusted with a design and content that corresponds to the emotion and provided to the user.

[0435] In NFT distribution, companies distribute NFTs to a list of target users selected from campaign participants via an administration screen. The server sends the token ID to the user's digital wallet and records the distribution history and reward information in a database. Users can verify their owned NFTs and apply for rewards; once ownership is confirmed, the rewards are granted.

[0436] Furthermore, in the secondary market process, when a user trades an NFT on an online marketplace, the transaction information is recorded on the blockchain. The server retrieves this information and grants or updates benefits to the new owner.

[0437] As a concrete example, in the case of a "Spring Campaign," the company inputs campaign information and brand logo into the server, and based on that, a generation AI model generates an original NFT. Users express their emotions on the campaign site, and their emotions are analyzed by an emotion analysis engine, and a customized NFT is distributed. Users can use that NFT to apply for rewards and receive additional rewards according to their emotions. An example of a prompt message would be, "Please generate an NFT for the Spring Campaign. The theme is 'Flowers,' and the brand logo is 'the logo of XX Corporation.'"

[0438] This system can enhance customer engagement and loyalty by generating unique digital content (NFTs) that incorporate user emotions and offering rewards based on those experiences.

[0439] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0440] User registration process

[0441] Step 1:

[0442] User actions

[0443] Users access the campaign website, fill in the required information including their name, email address, and digital wallet address in the web form, and click the "Submit" button.

[0444] Input: Name, email address, digital wallet address

[0445] Output: Input data is sent to the terminal.

[0446] Step 2:

[0447] Terminal measures

[0448] The terminal sends the entered information to the server as an HTTP POST request.

[0449] Input: Information entered by the user

[0450] Output: Information is sent to the server.

[0451] Step 3:

[0452] Server measures

[0453] The server stores the received user information in a database. Specifically, it establishes a database connection, executes SQL queries, and saves the user information.

[0454] Input: User information sent from the device

[0455] Output: Information stored in the database

[0456] Step 4:

[0457] Server measures

[0458] The server sends a registration confirmation email to the user to notify them that registration is complete. Specifically, it uses an SMTP server to send the email.

[0459] Input: User's email address

[0460] Output: A registration confirmation email is sent to the user.

[0461] NFT generation request process

[0462] Step 1:

[0463] Corporate measures

[0464] Companies enter campaign information from the administration screen and click the "Request Generation" button.

[0465] Input: Campaign name, theme, brand logo

[0466] Output: Input data is sent to the terminal.

[0467] Step 2:

[0468] Terminal measures

[0469] The terminal sends the entered campaign information to the server as an HTTP POST request.

[0470] Input: Campaign information entered by the company

[0471] Output: Information is sent to the server.

[0472] Step 3:

[0473] Server measures

[0474] The server sends a request to the generating AI model based on the received campaign information. Specifically, it generates a prompt message and sends a request to the generating AI model's API.

[0475] Input: Company campaign information

[0476] Output: Request to the Generative AI Model

[0477] Step 4:

[0478] Measures taken by generative AI models

[0479] The generative AI model generates an original NFT based on the provided information and returns the generated data to the server.

[0480] Input: Request from server

[0481] Output: Generated NFT data

[0482] Step 5:

[0483] Server measures

[0484] The server registers the generated NFT on the blockchain and obtains a token ID. Specifically, it registers the data using the blockchain API.

[0485] Input: NFT data from generated AI models

[0486] Output: Token ID registered on the blockchain

[0487] Step 6:

[0488] Server measures

[0489] The acquired token ID is assigned to the company's account, and a notification is sent via email or dashboard.

[0490] Input: Token ID

[0491] Output: Assigned to the corporate account and a notification is sent.

[0492] Emotion recognition process

[0493] Step 1:

[0494] User actions

[0495] Users express their emotions using a webcam and microphone on the campaign website.

[0496] Input: User's video and audio data

[0497] Output: Video and audio data are acquired by the device.

[0498] Step 2:

[0499] Terminal measures

[0500] The acquired video and audio data is encoded and sent to the server as an HTTP POST request.

[0501] Input: User's video and audio data

[0502] Output: Data sent to the server

[0503] Step 3:

[0504] Server measures

[0505] The received data is input into the emotion engine for analysis. Specifically, the data is sent to the emotion engine's API, and the analysis results are received.

[0506] Input: Data sent from the device

[0507] Output: Data sent to the emotion engine

[0508] Step 4:

[0509] Emotional Engine Measures

[0510] The emotion engine generates data to adjust the design and content based on the analysis results and returns it to the server.

[0511] Input: Data from the server

[0512] Output: Analysis results and adjustment data

[0513] NFT distribution process

[0514] Step 1:

[0515] Corporate measures

[0516] Companies select the target user list from the administration screen and click the "Distribute NFT" button.

[0517] Input: List of target users

[0518] Output: Selected user information is sent to the server.

[0519] Step 2:

[0520] Server measures

[0521] The server sends the token ID to the selected user's digital wallet. Specifically, it uses the blockchain API to send the token ID to the wallet.

[0522] Input: Digital wallet address and token ID of the target user

[0523] Output: Token ID is sent to the wallet.

[0524] Step 3:

[0525] Server measures

[0526] The distribution history is recorded in a database, and the bonus information is added to the user's account.

[0527] Input: Distribution history and bonus information

[0528] Output: Distribution history and bonus information stored in the database

[0529] Reward Granting Process

[0530] Step 1:

[0531] User actions

[0532] Users log in to the campaign website, verify their NFTs, and apply for the rewards.

[0533] Input: Owned NFT information

[0534] Output: Application information is sent to the server.

[0535] Step 2:

[0536] Server measures

[0537] The system retrieves NFT information from the user's digital wallet and verifies ownership. Specifically, it uses a blockchain API to verify NFT ownership.

[0538] Input: User's digital wallet information

[0539] Output: Ownership verification result

[0540] Step 3:

[0541] Server measures

[0542] The system assigns reward information to the user's account and displays details and instructions on how to use the rewards.

[0543] Input: Bonus information and ownership verification results

[0544] Output: The reward is credited to the user's account.

[0545] Step 4:

[0546] Server measures

[0547] Based on the analysis results of the emotion engine, additional benefits corresponding to emotions will be provided.

[0548] Input: Sentiment analysis results

[0549] Output: Additional benefits will be provided.

[0550] Secondary distribution promotion process

[0551] Step 1:

[0552] User actions

[0553] Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[0554] Input: Transaction Information

[0555] Output: Transaction information is recorded on the blockchain.

[0556] Step 2:

[0557] Server measures

[0558] The server retrieves transaction history from the blockchain and records it in a database. Specifically, it periodically retrieves transaction information via the blockchain API.

[0559] Input: Blockchain transaction information

[0560] Output: Transaction history stored in the database

[0561] Step 3:

[0562] Server measures

[0563] Verify the NFT information of the new owner and grant or update the benefits to that owner.

[0564] Input: New owner's information

[0565] Output: The benefit is granted or renewed to the new owner.

[0566] (Application Example 2)

[0567] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0568] Traditional campaign systems and customer engagement strategies have difficulty directly leveraging user emotions, and they do not offer customized rewards or items based on those emotions. As a result, companies have been unable to maximize customer satisfaction and experiential value, and their marketing effectiveness has been limited.

[0569] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting benefits, means for promoting secondary distribution, means for recognizing the user's emotions, means for customizing the NFT generated based on emotion recognition, and means for participating in campaigns at physical stores. This makes it possible to maximize customer satisfaction and experiential value and enhance the marketing effectiveness of companies by recognizing the user's emotions and providing customized NFTs and benefits accordingly.

[0570] "Means of generation" refers to methods for generating digital content using AI technology based on information provided by users and companies.

[0571] "Methods of registering on a blockchain" refer to the means of recording generated digital content or NFTs on a distributed ledger to guarantee their existence.

[0572] "Means of distribution" refers to the means of transferring generated NFTs or digital content to specific users and distributing ownership of them.

[0573] "Means of granting benefits" refers to means of providing specific rewards or benefits based on NFTs owned by users.

[0574] "Means to facilitate secondary trading" refer to means that when generated NFTs are traded between other users, transactions are tracked and recorded, and benefits are provided to the new owners.

[0575] "Means of recognizing user emotions" refers to methods for identifying a user's emotional state by utilizing technologies that analyze emotions from the user's facial expressions, voice, etc.

[0576] "Means for customizing NFTs generated based on emotion recognition" refers to means of changing the design and content of generated NFTs according to the recognized emotions of the user, thereby providing more personalized content.

[0577] "Means of participating in in-store campaigns" refers to the means by which users can participate in marketing events and campaigns held at physical stores.

[0578] The system that realizes this invention is composed of a combination of a smartphone, a server, blockchain technology, AI technology, and emotion recognition technology. The processing of the system's program is described below.

[0579] First, the user accesses the application using their smartphone. The application provides an interface for the user to enter their name, email address, and digital wallet address. This information is sent from the smartphone to the server, which stores it in a database. The server then sends a registration confirmation email to the user, completing the user registration process.

[0580] Next, to participate in the campaign at a physical store, the user scans a campaign-specific QR code using their smartphone. Once their participation is approved, the user expresses their emotions using their smartphone's camera and microphone. The smartphone device captures the user's facial expressions and voice data and sends it to the server.

[0581] The server inputs the received video and audio data into an emotion recognition engine (such as Microsoft Azure Cognitive Services) to analyze the user's emotions. The analyzed emotion data is sent to a generative AI model (OpenAI GPT-4). The generative AI model generates an original NFT based on the provided emotion data and campaign information. The generated NFT is registered on the blockchain by the server, and a token ID is obtained. This token ID is sent to the user's digital wallet.

[0582] Users can view their owned NFTs by checking their digital wallets. The server grants rewards for owned NFTs, which may be added based on the user's sentiment. Owned NFTs can also be traded with other users, and this transaction information is recorded on the blockchain. The server tracks the transaction history and provides similar rewards to new owners.

[0583] This system allows users to acquire customized NFTs tailored to their emotions and enjoy rewards. It also enables businesses to enhance emotion-based engagement.

[0584] A concrete example is the "Cherry Blossom Festival Campaign." In this campaign, the following prompt sentences are input to the generating AI model.

[0585] Prompt: For the cherry blossom festival campaign theme, generate an NFT with a design that evokes the feeling of spring, based on the user's smiling face.

[0586] Based on this prompt, the AI ​​model generates a spring-themed NFT incorporating the user's smiling face into its design and distributes it to the user. In this way, a unique digital campaign that makes the most of the user's emotions can be realized.

[0587] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0588] Step 1:

[0589] The user accesses the application using their smartphone and enters their name, email address, and digital wallet address. They enter the information into the input form on the smartphone screen and tap the "Register" button. This action sends the entered data from the device to the server.

[0590] Input: Name, email address, digital wallet address

[0591] Output: User information sent to the server

[0592] Step 2:

[0593] The server saves the received user information to the database. SQL statements related to saving the user information are executed in the database. If the saving is successful, the server generates a registration confirmation email and sends it to the user's email address.

[0594] Input: Received user information

[0595] Output: User information stored in the database, registration confirmation email sent.

[0596] Step 3:

[0597] Users scan the campaign's QR code with their smartphones at physical stores. They activate their smartphone's camera and read the QR code. This information is sent to the server as campaign participation information.

[0598] Input: Campaign QR code

[0599] Output: Campaign participation information sent to the server

[0600] Step 4:

[0601] The server receives campaign participation information and prepares to recognize the user's emotions. This involves calling the emotion recognition engine. The user expresses their emotions using their smartphone's camera and microphone.

[0602] Input: Campaign participation information

[0603] Output: Instructions for expressing emotions

[0604] Step 5:

[0605] The smartphone device acquires the user's facial expressions and voice data and transmits it to the server in real time. The data is compressed and efficiently sent to the server using a transfer protocol.

[0606] Input: Facial expression data, audio data

[0607] Output: Sentiment data sent to the server

[0608] Step 6:

[0609] The server inputs the received video and audio data into an emotion recognition engine (such as Microsoft Azure Cognitive Services) to analyze the user's emotions. The analysis results are stored as emotion data and sent to the generating AI model.

[0610] Input: Received video and audio data

[0611] Output: Analyzed sentiment data

[0612] Step 7:

[0613] The generative AI model (OpenAI GPT-4) generates original NFTs based on the provided sentiment data and campaign information. The generative AI model receives campaign information as input in the form of prompt sentences.

[0614] Input: Sentiment data, campaign information

[0615] Output: Generated NFT data

[0616] Step 8:

[0617] The server registers the generated NFT on the blockchain. This includes creating and confirming the transaction. It connects to the blockchain network and obtains the token ID.

[0618] Input: Generated NFT data

[0619] Output: Token ID registered on the blockchain

[0620] Step 9:

[0621] The server sends the acquired token ID to the user's digital wallet and notifies the user that the NFT has been distributed. The distribution history is also recorded in the database.

[0622] Input: Token ID

[0623] Output: Token ID sent to digital wallet, updated database

[0624] Step 10:

[0625] The server grants rewards based on NFT information obtained from the user's digital wallet. Emotion-based rewards are also added. Reward information is reflected in the user's account and the user is notified.

[0626] Input: NFT information from a digital wallet

[0627] Output: Benefits granted to the user, updated user account information

[0628] Step 11:

[0629] When a user resells an NFT, the new transaction information is recorded on the blockchain. The server retrieves the transaction history and provides benefits to the new owner.

[0630] Input: Blockchain transaction information

[0631] Output: Updated transaction history, benefits granted to the new owner

[0632] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0633] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0634] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0635] [Second Embodiment]

[0636] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0637] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0638] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0639] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0640] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0641] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0642] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0643] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0644] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0645] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0646] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0647] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0648] The present invention is a system that includes means for generating, means for registering on a blockchain, means for distributing, means for granting benefits, and means for facilitating secondary trading. The processing of the program of this system will be described in detail in natural language below.

[0649] User registration process

[0650] 1. Enter user information

[0651] User actions: To participate in the campaign, users must enter their name, email address, and digital wallet address on a dedicated website.

[0652] 2. Sending data

[0653] Terminal action: Send the entered user data to the server.

[0654] 3. Saving registration information

[0655] Server action: The received user data is saved to the database, and a registration confirmation email is sent to the user.

[0656] NFT generation request process

[0657] 1. Enter campaign information

[0658] Corporate actions: Companies enter necessary information such as the campaign name, theme, and brand logo, and request NFT generation.

[0659] 2. Input to the Generative AI Model

[0660] Server actions: Provide campaign information to the AI ​​model that generates it, and process it to generate the original NFT.

[0661] 3. NFT creation and blockchain registration

[0662] Generative AI model's actions: It generates original NFTs based on the input campaign information and returns the generated NFT data to the server.

[0663] Server actions: Register the generated NFT on the blockchain and obtain the token ID. Then, assign the token ID to the company and notify them.

[0664] NFT distribution process

[0665] 1. Select User Information

[0666] Company actions: Companies select users to distribute NFTs to from a list of campaign participants.

[0667] 2. Sending the Token ID

[0668] Server action: Send the token ID to the selected user's digital wallet address.

[0669] 3. Record of distribution history

[0670] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[0671] Reward Granting Process

[0672] 1. Application for benefits

[0673] User actions: Users log in to the campaign site, display the NFTs they own, and apply for the reward.

[0674] 2. Ownership confirmation

[0675] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[0676] 3. Granting of benefits

[0677] Server action: Grant reward information to the user's account and display instructions on how to use the reward.

[0678] Secondary distribution promotion process

[0679] 1. NFT trading

[0680] User actions: Users trade their NFTs on online marketplaces. This information is recorded on the blockchain.

[0681] 2. Record of transaction history

[0682] Server action: Retrieve transaction history from the blockchain and record it in the database.

[0683] 3. Verification of the new owner

[0684] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[0685] For example, if company A conducts a "summer campaign," company A inputs campaign information and brand logo into a server. Based on this, a generation AI model generates an original NFT and registers it on the blockchain. The registered NFT is distributed to campaign participants, who can receive their rewards along with their application. Furthermore, users can trade the NFT on an online marketplace, and new owners can also receive rewards, thus continuously maintaining the value and appeal of the NFT.

[0686] The following describes the processing flow.

[0687] Step 1:

[0688] User actions: Users must access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[0689] Step 2:

[0690] Terminal action: Send the entered information to the server.

[0691] Step 3:

[0692] Server action: Save the received user information to the database.

[0693] Step 4:

[0694] Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[0695] Step 5:

[0696] Company actions: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[0697] Step 6:

[0698] Terminal action: Send the entered campaign information to the server.

[0699] Step 7:

[0700] Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[0701] Step 8:

[0702] Generative AI model's actions: It generates an original NFT based on the provided campaign information and returns the generated NFT data to the server.

[0703] Step 9:

[0704] Server action: Register the generated NFT on the blockchain and obtain the token ID.

[0705] Step 10:

[0706] Server action: Assign the acquired token ID to the company's account and notify the company.

[0707] Step 11:

[0708] Company actions: Companies select a list of target users to distribute NFTs to campaign participants.

[0709] Step 12:

[0710] Server action: Send the token ID to the selected user's digital wallet address.

[0711] Step 13:

[0712] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[0713] Step 14:

[0714] User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[0715] Step 15:

[0716] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[0717] Step 16:

[0718] Server action: Grant reward information to the user's account and display details and instructions on how to use the reward.

[0719] Step 17:

[0720] User actions: Users trade their NFTs on online marketplaces and record the transactions on the blockchain.

[0721] Step 18:

[0722] Server action: Retrieve transaction history from the blockchain and record it in the database.

[0723] Step 19:

[0724] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[0725] (Example 1)

[0726] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0727] Traditional NFT systems struggled to efficiently manage campaign information and consistently oversee everything from user registration to NFT generation and distribution, reward granting, and facilitating secondary market share. Furthermore, the lack of a mechanism to grant rewards to generated NFTs and ensure those rewards carried over into secondary market share meant that the full value of NFTs was not being realized. This resulted in decreased user engagement and a weakened effectiveness of campaigns conducted by companies and organizations.

[0728] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0729] In this invention, the server includes means for inputting user information, means for transmitting the inputted user information, means for storing the transmitted user information, means for inputting campaign information, means for transmitting the campaign information to a generation AI model and generating an NFT, means for registering the generated NFT on the blockchain, means for distributing the generated NFT, means for granting benefits to users who own the generated NFT, and means for recording secondary transactions and granting benefits to new owners. This realizes a system that can centrally manage everything from user registration to NFT generation, distribution, benefit granting, and secondary transactions, making it possible to improve user engagement and maximize the effectiveness of campaigns for companies and organizations.

[0730] "Means for entering user information" refers to the means by which users enter their personal information, digital wallet addresses, etc., into a dedicated input form.

[0731] "Means for transmitting entered user information" refers to the means for sending information entered by a user to a server.

[0732] "Means for storing transmitted user information" refers to the means by which the server stores the received user information in a database.

[0733] "Means for entering campaign information" refers to the means by which companies and organizations enter information related to their campaigns (such as name, theme, and brand logo).

[0734] "Means for sending campaign information to a generation AI model and generating an NFT" refers to a means by which a server provides campaign information to a generation AI model and generates an original NFT.

[0735] "Methods for registering generated NFTs on the blockchain" refers to methods for recording generated NFTs on the blockchain as notarization.

[0736] "Means of distributing generated NFTs" refers to the means by which a company or organization distributes NFTs it has generated to specific users.

[0737] "Means of granting benefits to users who own generated NFTs" refers to the means by which users who own NFTs can receive benefits related to the campaign.

[0738] "Means of recording secondary transactions and providing benefits to new owners" refers to a means of recording information about new owners after NFTs have been traded on the secondary market, and providing benefits to those owners as well.

[0739] Modes for carrying out the invention

[0740] This invention is a system that consistently manages user information registration, campaign information input, NFT generation, distribution, reward granting, and secondary distribution. The program processing of this system will be described step by step.

[0741] User information registration

[0742] Users access a dedicated website and use a form to enter personal information such as their name, email address, and digital wallet address. This input form is created using HTML5 and validated on the client side using JavaScript. The entered data is sent to the server in JSON format using encrypted communication (SSL / TLS).

[0743] The server executes a PHP script to save the received user data to the MariaDB database. Once registration is complete, a confirmation email is sent to the user via the SMTP server.

[0744] Enter campaign information

[0745] Company and organization representatives log in to a dedicated management screen and enter information such as the campaign name, theme, and brand logo. The input form is subject to validation rules, and the information is checked accordingly.

[0746] Once campaign information is entered, the server uses a Python script to send a prompt to a generative AI model (e.g., GPT-3). This generative AI model generates an NFT based on the entered campaign information. An example of a specific prompt message is shown below:

[0747] "Please create an original NFT for our summer campaign. The theme is 'Summer Scenery,' and please use your brand logo."

[0748] NFT generation and registration

[0749] The generative AI model generates digital art based on campaign information and returns the data to the server in BASE64 format. The server registers this data on the Ethereum blockchain and obtains a token ID. This token ID is associated with the company's account and notified to the relevant person.

[0750] Distribution of NFTs

[0751] Company or organization representatives view a list of campaign participants from an administration screen and select specific users to receive NFTs. The server creates a transaction to send the token ID to the selected user's digital wallet address and sends it to the blockchain. The distribution history is recorded in a database, and reward information is added to the user's account.

[0752] Benefits

[0753] Users log in to the campaign website, display the NFTs they own, and apply for the reward. The server retrieves the NFT information from the user's digital wallet and verifies ownership. After that, the reward information is added to the user's account, and instructions on how to use it are displayed.

[0754] Management of the secondary market

[0755] Users can trade their NFTs on online marketplaces (such as OpenSea). The server uses blockchain APIs to retrieve transaction history and record it in a database. New owners are also granted or updated with bonus information.

[0756] This system allows for the consistent management of the entire process, from user information registration to NFT generation, distribution, reward granting, and secondary market management, thereby improving user engagement. It functions as a comprehensive solution to maximize the effectiveness of campaigns conducted by companies and organizations.

[0757] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0758] Step 1: Enter user information

[0759] Users access a dedicated website and enter personal information such as their name, email address, and digital wallet address. This input form is created using HTML5, and validation is performed using JavaScript.

[0760] input:

[0761] name

[0762] email address

[0763] Digital wallet address

[0764] output:

[0765] User data in JSON format

[0766] Specific actions:

[0767] The user opens a web browser, enters the required information, and clicks the "Submit" button.

[0768] Step 2: Send

[0769] The terminal converts the entered user data into JSON format and sends it to the server using the HTTPS protocol. Encrypted communication (SSL / TLS) is used during this process.

[0770] input:

[0771] User data in JSON format

[0772] output:

[0773] HTTPS request to the server

[0774] Specific actions:

[0775] The user's input information is encoded in JSON format by the device, and an HTTPS request is sent to the server.

[0776] Step 3: Save registration information

[0777] The server saves the received user data to the MariaDB database. A PHP script performs database operations and, upon success, sends a registration confirmation email using the SMTP server.

[0778] input:

[0779] User data in JSON format

[0780] output:

[0781] Adding records to the database

[0782] Sending a registration confirmation email

[0783] Specific actions:

[0784] The server inserts the received user data into the database, and a confirmation email is sent via a PHP script.

[0785] Step 4: Enter campaign information

[0786] Company representatives log in to a dedicated management screen and enter information such as the campaign name, theme, and brand logo. Form validation rules are then applied.

[0787] input:

[0788] Campaign Name

[0789] theme

[0790] Brand logo

[0791] output:

[0792] Campaign information in JSON format

[0793] Specific actions:

[0794] The company representative opens the backend management screen, enters the necessary campaign information, and clicks the "Request" button.

[0795] Step 5: Input into the Generative AI Model

[0796] The server uses a Python script to send the input campaign information as a prompt to a generating AI model (such as GPT-3), requesting it to generate an original NFT.

[0797] input:

[0798] Campaign information in JSON format

[0799] output:

[0800] Digital art data (BASE64 format) generated based on this.

[0801] Specific actions:

[0802] The server sends campaign information as a prompt to the generation AI model. Example prompt: "Generate an original NFT for our summer campaign. The theme is 'Summer Scenery,' and please use the brand logo."

[0803] Step 6: NFT creation and blockchain registration

[0804] The generation AI model generates original digital art data based on campaign information and sends it back to the server in BASE64 format. The digital art data is registered on the Ethereum blockchain, and a token ID is generated.

[0805] input:

[0806] Digital art data in BASE64 format

[0807] output:

[0808] Token ID

[0809] Specific actions:

[0810] The server registers the digital art data received from the generating AI model on the blockchain via a smart contract, obtains a token ID, and notifies the company.

[0811] Step 7: Select User Information

[0812] The company representative displays the campaign participant list from the management screen and selects the users to whom the NFTs will be distributed.

[0813] input:

[0814] List of campaign participants

[0815] output:

[0816] User data eligible for NFT distribution

[0817] Specific actions:

[0818] The company representative selects a specific user from the participant list and clicks the distribution button.

[0819] Step 8: Sending the Token ID

[0820] The server sends the token ID to the selected user's digital wallet address. A smart contract is used to transfer ownership of the token.

[0821] input:

[0822] User's digital wallet address

[0823] Token ID

[0824] output:

[0825] Transaction approval

[0826] Specific actions:

[0827] The server generates a transaction and sends the token ID to the user's digital wallet address.

[0828] Step 9: Recording the distribution history

[0829] The server records the distribution history of NFTs in a database and assigns reward information to the user's account.

[0830] input:

[0831] Transaction information

[0832] output:

[0833] Recording of distribution history in the database

[0834] Bonus information is provided.

[0835] Specific actions:

[0836] The server saves the distribution history to a database and adds the reward information to the user's account.

[0837] Step 10: Apply for benefits

[0838] Users log in to the campaign website, display the NFTs they own, and apply for the rewards.

[0839] input:

[0840] User account information

[0841] output:

[0842] Application for benefits

[0843] Specific actions:

[0844] Users log in to the campaign website, view a list of their owned NFTs, and click the reward application button.

[0845] Step 11: Ownership Verification

[0846] The server retrieves NFT information from the user's digital wallet and verifies ownership.

[0847] input:

[0848] User's digital wallet address

[0849] output:

[0850] Ownership confirmation result

[0851] Specific actions:

[0852] The server uses the Ethereum API to check the user's digital wallet and verify ownership.

[0853] Step 12: Granting of benefits

[0854] The server assigns the reward information to the user's account and displays instructions on how to use the reward.

[0855] input:

[0856] Ownership confirmation result

[0857] output:

[0858] Benefit Usage Information

[0859] Specific actions:

[0860] The server adds the reward information to the user's account and displays instructions on how to use the reward on the dashboard.

[0861] Step 13: NFT Transaction

[0862] Users trade their NFTs on an online marketplace, and this information is recorded on the blockchain.

[0863] input:

[0864] User NFTs

[0865] output:

[0866] Transaction records

[0867] Specific actions:

[0868] Users sell NFTs on the marketplace, and the transaction data is recorded on the blockchain.

[0869] Step 14: Recording Transaction History

[0870] The server retrieves transaction history from the blockchain and records it in a database.

[0871] input:

[0872] Transaction records

[0873] output:

[0874] Recording to the database

[0875] Specific actions:

[0876] The server uses the Ethereum REST API to retrieve transaction history and save it to a database.

[0877] Step 15: New Owner Verification

[0878] The server verifies the new owner's NFT information and grants or updates the benefits to that owner.

[0879] input:

[0880] New owner's wallet information

[0881] output:

[0882] Updated bonus information

[0883] Specific actions:

[0884] The server verifies the new owner's wallet data and grants or updates reward information.

[0885] (Application Example 1)

[0886] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0887] Traditional virtual stores lacked mechanisms to ensure users continuously enjoyed the benefits and value they received when purchasing products. Furthermore, the scope of available benefits was often limited, sometimes leading to low user engagement. This made long-term customer retention and transaction promotion a challenge for virtual stores.

[0888] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0889] In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting rewards, means for facilitating secondary trading, means for users to acquire NFTs when purchasing goods in a virtual store, means for users to receive rewards using the acquired NFTs, and means for users to trade the acquired NFTs with other users. This makes it possible for users to receive rewards while utilizing NFTs obtained through product purchases, and to continue to enjoy value by trading NFTs.

[0890] "Generation method" refers to a function for creating original NFTs based on information specified by users or companies.

[0891] "Methods for registering on the blockchain" refers to the function of recording the information of a generated NFT on the blockchain in a tamper-proof manner.

[0892] "Means of distribution" refers to the function of sending the generated NFT to the digital wallet of a designated user.

[0893] "Means of granting benefits" refers to functions that provide specific services or items based on NFTs owned by users.

[0894] "Means to promote secondary trading" refers to a function that allows users to trade NFTs they own with other users and records the transaction history on the blockchain.

[0895] "Means for obtaining NFTs when a user purchases products in a virtual store" refers to a function that automatically generates and obtains NFTs when a user purchases products in a virtual store.

[0896] "A means of receiving rewards using NFTs acquired by the user" refers to a function that allows users to redeem specific rewards by utilizing NFTs they have acquired.

[0897] "A means for users to trade NFTs they have acquired with other users" refers to a function that allows users to exchange NFTs they own with other users and transfer ownership of those NFTs.

[0898] This invention is a system for granting rewards and conducting transactions using NFTs (Non-Fungible Tokens) to enhance user engagement in virtual stores. The program processing of this system is described in detail below.

[0899] The server will utilize hardware and software that include the following key functions. The hardware will include a web server, database server, and blockchain nodes, while the software will utilize Flask (a web framework), generative AI models (such as GPT-3 and DALL-E), and blockchain libraries (such as Ethereum and Hyperledger).

[0900] First, when a user purchases an item within the application, they register using their digital wallet address. This registration information is stored in a database by the server. At this point, the AI ​​model generates an original NFT based on the input information. For example, if a user purchases a "summer limited item," providing this information to the AI ​​as a prompt generates the corresponding NFT. The prompt message takes the following format:

[0901] Example of a prompt:

[0902] Campaign Name: Summer Special Campaign

[0903] Theme: Summer Memories

[0904] Brand logo: https: / / example.com / logo.png

[0905] User ID: 12345

[0906] Product ID:xyz678

[0907] The generated NFTs are registered on the blockchain to prevent tampering and prove ownership. Next, the generated NFTs are sent to the user's digital wallet. The user can then use the NFTs to receive rewards. For example, they might be able to obtain exclusive items or discount coupons by participating in a campaign.

[0908] Furthermore, users can trade acquired NFTs with other users. Information on traded NFTs is recorded on the blockchain, and new owners can also receive the same benefits. This ensures that the value of NFTs is continuously maintained and enhances engagement within virtual stores.

[0909] As a concrete example, suppose user A purchases a limited-edition summer item in a virtual store and receives an NFT as a result of the purchase. Using this NFT, user A can receive a special discount. Subsequently, user A can transfer the NFT to their friend, user B, who can then enjoy the same benefits. This promotes interaction between users and continuously maintains the value and interest of the NFT.

[0910] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0911] Step 1:

[0912] When a user purchases a product, they enter their digital wallet address within the virtual store application and send the purchase information to the server.

[0913] Input: User's digital wallet address, product ID, purchase information

[0914] Output: Purchase information sent to the server

[0915] Specific operation: When a user selects a product and clicks the purchase button, the purchase information is sent to the server via the application.

[0916] Step 2:

[0917] The server saves the received purchase information to a database and verifies the purchase details to create prompts for the AI ​​model.

[0918] Input: Purchase information sent to the server

[0919] Output: Purchase information stored in the database, prompts for the generated AI model.

[0920] Specific operation: The server analyzes purchase information, extracts campaign name, theme, brand logo, user ID, product ID, etc., and provides this information to the AI ​​model that generates prompt messages.

[0921] Step 3:

[0922] The server takes prompt messages into the generating AI model to create an original NFT.

[0923] Input: Prompt message

[0924] Output: Generated NFT data

[0925] Specific operation: The generation AI model analyzes the prompt text, generates an original NFT based on it, and returns that data to the server.

[0926] Step 4:

[0927] The server receives the generated NFT data and registers it on the blockchain.

[0928] Input: Generated NFT data

[0929] Output: Token ID on the blockchain

[0930] Specific operation: The server communicates with the blockchain node and records the NFT data as a transaction on the blockchain. Once registration is complete, a token ID is generated and returned to the server.

[0931] Step 5:

[0932] The server sends the acquired token ID to the user's digital wallet address and distributes the NFT.

[0933] Input: Token ID, User's digital wallet address

[0934] Output: NFTs registered in the user's digital wallet

[0935] Specific operation: The server assigns the token ID to the user's digital wallet address and distributes the NFT.

[0936] Step 6:

[0937] Users can use the acquired NFT to receive rewards within the application.

[0938] Input: NFTs registered in the user's digital wallet

[0939] Output: Benefits (e.g., discount coupons, limited-edition items)

[0940] Specific operation: When a user requests a reward within the application, the server verifies the wallet address and grants the reward.

[0941] Step 7:

[0942] Users can trade acquired NFTs with other users.

[0943] Input: Digital wallet address of the user trading the NFT, transaction information

[0944] Output: NFT registered to a new owner, transaction history

[0945] Specific operation: Users list their NFTs on an online marketplace, and once a transaction is completed, the server records the transaction information on the blockchain and transfers the NFT to the new owner's wallet.

[0946] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0947] The present invention is a system that includes means for generating, means for registering on a blockchain, means for distributing, means for granting benefits, means for facilitating secondary trading, and an emotion engine for recognizing user emotions. The processing of the program of this system is described in detail in natural language below.

[0948] User registration process

[0949] 1. User Action: Users access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[0950] 2. Terminal action: Send the entered information to the server.

[0951] 3. Server action: Save the received user information to the database.

[0952] 4. Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[0953] NFT generation request process

[0954] 1. Company Action: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[0955] 2. Terminal action: Send the entered campaign information to the server.

[0956] 3. Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[0957] 4. Measures taken by the generation AI model: Based on the provided campaign information, it generates an original NFT and returns the generated NFT data to the server.

[0958] 5. Server actions: Register the generated NFT on the blockchain and obtain the token ID.

[0959] 6. Server action: Assign the acquired token ID to the company's account and notify the company.

[0960] Emotion recognition process

[0961] 1. User actions: Users express their emotions through a webcam and microphone on the campaign site.

[0962] 2. Terminal actions: The acquired video and audio data is sent to the server.

[0963] 3. Server actions: The received data is input into the emotion engine to analyze the user's emotions.

[0964] 4. Emotion Engine Measures: Generate data to adjust the design and content of the NFT based on the user's emotions, and return it to the server.

[0965] NFT distribution process

[0966] 1. Company actions: Companies select a list of target users in order to distribute NFTs to campaign participants.

[0967] 2. Server action: Send the token ID to the selected user's digital wallet address.

[0968] 3. Server measures: Record the distribution history in the database and assign the reward information to the user's account.

[0969] Reward Granting Process

[0970] 1. User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[0971] 2. Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[0972] 3. Server action: The server will assign the reward information to the user's account and display the details of the reward and how to use it.

[0973] 4. Server measures: Based on the analysis results from the emotion engine, additional benefits corresponding to the user's emotions will be provided.

[0974] Secondary distribution promotion process

[0975] 1. User actions: Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[0976] 2. Server measures: Retrieve transaction history from the blockchain and record it in the database.

[0977] 3. Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[0978] As a concrete example, if company B conducts a "Spring Campaign," company B inputs campaign information and brand logo into a server. Based on this, a generation AI model generates an original NFT and registers it on the blockchain. Users express their emotions on the campaign website, and these emotions are analyzed by an emotion engine. Based on the analysis results, customized NFTs are distributed. Users can use these NFTs to apply for rewards and receive additional rewards tailored to their emotions. NFTs are traded on an online marketplace, and rewards are provided to new owners along with the transaction history.

[0979] This system allows companies to develop unique campaigns that incorporate user emotions, thereby increasing customer engagement and loyalty.

[0980] The following describes the processing flow.

[0981] Step 1:

[0982] User actions: Users must access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[0983] Step 2:

[0984] Terminal action: Send the entered information to the server.

[0985] Step 3:

[0986] Server action: Save the received user information to the database.

[0987] Step 4:

[0988] Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[0989] Step 5:

[0990] Company actions: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[0991] Step 6:

[0992] Terminal action: Send the entered campaign information to the server.

[0993] Step 7:

[0994] Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[0995] Step 8:

[0996] Generative AI model's actions: It generates an original NFT based on the provided campaign information and returns the generated NFT data to the server.

[0997] Step 9:

[0998] Server action: Register the generated NFT on the blockchain and obtain the token ID.

[0999] Step 10:

[1000] Server action: Assign the acquired token ID to the company's account and notify the company.

[1001] Step 11:

[1002] Company actions: Companies select a list of target users to distribute NFTs to campaign participants.

[1003] Step 12:

[1004] Server action: Send the token ID to the selected user's digital wallet address.

[1005] Step 13:

[1006] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[1007] Step 14:

[1008] User actions: Users will use a webcam and microphone on the campaign site to express emotions.

[1009] Step 15:

[1010] Terminal action: Send the acquired video and audio data to the server.

[1011] Step 16:

[1012] Server action: The received data is input into the emotion engine to analyze the user's emotions.

[1013] Step 17:

[1014] Emotion Engine Action: Based on the user's emotion analysis results, the system generates data to adjust the design and content of the NFT and returns it to the server.

[1015] Step 18:

[1016] Server action: Re-register the adjusted NFT data on the blockchain and obtain the updated token ID.

[1017] Step 19:

[1018] Server action: Send the updated NFT to the user's digital wallet.

[1019] Step 20:

[1020] User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[1021] Step 20:

[1022] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[1023] Step 21:

[1024] Server action: Grant reward information to the user's account and display details and instructions on how to use the reward.

[1025] Step 22:

[1026] Server action: Based on the sentiment analysis results, provide additional special benefits that correspond to the user's emotions.

[1027] Step 23:

[1028] User actions: Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[1029] Step 24:

[1030] Server action: Retrieve transaction history from the blockchain and record it in the database.

[1031] Step 25:

[1032] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[1033] (Example 2)

[1034] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[1035] Traditional campaign systems lacked the mechanisms to incorporate user emotions, generate digital content based on that content, and then reward users accordingly. This made it difficult to improve user engagement and provide personalized experiences. Furthermore, smoothly facilitating the secondary market for generated digital content (NFTs) and properly managing transaction information were also challenges.

[1036] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1037] In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting rewards, means for facilitating secondary trading, means for performing sentiment analysis, and means for adjusting the digital content based on the sentiment analysis results. This makes it possible to generate unique digital content (NFTs) that incorporate the user's emotions and to provide rewards that correspond to the user's emotions. Furthermore, it enables the smooth promotion of secondary trading and management of transaction information.

[1038] "Generation means" refers to a function that automatically creates digital content (NFTs) based on information entered by users or companies.

[1039] "Methods for registering on the blockchain" refers to the function of writing ownership information of generated digital content onto the blockchain and obtaining a token ID.

[1040] "Means of distribution" refers to the function of transmitting generated digital content to users or participants and transferring ownership.

[1041] "Means of providing benefits" refers to functions that offer campaign benefits or additional rewards to users who own digital content.

[1042] "Means to promote secondary distribution" refer to functions that support the re-trading of generated digital content on online marketplaces and manage transaction information on the blockchain.

[1043] "Means for performing emotion analysis" refers to a function that analyzes the user's video and audio data to recognize their emotions and utilize the results.

[1044] "Means for adjusting digital content based on sentiment analysis results" refers to a function for optimizing the design and content of digital content based on the user's emotions obtained through sentiment analysis.

[1045] This invention relates to a system that generates and distributes digital content (NFTs) based on user sentiment analysis results and appropriately grants benefits related to them. This system mainly consists of three elements: a server, a terminal, and a user.

[1046] First, the user accesses the campaign website. They enter the required information, such as their name, email address, and digital wallet address, into a web form on the site and submit it. This information is sent from the device to the server and stored in the server's database. After saving the data, the server sends a registration confirmation email to the user.

[1047] When a company requests NFT generation, the company representative enters campaign information (campaign name, theme, brand logo, etc.) through the management screen. This information is sent from the terminal to the server, and the server sends a request to the generation AI model based on the received information. The generation AI model generates an NFT based on the campaign information and returns the data to the server. The server registers the generated NFT on the blockchain and obtains a token ID. The obtained token ID is assigned to the company's account and the company is notified.

[1048] Next, in the user emotion analysis process, users express their emotions using a webcam and microphone on the campaign website. This video and audio data is sent from the device to the server, which inputs it into the emotion analysis engine for analysis. Based on the analysis results, the NFT is adjusted with a design and content that corresponds to the emotion and provided to the user.

[1049] In NFT distribution, companies distribute NFTs to a list of target users selected from campaign participants via an administration screen. The server sends the token ID to the user's digital wallet and records the distribution history and reward information in a database. Users can verify their owned NFTs and apply for rewards; once ownership is confirmed, the rewards are granted.

[1050] Furthermore, in the secondary market process, when a user trades an NFT on an online marketplace, the transaction information is recorded on the blockchain. The server retrieves this information and grants or updates benefits to the new owner.

[1051] As a concrete example, in the case of a "Spring Campaign," the company inputs campaign information and brand logo into the server, and based on that, a generation AI model generates an original NFT. Users express their emotions on the campaign site, and their emotions are analyzed by an emotion analysis engine, and a customized NFT is distributed. Users can use that NFT to apply for rewards and receive additional rewards according to their emotions. An example of a prompt message would be, "Please generate an NFT for the Spring Campaign. The theme is 'Flowers,' and the brand logo is 'the logo of XX Corporation.'"

[1052] This system can enhance customer engagement and loyalty by generating unique digital content (NFTs) that incorporate user emotions and offering rewards based on those experiences.

[1053] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1054] User registration process

[1055] Step 1:

[1056] User actions

[1057] Users access the campaign website, fill in the required information including their name, email address, and digital wallet address in the web form, and click the "Submit" button.

[1058] Input: Name, email address, digital wallet address

[1059] Output: Input data is sent to the terminal.

[1060] Step 2:

[1061] Terminal measures

[1062] The terminal sends the entered information to the server as an HTTP POST request.

[1063] Input: Information entered by the user

[1064] Output: Information is sent to the server.

[1065] Step 3:

[1066] Server measures

[1067] The server stores the received user information in a database. Specifically, it establishes a database connection, executes SQL queries, and saves the user information.

[1068] Input: User information sent from the device

[1069] Output: Information stored in the database

[1070] Step 4:

[1071] Server measures

[1072] The server sends a registration confirmation email to the user to notify them that registration is complete. Specifically, it uses an SMTP server to send the email.

[1073] Input: User's email address

[1074] Output: A registration confirmation email is sent to the user.

[1075] NFT generation request process

[1076] Step 1:

[1077] Corporate measures

[1078] Companies enter campaign information from the administration screen and click the "Request Generation" button.

[1079] Input: Campaign name, theme, brand logo

[1080] Output: Input data is sent to the terminal.

[1081] Step 2:

[1082] Terminal measures

[1083] The terminal sends the entered campaign information to the server as an HTTP POST request.

[1084] Input: Campaign information entered by the company

[1085] Output: Information is sent to the server.

[1086] Step 3:

[1087] Server measures

[1088] The server sends a request to the generating AI model based on the received campaign information. Specifically, it generates a prompt message and sends a request to the generating AI model's API.

[1089] Input: Company campaign information

[1090] Output: Request to the Generative AI Model

[1091] Step 4:

[1092] Measures taken by generative AI models

[1093] The generative AI model generates an original NFT based on the provided information and returns the generated data to the server.

[1094] Input: Request from server

[1095] Output: Generated NFT data

[1096] Step 5:

[1097] Server measures

[1098] The server registers the generated NFT on the blockchain and obtains a token ID. Specifically, it registers the data using the blockchain API.

[1099] Input: NFT data from generated AI models

[1100] Output: Token ID registered on the blockchain

[1101] Step 6:

[1102] Server measures

[1103] The acquired token ID is assigned to the company's account, and a notification is sent via email or dashboard.

[1104] Input: Token ID

[1105] Output: Assigned to the corporate account and a notification is sent.

[1106] Emotion recognition process

[1107] Step 1:

[1108] User actions

[1109] Users express their emotions using a webcam and microphone on the campaign website.

[1110] Input: User's video and audio data

[1111] Output: Video and audio data are acquired by the device.

[1112] Step 2:

[1113] Terminal measures

[1114] The acquired video and audio data is encoded and sent to the server as an HTTP POST request.

[1115] Input: User's video and audio data

[1116] Output: Data sent to the server

[1117] Step 3:

[1118] Server measures

[1119] The received data is input into the emotion engine for analysis. Specifically, the data is sent to the emotion engine's API, and the analysis results are received.

[1120] Input: Data sent from the device

[1121] Output: Data sent to the emotion engine

[1122] Step 4:

[1123] Emotional Engine Measures

[1124] The emotion engine generates data to adjust the design and content based on the analysis results and returns it to the server.

[1125] Input: Data from the server

[1126] Output: Analysis results and adjustment data

[1127] NFT distribution process

[1128] Step 1:

[1129] Corporate measures

[1130] Companies select the target user list from the administration screen and click the "Distribute NFT" button.

[1131] Input: List of target users

[1132] Output: Selected user information is sent to the server.

[1133] Step 2:

[1134] Server measures

[1135] The server sends the token ID to the selected user's digital wallet. Specifically, it uses the blockchain API to send the token ID to the wallet.

[1136] Input: Digital wallet address and token ID of the target user

[1137] Output: Token ID is sent to the wallet.

[1138] Step 3:

[1139] Server measures

[1140] The distribution history is recorded in a database, and the bonus information is added to the user's account.

[1141] Input: Distribution history and bonus information

[1142] Output: Distribution history and bonus information stored in the database

[1143] Reward Granting Process

[1144] Step 1:

[1145] User actions

[1146] Users log in to the campaign website, verify their NFTs, and apply for the rewards.

[1147] Input: Owned NFT information

[1148] Output: Application information is sent to the server.

[1149] Step 2:

[1150] Server measures

[1151] The system retrieves NFT information from the user's digital wallet and verifies ownership. Specifically, it uses a blockchain API to verify NFT ownership.

[1152] Input: User's digital wallet information

[1153] Output: Ownership verification result

[1154] Step 3:

[1155] Server measures

[1156] The system assigns reward information to the user's account and displays details and instructions on how to use the rewards.

[1157] Input: Bonus information and ownership verification results

[1158] Output: The reward is credited to the user's account.

[1159] Step 4:

[1160] Server measures

[1161] Based on the analysis results of the emotion engine, additional benefits corresponding to emotions will be provided.

[1162] Input: Sentiment analysis results

[1163] Output: Additional benefits will be provided.

[1164] Secondary distribution promotion process

[1165] Step 1:

[1166] User actions

[1167] Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[1168] Input: Transaction Information

[1169] Output: Transaction information is recorded on the blockchain.

[1170] Step 2:

[1171] Server measures

[1172] The server retrieves transaction history from the blockchain and records it in a database. Specifically, it periodically retrieves transaction information via the blockchain API.

[1173] Input: Blockchain transaction information

[1174] Output: Transaction history stored in the database

[1175] Step 3:

[1176] Server measures

[1177] Verify the NFT information of the new owner and grant or update the benefits to that owner.

[1178] Input: New owner's information

[1179] Output: The benefit is granted or renewed to the new owner.

[1180] (Application Example 2)

[1181] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[1182] Traditional campaign systems and customer engagement strategies have difficulty directly leveraging user emotions, and they do not offer customized rewards or items based on those emotions. As a result, companies have been unable to maximize customer satisfaction and experiential value, and their marketing effectiveness has been limited.

[1183] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting benefits, means for promoting secondary distribution, means for recognizing the user's emotions, means for customizing the NFT generated based on emotion recognition, and means for participating in campaigns at physical stores. This makes it possible to maximize customer satisfaction and experiential value and enhance the marketing effectiveness of companies by recognizing the user's emotions and providing customized NFTs and benefits accordingly.

[1184] "Means of generation" refers to methods for generating digital content using AI technology based on information provided by users and companies.

[1185] "Methods of registering on a blockchain" refer to the means of recording generated digital content or NFTs on a distributed ledger to guarantee their existence.

[1186] "Means of distribution" refers to the means of transferring generated NFTs or digital content to specific users and distributing ownership of them.

[1187] "Means of granting benefits" refers to means of providing specific rewards or benefits based on NFTs owned by users.

[1188] "Means to facilitate secondary trading" refer to means that when generated NFTs are traded between other users, transactions are tracked and recorded, and benefits are provided to the new owners.

[1189] "Means of recognizing user emotions" refers to methods for identifying a user's emotional state by utilizing technologies that analyze emotions from the user's facial expressions, voice, etc.

[1190] "Means for customizing NFTs generated based on emotion recognition" refers to means of changing the design and content of generated NFTs according to the recognized emotions of the user, thereby providing more personalized content.

[1191] "Means of participating in in-store campaigns" refers to the means by which users can participate in marketing events and campaigns held at physical stores.

[1192] The system that realizes this invention is composed of a combination of a smartphone, a server, blockchain technology, AI technology, and emotion recognition technology. The processing of the system's program is described below.

[1193] First, the user accesses the application using their smartphone. The application provides an interface for the user to enter their name, email address, and digital wallet address. This information is sent from the smartphone to the server, which stores it in a database. The server then sends a registration confirmation email to the user, completing the user registration process.

[1194] Next, to participate in the campaign at a physical store, the user scans a campaign-specific QR code using their smartphone. Once their participation is approved, the user expresses their emotions using their smartphone's camera and microphone. The smartphone device captures the user's facial expressions and voice data and sends it to the server.

[1195] The server inputs the received video and audio data into an emotion recognition engine (such as Microsoft Azure Cognitive Services) to analyze the user's emotions. The analyzed emotion data is sent to a generative AI model (OpenAI GPT-4). The generative AI model generates an original NFT based on the provided emotion data and campaign information. The generated NFT is registered on the blockchain by the server, and a token ID is obtained. This token ID is sent to the user's digital wallet.

[1196] Users can view their owned NFTs by checking their digital wallets. The server grants rewards for owned NFTs, which may be added based on the user's sentiment. Owned NFTs can also be traded with other users, and this transaction information is recorded on the blockchain. The server tracks the transaction history and provides similar rewards to new owners.

[1197] This system allows users to acquire customized NFTs tailored to their emotions and enjoy rewards. It also enables businesses to enhance emotion-based engagement.

[1198] A concrete example is the "Cherry Blossom Festival Campaign." In this campaign, the following prompt sentences are input to the generating AI model.

[1199] Prompt: For the cherry blossom festival campaign theme, generate an NFT with a design that evokes the feeling of spring, based on the user's smiling face.

[1200] Based on this prompt, the AI ​​model generates a spring-themed NFT incorporating the user's smiling face into its design and distributes it to the user. In this way, a unique digital campaign that makes the most of the user's emotions can be realized.

[1201] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1202] Step 1:

[1203] The user accesses the application using their smartphone and enters their name, email address, and digital wallet address. They enter the information into the input form on the smartphone screen and tap the "Register" button. This action sends the entered data from the device to the server.

[1204] Input: Name, email address, digital wallet address

[1205] Output: User information sent to the server

[1206] Step 2:

[1207] The server saves the received user information to the database. SQL statements related to saving the user information are executed in the database. If the saving is successful, the server generates a registration confirmation email and sends it to the user's email address.

[1208] Input: Received user information

[1209] Output: User information stored in the database, registration confirmation email sent.

[1210] Step 3:

[1211] Users scan the campaign's QR code with their smartphones at physical stores. They activate their smartphone's camera and read the QR code. This information is sent to the server as campaign participation information.

[1212] Input: Campaign QR code

[1213] Output: Campaign participation information sent to the server

[1214] Step 4:

[1215] The server receives campaign participation information and prepares to recognize the user's emotions. This involves calling the emotion recognition engine. The user expresses their emotions using their smartphone's camera and microphone.

[1216] Input: Campaign participation information

[1217] Output: Instructions for expressing emotions

[1218] Step 5:

[1219] The smartphone device acquires the user's facial expressions and voice data and transmits it to the server in real time. The data is compressed and efficiently sent to the server using a transfer protocol.

[1220] Input: Facial expression data, audio data

[1221] Output: Sentiment data sent to the server

[1222] Step 6:

[1223] The server inputs the received video and audio data into an emotion recognition engine (such as Microsoft Azure Cognitive Services) to analyze the user's emotions. The analysis results are stored as emotion data and sent to the generating AI model.

[1224] Input: Received video and audio data

[1225] Output: Analyzed sentiment data

[1226] Step 7:

[1227] The generative AI model (OpenAI GPT-4) generates original NFTs based on the provided sentiment data and campaign information. The generative AI model receives campaign information as input in the form of prompt sentences.

[1228] Input: Sentiment data, campaign information

[1229] Output: Generated NFT data

[1230] Step 8:

[1231] The server registers the generated NFT on the blockchain. This includes creating and confirming the transaction. It connects to the blockchain network and obtains the token ID.

[1232] Input: Generated NFT data

[1233] Output: Token ID registered on the blockchain

[1234] Step 9:

[1235] The server sends the acquired token ID to the user's digital wallet and notifies the user that the NFT has been distributed. The distribution history is also recorded in the database.

[1236] Input: Token ID

[1237] Output: Token ID sent to digital wallet, updated database

[1238] Step 10:

[1239] The server grants rewards based on NFT information obtained from the user's digital wallet. Emotion-based rewards are also added. Reward information is reflected in the user's account and the user is notified.

[1240] Input: NFT information from a digital wallet

[1241] Output: Benefits granted to the user, updated user account information

[1242] Step 11:

[1243] When a user resells an NFT, the new transaction information is recorded on the blockchain. The server retrieves the transaction history and provides benefits to the new owner.

[1244] Input: Blockchain transaction information

[1245] Output: Updated transaction history, benefits granted to the new owner

[1246] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1247] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1248] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[1249] [Third Embodiment]

[1250] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[1251] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1252] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1253] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[1254] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1255] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1256] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1257] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1258] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1259] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1260] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1261] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[1262] The present invention is a system that includes means for generating, means for registering on a blockchain, means for distributing, means for granting benefits, and means for facilitating secondary trading. The processing of the program of this system will be described in detail in natural language below.

[1263] User registration process

[1264] 1. Enter user information

[1265] User actions: To participate in the campaign, users must enter their name, email address, and digital wallet address on a dedicated website.

[1266] 2. Sending data

[1267] Terminal action: Send the entered user data to the server.

[1268] 3. Saving registration information

[1269] Server action: The received user data is saved to the database, and a registration confirmation email is sent to the user.

[1270] NFT generation request process

[1271] 1. Enter campaign information

[1272] Corporate actions: Companies enter necessary information such as the campaign name, theme, and brand logo, and request NFT generation.

[1273] 2. Input to the Generative AI Model

[1274] Server actions: Provide campaign information to the AI ​​model that generates it, and process it to generate the original NFT.

[1275] 3. NFT creation and blockchain registration

[1276] Generative AI model's actions: It generates original NFTs based on the input campaign information and returns the generated NFT data to the server.

[1277] Server actions: Register the generated NFT on the blockchain and obtain the token ID. Then, assign the token ID to the company and notify them.

[1278] NFT distribution process

[1279] 1. Select User Information

[1280] Company actions: Companies select users to distribute NFTs to from a list of campaign participants.

[1281] 2. Sending the Token ID

[1282] Server action: Send the token ID to the selected user's digital wallet address.

[1283] 3. Record of distribution history

[1284] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[1285] Reward Granting Process

[1286] 1. Application for benefits

[1287] User actions: Users log in to the campaign site, display the NFTs they own, and apply for the reward.

[1288] 2. Ownership confirmation

[1289] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[1290] 3. Granting of benefits

[1291] Server action: Grant reward information to the user's account and display instructions on how to use the reward.

[1292] Secondary distribution promotion process

[1293] 1. NFT trading

[1294] User actions: Users trade their NFTs on online marketplaces. This information is recorded on the blockchain.

[1295] 2. Record of transaction history

[1296] Server action: Retrieve transaction history from the blockchain and record it in the database.

[1297] 3. Verification of the new owner

[1298] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[1299] For example, if company A conducts a "summer campaign," company A inputs campaign information and brand logo into a server. Based on this, a generation AI model generates an original NFT and registers it on the blockchain. The registered NFT is distributed to campaign participants, who can receive their rewards along with their application. Furthermore, users can trade the NFT on an online marketplace, and new owners can also receive rewards, thus continuously maintaining the value and appeal of the NFT.

[1300] The following describes the processing flow.

[1301] Step 1:

[1302] User actions: Users must access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[1303] Step 2:

[1304] Terminal action: Send the entered information to the server.

[1305] Step 3:

[1306] Server action: Save the received user information to the database.

[1307] Step 4:

[1308] Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[1309] Step 5:

[1310] Company actions: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[1311] Step 6:

[1312] Terminal action: Send the entered campaign information to the server.

[1313] Step 7:

[1314] Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[1315] Step 8:

[1316] Generative AI model's actions: It generates an original NFT based on the provided campaign information and returns the generated NFT data to the server.

[1317] Step 9:

[1318] Server action: Register the generated NFT on the blockchain and obtain the token ID.

[1319] Step 10:

[1320] Server action: Assign the acquired token ID to the company's account and notify the company.

[1321] Step 11:

[1322] Company actions: Companies select a list of target users to distribute NFTs to campaign participants.

[1323] Step 12:

[1324] Server action: Send the token ID to the selected user's digital wallet address.

[1325] Step 13:

[1326] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[1327] Step 14:

[1328] User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[1329] Step 15:

[1330] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[1331] Step 16:

[1332] Server action: Grant reward information to the user's account and display details and instructions on how to use the reward.

[1333] Step 17:

[1334] User actions: Users trade their NFTs on online marketplaces and record the transactions on the blockchain.

[1335] Step 18:

[1336] Server action: Retrieve transaction history from the blockchain and record it in the database.

[1337] Step 19:

[1338] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[1339] (Example 1)

[1340] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1341] Traditional NFT systems struggled to efficiently manage campaign information and consistently oversee everything from user registration to NFT generation and distribution, reward granting, and facilitating secondary market share. Furthermore, the lack of a mechanism to grant rewards to generated NFTs and ensure those rewards carried over into secondary market share meant that the full value of NFTs was not being realized. This resulted in decreased user engagement and a weakened effectiveness of campaigns conducted by companies and organizations.

[1342] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1343] In this invention, the server includes means for inputting user information, means for transmitting the inputted user information, means for storing the transmitted user information, means for inputting campaign information, means for transmitting the campaign information to a generation AI model and generating an NFT, means for registering the generated NFT on the blockchain, means for distributing the generated NFT, means for granting benefits to users who own the generated NFT, and means for recording secondary transactions and granting benefits to new owners. This realizes a system that can centrally manage everything from user registration to NFT generation, distribution, benefit granting, and secondary transactions, making it possible to improve user engagement and maximize the effectiveness of campaigns for companies and organizations.

[1344] "Means for entering user information" refers to the means by which users enter their personal information, digital wallet addresses, etc., into a dedicated input form.

[1345] "Means for transmitting entered user information" refers to the means for sending information entered by a user to a server.

[1346] "Means for storing transmitted user information" refers to the means by which the server stores the received user information in a database.

[1347] "Means for entering campaign information" refers to the means by which companies and organizations enter information related to their campaigns (such as name, theme, and brand logo).

[1348] "Means for sending campaign information to a generation AI model and generating an NFT" refers to a means by which a server provides campaign information to a generation AI model and generates an original NFT.

[1349] "Methods for registering generated NFTs on the blockchain" refers to methods for recording generated NFTs on the blockchain as notarization.

[1350] "Means of distributing generated NFTs" refers to the means by which a company or organization distributes NFTs it has generated to specific users.

[1351] "Means of granting benefits to users who own generated NFTs" refers to the means by which users who own NFTs can receive benefits related to the campaign.

[1352] "Means of recording secondary transactions and providing benefits to new owners" refers to a means of recording information about new owners after NFTs have been traded on the secondary market, and providing benefits to those owners as well.

[1353] Modes for carrying out the invention

[1354] This invention is a system that consistently manages user information registration, campaign information input, NFT generation, distribution, reward granting, and secondary distribution. The program processing of this system will be described step by step.

[1355] User information registration

[1356] Users access a dedicated website and use a form to enter personal information such as their name, email address, and digital wallet address. This input form is created using HTML5 and validated on the client side using JavaScript. The entered data is sent to the server in JSON format using encrypted communication (SSL / TLS).

[1357] The server executes a PHP script to save the received user data to the MariaDB database. Once registration is complete, a confirmation email is sent to the user via the SMTP server.

[1358] Enter campaign information

[1359] Company and organization representatives log in to a dedicated management screen and enter information such as the campaign name, theme, and brand logo. The input form is subject to validation rules, and the information is checked accordingly.

[1360] Once campaign information is entered, the server uses a Python script to send a prompt to a generative AI model (e.g., GPT-3). This generative AI model generates an NFT based on the entered campaign information. An example of a specific prompt message is shown below:

[1361] "Please create an original NFT for our summer campaign. The theme is 'Summer Scenery,' and please use your brand logo."

[1362] NFT generation and registration

[1363] The generative AI model generates digital art based on campaign information and returns the data to the server in BASE64 format. The server registers this data on the Ethereum blockchain and obtains a token ID. This token ID is associated with the company's account and notified to the relevant person.

[1364] Distribution of NFTs

[1365] Company or organization representatives view a list of campaign participants from an administration screen and select specific users to receive NFTs. The server creates a transaction to send the token ID to the selected user's digital wallet address and sends it to the blockchain. The distribution history is recorded in a database, and reward information is added to the user's account.

[1366] Benefits

[1367] Users log in to the campaign website, display the NFTs they own, and apply for the reward. The server retrieves the NFT information from the user's digital wallet and verifies ownership. After that, the reward information is added to the user's account, and instructions on how to use it are displayed.

[1368] Management of the secondary market

[1369] Users can trade their NFTs on online marketplaces (such as OpenSea). The server uses blockchain APIs to retrieve transaction history and record it in a database. New owners are also granted or updated with bonus information.

[1370] This system allows for the consistent management of the entire process, from user information registration to NFT generation, distribution, reward granting, and secondary market management, thereby improving user engagement. It functions as a comprehensive solution to maximize the effectiveness of campaigns conducted by companies and organizations.

[1371] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1372] Step 1: Enter user information

[1373] Users access a dedicated website and enter personal information such as their name, email address, and digital wallet address. This input form is created using HTML5, and validation is performed using JavaScript.

[1374] input:

[1375] name

[1376] email address

[1377] Digital wallet address

[1378] output:

[1379] User data in JSON format

[1380] Specific actions:

[1381] The user opens a web browser, enters the required information, and clicks the "Submit" button.

[1382] Step 2: Send

[1383] The terminal converts the entered user data into JSON format and sends it to the server using the HTTPS protocol. Encrypted communication (SSL / TLS) is used during this process.

[1384] input:

[1385] User data in JSON format

[1386] output:

[1387] HTTPS request to the server

[1388] Specific actions:

[1389] The user's input information is encoded in JSON format by the device, and an HTTPS request is sent to the server.

[1390] Step 3: Save registration information

[1391] The server saves the received user data to the MariaDB database. A PHP script performs database operations and, upon success, sends a registration confirmation email using the SMTP server.

[1392] input:

[1393] User data in JSON format

[1394] output:

[1395] Adding records to the database

[1396] Sending a registration confirmation email

[1397] Specific actions:

[1398] The server inserts the received user data into the database, and a confirmation email is sent via a PHP script.

[1399] Step 4: Enter campaign information

[1400] Company representatives log in to a dedicated management screen and enter information such as the campaign name, theme, and brand logo. Form validation rules are then applied.

[1401] input:

[1402] Campaign Name

[1403] theme

[1404] Brand logo

[1405] output:

[1406] Campaign information in JSON format

[1407] Specific actions:

[1408] The company representative opens the backend management screen, enters the necessary campaign information, and clicks the "Request" button.

[1409] Step 5: Input into the Generative AI Model

[1410] The server uses a Python script to send the input campaign information as a prompt to a generating AI model (such as GPT-3), requesting it to generate an original NFT.

[1411] input:

[1412] Campaign information in JSON format

[1413] output:

[1414] Digital art data (BASE64 format) generated based on this.

[1415] Specific actions:

[1416] The server sends campaign information as a prompt to the generation AI model. Example prompt: "Generate an original NFT for our summer campaign. The theme is 'Summer Scenery,' and please use the brand logo."

[1417] Step 6: NFT creation and blockchain registration

[1418] The generation AI model generates original digital art data based on campaign information and sends it back to the server in BASE64 format. The digital art data is registered on the Ethereum blockchain, and a token ID is generated.

[1419] input:

[1420] Digital art data in BASE64 format

[1421] output:

[1422] Token ID

[1423] Specific actions:

[1424] The server registers the digital art data received from the generating AI model on the blockchain via a smart contract, obtains a token ID, and notifies the company.

[1425] Step 7: Select User Information

[1426] The company representative displays the campaign participant list from the management screen and selects the users to whom the NFTs will be distributed.

[1427] input:

[1428] List of campaign participants

[1429] output:

[1430] User data eligible for NFT distribution

[1431] Specific actions:

[1432] The company representative selects a specific user from the participant list and clicks the distribution button.

[1433] Step 8: Sending the Token ID

[1434] The server sends the token ID to the selected user's digital wallet address. A smart contract is used to transfer ownership of the token.

[1435] input:

[1436] User's digital wallet address

[1437] Token ID

[1438] output:

[1439] Transaction approval

[1440] Specific actions:

[1441] The server generates a transaction and sends the token ID to the user's digital wallet address.

[1442] Step 9: Recording the distribution history

[1443] The server records the distribution history of NFTs in a database and assigns reward information to the user's account.

[1444] input:

[1445] Transaction information

[1446] output:

[1447] Recording of distribution history in the database

[1448] Bonus information is provided.

[1449] Specific actions:

[1450] The server saves the distribution history to a database and adds the reward information to the user's account.

[1451] Step 10: Apply for benefits

[1452] Users log in to the campaign website, display the NFTs they own, and apply for the rewards.

[1453] input:

[1454] User account information

[1455] output:

[1456] Application for benefits

[1457] Specific actions:

[1458] Users log in to the campaign website, view a list of their owned NFTs, and click the reward application button.

[1459] Step 11: Ownership Verification

[1460] The server retrieves NFT information from the user's digital wallet and verifies ownership.

[1461] input:

[1462] User's digital wallet address

[1463] output:

[1464] Ownership confirmation result

[1465] Specific actions:

[1466] The server uses the Ethereum API to check the user's digital wallet and verify ownership.

[1467] Step 12: Granting of benefits

[1468] The server assigns the reward information to the user's account and displays instructions on how to use the reward.

[1469] input:

[1470] Ownership confirmation result

[1471] output:

[1472] Benefit Usage Information

[1473] Specific actions:

[1474] The server adds the reward information to the user's account and displays instructions on how to use the reward on the dashboard.

[1475] Step 13: NFT Transaction

[1476] Users trade their NFTs on an online marketplace, and this information is recorded on the blockchain.

[1477] input:

[1478] User NFTs

[1479] output:

[1480] Transaction records

[1481] Specific actions:

[1482] Users sell NFTs on the marketplace, and the transaction data is recorded on the blockchain.

[1483] Step 14: Recording Transaction History

[1484] The server retrieves transaction history from the blockchain and records it in a database.

[1485] input:

[1486] Transaction records

[1487] output:

[1488] Recording to the database

[1489] Specific actions:

[1490] The server uses the Ethereum REST API to retrieve transaction history and save it to a database.

[1491] Step 15: New Owner Verification

[1492] The server verifies the new owner's NFT information and grants or updates the benefits to that owner.

[1493] input:

[1494] New owner's wallet information

[1495] output:

[1496] Updated bonus information

[1497] Specific actions:

[1498] The server verifies the new owner's wallet data and grants or updates reward information.

[1499] (Application Example 1)

[1500] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1501] Traditional virtual stores lacked mechanisms to ensure users continuously enjoyed the benefits and value they received when purchasing products. Furthermore, the scope of available benefits was often limited, sometimes leading to low user engagement. This made long-term customer retention and transaction promotion a challenge for virtual stores.

[1502] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1503] In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting rewards, means for facilitating secondary trading, means for users to acquire NFTs when purchasing goods in a virtual store, means for users to receive rewards using the acquired NFTs, and means for users to trade the acquired NFTs with other users. This makes it possible for users to receive rewards while utilizing NFTs obtained through product purchases, and to continue to enjoy value by trading NFTs.

[1504] "Generation method" refers to a function for creating original NFTs based on information specified by users or companies.

[1505] "Methods for registering on the blockchain" refers to the function of recording the information of a generated NFT on the blockchain in a tamper-proof manner.

[1506] "Means of distribution" refers to the function of sending the generated NFT to the digital wallet of a designated user.

[1507] "Means of granting benefits" refers to functions that provide specific services or items based on NFTs owned by users.

[1508] "Means to promote secondary trading" refers to a function that allows users to trade NFTs they own with other users and records the transaction history on the blockchain.

[1509] "Means for obtaining NFTs when a user purchases products in a virtual store" refers to a function that automatically generates and obtains NFTs when a user purchases products in a virtual store.

[1510] "A means of receiving rewards using NFTs acquired by the user" refers to a function that allows users to redeem specific rewards by utilizing NFTs they have acquired.

[1511] "A means for users to trade NFTs they have acquired with other users" refers to a function that allows users to exchange NFTs they own with other users and transfer ownership of those NFTs.

[1512] This invention is a system for granting rewards and conducting transactions using NFTs (Non-Fungible Tokens) to enhance user engagement in virtual stores. The program processing of this system is described in detail below.

[1513] The server will utilize hardware and software that include the following key functions. The hardware will include a web server, database server, and blockchain nodes, while the software will utilize Flask (a web framework), generative AI models (such as GPT-3 and DALL-E), and blockchain libraries (such as Ethereum and Hyperledger).

[1514] First, when a user purchases an item within the application, they register using their digital wallet address. This registration information is stored in a database by the server. At this point, the AI ​​model generates an original NFT based on the input information. For example, if a user purchases a "summer limited item," providing this information to the AI ​​as a prompt generates the corresponding NFT. The prompt message takes the following format:

[1515] Example of a prompt:

[1516] Campaign Name: Summer Special Campaign

[1517] Theme: Summer Memories

[1518] Brand logo: https: / / example.com / logo.png

[1519] User ID: 12345

[1520] Product ID:xyz678

[1521] The generated NFTs are registered on the blockchain to prevent tampering and prove ownership. Next, the generated NFTs are sent to the user's digital wallet. The user can then use the NFTs to receive rewards. For example, they might be able to obtain exclusive items or discount coupons by participating in a campaign.

[1522] Furthermore, users can trade acquired NFTs with other users. Information on traded NFTs is recorded on the blockchain, and new owners can also receive the same benefits. This ensures that the value of NFTs is continuously maintained and enhances engagement within virtual stores.

[1523] As a concrete example, suppose user A purchases a limited-edition summer item in a virtual store and receives an NFT as a result of the purchase. Using this NFT, user A can receive a special discount. Subsequently, user A can transfer the NFT to their friend, user B, who can then enjoy the same benefits. This promotes interaction between users and continuously maintains the value and interest of the NFT.

[1524] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1525] Step 1:

[1526] When a user purchases a product, they enter their digital wallet address within the virtual store application and send the purchase information to the server.

[1527] Input: User's digital wallet address, product ID, purchase information

[1528] Output: Purchase information sent to the server

[1529] Specific operation: When a user selects a product and clicks the purchase button, the purchase information is sent to the server via the application.

[1530] Step 2:

[1531] The server saves the received purchase information to a database and verifies the purchase details to create prompts for the AI ​​model.

[1532] Input: Purchase information sent to the server

[1533] Output: Purchase information stored in the database, prompts for the generated AI model.

[1534] Specific operation: The server analyzes purchase information, extracts campaign name, theme, brand logo, user ID, product ID, etc., and provides this information to the AI ​​model that generates prompt messages.

[1535] Step 3:

[1536] The server takes prompt messages into the generating AI model to create an original NFT.

[1537] Input: Prompt message

[1538] Output: Generated NFT data

[1539] Specific operation: The generation AI model analyzes the prompt text, generates an original NFT based on it, and returns that data to the server.

[1540] Step 4:

[1541] The server receives the generated NFT data and registers it on the blockchain.

[1542] Input: Generated NFT data

[1543] Output: Token ID on the blockchain

[1544] Specific operation: The server communicates with the blockchain node and records the NFT data as a transaction on the blockchain. Once registration is complete, a token ID is generated and returned to the server.

[1545] Step 5:

[1546] The server sends the acquired token ID to the user's digital wallet address and distributes the NFT.

[1547] Input: Token ID, User's digital wallet address

[1548] Output: NFTs registered in the user's digital wallet

[1549] Specific operation: The server assigns the token ID to the user's digital wallet address and distributes the NFT.

[1550] Step 6:

[1551] Users can use the acquired NFT to receive rewards within the application.

[1552] Input: NFTs registered in the user's digital wallet

[1553] Output: Benefits (e.g., discount coupons, limited-edition items)

[1554] Specific operation: When a user requests a reward within the application, the server verifies the wallet address and grants the reward.

[1555] Step 7:

[1556] Users can trade acquired NFTs with other users.

[1557] Input: Digital wallet address of the user trading the NFT, transaction information

[1558] Output: NFT registered to a new owner, transaction history

[1559] Specific operation: Users list their NFTs on an online marketplace, and once a transaction is completed, the server records the transaction information on the blockchain and transfers the NFT to the new owner's wallet.

[1560] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1561] The present invention is a system that includes means for generating, means for registering on a blockchain, means for distributing, means for granting benefits, means for facilitating secondary trading, and an emotion engine for recognizing user emotions. The processing of the program of this system is described in detail in natural language below.

[1562] User registration process

[1563] 1. User Action: Users access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[1564] 2. Terminal action: Send the entered information to the server.

[1565] 3. Server action: Save the received user information to the database.

[1566] 4. Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[1567] NFT generation request process

[1568] 1. Company Action: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[1569] 2. Terminal action: Send the entered campaign information to the server.

[1570] 3. Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[1571] 4. Measures taken by the generation AI model: Based on the provided campaign information, it generates an original NFT and returns the generated NFT data to the server.

[1572] 5. Server actions: Register the generated NFT on the blockchain and obtain the token ID.

[1573] 6. Server action: Assign the acquired token ID to the company's account and notify the company.

[1574] Emotion recognition process

[1575] 1. User actions: Users express their emotions through a webcam and microphone on the campaign site.

[1576] 2. Terminal actions: The acquired video and audio data is sent to the server.

[1577] 3. Server actions: The received data is input into the emotion engine to analyze the user's emotions.

[1578] 4. Emotion Engine Measures: Generate data to adjust the design and content of the NFT based on the user's emotions, and return it to the server.

[1579] NFT distribution process

[1580] 1. Company actions: Companies select a list of target users in order to distribute NFTs to campaign participants.

[1581] 2. Server action: Send the token ID to the selected user's digital wallet address.

[1582] 3. Server measures: Record the distribution history in the database and assign the reward information to the user's account.

[1583] Reward Granting Process

[1584] 1. User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[1585] 2. Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[1586] 3. Server action: The server will assign the reward information to the user's account and display the details of the reward and how to use it.

[1587] 4. Server measures: Based on the analysis results from the emotion engine, additional benefits corresponding to the user's emotions will be provided.

[1588] Secondary distribution promotion process

[1589] 1. User actions: Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[1590] 2. Server measures: Retrieve transaction history from the blockchain and record it in the database.

[1591] 3. Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[1592] As a concrete example, if company B conducts a "Spring Campaign," company B inputs campaign information and brand logo into a server. Based on this, a generation AI model generates an original NFT and registers it on the blockchain. Users express their emotions on the campaign website, and these emotions are analyzed by an emotion engine. Based on the analysis results, customized NFTs are distributed. Users can use these NFTs to apply for rewards and receive additional rewards tailored to their emotions. NFTs are traded on an online marketplace, and rewards are provided to new owners along with the transaction history.

[1593] This system allows companies to develop unique campaigns that incorporate user emotions, thereby increasing customer engagement and loyalty.

[1594] The following describes the processing flow.

[1595] Step 1:

[1596] User actions: Users must access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[1597] Step 2:

[1598] Terminal action: Send the entered information to the server.

[1599] Step 3:

[1600] Server action: Save the received user information to the database.

[1601] Step 4:

[1602] Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[1603] Step 5:

[1604] Company actions: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[1605] Step 6:

[1606] Terminal action: Send the entered campaign information to the server.

[1607] Step 7:

[1608] Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[1609] Step 8:

[1610] Generative AI model's actions: It generates an original NFT based on the provided campaign information and returns the generated NFT data to the server.

[1611] Step 9:

[1612] Server action: Register the generated NFT on the blockchain and obtain the token ID.

[1613] Step 10:

[1614] Server action: Assign the acquired token ID to the company's account and notify the company.

[1615] Step 11:

[1616] Company actions: Companies select a list of target users to distribute NFTs to campaign participants.

[1617] Step 12:

[1618] Server action: Send the token ID to the selected user's digital wallet address.

[1619] Step 13:

[1620] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[1621] Step 14:

[1622] User actions: Users will use a webcam and microphone on the campaign site to express emotions.

[1623] Step 15:

[1624] Terminal action: Send the acquired video and audio data to the server.

[1625] Step 16:

[1626] Server action: The received data is input into the emotion engine to analyze the user's emotions.

[1627] Step 17:

[1628] Emotion Engine Action: Based on the user's emotion analysis results, the system generates data to adjust the design and content of the NFT and returns it to the server.

[1629] Step 18:

[1630] Server action: Re-register the adjusted NFT data on the blockchain and obtain the updated token ID.

[1631] Step 19:

[1632] Server action: Send the updated NFT to the user's digital wallet.

[1633] Step 20:

[1634] User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[1635] Step 20:

[1636] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[1637] Step 21:

[1638] Server action: Grant reward information to the user's account and display details and instructions on how to use the reward.

[1639] Step 22:

[1640] Server action: Based on the sentiment analysis results, provide additional special benefits that correspond to the user's emotions.

[1641] Step 23:

[1642] User actions: Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[1643] Step 24:

[1644] Server action: Retrieve transaction history from the blockchain and record it in the database.

[1645] Step 25:

[1646] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[1647] (Example 2)

[1648] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1649] Traditional campaign systems lacked the mechanisms to incorporate user emotions, generate digital content based on that content, and then reward users accordingly. This made it difficult to improve user engagement and provide personalized experiences. Furthermore, smoothly facilitating the secondary market for generated digital content (NFTs) and properly managing transaction information were also challenges.

[1650] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1651] In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting rewards, means for facilitating secondary trading, means for performing sentiment analysis, and means for adjusting the digital content based on the sentiment analysis results. This makes it possible to generate unique digital content (NFTs) that incorporate the user's emotions and to provide rewards that correspond to the user's emotions. Furthermore, it enables the smooth promotion of secondary trading and management of transaction information.

[1652] "Generation means" refers to a function that automatically creates digital content (NFTs) based on information entered by users or companies.

[1653] "Methods for registering on the blockchain" refers to the function of writing ownership information of generated digital content onto the blockchain and obtaining a token ID.

[1654] "Means of distribution" refers to the function of transmitting generated digital content to users or participants and transferring ownership.

[1655] "Means of providing benefits" refers to functions that offer campaign benefits or additional rewards to users who own digital content.

[1656] "Means to promote secondary distribution" refer to functions that support the re-trading of generated digital content on online marketplaces and manage transaction information on the blockchain.

[1657] "Means for performing emotion analysis" refers to a function that analyzes the user's video and audio data to recognize their emotions and utilize the results.

[1658] "Means for adjusting digital content based on sentiment analysis results" refers to a function for optimizing the design and content of digital content based on the user's emotions obtained through sentiment analysis.

[1659] This invention relates to a system that generates and distributes digital content (NFTs) based on user sentiment analysis results and appropriately grants benefits related to them. This system mainly consists of three elements: a server, a terminal, and a user.

[1660] First, the user accesses the campaign website. They enter the required information, such as their name, email address, and digital wallet address, into a web form on the site and submit it. This information is sent from the device to the server and stored in the server's database. After saving the data, the server sends a registration confirmation email to the user.

[1661] When a company requests NFT generation, the company representative enters campaign information (campaign name, theme, brand logo, etc.) through the management screen. This information is sent from the terminal to the server, and the server sends a request to the generation AI model based on the received information. The generation AI model generates an NFT based on the campaign information and returns the data to the server. The server registers the generated NFT on the blockchain and obtains a token ID. The obtained token ID is assigned to the company's account and the company is notified.

[1662] Next, in the user emotion analysis process, users express their emotions using a webcam and microphone on the campaign website. This video and audio data is sent from the device to the server, which inputs it into the emotion analysis engine for analysis. Based on the analysis results, the NFT is adjusted with a design and content that corresponds to the emotion and provided to the user.

[1663] In NFT distribution, companies distribute NFTs to a list of target users selected from campaign participants via an administration screen. The server sends the token ID to the user's digital wallet and records the distribution history and reward information in a database. Users can verify their owned NFTs and apply for rewards; once ownership is confirmed, the rewards are granted.

[1664] Furthermore, in the secondary market process, when a user trades an NFT on an online marketplace, the transaction information is recorded on the blockchain. The server retrieves this information and grants or updates benefits to the new owner.

[1665] As a concrete example, in the case of a "Spring Campaign," the company inputs campaign information and brand logo into the server, and based on that, a generation AI model generates an original NFT. Users express their emotions on the campaign site, and their emotions are analyzed by an emotion analysis engine, and a customized NFT is distributed. Users can use that NFT to apply for rewards and receive additional rewards according to their emotions. An example of a prompt message would be, "Please generate an NFT for the Spring Campaign. The theme is 'Flowers,' and the brand logo is 'the logo of XX Corporation.'"

[1666] This system can enhance customer engagement and loyalty by generating unique digital content (NFTs) that incorporate user emotions and offering rewards based on those experiences.

[1667] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1668] User registration process

[1669] Step 1:

[1670] User actions

[1671] Users access the campaign website, fill in the required information including their name, email address, and digital wallet address in the web form, and click the "Submit" button.

[1672] Input: Name, email address, digital wallet address

[1673] Output: Input data is sent to the terminal.

[1674] Step 2:

[1675] Terminal measures

[1676] The terminal sends the entered information to the server as an HTTP POST request.

[1677] Input: Information entered by the user

[1678] Output: Information is sent to the server.

[1679] Step 3:

[1680] Server measures

[1681] The server stores the received user information in a database. Specifically, it establishes a database connection, executes SQL queries, and saves the user information.

[1682] Input: User information sent from the device

[1683] Output: Information stored in the database

[1684] Step 4:

[1685] Server measures

[1686] The server sends a registration confirmation email to the user to notify them that registration is complete. Specifically, it uses an SMTP server to send the email.

[1687] Input: User's email address

[1688] Output: A registration confirmation email is sent to the user.

[1689] NFT generation request process

[1690] Step 1:

[1691] Corporate measures

[1692] Companies enter campaign information from the administration screen and click the "Request Generation" button.

[1693] Input: Campaign name, theme, brand logo

[1694] Output: Input data is sent to the terminal.

[1695] Step 2:

[1696] Terminal measures

[1697] The terminal sends the entered campaign information to the server as an HTTP POST request.

[1698] Input: Campaign information entered by the company

[1699] Output: Information is sent to the server.

[1700] Step 3:

[1701] Server measures

[1702] The server sends a request to the generating AI model based on the received campaign information. Specifically, it generates a prompt message and sends a request to the generating AI model's API.

[1703] Input: Company campaign information

[1704] Output: Request to the Generative AI Model

[1705] Step 4:

[1706] Measures taken by generative AI models

[1707] The generative AI model generates an original NFT based on the provided information and returns the generated data to the server.

[1708] Input: Request from server

[1709] Output: Generated NFT data

[1710] Step 5:

[1711] Server measures

[1712] The server registers the generated NFT on the blockchain and obtains a token ID. Specifically, it registers the data using the blockchain API.

[1713] Input: NFT data from generated AI models

[1714] Output: Token ID registered on the blockchain

[1715] Step 6:

[1716] Server measures

[1717] The acquired token ID is assigned to the company's account, and a notification is sent via email or dashboard.

[1718] Input: Token ID

[1719] Output: Assigned to the corporate account and a notification is sent.

[1720] Emotion recognition process

[1721] Step 1:

[1722] User actions

[1723] Users express their emotions using a webcam and microphone on the campaign website.

[1724] Input: User's video and audio data

[1725] Output: Video and audio data are acquired by the device.

[1726] Step 2:

[1727] Terminal measures

[1728] The acquired video and audio data is encoded and sent to the server as an HTTP POST request.

[1729] Input: User's video and audio data

[1730] Output: Data sent to the server

[1731] Step 3:

[1732] Server measures

[1733] The received data is input into the emotion engine for analysis. Specifically, the data is sent to the emotion engine's API, and the analysis results are received.

[1734] Input: Data sent from the device

[1735] Output: Data sent to the emotion engine

[1736] Step 4:

[1737] Emotional Engine Measures

[1738] The emotion engine generates data to adjust the design and content based on the analysis results and returns it to the server.

[1739] Input: Data from the server

[1740] Output: Analysis results and adjustment data

[1741] NFT distribution process

[1742] Step 1:

[1743] Corporate measures

[1744] Companies select the target user list from the administration screen and click the "Distribute NFT" button.

[1745] Input: List of target users

[1746] Output: Selected user information is sent to the server.

[1747] Step 2:

[1748] Server measures

[1749] The server sends the token ID to the selected user's digital wallet. Specifically, it uses the blockchain API to send the token ID to the wallet.

[1750] Input: Digital wallet address and token ID of the target user

[1751] Output: Token ID is sent to the wallet.

[1752] Step 3:

[1753] Server measures

[1754] The distribution history is recorded in a database, and the bonus information is added to the user's account.

[1755] Input: Distribution history and bonus information

[1756] Output: Distribution history and bonus information stored in the database

[1757] Reward Granting Process

[1758] Step 1:

[1759] User actions

[1760] Users log in to the campaign website, verify their NFTs, and apply for the rewards.

[1761] Input: Owned NFT information

[1762] Output: Application information is sent to the server.

[1763] Step 2:

[1764] Server measures

[1765] The system retrieves NFT information from the user's digital wallet and verifies ownership. Specifically, it uses a blockchain API to verify NFT ownership.

[1766] Input: User's digital wallet information

[1767] Output: Ownership verification result

[1768] Step 3:

[1769] Server measures

[1770] The system assigns reward information to the user's account and displays details and instructions on how to use the rewards.

[1771] Input: Bonus information and ownership verification results

[1772] Output: The reward is credited to the user's account.

[1773] Step 4:

[1774] Server measures

[1775] Based on the analysis results of the emotion engine, additional benefits corresponding to emotions will be provided.

[1776] Input: Sentiment analysis results

[1777] Output: Additional benefits will be provided.

[1778] Secondary distribution promotion process

[1779] Step 1:

[1780] User actions

[1781] Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[1782] Input: Transaction Information

[1783] Output: Transaction information is recorded on the blockchain.

[1784] Step 2:

[1785] Server measures

[1786] The server retrieves transaction history from the blockchain and records it in a database. Specifically, it periodically retrieves transaction information via the blockchain API.

[1787] Input: Blockchain transaction information

[1788] Output: Transaction history stored in the database

[1789] Step 3:

[1790] Server measures

[1791] Verify the NFT information of the new owner and grant or update the benefits to that owner.

[1792] Input: New owner's information

[1793] Output: The benefit is granted or renewed to the new owner.

[1794] (Application Example 2)

[1795] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1796] Traditional campaign systems and customer engagement strategies have difficulty directly leveraging user emotions, and they do not offer customized rewards or items based on those emotions. As a result, companies have been unable to maximize customer satisfaction and experiential value, and their marketing effectiveness has been limited.

[1797] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting benefits, means for promoting secondary distribution, means for recognizing the user's emotions, means for customizing the NFT generated based on emotion recognition, and means for participating in campaigns at physical stores. This makes it possible to maximize customer satisfaction and experiential value and enhance the marketing effectiveness of companies by recognizing the user's emotions and providing customized NFTs and benefits accordingly.

[1798] "Means of generation" refers to methods for generating digital content using AI technology based on information provided by users and companies.

[1799] "Methods of registering on a blockchain" refer to the means of recording generated digital content or NFTs on a distributed ledger to guarantee their existence.

[1800] "Means of distribution" refers to the means of transferring generated NFTs or digital content to specific users and distributing ownership of them.

[1801] "Means of granting benefits" refers to means of providing specific rewards or benefits based on NFTs owned by users.

[1802] "Means to facilitate secondary trading" refer to means that when generated NFTs are traded between other users, transactions are tracked and recorded, and benefits are provided to the new owners.

[1803] "Means of recognizing user emotions" refers to methods for identifying a user's emotional state by utilizing technologies that analyze emotions from the user's facial expressions, voice, etc.

[1804] "Means for customizing NFTs generated based on emotion recognition" refers to means of changing the design and content of generated NFTs according to the recognized emotions of the user, thereby providing more personalized content.

[1805] "Means of participating in in-store campaigns" refers to the means by which users can participate in marketing events and campaigns held at physical stores.

[1806] The system that realizes this invention is composed of a combination of a smartphone, a server, blockchain technology, AI technology, and emotion recognition technology. The processing of the system's program is described below.

[1807] First, the user accesses the application using their smartphone. The application provides an interface for the user to enter their name, email address, and digital wallet address. This information is sent from the smartphone to the server, which stores it in a database. The server then sends a registration confirmation email to the user, completing the user registration process.

[1808] Next, to participate in the campaign at a physical store, the user scans a campaign-specific QR code using their smartphone. Once their participation is approved, the user expresses their emotions using their smartphone's camera and microphone. The smartphone device captures the user's facial expressions and voice data and sends it to the server.

[1809] The server inputs the received video and audio data into an emotion recognition engine (such as Microsoft Azure Cognitive Services) to analyze the user's emotions. The analyzed emotion data is sent to a generative AI model (OpenAI GPT-4). The generative AI model generates an original NFT based on the provided emotion data and campaign information. The generated NFT is registered on the blockchain by the server, and a token ID is obtained. This token ID is sent to the user's digital wallet.

[1810] Users can view their owned NFTs by checking their digital wallets. The server grants rewards for owned NFTs, which may be added based on the user's sentiment. Owned NFTs can also be traded with other users, and this transaction information is recorded on the blockchain. The server tracks the transaction history and provides similar rewards to new owners.

[1811] This system allows users to acquire customized NFTs tailored to their emotions and enjoy rewards. It also enables businesses to enhance emotion-based engagement.

[1812] A concrete example is the "Cherry Blossom Festival Campaign." In this campaign, the following prompt sentences are input to the generating AI model.

[1813] Prompt: For the cherry blossom festival campaign theme, generate an NFT with a design that evokes the feeling of spring, based on the user's smiling face.

[1814] Based on this prompt, the AI ​​model generates a spring-themed NFT incorporating the user's smiling face into its design and distributes it to the user. In this way, a unique digital campaign that makes the most of the user's emotions can be realized.

[1815] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1816] Step 1:

[1817] The user accesses the application using their smartphone and enters their name, email address, and digital wallet address. They enter the information into the input form on the smartphone screen and tap the "Register" button. This action sends the entered data from the device to the server.

[1818] Input: Name, email address, digital wallet address

[1819] Output: User information sent to the server

[1820] Step 2:

[1821] The server saves the received user information to the database. SQL statements related to saving the user information are executed in the database. If the saving is successful, the server generates a registration confirmation email and sends it to the user's email address.

[1822] Input: Received user information

[1823] Output: User information stored in the database, registration confirmation email sent.

[1824] Step 3:

[1825] Users scan the campaign's QR code with their smartphones at physical stores. They activate their smartphone's camera and read the QR code. This information is sent to the server as campaign participation information.

[1826] Input: Campaign QR code

[1827] Output: Campaign participation information sent to the server

[1828] Step 4:

[1829] The server receives campaign participation information and prepares to recognize the user's emotions. This involves calling the emotion recognition engine. The user expresses their emotions using their smartphone's camera and microphone.

[1830] Input: Campaign participation information

[1831] Output: Instructions for expressing emotions

[1832] Step 5:

[1833] The smartphone device acquires the user's facial expressions and voice data and transmits it to the server in real time. The data is compressed and efficiently sent to the server using a transfer protocol.

[1834] Input: Facial expression data, audio data

[1835] Output: Sentiment data sent to the server

[1836] Step 6:

[1837] The server inputs the received video and audio data into an emotion recognition engine (such as Microsoft Azure Cognitive Services) to analyze the user's emotions. The analysis results are stored as emotion data and sent to the generating AI model.

[1838] Input: Received video and audio data

[1839] Output: Analyzed sentiment data

[1840] Step 7:

[1841] The generative AI model (OpenAI GPT-4) generates original NFTs based on the provided sentiment data and campaign information. The generative AI model receives campaign information as input in the form of prompt sentences.

[1842] Input: Sentiment data, campaign information

[1843] Output: Generated NFT data

[1844] Step 8:

[1845] The server registers the generated NFT on the blockchain. This includes creating and confirming the transaction. It connects to the blockchain network and obtains the token ID.

[1846] Input: Generated NFT data

[1847] Output: Token ID registered on the blockchain

[1848] Step 9:

[1849] The server sends the acquired token ID to the user's digital wallet and notifies the user that the NFT has been distributed. The distribution history is also recorded in the database.

[1850] Input: Token ID

[1851] Output: Token ID sent to digital wallet, updated database

[1852] Step 10:

[1853] The server grants rewards based on NFT information obtained from the user's digital wallet. Emotion-based rewards are also added. Reward information is reflected in the user's account and the user is notified.

[1854] Input: NFT information from a digital wallet

[1855] Output: Benefits granted to the user, updated user account information

[1856] Step 11:

[1857] When a user resells an NFT, the new transaction information is recorded on the blockchain. The server retrieves the transaction history and provides benefits to the new owner.

[1858] Input: Blockchain transaction information

[1859] Output: Updated transaction history, benefits granted to the new owner

[1860] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1861] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1862] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1863] [Fourth Embodiment]

[1864] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1865] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1866] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1867] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1868] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1869] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1870] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1871] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1872] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1873] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1874] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1875] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1876] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1877] The present invention is a system that includes means for generating, means for registering on a blockchain, means for distributing, means for granting benefits, and means for facilitating secondary trading. The processing of the program of this system will be described in detail in natural language below.

[1878] User registration process

[1879] 1. Enter user information

[1880] User actions: To participate in the campaign, users must enter their name, email address, and digital wallet address on a dedicated website.

[1881] 2. Sending data

[1882] Terminal action: Send the entered user data to the server.

[1883] 3. Saving registration information

[1884] Server action: The received user data is saved to the database, and a registration confirmation email is sent to the user.

[1885] NFT generation request process

[1886] 1. Enter campaign information

[1887] Corporate actions: Companies enter necessary information such as the campaign name, theme, and brand logo, and request NFT generation.

[1888] 2. Input to the Generative AI Model

[1889] Server actions: Provide campaign information to the AI ​​model that generates it, and process it to generate the original NFT.

[1890] 3. NFT creation and blockchain registration

[1891] Generative AI model's actions: It generates original NFTs based on the input campaign information and returns the generated NFT data to the server.

[1892] Server actions: Register the generated NFT on the blockchain and obtain the token ID. Then, assign the token ID to the company and notify them.

[1893] NFT distribution process

[1894] 1. Select User Information

[1895] Company actions: Companies select users to distribute NFTs to from a list of campaign participants.

[1896] 2. Sending the Token ID

[1897] Server action: Send the token ID to the selected user's digital wallet address.

[1898] 3. Record of distribution history

[1899] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[1900] Reward Granting Process

[1901] 1. Application for benefits

[1902] User actions: Users log in to the campaign site, display the NFTs they own, and apply for the reward.

[1903] 2. Ownership confirmation

[1904] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[1905] 3. Granting of benefits

[1906] Server action: Grant reward information to the user's account and display instructions on how to use the reward.

[1907] Secondary distribution promotion process

[1908] 1. NFT trading

[1909] User actions: Users trade their NFTs on online marketplaces. This information is recorded on the blockchain.

[1910] 2. Record of transaction history

[1911] Server action: Retrieve transaction history from the blockchain and record it in the database.

[1912] 3. Verification of the new owner

[1913] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[1914] For example, if company A conducts a "summer campaign," company A inputs campaign information and brand logo into a server. Based on this, a generation AI model generates an original NFT and registers it on the blockchain. The registered NFT is distributed to campaign participants, who can receive their rewards along with their application. Furthermore, users can trade the NFT on an online marketplace, and new owners can also receive rewards, thus continuously maintaining the value and appeal of the NFT.

[1915] The following describes the processing flow.

[1916] Step 1:

[1917] User actions: Users must access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[1918] Step 2:

[1919] Terminal action: Send the entered information to the server.

[1920] Step 3:

[1921] Server action: Save the received user information to the database.

[1922] Step 4:

[1923] Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[1924] Step 5:

[1925] Company actions: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[1926] Step 6:

[1927] Terminal action: Send the entered campaign information to the server.

[1928] Step 7:

[1929] Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[1930] Step 8:

[1931] Generative AI model's actions: It generates an original NFT based on the provided campaign information and returns the generated NFT data to the server.

[1932] Step 9:

[1933] Server action: Register the generated NFT on the blockchain and obtain the token ID.

[1934] Step 10:

[1935] Server action: Assign the acquired token ID to the company's account and notify the company.

[1936] Step 11:

[1937] Company actions: Companies select a list of target users to distribute NFTs to campaign participants.

[1938] Step 12:

[1939] Server action: Send the token ID to the selected user's digital wallet address.

[1940] Step 13:

[1941] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[1942] Step 14:

[1943] User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[1944] Step 15:

[1945] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[1946] Step 16:

[1947] Server action: Grant reward information to the user's account and display details and instructions on how to use the reward.

[1948] Step 17:

[1949] User actions: Users trade their NFTs on online marketplaces and record the transactions on the blockchain.

[1950] Step 18:

[1951] Server action: Retrieve transaction history from the blockchain and record it in the database.

[1952] Step 19:

[1953] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[1954] (Example 1)

[1955] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1956] Traditional NFT systems struggled to efficiently manage campaign information and consistently oversee everything from user registration to NFT generation and distribution, reward granting, and facilitating secondary market share. Furthermore, the lack of a mechanism to grant rewards to generated NFTs and ensure those rewards carried over into secondary market share meant that the full value of NFTs was not being realized. This resulted in decreased user engagement and a weakened effectiveness of campaigns conducted by companies and organizations.

[1957] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1958] In this invention, the server includes means for inputting user information, means for transmitting the inputted user information, means for storing the transmitted user information, means for inputting campaign information, means for transmitting the campaign information to a generation AI model and generating an NFT, means for registering the generated NFT on the blockchain, means for distributing the generated NFT, means for granting benefits to users who own the generated NFT, and means for recording secondary transactions and granting benefits to new owners. This realizes a system that can centrally manage everything from user registration to NFT generation, distribution, benefit granting, and secondary transactions, making it possible to improve user engagement and maximize the effectiveness of campaigns for companies and organizations.

[1959] "Means for entering user information" refers to the means by which users enter their personal information, digital wallet addresses, etc., into a dedicated input form.

[1960] "Means for transmitting entered user information" refers to the means for sending information entered by a user to a server.

[1961] "Means for storing transmitted user information" refers to the means by which the server stores the received user information in a database.

[1962] "Means for entering campaign information" refers to the means by which companies and organizations enter information related to their campaigns (such as name, theme, and brand logo).

[1963] "Means for sending campaign information to a generation AI model and generating an NFT" refers to a means by which a server provides campaign information to a generation AI model and generates an original NFT.

[1964] "Methods for registering generated NFTs on the blockchain" refers to methods for recording generated NFTs on the blockchain as notarization.

[1965] "Means of distributing generated NFTs" refers to the means by which a company or organization distributes NFTs it has generated to specific users.

[1966] "Means of granting benefits to users who own generated NFTs" refers to the means by which users who own NFTs can receive benefits related to the campaign.

[1967] "Means of recording secondary transactions and providing benefits to new owners" refers to a means of recording information about new owners after NFTs have been traded on the secondary market, and providing benefits to those owners as well.

[1968] Modes for carrying out the invention

[1969] This invention is a system that consistently manages user information registration, campaign information input, NFT generation, distribution, reward granting, and secondary distribution. The program processing of this system will be described step by step.

[1970] User information registration

[1971] Users access a dedicated website and use a form to enter personal information such as their name, email address, and digital wallet address. This input form is created using HTML5 and validated on the client side using JavaScript. The entered data is sent to the server in JSON format using encrypted communication (SSL / TLS).

[1972] The server executes a PHP script to save the received user data to the MariaDB database. Once registration is complete, a confirmation email is sent to the user via the SMTP server.

[1973] Enter campaign information

[1974] Company and organization representatives log in to a dedicated management screen and enter information such as the campaign name, theme, and brand logo. The input form is subject to validation rules, and the information is checked accordingly.

[1975] Once campaign information is entered, the server uses a Python script to send a prompt to a generative AI model (e.g., GPT-3). This generative AI model generates an NFT based on the entered campaign information. An example of a specific prompt message is shown below:

[1976] "Please create an original NFT for our summer campaign. The theme is 'Summer Scenery,' and please use your brand logo."

[1977] NFT generation and registration

[1978] The generative AI model generates digital art based on campaign information and returns the data to the server in BASE64 format. The server registers this data on the Ethereum blockchain and obtains a token ID. This token ID is associated with the company's account and notified to the relevant person.

[1979] Distribution of NFTs

[1980] Company or organization representatives view a list of campaign participants from an administration screen and select specific users to receive NFTs. The server creates a transaction to send the token ID to the selected user's digital wallet address and sends it to the blockchain. The distribution history is recorded in a database, and reward information is added to the user's account.

[1981] Benefits

[1982] Users log in to the campaign website, display the NFTs they own, and apply for the reward. The server retrieves the NFT information from the user's digital wallet and verifies ownership. After that, the reward information is added to the user's account, and instructions on how to use it are displayed.

[1983] Management of the secondary market

[1984] Users can trade their NFTs on online marketplaces (such as OpenSea). The server uses blockchain APIs to retrieve transaction history and record it in a database. New owners are also granted or updated with bonus information.

[1985] This system allows for the consistent management of the entire process, from user information registration to NFT generation, distribution, reward granting, and secondary market management, thereby improving user engagement. It functions as a comprehensive solution to maximize the effectiveness of campaigns conducted by companies and organizations.

[1986] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1987] Step 1: Enter user information

[1988] Users access a dedicated website and enter personal information such as their name, email address, and digital wallet address. This input form is created using HTML5, and validation is performed using JavaScript.

[1989] input:

[1990] name

[1991] email address

[1992] Digital wallet address

[1993] output:

[1994] User data in JSON format

[1995] Specific actions:

[1996] The user opens a web browser, enters the required information, and clicks the "Submit" button.

[1997] Step 2: Send

[1998] The terminal converts the entered user data into JSON format and sends it to the server using the HTTPS protocol. Encrypted communication (SSL / TLS) is used during this process.

[1999] input:

[2000] User data in JSON format

[2001] output:

[2002] HTTPS request to the server

[2003] Specific actions:

[2004] The user's input information is encoded in JSON format by the device, and an HTTPS request is sent to the server.

[2005] Step 3: Save registration information

[2006] The server saves the received user data to the MariaDB database. A PHP script performs database operations and, upon success, sends a registration confirmation email using the SMTP server.

[2007] input:

[2008] User data in JSON format

[2009] output:

[2010] Adding records to the database

[2011] Sending a registration confirmation email

[2012] Specific actions:

[2013] The server inserts the received user data into the database, and a confirmation email is sent via a PHP script.

[2014] Step 4: Enter campaign information

[2015] Company representatives log in to a dedicated management screen and enter information such as the campaign name, theme, and brand logo. Form validation rules are then applied.

[2016] input:

[2017] Campaign Name

[2018] theme

[2019] Brand logo

[2020] output:

[2021] Campaign information in JSON format

[2022] Specific actions:

[2023] The company representative opens the backend management screen, enters the necessary campaign information, and clicks the "Request" button.

[2024] Step 5: Input into the Generative AI Model

[2025] The server uses a Python script to send the input campaign information as a prompt to a generating AI model (such as GPT-3), requesting it to generate an original NFT.

[2026] input:

[2027] Campaign information in JSON format

[2028] output:

[2029] Digital art data (BASE64 format) generated based on this.

[2030] Specific actions:

[2031] The server sends campaign information as a prompt to the generation AI model. Example prompt: "Generate an original NFT for our summer campaign. The theme is 'Summer Scenery,' and please use the brand logo."

[2032] Step 6: NFT creation and blockchain registration

[2033] The generation AI model generates original digital art data based on campaign information and sends it back to the server in BASE64 format. The digital art data is registered on the Ethereum blockchain, and a token ID is generated.

[2034] input:

[2035] Digital art data in BASE64 format

[2036] output:

[2037] Token ID

[2038] Specific actions:

[2039] The server registers the digital art data received from the generating AI model on the blockchain via a smart contract, obtains a token ID, and notifies the company.

[2040] Step 7: Select User Information

[2041] The company representative displays the campaign participant list from the management screen and selects the users to whom the NFTs will be distributed.

[2042] input:

[2043] List of campaign participants

[2044] output:

[2045] User data eligible for NFT distribution

[2046] Specific actions:

[2047] The company representative selects a specific user from the participant list and clicks the distribution button.

[2048] Step 8: Sending the Token ID

[2049] The server sends the token ID to the selected user's digital wallet address. A smart contract is used to transfer ownership of the token.

[2050] input:

[2051] User's digital wallet address

[2052] Token ID

[2053] output:

[2054] Transaction approval

[2055] Specific actions:

[2056] The server generates a transaction and sends the token ID to the user's digital wallet address.

[2057] Step 9: Recording the distribution history

[2058] The server records the distribution history of NFTs in a database and assigns reward information to the user's account.

[2059] input:

[2060] Transaction information

[2061] output:

[2062] Recording of distribution history in the database

[2063] Bonus information is provided.

[2064] Specific actions:

[2065] The server saves the distribution history to a database and adds the reward information to the user's account.

[2066] Step 10: Apply for benefits

[2067] Users log in to the campaign website, display the NFTs they own, and apply for the rewards.

[2068] input:

[2069] User account information

[2070] output:

[2071] Application for benefits

[2072] Specific actions:

[2073] Users log in to the campaign website, view a list of their owned NFTs, and click the reward application button.

[2074] Step 11: Ownership Verification

[2075] The server retrieves NFT information from the user's digital wallet and verifies ownership.

[2076] input:

[2077] User's digital wallet address

[2078] output:

[2079] Ownership confirmation result

[2080] Specific actions:

[2081] The server uses the Ethereum API to check the user's digital wallet and verify ownership.

[2082] Step 12: Granting of benefits

[2083] The server assigns the reward information to the user's account and displays instructions on how to use the reward.

[2084] input:

[2085] Ownership confirmation result

[2086] output:

[2087] Benefit Usage Information

[2088] Specific actions:

[2089] The server adds the reward information to the user's account and displays instructions on how to use the reward on the dashboard.

[2090] Step 13: NFT Transaction

[2091] Users trade their NFTs on an online marketplace, and this information is recorded on the blockchain.

[2092] input:

[2093] User NFTs

[2094] output:

[2095] Transaction records

[2096] Specific actions:

[2097] Users sell NFTs on the marketplace, and the transaction data is recorded on the blockchain.

[2098] Step 14: Recording Transaction History

[2099] The server retrieves transaction history from the blockchain and records it in a database.

[2100] input:

[2101] Transaction records

[2102] output:

[2103] Recording to the database

[2104] Specific actions:

[2105] The server uses the Ethereum REST API to retrieve transaction history and save it to a database.

[2106] Step 15: New Owner Verification

[2107] The server verifies the new owner's NFT information and grants or updates the benefits to that owner.

[2108] input:

[2109] New owner's wallet information

[2110] output:

[2111] Updated bonus information

[2112] Specific actions:

[2113] The server verifies the new owner's wallet data and grants or updates reward information.

[2114] (Application Example 1)

[2115] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2116] Traditional virtual stores lacked mechanisms to ensure users continuously enjoyed the benefits and value they received when purchasing products. Furthermore, the scope of available benefits was often limited, sometimes leading to low user engagement. This made long-term customer retention and transaction promotion a challenge for virtual stores.

[2117] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[2118] In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting rewards, means for facilitating secondary trading, means for users to acquire NFTs when purchasing goods in a virtual store, means for users to receive rewards using the acquired NFTs, and means for users to trade the acquired NFTs with other users. This makes it possible for users to receive rewards while utilizing NFTs obtained through product purchases, and to continue to enjoy value by trading NFTs.

[2119] "Generation method" refers to a function for creating original NFTs based on information specified by users or companies.

[2120] "Methods for registering on the blockchain" refers to the function of recording the information of a generated NFT on the blockchain in a tamper-proof manner.

[2121] "Means of distribution" refers to the function of sending the generated NFT to the digital wallet of a designated user.

[2122] "Means of granting benefits" refers to functions that provide specific services or items based on NFTs owned by users.

[2123] "Means to promote secondary trading" refers to a function that allows users to trade NFTs they own with other users and records the transaction history on the blockchain.

[2124] "Means for obtaining NFTs when a user purchases products in a virtual store" refers to a function that automatically generates and obtains NFTs when a user purchases products in a virtual store.

[2125] "A means of receiving rewards using NFTs acquired by the user" refers to a function that allows users to redeem specific rewards by utilizing NFTs they have acquired.

[2126] "A means for users to trade NFTs they have acquired with other users" refers to a function that allows users to exchange NFTs they own with other users and transfer ownership of those NFTs.

[2127] This invention is a system for granting rewards and conducting transactions using NFTs (Non-Fungible Tokens) to enhance user engagement in virtual stores. The program processing of this system is described in detail below.

[2128] The server will utilize hardware and software that include the following key functions. The hardware will include a web server, database server, and blockchain nodes, while the software will utilize Flask (a web framework), generative AI models (such as GPT-3 and DALL-E), and blockchain libraries (such as Ethereum and Hyperledger).

[2129] First, when a user purchases an item within the application, they register using their digital wallet address. This registration information is stored in a database by the server. At this point, the AI ​​model generates an original NFT based on the input information. For example, if a user purchases a "summer limited item," providing this information to the AI ​​as a prompt generates the corresponding NFT. The prompt message takes the following format:

[2130] Example of a prompt:

[2131] Campaign Name: Summer Special Campaign

[2132] Theme: Summer Memories

[2133] Brand logo: https: / / example.com / logo.png

[2134] User ID: 12345

[2135] Product ID:xyz678

[2136] The generated NFTs are registered on the blockchain to prevent tampering and prove ownership. Next, the generated NFTs are sent to the user's digital wallet. The user can then use the NFTs to receive rewards. For example, they might be able to obtain exclusive items or discount coupons by participating in a campaign.

[2137] Furthermore, users can trade acquired NFTs with other users. Information on traded NFTs is recorded on the blockchain, and new owners can also receive the same benefits. This ensures that the value of NFTs is continuously maintained and enhances engagement within virtual stores.

[2138] As a concrete example, suppose user A purchases a limited-edition summer item in a virtual store and receives an NFT as a result of the purchase. Using this NFT, user A can receive a special discount. Subsequently, user A can transfer the NFT to their friend, user B, who can then enjoy the same benefits. This promotes interaction between users and continuously maintains the value and interest of the NFT.

[2139] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[2140] Step 1:

[2141] When a user purchases a product, they enter their digital wallet address within the virtual store application and send the purchase information to the server.

[2142] Input: User's digital wallet address, product ID, purchase information

[2143] Output: Purchase information sent to the server

[2144] Specific operation: When a user selects a product and clicks the purchase button, the purchase information is sent to the server via the application.

[2145] Step 2:

[2146] The server saves the received purchase information to a database and verifies the purchase details to create prompts for the AI ​​model.

[2147] Input: Purchase information sent to the server

[2148] Output: Purchase information stored in the database, prompts for the generated AI model.

[2149] Specific operation: The server analyzes purchase information, extracts campaign name, theme, brand logo, user ID, product ID, etc., and provides this information to the AI ​​model that generates prompt messages.

[2150] Step 3:

[2151] The server takes prompt messages into the generating AI model to create an original NFT.

[2152] Input: Prompt message

[2153] Output: Generated NFT data

[2154] Specific operation: The generation AI model analyzes the prompt text, generates an original NFT based on it, and returns that data to the server.

[2155] Step 4:

[2156] The server receives the generated NFT data and registers it on the blockchain.

[2157] Input: Generated NFT data

[2158] Output: Token ID on the blockchain

[2159] Specific operation: The server communicates with the blockchain node and records the NFT data as a transaction on the blockchain. Once registration is complete, a token ID is generated and returned to the server.

[2160] Step 5:

[2161] The server sends the acquired token ID to the user's digital wallet address and distributes the NFT.

[2162] Input: Token ID, User's digital wallet address

[2163] Output: NFTs registered in the user's digital wallet

[2164] Specific operation: The server assigns the token ID to the user's digital wallet address and distributes the NFT.

[2165] Step 6:

[2166] Users can use the acquired NFT to receive rewards within the application.

[2167] Input: NFTs registered in the user's digital wallet

[2168] Output: Benefits (e.g., discount coupons, limited-edition items)

[2169] Specific operation: When a user requests a reward within the application, the server verifies the wallet address and grants the reward.

[2170] Step 7:

[2171] Users can trade acquired NFTs with other users.

[2172] Input: Digital wallet address of the user trading the NFT, transaction information

[2173] Output: NFT registered to a new owner, transaction history

[2174] Specific operation: Users list their NFTs on an online marketplace, and once a transaction is completed, the server records the transaction information on the blockchain and transfers the NFT to the new owner's wallet.

[2175] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[2176] The present invention is a system that includes means for generating, means for registering on a blockchain, means for distributing, means for granting benefits, means for facilitating secondary trading, and an emotion engine for recognizing user emotions. The processing of the program of this system is described in detail in natural language below.

[2177] User registration process

[2178] 1. User Action: Users access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[2179] 2. Terminal action: Send the entered information to the server.

[2180] 3. Server action: Save the received user information to the database.

[2181] 4. Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[2182] NFT generation request process

[2183] 1. Company Action: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[2184] 2. Terminal action: Send the entered campaign information to the server.

[2185] 3. Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[2186] 4. Measures taken by the generation AI model: Based on the provided campaign information, it generates an original NFT and returns the generated NFT data to the server.

[2187] 5. Server actions: Register the generated NFT on the blockchain and obtain the token ID.

[2188] 6. Server action: Assign the acquired token ID to the company's account and notify the company.

[2189] Emotion recognition process

[2190] 1. User actions: Users express their emotions through a webcam and microphone on the campaign site.

[2191] 2. Terminal actions: The acquired video and audio data is sent to the server.

[2192] 3. Server actions: The received data is input into the emotion engine to analyze the user's emotions.

[2193] 4. Emotion Engine Measures: Generate data to adjust the design and content of the NFT based on the user's emotions, and return it to the server.

[2194] NFT distribution process

[2195] 1. Company actions: Companies select a list of target users in order to distribute NFTs to campaign participants.

[2196] 2. Server action: Send the token ID to the selected user's digital wallet address.

[2197] 3. Server measures: Record the distribution history in the database and assign the reward information to the user's account.

[2198] Reward Granting Process

[2199] 1. User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[2200] 2. Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[2201] 3. Server action: The server will assign the reward information to the user's account and display the details of the reward and how to use it.

[2202] 4. Server measures: Based on the analysis results from the emotion engine, additional benefits corresponding to the user's emotions will be provided.

[2203] Secondary distribution promotion process

[2204] 1. User actions: Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[2205] 2. Server measures: Retrieve transaction history from the blockchain and record it in the database.

[2206] 3. Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[2207] As a concrete example, if company B conducts a "Spring Campaign," company B inputs campaign information and brand logo into a server. Based on this, a generation AI model generates an original NFT and registers it on the blockchain. Users express their emotions on the campaign website, and these emotions are analyzed by an emotion engine. Based on the analysis results, customized NFTs are distributed. Users can use these NFTs to apply for rewards and receive additional rewards tailored to their emotions. NFTs are traded on an online marketplace, and rewards are provided to new owners along with the transaction history.

[2208] This system allows companies to develop unique campaigns that incorporate user emotions, thereby increasing customer engagement and loyalty.

[2209] The following describes the processing flow.

[2210] Step 1:

[2211] User actions: Users must access the campaign website and enter the required information, including their name, email address, and digital wallet address.

[2212] Step 2:

[2213] Terminal action: Send the entered information to the server.

[2214] Step 3:

[2215] Server action: Save the received user information to the database.

[2216] Step 4:

[2217] Server action: Send a registration confirmation email to the user to inform them that registration is complete.

[2218] Step 5:

[2219] Company actions: Companies enter campaign information (campaign name, theme, brand logo, etc.) through the management screen and request NFT generation.

[2220] Step 6:

[2221] Terminal action: Send the entered campaign information to the server.

[2222] Step 7:

[2223] Server action: Based on the received campaign information, a request for NFT generation is sent to the AI ​​model.

[2224] Step 8:

[2225] Generative AI model's actions: It generates an original NFT based on the provided campaign information and returns the generated NFT data to the server.

[2226] Step 9:

[2227] Server action: Register the generated NFT on the blockchain and obtain the token ID.

[2228] Step 10:

[2229] Server action: Assign the acquired token ID to the company's account and notify the company.

[2230] Step 11:

[2231] Company actions: Companies select a list of target users to distribute NFTs to campaign participants.

[2232] Step 12:

[2233] Server action: Send the token ID to the selected user's digital wallet address.

[2234] Step 13:

[2235] Server action: Record the distribution history in the database and assign the reward information to the user's account.

[2236] Step 14:

[2237] User actions: Users will use a webcam and microphone on the campaign site to express emotions.

[2238] Step 15:

[2239] Terminal action: Send the acquired video and audio data to the server.

[2240] Step 16:

[2241] Server action: The received data is input into the emotion engine to analyze the user's emotions.

[2242] Step 17:

[2243] Emotion Engine Action: Based on the user's emotion analysis results, the system generates data to adjust the design and content of the NFT and returns it to the server.

[2244] Step 18:

[2245] Server action: Re-register the adjusted NFT data on the blockchain and obtain the updated token ID.

[2246] Step 19:

[2247] Server action: Send the updated NFT to the user's digital wallet.

[2248] Step 20:

[2249] User Action: Users log in to the campaign website, verify the NFTs they own, and apply for the reward.

[2250] Step 20:

[2251] Server action: Retrieve NFT information from the user's digital wallet and verify ownership.

[2252] Step 21:

[2253] Server action: Grant reward information to the user's account and display details and instructions on how to use the reward.

[2254] Step 22:

[2255] Server action: Based on the sentiment analysis results, provide additional special benefits that correspond to the user's emotions.

[2256] Step 23:

[2257] User actions: Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[2258] Step 24:

[2259] Server action: Retrieve transaction history from the blockchain and record it in the database.

[2260] Step 25:

[2261] Server action: Verify the NFT information of the new owner and grant or update the benefits to that owner.

[2262] (Example 2)

[2263] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2264] Traditional campaign systems lacked the mechanisms to incorporate user emotions, generate digital content based on that content, and then reward users accordingly. This made it difficult to improve user engagement and provide personalized experiences. Furthermore, smoothly facilitating the secondary market for generated digital content (NFTs) and properly managing transaction information were also challenges.

[2265] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[2266] In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting rewards, means for facilitating secondary trading, means for performing sentiment analysis, and means for adjusting the digital content based on the sentiment analysis results. This makes it possible to generate unique digital content (NFTs) that incorporate the user's emotions and to provide rewards that correspond to the user's emotions. Furthermore, it enables the smooth promotion of secondary trading and management of transaction information.

[2267] "Generation means" refers to a function that automatically creates digital content (NFTs) based on information entered by users or companies.

[2268] "Methods for registering on the blockchain" refers to the function of writing ownership information of generated digital content onto the blockchain and obtaining a token ID.

[2269] "Means of distribution" refers to the function of transmitting generated digital content to users or participants and transferring ownership.

[2270] "Means of providing benefits" refers to functions that offer campaign benefits or additional rewards to users who own digital content.

[2271] "Means to promote secondary distribution" refer to functions that support the re-trading of generated digital content on online marketplaces and manage transaction information on the blockchain.

[2272] "Means for performing emotion analysis" refers to a function that analyzes the user's video and audio data to recognize their emotions and utilize the results.

[2273] "Means for adjusting digital content based on sentiment analysis results" refers to a function for optimizing the design and content of digital content based on the user's emotions obtained through sentiment analysis.

[2274] This invention relates to a system that generates and distributes digital content (NFTs) based on user sentiment analysis results and appropriately grants benefits related to them. This system mainly consists of three elements: a server, a terminal, and a user.

[2275] First, the user accesses the campaign website. They enter the required information, such as their name, email address, and digital wallet address, into a web form on the site and submit it. This information is sent from the device to the server and stored in the server's database. After saving the data, the server sends a registration confirmation email to the user.

[2276] When a company requests NFT generation, the company representative enters campaign information (campaign name, theme, brand logo, etc.) through the management screen. This information is sent from the terminal to the server, and the server sends a request to the generation AI model based on the received information. The generation AI model generates an NFT based on the campaign information and returns the data to the server. The server registers the generated NFT on the blockchain and obtains a token ID. The obtained token ID is assigned to the company's account and the company is notified.

[2277] Next, in the user emotion analysis process, users express their emotions using a webcam and microphone on the campaign website. This video and audio data is sent from the device to the server, which inputs it into the emotion analysis engine for analysis. Based on the analysis results, the NFT is adjusted with a design and content that corresponds to the emotion and provided to the user.

[2278] In NFT distribution, companies distribute NFTs to a list of target users selected from campaign participants via an administration screen. The server sends the token ID to the user's digital wallet and records the distribution history and reward information in a database. Users can verify their owned NFTs and apply for rewards; once ownership is confirmed, the rewards are granted.

[2279] Furthermore, in the secondary market process, when a user trades an NFT on an online marketplace, the transaction information is recorded on the blockchain. The server retrieves this information and grants or updates benefits to the new owner.

[2280] As a concrete example, in the case of a "Spring Campaign," the company inputs campaign information and brand logo into the server, and based on that, a generation AI model generates an original NFT. Users express their emotions on the campaign site, and their emotions are analyzed by an emotion analysis engine, and a customized NFT is distributed. Users can use that NFT to apply for rewards and receive additional rewards according to their emotions. An example of a prompt message would be, "Please generate an NFT for the Spring Campaign. The theme is 'Flowers,' and the brand logo is 'the logo of XX Corporation.'"

[2281] This system can enhance customer engagement and loyalty by generating unique digital content (NFTs) that incorporate user emotions and offering rewards based on those experiences.

[2282] The flow of the specific processing in Example 2 will be explained using Figure 13.

[2283] User registration process

[2284] Step 1:

[2285] User actions

[2286] Users access the campaign website, fill in the required information including their name, email address, and digital wallet address in the web form, and click the "Submit" button.

[2287] Input: Name, email address, digital wallet address

[2288] Output: Input data is sent to the terminal.

[2289] Step 2:

[2290] Terminal measures

[2291] The terminal sends the entered information to the server as an HTTP POST request.

[2292] Input: Information entered by the user

[2293] Output: Information is sent to the server.

[2294] Step 3:

[2295] Server measures

[2296] The server stores the received user information in a database. Specifically, it establishes a database connection, executes SQL queries, and saves the user information.

[2297] Input: User information sent from the device

[2298] Output: Information stored in the database

[2299] Step 4:

[2300] Server measures

[2301] The server sends a registration confirmation email to the user to notify them that registration is complete. Specifically, it uses an SMTP server to send the email.

[2302] Input: User's email address

[2303] Output: A registration confirmation email is sent to the user.

[2304] NFT generation request process

[2305] Step 1:

[2306] Corporate measures

[2307] Companies enter campaign information from the administration screen and click the "Request Generation" button.

[2308] Input: Campaign name, theme, brand logo

[2309] Output: Input data is sent to the terminal.

[2310] Step 2:

[2311] Terminal measures

[2312] The terminal sends the entered campaign information to the server as an HTTP POST request.

[2313] Input: Campaign information entered by the company

[2314] Output: Information is sent to the server.

[2315] Step 3:

[2316] Server measures

[2317] The server sends a request to the generating AI model based on the received campaign information. Specifically, it generates a prompt message and sends a request to the generating AI model's API.

[2318] Input: Company campaign information

[2319] Output: Request to the Generative AI Model

[2320] Step 4:

[2321] Measures taken by generative AI models

[2322] The generative AI model generates an original NFT based on the provided information and returns the generated data to the server.

[2323] Input: Request from server

[2324] Output: Generated NFT data

[2325] Step 5:

[2326] Server measures

[2327] The server registers the generated NFT on the blockchain and obtains a token ID. Specifically, it registers the data using the blockchain API.

[2328] Input: NFT data from generated AI models

[2329] Output: Token ID registered on the blockchain

[2330] Step 6:

[2331] Server measures

[2332] The acquired token ID is assigned to the company's account, and a notification is sent via email or dashboard.

[2333] Input: Token ID

[2334] Output: Assigned to the corporate account and a notification is sent.

[2335] Emotion recognition process

[2336] Step 1:

[2337] User actions

[2338] Users express their emotions using a webcam and microphone on the campaign website.

[2339] Input: User's video and audio data

[2340] Output: Video and audio data are acquired by the device.

[2341] Step 2:

[2342] Terminal measures

[2343] The acquired video and audio data is encoded and sent to the server as an HTTP POST request.

[2344] Input: User's video and audio data

[2345] Output: Data sent to the server

[2346] Step 3:

[2347] Server measures

[2348] The received data is input into the emotion engine for analysis. Specifically, the data is sent to the emotion engine's API, and the analysis results are received.

[2349] Input: Data sent from the device

[2350] Output: Data sent to the emotion engine

[2351] Step 4:

[2352] Emotional Engine Measures

[2353] The emotion engine generates data to adjust the design and content based on the analysis results and returns it to the server.

[2354] Input: Data from the server

[2355] Output: Analysis results and adjustment data

[2356] NFT distribution process

[2357] Step 1:

[2358] Corporate measures

[2359] Companies select the target user list from the administration screen and click the "Distribute NFT" button.

[2360] Input: List of target users

[2361] Output: Selected user information is sent to the server.

[2362] Step 2:

[2363] Server measures

[2364] The server sends the token ID to the selected user's digital wallet. Specifically, it uses the blockchain API to send the token ID to the wallet.

[2365] Input: Digital wallet address and token ID of the target user

[2366] Output: Token ID is sent to the wallet.

[2367] Step 3:

[2368] Server measures

[2369] The distribution history is recorded in a database, and the bonus information is added to the user's account.

[2370] Input: Distribution history and bonus information

[2371] Output: Distribution history and bonus information stored in the database

[2372] Reward Granting Process

[2373] Step 1:

[2374] User actions

[2375] Users log in to the campaign website, verify their NFTs, and apply for the rewards.

[2376] Input: Owned NFT information

[2377] Output: Application information is sent to the server.

[2378] Step 2:

[2379] Server measures

[2380] The system retrieves NFT information from the user's digital wallet and verifies ownership. Specifically, it uses a blockchain API to verify NFT ownership.

[2381] Input: User's digital wallet information

[2382] Output: Ownership verification result

[2383] Step 3:

[2384] Server measures

[2385] The system assigns reward information to the user's account and displays details and instructions on how to use the rewards.

[2386] Input: Bonus information and ownership verification results

[2387] Output: The reward is credited to the user's account.

[2388] Step 4:

[2389] Server measures

[2390] Based on the analysis results of the emotion engine, additional benefits corresponding to emotions will be provided.

[2391] Input: Sentiment analysis results

[2392] Output: Additional benefits will be provided.

[2393] Secondary distribution promotion process

[2394] Step 1:

[2395] User actions

[2396] Users trade their NFTs on online marketplaces, and this information is recorded on the blockchain.

[2397] Input: Transaction Information

[2398] Output: Transaction information is recorded on the blockchain.

[2399] Step 2:

[2400] Server measures

[2401] The server retrieves transaction history from the blockchain and records it in a database. Specifically, it periodically retrieves transaction information via the blockchain API.

[2402] Input: Blockchain transaction information

[2403] Output: Transaction history stored in the database

[2404] Step 3:

[2405] Server measures

[2406] Verify the NFT information of the new owner and grant or update the benefits to that owner.

[2407] Input: New owner's information

[2408] Output: The benefit is granted or renewed to the new owner.

[2409] (Application Example 2)

[2410] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[2411] Traditional campaign systems and customer engagement strategies have difficulty directly leveraging user emotions, and they do not offer customized rewards or items based on those emotions. As a result, companies have been unable to maximize customer satisfaction and experiential value, and their marketing effectiveness has been limited.

[2412] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for generating, means for registering on the blockchain, means for distributing, means for granting benefits, means for promoting secondary distribution, means for recognizing the user's emotions, means for customizing the NFT generated based on emotion recognition, and means for participating in campaigns at physical stores. This makes it possible to maximize customer satisfaction and experiential value and enhance the marketing effectiveness of companies by recognizing the user's emotions and providing customized NFTs and benefits accordingly.

[2413] "Means of generation" refers to methods for generating digital content using AI technology based on information provided by users and companies.

[2414] "Methods of registering on a blockchain" refer to the means of recording generated digital content or NFTs on a distributed ledger to guarantee their existence.

[2415] "Means of distribution" refers to the means of transferring generated NFTs or digital content to specific users and distributing ownership of them.

[2416] "Means of granting benefits" refers to means of providing specific rewards or benefits based on NFTs owned by users.

[2417] "Means to facilitate secondary trading" refer to means that when generated NFTs are traded between other users, transactions are tracked and recorded, and benefits are provided to the new owners.

[2418] "Means of recognizing user emotions" refers to methods for identifying a user's emotional state by utilizing technologies that analyze emotions from the user's facial expressions, voice, etc.

[2419] "Means for customizing NFTs generated based on emotion recognition" refers to means of changing the design and content of generated NFTs according to the recognized emotions of the user, thereby providing more personalized content.

[2420] "Means of participating in in-store campaigns" refers to the means by which users can participate in marketing events and campaigns held at physical stores.

[2421] The system that realizes this invention is composed of a combination of a smartphone, a server, blockchain technology, AI technology, and emotion recognition technology. The processing of the system's program is described below.

[2422] First, the user accesses the application using their smartphone. The application provides an interface for the user to enter their name, email address, and digital wallet address. This information is sent from the smartphone to the server, which stores it in a database. The server then sends a registration confirmation email to the user, completing the user registration process.

[2423] Next, to participate in the campaign at a physical store, the user scans a campaign-specific QR code using their smartphone. Once their participation is approved, the user expresses their emotions using their smartphone's camera and microphone. The smartphone device captures the user's facial expressions and voice data and sends it to the server.

[2424] The server inputs the received video and audio data into an emotion recognition engine (such as Microsoft Azure Cognitive Services) to analyze the user's emotions. The analyzed emotion data is sent to a generative AI model (OpenAI GPT-4). The generative AI model generates an original NFT based on the provided emotion data and campaign information. The generated NFT is registered on the blockchain by the server, and a token ID is obtained. This token ID is sent to the user's digital wallet.

[2425] Users can view their owned NFTs by checking their digital wallets. The server grants rewards for owned NFTs, which may be added based on the user's sentiment. Owned NFTs can also be traded with other users, and this transaction information is recorded on the blockchain. The server tracks the transaction history and provides similar rewards to new owners.

[2426] This system allows users to acquire customized NFTs tailored to their emotions and enjoy rewards. It also enables businesses to enhance emotion-based engagement.

[2427] A concrete example is the "Cherry Blossom Festival Campaign." In this campaign, the following prompt sentences are input to the generating AI model.

[2428] Prompt: For the cherry blossom festival campaign theme, generate an NFT with a design that evokes the feeling of spring, based on the user's smiling face.

[2429] Based on this prompt, the AI ​​model generates a spring-themed NFT incorporating the user's smiling face into its design and distributes it to the user. In this way, a unique digital campaign that makes the most of the user's emotions can be realized.

[2430] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[2431] Step 1:

[2432] The user accesses the application using their smartphone and enters their name, email address, and digital wallet address. They enter the information into the input form on the smartphone screen and tap the "Register" button. This action sends the entered data from the device to the server.

[2433] Input: Name, email address, digital wallet address

[2434] Output: User information sent to the server

[2435] Step 2:

[2436] The server saves the received user information to the database. SQL statements related to saving the user information are executed in the database. If the saving is successful, the server generates a registration confirmation email and sends it to the user's email address.

[2437] Input: Received user information

[2438] Output: User information stored in the database, registration confirmation email sent.

[2439] Step 3:

[2440] Users scan the campaign's QR code with their smartphones at physical stores. They activate their smartphone's camera and read the QR code. This information is sent to the server as campaign participation information.

[2441] Input: Campaign QR code

[2442] Output: Campaign participation information sent to the server

[2443] Step 4:

[2444] The server receives campaign participation information and prepares to recognize the user's emotions. This involves calling the emotion recognition engine. The user expresses their emotions using their smartphone's camera and microphone.

[2445] Input: Campaign participation information

[2446] Output: Instructions for expressing emotions

[2447] Step 5:

[2448] The smartphone device acquires the user's facial expressions and voice data and transmits it to the server in real time. The data is compressed and efficiently sent to the server using a transfer protocol.

[2449] Input: Facial expression data, audio data

[2450] Output: Sentiment data sent to the server

[2451] Step 6:

[2452] The server inputs the received video and audio data into an emotion recognition engine (such as Microsoft Azure Cognitive Services) to analyze the user's emotions. The analysis results are stored as emotion data and sent to the generating AI model.

[2453] Input: Received video and audio data

[2454] Output: Analyzed sentiment data

[2455] Step 7:

[2456] The generative AI model (OpenAI GPT-4) generates original NFTs based on the provided sentiment data and campaign information. The generative AI model receives campaign information as input in the form of prompt sentences.

[2457] Input: Sentiment data, campaign information

[2458] Output: Generated NFT data

[2459] Step 8:

[2460] The server registers the generated NFT on the blockchain. This includes creating and confirming the transaction. It connects to the blockchain network and obtains the token ID.

[2461] Input: Generated NFT data

[2462] Output: Token ID registered on the blockchain

[2463] Step 9:

[2464] The server sends the acquired token ID to the user's digital wallet and notifies the user that the NFT has been distributed. The distribution history is also recorded in the database.

[2465] Input: Token ID

[2466] Output: Token ID sent to digital wallet, updated database

[2467] Step 10:

[2468] The server grants rewards based on NFT information obtained from the user's digital wallet. Emotion-based rewards are also added. Reward information is reflected in the user's account and the user is notified.

[2469] Input: NFT information from a digital wallet

[2470] Output: Benefits granted to the user, updated user account information

[2471] Step 11:

[2472] When a user resells an NFT, the new transaction information is recorded on the blockchain. The server retrieves the transaction history and provides benefits to the new owner.

[2473] Input: Blockchain transaction information

[2474] Output: Updated transaction history, benefits granted to the new owner

[2475] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[2476] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include those described above. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions shown by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2477] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[2478] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2479] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. In the upper and lower directions of the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. Also, the upper side of the concentric circles is where "pleasant" emotions are located, and the lower side is where "unpleasant" emotions are located. In this way, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[2480] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[2481] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[2482] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[2483] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[2484] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[2485] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[2486] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[2487] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[2488] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2489] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[2490] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[2491] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[2492] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[2493] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[2494] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[2495] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[2496] The following is further disclosed regarding the embodiments described above.

[2497] (Claim 1)

[2498] Means of generating,

[2499] Methods for registering on the blockchain,

[2500] The means of distribution,

[2501] The means of granting benefits,

[2502] Means to promote secondary distribution,

[2503] A system that includes this.

[2504] (Claim 2)

[2505] The system according to claim 1 for entering campaign information.

[2506] (Claim 3)

[2507] The system according to claim 1, which provides benefits to users who own the generated NFTs.

[2508] "Example 1"

[2509] (Claim 1)

[2510] Means of entering user information,

[2511] A means for transmitting the entered user information,

[2512] Means for storing transmitted user information,

[2513] Methods for entering campaign information,

[2514] A means of sending campaign information to an AI model to generate NFTs,

[2515] A means of registering the generated NFT on the blockchain,

[2516] A means of distributing the generated NFTs,

[2517] A means of granting benefits to users who own the generated NFTs,

[2518] A means of recording secondary transactions and providing benefits to new owners,

[2519] A system that includes this.

[2520] (Claim 2)

[2521] The system according to claim 1 for entering campaign information.

[2522] (Claim 3)

[2523] The system according to claim 1, which provides benefits to users who own the generated NFTs.

[2524] "Application Example 1"

[2525] (Claim 1)

[2526] Means of generating,

[2527] Methods for registering on the blockchain,

[2528] The means of distribution,

[2529] The means of granting benefits,

[2530] Means to promote secondary distribution,

[2531] A means for users to obtain NFTs when purchasing products in a virtual store,

[2532] A means for users to receive rewards using NFTs they have acquired,

[2533] A means for users to trade NFTs they have acquired with other users,

[2534] A system that includes this.

[2535] (Claim 2)

[2536] The system according to claim 1 for entering campaign information.

[2537] (Claim 3)

[2538] The system according to claim 1, which provides benefits to users who own the generated NFTs.

[2539] "Example 2 of combining an emotion engine"

[2540] (Claim 1)

[2541] Means of generating,

[2542] Methods for registering on the blockchain,

[2543] The means of distribution,

[2544] The means of granting benefits,

[2545] Means to promote secondary distribution,

[2546] Methods for performing emotion analysis,

[2547] A means of adjusting digital content based on sentiment analysis results,

[2548] A system that includes this.

[2549] (Claim 2)

[2550] The system according to claim 1 for entering campaign information.

[2551] (Claim 3)

[2552] The system according to claim 1, which provides benefits to users who own the generated digital content.

[2553] "Application example 2 when combining with an emotional engine"

[2554] (Claim 1)

[2555] Means of generating,

[2556] Methods for registering on the blockchain,

[2557] The means of distribution,

[2558] The means of granting benefits,

[2559] Means to promote secondary distribution,

[2560] Means of recognizing user emotions,

[2561] A means of customizing NFTs generated based on emotion recognition,

[2562] How to participate in in-store campaigns,

[2563] A system that includes this.

[2564] (Claim 2)

[2565] The system according to claim 1 for entering campaign information.

[2566] (Claim 3)

[2567] The system according to claim 1, which provides benefits to users who own the generated NFTs and provides additional benefits based on recognized emotions. [Explanation of Symbols]

[2568] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Devices 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robots< / url:> < / url:> < / url:> < / url:>

Claims

1. A means of generating original NFTs based on a company's brand and campaign content, A means for recording the generated NFT using distributed ledger technology and generating its token ID, A means by which companies send and distribute generated NFTs to campaign participants via digital wallets, etc. A means of providing benefits or services to NFT owners when they meet certain conditions, When NFTs distributed on the primary market are traded between users, a means of recording the transaction history and providing benefits to the new owner is required. A system that includes this.

2. The system according to claim 1 for inputting campaign information.

3. The system according to claim 1, which provides benefits to users who own the generated NFTs.

Images