system

Abstract

We provide the system. [Solution] A means for generating a virtual character based on parameters entered by the user, A means for the virtual character and the user to communicate bidirectionally, In order to grow the virtual character, means for changing the characteristics of the virtual character based on the user's input, A means for allowing the aforementioned virtual character to interact with other users in a virtual space, A means for generating the aforementioned virtual character as a digital asset and making it tradable, A system that includes this.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In recent years, the number of single people and those who do not engage in romantic relationships has been increasing, and the culture of supporting "oshi" (favorite idol) has been expanding. However, real idols are accompanied by risks such as slander, scandals, and retirements, making it difficult for fans to continue supporting them with peace of mind. In addition, virtual idols also have problems such as the difficulty of the existence of the performers and operation. Furthermore, there is a problem that the interaction between fans and idols is limited and diverse experiences cannot be provided. There is a need to solve these problems and provide a new oshi experience that allows fans to support more comfortably and continuously.

Means for Solving the Problems

[0005] To solve the above-mentioned problems, the present invention provides the following means: a system including means for generating a virtual character based on parameters input by a user, means for the virtual character and the user to communicate bidirectionally, means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character, means for the virtual character to interact with other users in a virtual space, and means for generating the virtual character as a digital asset and making it tradable. With this system, fans can support virtual characters without fear of risk and gain new experiences through various interactions and development. In addition, economic value is created through trading as a digital asset, and interaction among fans is also promoted.

[0006] 1. "User" refers to an individual or group that operates this system and engages in the creation, development, interaction, and trading of virtual characters.

[0007] 2. "Parameters" refer to information that indicates specific characteristics such as gender, age, hairstyle, and voice tone, which are entered by the user when generating a virtual character.

[0008] 3. A "virtual character" refers to a digital idol created using generative AI that operates in a virtual space.

[0009] 4. "Means of two-way communication" refers to methods by which users and virtual characters interact in real time through messages and voice.

[0010] 5. "Means of growth" refers to the system's functions that allow the virtual character's abilities and characteristics to change based on the user's actions and input.

[0011] 6. "Virtual space" refers to a three-dimensional or two-dimensional space built on the internet for users and digital entities to interact with each other.

[0012] 7. "Digital assets" refer to digital assets, including virtual characters, whose ownership is managed using blockchain technology.

[0013] 8. "Means of making tradable" refers to a function within the system for buying, selling, or exchanging virtual characters with other users.

[0014] 9. A "live event" refers to an online activity in which a virtual character interacts with fans in real time and performs or holds events.

[0015] 10. "Blockchain technology" refers to technology for recording transaction information and ownership information in an immutable form and for decentralized management. [Brief explanation of the drawing]

[0016] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of the data processing device and smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] It is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] It shows an emotion map to which a plurality of emotions are mapped. [Figure 10] It shows an emotion map to which a plurality of emotions are mapped. [Figure 11] It is a sequence diagram showing the processing flow of the data processing system in Example 1. [Figure 12] It is a sequence diagram showing the processing flow of the data processing system in Application Example 1. [Figure 13] It is a sequence diagram showing the processing flow of the data processing system in Example 2 when an emotion engine is combined. [Figure 14] It is a sequence diagram showing the processing flow of the data processing system in Application Example 2 when an emotion engine is combined.

Mode for Carrying Out the Invention

[0017] Hereinafter, an example of an embodiment of a system according to the technology of the present disclosure will be described according to the accompanying drawings.

[0018] First, the terms used in the following description will be described.

[0019] In the following embodiments, a processor with a reference numeral (hereinafter simply referred to as "processor") may be one arithmetic unit or a combination of a plurality of arithmetic units. Also, the processor may be one type of arithmetic unit or a combination of a plurality of types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), and the like.

[0020] In the following embodiments, signed RAM (Random Access Memory) is a memory that temporarily stores information and is used as work memory by the processor.

[0021] In the following embodiments, the signed storage is one or more non-volatile storage devices that store various programs and various parameters. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes.

[0022] In the following embodiments, the signed communication interface (I / F) is an interface that includes a communication processor and an antenna, etc. The communication interface manages communication between multiple computers. Examples of communication standards applicable to the communication interface include wireless communication standards such as 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark).

[0023] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0024] [First Embodiment]

[0025] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0026] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0027] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0028] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0029] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0030] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0031] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0032] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0033] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0034] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0035] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0036] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0037] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and further trade them as digital assets. Specific embodiments of this system are described below.

[0038] Generating virtual text

[0039] The user requests the generation of a virtual character using their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which uses a generation AI to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[0040] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[0041] Communication and development

[0042] Users can communicate interactively with virtual characters generated through their devices. When a user asks a question via text message or voice input, the device sends the message to a server. The server uses NLP (Natural Language Processing) technology to analyze the user's intent, generate an appropriate response, and send it to the device.

[0043] Furthermore, based on the user's communication history, the server executes an algorithm that automatically develops and changes the virtual character's personality and skills. This allows the virtual character to evolve into a more realistic presence.

[0044] Specific example: When a user asks the character, "What did you do today?", the server uses an NLP algorithm to generate a response, "I was practicing a new dance today," and sends it to the terminal.

[0045] Developments in the metaverse and live events

[0046] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves the necessary resources and sets up the event. By joining the event from their device, users and other participants can interact in real time.

[0047] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0048] Transactions as digital assets

[0049] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[0050] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0051] In this way, this system comprehensively supports the creation, development, interaction, and trading of virtual characters, providing users with a new entertainment experience.

[0052] The following describes the processing flow.

[0053] Generating virtual text

[0054] Step 1:

[0055] The user uses their device to request the generation of a virtual character. The user enters parameters such as gender, age, hairstyle, and voice tone.

[0056] Step 2:

[0057] The terminal sends these input parameters to the server. The data is sent in a format such as JSON.

[0058] Step 3:

[0059] The server analyzes the received parameters and activates the generation AI to create a virtual character. The AI ​​generates the appearance, voice, and personality based on the specified parameters.

[0060] Step 4:

[0061] The server sends the generated virtual character data to the user's terminal. This data includes a 3D model, voice data, and initial settings.

[0062] Communication and development

[0063] Step 5:

[0064] The user uses their device to ask a virtual character a question via message or voice. The entered message or voice data is sent from the device to the server.

[0065] Step 6:

[0066] The server analyzes the received message and uses NLP techniques to understand the user's intent. It then executes an algorithm to generate a corresponding response.

[0067] Step 7:

[0068] The server sends the generated response to the terminal. The message or audio data is displayed or played on the terminal.

[0069] Step 8:

[0070] The server executes a training algorithm that adjusts the virtual character's skills and personality based on user actions and messages. This causes the virtual character to grow and change.

[0071] Developments in the metaverse and live events

[0072] Step 9:

[0073] A user requests to host a live event. They send detailed information, including the date, time, and content, from their device to the server.

[0074] Step 10:

[0075] The server receives the request and begins preparing for the live event. It reserves and configures the necessary resources.

[0076] Step 11:

[0077] Users access the metaverse platform from their devices and participate in live events. Other users can also participate simultaneously.

[0078] Step 12:

[0079] The server performs virtual character actions in real time and delivers them to participating users' devices. Users can send reactions and requests in real time.

[0080] Transactions as digital assets

[0081] Step 13:

[0082] The user requests to list their created virtual character as an NFT. This information is sent from the terminal to the server.

[0083] Step 14:

[0084] The server receives the request and converts the virtual character into an NFT. Blockchain technology is used to generate the NFT and record ownership information.

[0085] Step 15:

[0086] The server posts the generated NFT on the marketplace. It is made public on the marketplace along with the virtual character's information.

[0087] Step 16:

[0088] Other users browse the marketplace through their devices and purchase the NFTs they want. The purchase information is sent to the server.

[0089] Step 17:

[0090] The server confirms the purchase and transfers ownership on the blockchain. The information of the original and new owners is updated.

[0091] The above describes the specific processing steps of the program for implementing the present invention.

[0092] (Example 1)

[0093] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0094] Traditional virtual character generation systems required numerous manual operations for character creation and growth, placing a significant burden on users. Furthermore, they lacked an integrated system for comprehensively managing communication with characters, interaction within the virtual space, and trading of characters as digital assets. Additionally, there was a lack of appropriate means to securely and reliably manage ownership of the generated virtual characters.

[0095] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0096] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for using an AI model that generates the virtual character as character data including a 3D model, voice data, and personality settings based on user-specified parameters; means for analyzing the user's message using natural language processing technology and generating an appropriate response; and means for registering the virtual character as an NFT on the blockchain and managing ownership. This makes it possible to consistently perform everything from the generation to growth, interaction, and trading of virtual characters.

[0097] A "virtual character" is a virtual person or entity that is generated based on parameters entered by the user.

[0098] A "user" is an individual or legal entity that uses this system to generate a virtual character and communicate with that character.

[0099] "Parameters" refer to specific information such as gender, age, hairstyle, and voice tone that is necessary for creating and configuring a virtual character.

[0100] A "generative AI model" is an artificial intelligence model used to generate virtual characters based on parameters specified by the user.

[0101] A "server" is a central computing resource and processing unit used for generating, managing, developing, interacting with, and trading virtual characters.

[0102] A "terminal" refers to a device used by a user to request the creation of a virtual character and to check and manipulate the results; examples include personal computers and smartphones.

[0103] "Natural language processing" is the technology that allows computers to understand, analyze, and generate appropriate responses to human language.

[0104] "Two-way communication" refers to the interaction between users and virtual characters through text and voice.

[0105] "Growth" refers to the change and development of a virtual character's personality and skills based on user input and actions.

[0106] A "virtual space" is a digital place or environment that uses 3D graphics and allows users to interact with each other on the internet.

[0107] "Digital assets" refer to assets that exist in digital form, including virtual characters, and can be bought, sold, and owned.

[0108] "NFT" stands for Non-Fungible Token, and it is a technology based on blockchain technology that guarantees the uniqueness and ownership of digital assets.

[0109] Blockchain is a distributed digital ledger technology used to securely record and manage transaction information and ownership information of digital assets.

[0110] Modes for carrying out the invention

[0111] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and further trade them as digital assets.

[0112] Generating virtual text

[0113] The user requests the generation of a virtual character using their device. The user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The server uses a generation AI model (e.g., OpenAI's GPT-3 or DALL-E) to generate a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings. The completed virtual character data is sent to the user's device and displayed on it.

[0114] Specific example: When a user specifies "20-year-old male, short hair, low voice," the server sends the prompt message "Generate a 20-year-old male character. Features are short hair and a low voice" to the AI ​​model. The generated character data is then sent back to the device and displayed on the screen.

[0115] Communication and development

[0116] Users can communicate interactively with virtual characters generated through their devices. When a user asks a question via text message or voice input, the device sends the message to a server. The server uses natural language processing (NLP) techniques (e.g., GPT-3 or BERT) to analyze the user's intent, generate an appropriate response, and send it to the device.

[0117] Furthermore, based on the user's communication history, the server executes an algorithm that automatically develops and changes the virtual character's personality and skills. This allows the virtual character to evolve into a more realistic presence.

[0118] Specific example: When a user asks the character, "What did you do today?", the server uses an NLP algorithm to generate a response, "I was practicing a new dance today," and sends it to the terminal.

[0119] Developments in the metaverse and live events

[0120] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves the necessary resources and sets up the event. By joining the event from their device, users and other participants can interact in real time.

[0121] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0122] Transactions as digital assets

[0123] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology (e.g., Ethereum) and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[0124] Specific example: If a user wants to sell a virtual character they have created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0125] In this way, this system comprehensively supports the creation, development, interaction, and trading of virtual characters, providing users with a new entertainment experience.

[0126] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0127] Program processing flow

[0128] Generating virtual text

[0129] Step 1:

[0130] The user requests the generation of a virtual character using a terminal. The user inputs parameters such as gender, age, hairstyle, and voice tone. The input to this process is the various parameters specified by the user, and the output is a dataset of those parameters.

[0131] Specific operation: The user enters parameters such as "20-year-old male, short hair, low voice" into the input field on the terminal screen and presses the "Generate" button.

[0132] Step 2:

[0133] The terminal sends the entered parameters to the server. The input to this process is a dataset of parameters entered by the user, and the output is a request message containing those parameters.

[0134] Specific operation: The terminal converts the user's input into a JSON-formatted request and sends it to the server using a REST API.

[0135] Step 3:

[0136] The server sends prompt messages to the generating AI model (e.g., OpenAI's GPT-3 or DALL-E) to instruct it to generate a virtual character. The process's input is a request message containing parameters, and its output is prompt messages sent to the generating AI model.

[0137] Specific operation: The server sends the prompt message "Generate a 20-year-old male character. The characteristics are short hair and a low voice" to the generation AI model based on the parameters "20-year-old male, short hair, low voice".

[0138] Step 4:

[0139] The generative AI model generates a virtual character, including a 3D model, voice data, and personality settings, based on prompt text. The input to the process is prompt text, and the output is a set of character data.

[0140] Specific operation: The generated AI model renders a 3D model of the character based on the given parameters, generates audio data, and outputs personality settings in JSON format.

[0141] Step 5:

[0142] The server receives the generated character data and sends it to the user's terminal. The process's input is a set of character data, and its output is a response message to send to the terminal.

[0143] Specific operation: The server reformats the character data along with the user's unique terminal identifier and sends it to the terminal.

[0144] Step 6:

[0145] The terminal interprets the received character data and displays it to the user. The process's input is character data sent from the server, and its output is a virtual character displayed on the screen.

[0146] Specific operation: The device renders a 3D model of the character, plays audio data, applies personality settings, and displays it to the user.

[0147] Communication and development

[0148] Step 1:

[0149] Users communicate with a virtual character via text messages or voice input. The process's input is the user's message, and its output is the data of the input message.

[0150] Specific action: The user types "What did you do today?" into the chat box on their device and presses the send button.

[0151] Step 2:

[0152] The terminal receives user messages and sends them to the server. The process's input is the user's message, and its output is the request message to be sent to the server.

[0153] Specific operation: The terminal retrieves the user's message as text data and converts it into a request message to send to the server.

[0154] Step 3:

[0155] The server uses natural language processing (NLP) techniques to analyze the user's intent. The process's input is the user's message, and its output is the analysis result.

[0156] Specific operation: The server uses an NLP model (e.g., GPT-3 or BERT) to generate a prompt message such as "The user asked 'What did you do today?'. How would you answer as a character?" and sends it to the model.

[0157] Step 4:

[0158] The server generates an appropriate response and sends it to the terminal. The process's input is the parsing result, and its output is the response message.

[0159] Specific operation: The server reformats the response "I was practicing a new dance today" returned by the NLP model and sends it to the terminal.

[0160] Step 5:

[0161] The terminal displays the received response to the user, and if it is to be played back as audio, it uses speech synthesis. The input to the process is the response message sent from the server, and the output is the displayed text or the played audio.

[0162] Specific operation: The terminal displays the response message in a text box, generates speech using a speech synthesis engine, and plays it through the speaker.

[0163] Step 6:

[0164] The server analyzes the user's communication history and applies algorithms to improve the virtual character's personality and skills. The input to the process is the communication history, and the output is updated character personality or skill data.

[0165] Specific operation: The server analyzes the dialogue history, updates the character's personality parameters and skill values, and saves them to the database.

[0166] Developments in the metaverse and live events

[0167] Step 1:

[0168] Users request to host live events to allow their virtual characters to interact with other users in a virtual space. The process's input is the user's event request, and its output is the request data.

[0169] Specific action: The user uses the terminal interface to enter a request such as, "Please sing this song at next week's live event."

[0170] Step 2:

[0171] The server reserves the necessary resources and configures events. The process's input is user request data, and its output is event configuration data.

[0172] Specific operation: The server receives a request, reserves resources within the virtual space (server configuration, network bandwidth, etc.), and configures the event.

[0173] Step 3:

[0174] By joining an event from a device, users and other participants can interact in real time. The process's input is event configuration data, and its output is interaction data.

[0175] Specific operation: The device displays the event participation interface, and when the user clicks the participate button, real-time interaction with other participants begins.

[0176] Transactions as digital assets

[0177] Step 1:

[0178] The user requests the creation of an NFT of a virtual character. The process's input is the user's request, and its output is the request data.

[0179] Specific operation: The user uses the terminal interface to enter a request saying, "Please register this character as an NFT."

[0180] Step 2:

[0181] The server generates NFTs using blockchain technology and records their ownership information. The process's input is request data, and its output is NFT data and ownership information.

[0182] Specific operation: The server accesses the blockchain network, generates an NFT based on the character information, and records ownership information on the blockchain.

[0183] Step 3:

[0184] The server lists the generated NFTs on a marketplace, allowing other users to trade them. The input to the process is the NFT data, and the output is the marketplace list.

[0185] Specific operation: The server registers the generated NFT on the digital marketplace and makes it viewable.

[0186] Step 4:

[0187] Users conduct transactions with other users on the marketplace. The input to the process is the marketplace list, and the output is transaction data.

[0188] Specific operation: A user sells a character NFT on a marketplace, and another user purchases it.

[0189] Step 5:

[0190] After a transaction is completed, the server updates ownership on the blockchain and transfers ownership to the new owner. The input to the process is the transaction data, and the output is the updated ownership information.

[0191] Specific operation: The server accesses the blockchain network and executes a transaction to transfer ownership of the NFT to the new buyer once the transaction is complete.

[0192] (Application Example 1)

[0193] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0194] Traditional virtual character systems offered character generation, two-way communication, character development, interaction in virtual spaces, and trading as digital assets. However, these systems had limited practicality within virtual stores, particularly in areas like customer support. New features are needed to meet the needs of users seeking more realistic and interactive experiences.

[0195] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0196] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for making the virtual character function as a customer support agent using smart glasses; and means for using a generative AI model for the customer support agent to generate responses to user questions. This makes it possible to provide realistic and interactive customer support within a virtual store.

[0197] A "user" is anyone who operates the system, creates, manipulates, or trades virtual characters.

[0198] "Parameters" refer to setting information such as gender, age, hairstyle, and voice tone that users input when creating a virtual character.

[0199] A "virtual character" is a digital person or character generated based on user input, and it can be used for communication, nurturing, interaction in a virtual space, and trading as a digital asset.

[0200] "Communication" refers to the act of two-way information exchange between a virtual character and a user, which takes place through text messages or voice input.

[0201] "Characteristics" refer to elements that make up a virtual character, such as its personality, skills, and appearance.

[0202] A "virtual space" refers to a 3D environment or other digital environment created by a computer system.

[0203] "Digital assets" refer to items and characters that exist in digital form and can be owned and traded.

[0204] "Smart glasses" are visual devices equipped with internet connectivity and augmented reality capabilities that allow users to display information and perform actions while wearing them.

[0205] A "customer support agent" is a virtual character whose role is to provide support when users make inquiries about products or services within a virtual store.

[0206] A "generative AI model" refers to algorithms and software that utilize artificial intelligence technology to generate text and dialogue.

[0207] A "response" refers to the content of the reply generated by a customer support agent in response to a user's question.

[0208] Modes for carrying out the invention

[0209] This invention relates to a system for generating virtual characters and utilizing them as customer support agents in virtual stores. Specific embodiments are described below.

[0210] Generating virtual text

[0211] A user requests the generation of a virtual character using their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which then uses a generation AI model to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[0212] Activities as a customer support agent

[0213] The virtual character acts as a customer support agent while the user is browsing products in a virtual store using smart glasses. When the user asks a question, the question is sent from the device (smart glasses) to the server. The server uses a generative AI model to analyze the question and generate an appropriate response. The generated response is sent to the user's smart glasses, and the virtual character presents the answer in voice or text.

[0214] Data processing and computation

[0215] The server-side processing includes the following elements:

[0216] Hardware: Servers, smart glasses, terminals.

[0217] Software: Generative AI models (e.g., GPT-3), Flask (server-side application framework), PyTorch (machine learning framework).

[0218] By using a generative AI model, natural and appropriate responses to user questions are generated. For example, if a user asks "I want to know more about this product" through smart glasses, the server receives the question as text data, and the generative AI model analyzes it. Based on the analysis results, it then generates a detailed product description and sends it back to the user.

[0219] Specific example

[0220] For example, if a user requests the creation of a virtual character described as "a 20-year-old male with short hair and a low voice," the server will generate the character using the following prompt message.

[0221] Prompt message:

[0222] A 20-year-old male with short hair and a low voice. He works as a customer support agent and excels at inventory management and product descriptions.

[0223] Input example:

[0224] "I'd like to know more about this product."

[0225] Expected output:

[0226] "This product is made from high-quality materials and is highly durable. It is especially suitable for everyday use. Furthermore, we currently have limited stock, so we recommend purchasing it as soon as possible."

[0227] This allows users to obtain detailed information about products in real time within the virtual store, and also makes the shopping experience more interactive and satisfying.

[0228] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0229] Step 1:

[0230] A user requests the creation of a virtual character using their device. The user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The input data consists of specific setting information such as gender and age, and based on this, the data necessary for creating the virtual character is collected.

[0231] Step 2:

[0232] The server passes the received parameters to the generating AI model and begins generating the virtual character. The generating AI model generates a 3D model, voice data, and personality settings based on the received parameters. In this process, the generating AI model processes the data based on the input parameters (gender, age, hairstyle, voice tone) to generate each element of the virtual character.

[0233] Step 3:

[0234] The generated virtual character data is sent from the server to the terminal. The terminal uses this data to convert the virtual character into a displayable format and presents it to the user. The output data includes the generated character's 3D model and audio data, as well as the specific actions taken to visualize and vocalize it.

[0235] Step 4:

[0236] Users ask questions while browsing products in a virtual store using smart glasses. These questions are entered into the device as voice or text and sent to the server via the smart glasses. This input data includes the user's question, and the following processing is performed based on that content.

[0237] Step 5:

[0238] The server inputs the received question into a generative AI model and generates an appropriate response. The generative AI model uses NLP (Neuro-Linguistic Programming) techniques to analyze the question and generate a response that matches the tone and personality of the configured virtual character. The input data is the user's question, and the output data is the appropriate response. The generative AI model processes and calculates the relationships between this data to create a natural response.

[0239] Step 6:

[0240] The generated response is sent from the server to the terminal and presented to the user through smart glasses. The terminal displays the received data as audio or text, and presents it to the user in the form of a virtual character actually providing the answer. This process includes specific output actions using audio playback devices and displays.

[0241] Step 7:

[0242] User question and answer history is stored on the server and used for the growth and skill development of the virtual character. The server uses this historical data to execute algorithms that change the character's characteristics, providing a more realistic experience. The stored data is a history of past interactions, and includes actions that cause the character to grow and change based on that history.

[0243] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0244] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and even trade them as digital assets. Furthermore, by combining it with an emotion engine, it provides interactions that respond to the user's emotions.

[0245] Generating virtual text

[0246] The user uses their device to request the generation of a virtual character. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which uses a generation AI to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[0247] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[0248] Using an Emotion Engine

[0249] The device sends user input (text, voice, video, etc.) to the server, which uses an emotion engine to analyze it and recognize the user's emotions. The emotion engine grasps the user's emotional state, such as whether they are happy, sad, or angry, in real time.

[0250] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's level of fatigue (a negative emotion) from that text.

[0251] Communication and response

[0252] The server generates responses from the virtual character based on the emotions recognized by the emotion engine. These responses are tailored to the user's emotions, enabling more empathetic dialogue.

[0253] Specific example: A virtual character responds to a tired user with a message like, "That must have been tough. You should take a break."

[0254] Development and changes in characteristics

[0255] The server changes the growth and characteristics of the virtual character based on the user's emotional data. For example, it adjusts the character's personality to be more supportive when the user is sad.

[0256] Specific example: For users who frequently post sad messages, the character will grow to use more comforting words.

[0257] Developments in the metaverse and live events

[0258] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources. By joining the event from their device, users and other participants can interact in real time.

[0259] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0260] Transactions as digital assets

[0261] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[0262] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0263] By introducing an emotion engine, it becomes possible to provide virtual character experiences that are based on the user's emotions, offering deeper empathy and a greater sense of realism.

[0264] The following describes the processing flow.

[0265] Virtual character generation and the use of emotion engines

[0266] Step 1:

[0267] The user uses their device to request the generation of a virtual character. The user enters parameters such as gender, age, hairstyle, and voice tone.

[0268] Step 2:

[0269] The terminal sends these input parameters to the server. The data is sent in a format such as JSON.

[0270] Step 3:

[0271] The server analyzes the received parameters and activates the generation AI to create a virtual character. The AI ​​generates the appearance, voice, and personality based on the specified parameters.

[0272] Step 4:

[0273] The server sends the generated virtual character data to the user's terminal. This data includes a 3D model, voice data, and initial settings.

[0274] Communication and Emotion Recognition

[0275] Step 5:

[0276] The user uses their device to ask a virtual character a question via message or voice. The entered message or voice data is sent from the device to the server.

[0277] Step 6:

[0278] The server sends received messages to the emotion engine, which analyzes the user's emotional state. The emotion engine recognizes the user's emotions from input data such as text, audio, and video.

[0279] Step 7:

[0280] The server executes an algorithm that generates a response based on the recognized emotions. NLP techniques are used to create a response that matches the user's emotions.

[0281] Step 8:

[0282] The server sends the generated response to the terminal. The message or audio data is displayed or played on the terminal.

[0283] Emotion-based character development

[0284] Step 9:

[0285] The server adjusts the characteristics and personality of the virtual character based on the data of the emotion engine. As a result, the character achieves growth that aligns with the user's emotions.

[0286] Specific example: For a user who frequently inputs sad emotions, the character will come to use more comforting words.

[0287] Deployment in the metaverse and live events

[0288] Step 10: [[ID=第十九]]

[0289] The user requests the holding of a live event. Transmit the detailed date, time, and content from the terminal to the server.

[0290] Step 11:

[0291] The server receives the request and starts preparing for the live event. Reserve the necessary resources and perform the settings.

[0292] Step 12: <第二十五]]

[0293] The user accesses the metaverse platform from the terminal and participates in the live event. Other users can also participate simultaneously.

[0294] Step 13:

[0295] The server executes the performance of the virtual character in real time and distributes it to the terminals of the participating users. Users can send reactions and requests in real time.

[0296] Transactions as digital assets

[0297] Step 14:

[0298] Request the user to offer the virtual character they have raised as an NFT. The information is sent from the terminal to the server.

[0299] Step 15:

[0300] The server receives the request and NFT-izes the virtual character. Use blockchain technology to generate the NFT and record the ownership information.

[0301] Step 16:

[0302] The server posts the generated NFT on the marketplace. It is made public on the marketplace together with the information of the virtual character.

[0303] Step 17:

[0304] Other users browse the marketplace through the terminal and purchase the desired NFT. The purchase information is sent to the server.

[0305] Step 18:

[0306] <000096*5*>The server confirms the purchase and transfers the ownership on the blockchain. The information of the original owner and the new owner is updated.

[0307] The above are the specific processing steps of the program for implementing the present invention. By introducing the emotion engine, interaction based on the emotions of the user becomes possible, and a virtual character experience with deeper empathy and reality can be provided. [[ID=**38]]

[0308] (Example 2)

[0309] <**0000974**>Next, Example 2 will be described. In the following description, the data processing device 12 is referred to as the "server", and the smart device 14 is referred to as the "terminal".

[0310] Note: There was a small error in the original text where the number in the tag was incorrect. It should be instead of <000096*5*>. Also, there was an error in the tag which was repeated as <**0000974**>. These have been corrected in the translation for accuracy.In the modern era, the creation and interaction of virtual characters have attracted much attention. However, conventional systems have lacked responses and growth that respond to user emotions, and have been unable to effectively facilitate interaction in virtual spaces or transactions as digital assets. As a result, there are challenges such as limited user experiences and difficulty in forming deep connections with virtual characters.

[0311] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0312] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's emotional data in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for using an emotion engine that analyzes the user's input data to recognize emotions; and means for generating the virtual character using a generative AI model. This enables responses and growth based on the user's emotions, interaction in a virtual space, and trading as a digital asset.

[0313] A "user" is an individual or group that uses the system to create, develop, trade, or otherwise interact with virtual characters.

[0314] A "virtual character" is a digital character generated by a server using a generative AI model and emotion engine based on parameters entered by the user.

[0315] A "generative AI model" is a type of artificial intelligence technology used to generate virtual characters based on parameters input by the user.

[0316] An "emotion engine" is a technology that analyzes user input data (text, audio, video, etc.) and recognizes the user's emotions.

[0317] "Communication methods" refer to technologies that enable virtual characters and users to exchange information in a two-way manner.

[0318] "Growth method" refers to a technology that changes and develops the characteristics of a virtual character based on the user's emotional data.

[0319] A "virtual space" is a digital environment in which virtual characters and users interact.

[0320] "Digital assets" refer to virtual characters that can be traded as digital possessions in forms such as NFTs.

[0321] Blockchain is a distributed ledger technology used for managing ownership and trading digital assets.

[0322] A "live event" is an event in which a virtual character performs and interacts with users and other users in real time.

[0323] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and even trade them as digital assets. Furthermore, by combining it with an emotion engine, it provides interactions that respond to the user's emotions.

[0324] Generating virtual text

[0325] The user requests the generation of a virtual character using a dedicated application on their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The server uses a generation AI model to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[0326] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[0327] Using an Emotion Engine

[0328] The device sends user input data (text, audio, video, etc.) to the server. The server uses an emotion engine to analyze the input data and recognize the user's emotions. The emotion engine understands the user's emotional state, such as being happy, sad, or angry, in real time.

[0329] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's level of fatigue (a negative emotion) from that text.

[0330] Communication and response

[0331] The server generates responses from the virtual character based on the emotions recognized by the emotion engine. These responses are tailored to the user's emotions, enabling more empathetic dialogue.

[0332] Specific example: A virtual character responds to a tired user with a message like, "That must have been tough. You should take a break."

[0333] Development and changes in characteristics

[0334] The server changes the growth and characteristics of the virtual character based on the user's emotional data. For example, it adjusts the character's personality to be more supportive when the user is sad.

[0335] Specific example: For users who frequently post sad messages, the character will grow to use more comforting words.

[0336] Developments in the metaverse and live events

[0337] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources. By joining the event from their device, users and other participants can interact in real time.

[0338] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0339] Transactions as digital assets

[0340] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[0341] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0342] Thus, by introducing an emotion engine, it becomes possible to have interactions based on the user's emotions, providing users with a more empathetic and realistic virtual character experience.

[0343] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0344] Step 1:

[0345] The user launches a dedicated application and selects to generate a virtual character.

[0346] Input: Parameters such as gender, age, hairstyle, and voice tone.

[0347] Specific operation: Enter the parameters into the form within the application and press the submit button.

[0348] Step 2:

[0349] The terminal sends the parameters entered by the user to the server.

[0350] Input: Parameter data entered by the user.

[0351] Output: Parameter data included in the HTTP request.

[0352] Specific operation: When the submit button is pressed, an HTTP request is generated and parameter data is sent to the server's API endpoint.

[0353] Step 3:

[0354] The server uses a generative AI model to generate a virtual character based on the parameters sent to it.

[0355] Input: Parameter data sent to the server.

[0356] Output: Data of the generated virtual character (3D model, voice data, personality settings).

[0357] Specific operation: The AI ​​generator is given prompt text such as "Gender: Male, Age: 20, Short hair, Low voice," and a virtual character is generated based on this. The generated data is serialized in JSON format and sent back to the terminal.

[0358] Step 4:

[0359] The terminal receives the generated virtual character data and displays it to the user.

[0360] Input: Character data sent from the server.

[0361] Output: A virtual character displayed to the user.

[0362] Specific operation: Parses received data and displays / plays 3D models and audio within the application.

[0363] Step 5:

[0364] Users interact with virtual characters by inputting text, voice, video, and other information.

[0365] Input: User's text, audio, and video data.

[0366] Output: Input data sent from the terminal to the server.

[0367] Specific operation: Input data using a microphone, camera, and keyboard, and send it to the server in real time.

[0368] Step 6:

[0369] The server uses an emotion engine to analyze the input data and recognize the user's emotions.

[0370] Input: Text, audio, and video data sent by the user.

[0371] Output: Sentiment data of recognized users.

[0372] Specific operation: The emotion engine performs text analysis, speech analysis, and emotion recognition algorithms, and records the user's emotional state in a database.

[0373] Step 7:

[0374] The server generates responses from the virtual character based on the emotional data recognized by the emotion engine.

[0375] Input: Emotional data generated by the emotion engine.

[0376] Output: Virtual character response data.

[0377] Specific operation: Based on emotion data and character personality settings, a dialogue generation model is used to generate a response. The generated text and audio data are sent back to the terminal as an HTTP response.

[0378] Step 8:

[0379] The terminal displays the response data to the user.

[0380] Input: Response data sent from the server.

[0381] Output: Text displayed to the user or audio played.

[0382] Specific actions: Text responses are displayed in the chat window, and voice responses are played through the speaker.

[0383] Step 9:

[0384] The server adjusts the characteristics and behavior of the virtual character based on the user's emotional data.

[0385] Input: Past user sentiment data.

[0386] Output: Updated virtual character settings.

[0387] Specific operation: Retrieve emotional data from the database and update the character's behavior patterns based on the analysis results.

[0388] Step 10:

[0389] Users perform actions to allow their virtual characters to interact with other users in the virtual space.

[0390] Input: Event request data.

[0391] Output: Live event setup and resource reservation.

[0392] Specific operation: The user sets the event date and details within the app and sends a request. The server uses a reservation system to secure the necessary resources and register the event details.

[0393] Step 11:

[0394] Based on NFT requests from users, the server generates virtual characters as digital assets and makes them tradable.

[0395] Input: NFT request data submitted by the user.

[0396] Output: The generated NFT and its listing information on the marketplace.

[0397] Specific operation: Generate NFTs using blockchain technology and register ownership information on the blockchain. Then, list the NFTs using a marketplace API and enable trading.

[0398] In this way, through a series of processing steps, users can generate virtual characters, experience emotion-based interactions, and engage in activities and transactions as digital assets in a virtual space.

[0399] (Application Example 2)

[0400] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0401] Traditional virtual character systems were limited to simply generating characters and engaging in static interactions with users. They lacked the ability to respond to user emotions, dynamically evolve characters, or even trade them as digital assets. As a result, these systems had limitations in terms of improving user experience and commercial viability.

[0402] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for generating a virtual character based on parameters input by the user, means for the virtual character and the user to communicate bidirectionally, means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character, means for the virtual character to analyze the user's emotions using an emotion engine and generate a response from the virtual character, and means for controlling the growth of the virtual character based on the results of interaction with the virtual character. This enables dynamic growth of the virtual character and trading as a digital asset while providing interaction that responds to the user's emotions.

[0403] A "user" is an end-user who uses the system to generate virtual characters and interact with them.

[0404] "Parameters" are items used by users to specify the attributes and characteristics of a virtual character. Specifically, these include gender, age, hairstyle, voice tone, and so on.

[0405] A "virtual character" is a digital character generated using AI based on user input. This includes 3D models, voice data, and personality settings.

[0406] "Two-way communication" refers to a dialogue-based interaction where the user and the virtual character exchange information with each other. This can be done using text, audio, video, etc.

[0407] "Growth" refers to the process by which a virtual character evolves, changing its characteristics and personality based on user interactions and emotional data.

[0408] A "virtual space" is a simulated three-dimensional space generated through the internet or other digital networks. It is a place where users and virtual characters engage in activities and interactions.

[0409] An "emotion engine" is a software module that analyzes user input (text, voice, video, etc.) to recognize their emotional state.

[0410] "Digital assets" are digital objects that exist electronically, have an identifiable owner, and possess economic value. In particular, they refer to virtual characters.

[0411] "Transactions" refer to activities such as buying, selling, and exchanging virtual characters, which are generated as digital assets. These are primarily conducted using marketplaces and blockchain technology.

[0412] A "live event" is an event held in real time in a virtual space or other digital platform. It allows a large number of users to participate and interact simultaneously.

[0413] Blockchain is a system that uses distributed ledger technology to manage transaction information and ownership information of digital assets. It has the characteristic of preventing fraudulent tampering.

[0414] This invention relates to a system that generates a virtual character based on parameters entered by a user and enables two-way communication using an emotion engine. This system allows for the growth of the virtual character, interaction in a virtual space, and trading of digital assets.

[0415] System Configuration

[0416] This system consists of the following main elements.

[0417] 1. User terminal

[0418] 2. Server

[0419] 3. Emotional Engine

[0420] 4. Virtual Space Platform

[0421] 5. Blockchain Technology

[0422] Main Features

[0423] 1. Generating virtual characters

[0424] The user uses a device to input parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to a server, which then generates a virtual character using a generative AI model. This character includes a 3D model, voice data, and personality settings.

[0425] Specific example: If a user specifies "25-year-old male, short hair, deep voice," the server generates a virtual character that matches these criteria and sends that data to the user's terminal.

[0426] 2. Interaction using an emotion engine

[0427] The terminal sends text or voice input from the user to the server, which uses an emotion engine to analyze the user's emotional state in real time. The emotion engine recognizes the user's emotions, and a virtual character generates a response corresponding to those emotions.

[0428] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's fatigue (a negative emotion) from the text and responds with something like, "That must have been tough. You should take a break."

[0429] 3. Growth and changes in the characteristics of virtual characters

[0430] Based on user emotion data and interaction results, the server adaptively changes the characteristics and personality of the virtual character.

[0431] Specific example: If the user frequently makes sad inputs, the character will grow to use more comforting words.

[0432] 4. Interaction and live events in virtual space

[0433] Users can have their virtual characters interact with other users in the virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources.

[0434] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0435] 5. Transactions as digital assets

[0436] To trade virtual characters as digital assets, users request the creation of NFTs (Non-Fiber Capture) versions of their characters from their devices. The server uses blockchain technology to generate the NFTs and records their ownership information.

[0437] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0438] Hardware and software to be used

[0439] Hardware:

[0440] User devices (smartphones, smart glasses, head-mounted displays)

[0441] server

[0442] software:

[0443] Generative AI models (such as OpenAI)

[0444] Emotion engine (TextBlob, etc.)

[0445] Virtual space platform

[0446] Blockchain technology

[0447] Example of a prompt

[0448] 1. "Create a 25-year-old male with short hair and a deep voice."

[0449] 2. “I am feeling a bit tired today.”

[0450] 3. "Today, let's have a fun conversation."

[0451] Based on the above, the present invention provides a virtual character system that enables interaction in accordance with the user's emotions and realizes the trading of commercially valuable digital assets.

[0452] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0453] Step 1:

[0454] The user requests the generation of a virtual character using their device. Specifically, they input parameters such as gender, age, hairstyle, and voice tone, and the device sends this data to the server. For example, input parameters might include "25-year-old male, short hair, deep voice." The server receives this input data and passes it to the generation AI model. The generation AI model generates a virtual character based on the specified parameters. As output, it generates character data including a 3D model, voice data, and personality settings, and sends this to the device.

[0455] Step 2:

[0456] The device receives input (text, voice) from the user. When the user enters text such as "I'm tired today," this input data is sent to the server. The server analyzes this text input using an emotion engine (such as TextBlob). The emotion engine recognizes the user's emotional state from the text and generates an analysis result such as "fatigue (negative emotion)." This analysis result is used in the next step.

[0457] Step 3:

[0458] The server generates a virtual character response based on the analysis results of the emotion engine. Taking the analysis result "fatigue (negative emotion)" as input, the server generates the prompt response "That must have been tough." This response is processed as voice data for the virtual character and sent to the terminal. The terminal plays this voice data and provides feedback to the user.

[0459] Step 4:

[0460] Based on the results of user interactions, the server controls the growth of the virtual character. For example, if the user frequently says "I'm tired," the server processes the data to help the character grow by using more comforting words. Specifically, the server updates the character's personality settings and generates new response patterns based on the user's emotional history. This changes the character's personality and response characteristics, causing the character to "grow."

[0461] Step 5:

[0462] Users can interact with other users in a virtual space through their terminals using their virtual characters. When a user requests a live event, the server reserves the necessary resources and sets up the event. Once the event starts, the server manages interactions in real time and facilitates communication between participants. The server takes a user request, such as "Sing this song at next week's live event," as input and generates event settings and real-time interaction management as output.

[0463] Step 6:

[0464] Users can trade virtual characters as digital assets. When a user requests to convert a character into an NFT from their device, the server generates the NFT using blockchain technology. Specifically, it encrypts the character's ownership information and records it on the blockchain. In this process, the server receives character data as input, generates an NFT as output, and lists it on the marketplace. When a user expresses interest in purchasing, the server transfers ownership using blockchain technology.

[0465] Through the above processing steps, a virtual character system capable of interacting with users in accordance with their emotions is realized.

[0466] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0467] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0468] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0469] [Second Embodiment]

[0470] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0471] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0472] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0473] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0474] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0475] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0476] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0477] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0478] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0479] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0480] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0481] Next, the identification processing performed by the identification processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0482] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and further trade them as digital assets. Specific embodiments of this system are described below.

[0483] Generating virtual text

[0484] The user requests the generation of a virtual character using their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which uses a generation AI to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[0485] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[0486] Communication and development

[0487] Users can communicate interactively with virtual characters generated through their devices. When a user asks a question via text message or voice input, the device sends the message to a server. The server uses NLP (Natural Language Processing) technology to analyze the user's intent, generate an appropriate response, and send it to the device.

[0488] Furthermore, based on the user's communication history, the server executes an algorithm that automatically develops and changes the virtual character's personality and skills. This allows the virtual character to evolve into a more realistic presence.

[0489] Specific example: When a user asks the character, "What did you do today?", the server uses an NLP algorithm to generate a response, "I was practicing a new dance today," and sends it to the terminal.

[0490] Developments in the metaverse and live events

[0491] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves the necessary resources and sets up the event. By joining the event from their device, users and other participants can interact in real time.

[0492] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0493] Transactions as digital assets

[0494] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[0495] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0496] In this way, this system comprehensively supports the creation, development, interaction, and trading of virtual characters, providing users with a new entertainment experience.

[0497] The following describes the processing flow.

[0498] Generating virtual text

[0499] Step 1:

[0500] The user uses their device to request the generation of a virtual character. The user enters parameters such as gender, age, hairstyle, and voice tone.

[0501] Step 2:

[0502] The terminal sends these input parameters to the server. The data is sent in a format such as JSON.

[0503] Step 3:

[0504] The server analyzes the received parameters and activates the generation AI to create a virtual character. The AI ​​generates the appearance, voice, and personality based on the specified parameters.

[0505] Step 4:

[0506] The server sends the generated virtual character data to the user's terminal. This data includes a 3D model, voice data, and initial settings.

[0507] Communication and development

[0508] Step 5:

[0509] The user uses their device to ask a virtual character a question via message or voice. The entered message or voice data is sent from the device to the server.

[0510] Step 6:

[0511] The server analyzes the received message and uses NLP techniques to understand the user's intent. It then executes an algorithm to generate a corresponding response.

[0512] Step 7:

[0513] The server sends the generated response to the terminal. The message or audio data is displayed or played on the terminal.

[0514] Step 8:

[0515] The server executes a training algorithm that adjusts the virtual character's skills and personality based on user actions and messages. This causes the virtual character to grow and change.

[0516] Developments in the metaverse and live events

[0517] Step 9:

[0518] A user requests to host a live event. They send detailed information, including the date, time, and content, from their device to the server.

[0519] Step 10:

[0520] The server receives the request and begins preparing for the live event. It reserves and configures the necessary resources.

[0521] Step 11:

[0522] Users access the metaverse platform from their devices and participate in live events. Other users can also participate simultaneously.

[0523] Step 12:

[0524] The server performs virtual character actions in real time and delivers them to participating users' devices. Users can send reactions and requests in real time.

[0525] Transactions as digital assets

[0526] Step 13:

[0527] The user requests to list their created virtual character as an NFT. This information is sent from the terminal to the server.

[0528] Step 14:

[0529] The server receives the request and converts the virtual character into an NFT. Blockchain technology is used to generate the NFT and record ownership information.

[0530] Step 15:

[0531] The server posts the generated NFT on the marketplace. It is made public on the marketplace along with the virtual character's information.

[0532] Step 16:

[0533] Other users browse the marketplace through their devices and purchase the NFTs they want. The purchase information is sent to the server.

[0534] Step 17:

[0535] The server confirms the purchase and transfers ownership on the blockchain. The information of the original and new owners is updated.

[0536] The above describes the specific processing steps of the program for implementing the present invention.

[0537] (Example 1)

[0538] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0539] Traditional virtual character generation systems required numerous manual operations for character creation and growth, placing a significant burden on users. Furthermore, they lacked an integrated system for comprehensively managing communication with characters, interaction within the virtual space, and trading of characters as digital assets. Additionally, there was a lack of appropriate means to securely and reliably manage ownership of the generated virtual characters.

[0540] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0541] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for using an AI model that generates the virtual character as character data including a 3D model, voice data, and personality settings based on user-specified parameters; means for analyzing the user's message using natural language processing technology and generating an appropriate response; and means for registering the virtual character as an NFT on the blockchain and managing ownership. This makes it possible to consistently perform everything from the generation to growth, interaction, and trading of virtual characters.

[0542] A "virtual character" is a virtual person or entity that is generated based on parameters entered by the user.

[0543] A "user" is an individual or legal entity that uses this system to generate a virtual character and communicate with that character.

[0544] "Parameters" refer to specific information such as gender, age, hairstyle, and voice tone that is necessary for creating and configuring a virtual character.

[0545] A "generative AI model" is an artificial intelligence model used to generate virtual characters based on parameters specified by the user.

[0546] A "server" is a central computing resource and processing unit used for generating, managing, developing, interacting with, and trading virtual characters.

[0547] A "terminal" refers to a device used by a user to request the creation of a virtual character and to check and manipulate the results; examples include personal computers and smartphones.

[0548] "Natural language processing" is the technology that allows computers to understand, analyze, and generate appropriate responses to human language.

[0549] "Two-way communication" refers to the interaction between users and virtual characters through text and voice.

[0550] "Growth" refers to the change and development of a virtual character's personality and skills based on user input and actions.

[0551] A "virtual space" is a digital place or environment that uses 3D graphics and allows users to interact with each other on the internet.

[0552] "Digital assets" refer to assets that exist in digital form, including virtual characters, and can be bought, sold, and owned.

[0553] "NFT" stands for Non-Fungible Token, and it is a technology based on blockchain technology that guarantees the uniqueness and ownership of digital assets.

[0554] Blockchain is a distributed digital ledger technology used to securely record and manage transaction information and ownership information of digital assets.

[0555] Modes for carrying out the invention

[0556] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and further trade them as digital assets.

[0557] Generating virtual text

[0558] The user requests the generation of a virtual character using their device. The user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The server uses a generation AI model (e.g., OpenAI's GPT-3 or DALL-E) to generate a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings. The completed virtual character data is sent to the user's device and displayed on it.

[0559] Specific example: When a user specifies "20-year-old male, short hair, low voice," the server sends the prompt message "Generate a 20-year-old male character. Features are short hair and a low voice" to the AI ​​model. The generated character data is then sent back to the device and displayed on the screen.

[0560] Communication and development

[0561] Users can communicate interactively with virtual characters generated through their devices. When a user asks a question via text message or voice input, the device sends the message to a server. The server uses natural language processing (NLP) techniques (e.g., GPT-3 or BERT) to analyze the user's intent, generate an appropriate response, and send it to the device.

[0562] Furthermore, based on the user's communication history, the server executes an algorithm that automatically develops and changes the virtual character's personality and skills. This allows the virtual character to evolve into a more realistic presence.

[0563] Specific example: When a user asks the character, "What did you do today?", the server uses an NLP algorithm to generate a response, "I was practicing a new dance today," and sends it to the terminal.

[0564] Developments in the metaverse and live events

[0565] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves the necessary resources and sets up the event. By joining the event from their device, users and other participants can interact in real time.

[0566] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0567] Transactions as digital assets

[0568] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology (e.g., Ethereum) and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[0569] Specific example: If a user wants to sell a virtual character they have created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0570] In this way, this system comprehensively supports the creation, development, interaction, and trading of virtual characters, providing users with a new entertainment experience.

[0571] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0572] Program processing flow

[0573] Generating virtual text

[0574] Step 1:

[0575] The user requests the generation of a virtual character using a terminal. The user inputs parameters such as gender, age, hairstyle, and voice tone. The input to this process is the various parameters specified by the user, and the output is a dataset of those parameters.

[0576] Specific operation: The user enters parameters such as "20-year-old male, short hair, low voice" into the input field on the terminal screen and presses the "Generate" button.

[0577] Step 2:

[0578] The terminal sends the entered parameters to the server. The input to this process is a dataset of parameters entered by the user, and the output is a request message containing those parameters.

[0579] Specific operation: The terminal converts the user's input into a JSON-formatted request and sends it to the server using a REST API.

[0580] Step 3:

[0581] The server sends prompt messages to the generating AI model (e.g., OpenAI's GPT-3 or DALL-E) to instruct it to generate a virtual character. The process's input is a request message containing parameters, and its output is prompt messages sent to the generating AI model.

[0582] Specific operation: The server sends the prompt message "Generate a 20-year-old male character. The characteristics are short hair and a low voice" to the generation AI model based on the parameters "20-year-old male, short hair, low voice".

[0583] Step 4:

[0584] The generative AI model generates a virtual character, including a 3D model, voice data, and personality settings, based on prompt text. The input to the process is prompt text, and the output is a set of character data.

[0585] Specific operation: The generated AI model renders a 3D model of the character based on the given parameters, generates audio data, and outputs personality settings in JSON format.

[0586] Step 5:

[0587] The server receives the generated character data and sends it to the user's terminal. The process's input is a set of character data, and its output is a response message to send to the terminal.

[0588] Specific operation: The server reformats the character data along with the user's unique terminal identifier and sends it to the terminal.

[0589] Step 6:

[0590] The terminal interprets the received character data and displays it to the user. The process's input is character data sent from the server, and its output is a virtual character displayed on the screen.

[0591] Specific operation: The device renders a 3D model of the character, plays audio data, applies personality settings, and displays it to the user.

[0592] Communication and development

[0593] Step 1:

[0594] Users communicate with a virtual character via text messages or voice input. The process's input is the user's message, and its output is the data of the input message.

[0595] Specific action: The user types "What did you do today?" into the chat box on their device and presses the send button.

[0596] Step 2:

[0597] The terminal receives user messages and sends them to the server. The process's input is the user's message, and its output is the request message to be sent to the server.

[0598] Specific operation: The terminal retrieves the user's message as text data and converts it into a request message to send to the server.

[0599] Step 3:

[0600] The server uses natural language processing (NLP) techniques to analyze the user's intent. The process's input is the user's message, and its output is the analysis result.

[0601] Specific operation: The server uses an NLP model (e.g., GPT-3 or BERT) to generate a prompt message such as "The user asked 'What did you do today?'. How would you answer as a character?" and sends it to the model.

[0602] Step 4:

[0603] The server generates an appropriate response and sends it to the terminal. The process's input is the parsing result, and its output is the response message.

[0604] Specific operation: The server reformats the response "I was practicing a new dance today" returned by the NLP model and sends it to the terminal.

[0605] Step 5:

[0606] The terminal displays the received response to the user, and if it is to be played back as audio, it uses speech synthesis. The input to the process is the response message sent from the server, and the output is the displayed text or the played audio.

[0607] Specific operation: The terminal displays the response message in a text box, generates speech using a speech synthesis engine, and plays it through the speaker.

[0608] Step 6:

[0609] The server analyzes the user's communication history and applies algorithms to improve the virtual character's personality and skills. The input to the process is the communication history, and the output is updated character personality or skill data.

[0610] Specific operation: The server analyzes the dialogue history, updates the character's personality parameters and skill values, and saves them to the database.

[0611] Developments in the metaverse and live events

[0612] Step 1:

[0613] Users request to host live events to allow their virtual characters to interact with other users in a virtual space. The process's input is the user's event request, and its output is the request data.

[0614] Specific action: The user uses the terminal interface to enter a request such as, "Please sing this song at next week's live event."

[0615] Step 2:

[0616] The server reserves the necessary resources and configures events. The process's input is user request data, and its output is event configuration data.

[0617] Specific operation: The server receives a request, reserves resources within the virtual space (server configuration, network bandwidth, etc.), and configures the event.

[0618] Step 3:

[0619] By joining an event from a device, users and other participants can interact in real time. The process's input is event configuration data, and its output is interaction data.

[0620] Specific operation: The device displays the event participation interface, and when the user clicks the participate button, real-time interaction with other participants begins.

[0621] Transactions as digital assets

[0622] Step 1:

[0623] The user requests the creation of an NFT of a virtual character. The process's input is the user's request, and its output is the request data.

[0624] Specific operation: The user uses the terminal interface to enter a request saying, "Please register this character as an NFT."

[0625] Step 2:

[0626] The server generates NFTs using blockchain technology and records their ownership information. The process's input is request data, and its output is NFT data and ownership information.

[0627] Specific operation: The server accesses the blockchain network, generates an NFT based on the character information, and records ownership information on the blockchain.

[0628] Step 3:

[0629] The server lists the generated NFTs on a marketplace, allowing other users to trade them. The input to the process is the NFT data, and the output is the marketplace list.

[0630] Specific operation: The server registers the generated NFT on the digital marketplace and makes it viewable.

[0631] Step 4:

[0632] Users conduct transactions with other users on the marketplace. The input to the process is the marketplace list, and the output is transaction data.

[0633] Specific operation: A user sells a character NFT on a marketplace, and another user purchases it.

[0634] Step 5:

[0635] After a transaction is completed, the server updates ownership on the blockchain and transfers ownership to the new owner. The input to the process is the transaction data, and the output is the updated ownership information.

[0636] Specific operation: The server accesses the blockchain network and executes a transaction to transfer ownership of the NFT to the new buyer once the transaction is complete.

[0637] (Application Example 1)

[0638] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0639] Traditional virtual character systems offered character generation, two-way communication, character development, interaction in virtual spaces, and trading as digital assets. However, these systems had limited practicality within virtual stores, particularly in areas like customer support. New features are needed to meet the needs of users seeking more realistic and interactive experiences.

[0640] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0641] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for making the virtual character function as a customer support agent using smart glasses; and means for using a generative AI model for the customer support agent to generate responses to user questions. This makes it possible to provide realistic and interactive customer support within a virtual store.

[0642] A "user" is anyone who operates the system, creates, manipulates, or trades virtual characters.

[0643] "Parameters" refer to setting information such as gender, age, hairstyle, and voice tone that users input when creating a virtual character.

[0644] A "virtual character" is a digital person or character generated based on user input, and it can be used for communication, nurturing, interaction in a virtual space, and trading as a digital asset.

[0645] "Communication" refers to the act of two-way information exchange between a virtual character and a user, which takes place through text messages or voice input.

[0646] "Characteristics" refer to elements that make up a virtual character, such as its personality, skills, and appearance.

[0647] A "virtual space" refers to a 3D environment or other digital environment created by a computer system.

[0648] "Digital assets" refer to items and characters that exist in digital form and can be owned and traded.

[0649] "Smart glasses" are visual devices equipped with internet connectivity and augmented reality capabilities that allow users to display information and perform actions while wearing them.

[0650] A "customer support agent" is a virtual character whose role is to provide support when users make inquiries about products or services within a virtual store.

[0651] A "generative AI model" refers to algorithms and software that utilize artificial intelligence technology to generate text and dialogue.

[0652] A "response" refers to the content of the reply generated by a customer support agent in response to a user's question.

[0653] Modes for carrying out the invention

[0654] This invention relates to a system for generating virtual characters and utilizing them as customer support agents in virtual stores. Specific embodiments are described below.

[0655] Generating virtual text

[0656] A user requests the generation of a virtual character using their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which then uses a generation AI model to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[0657] Activities as a customer support agent

[0658] The virtual character acts as a customer support agent while the user is browsing products in a virtual store using smart glasses. When the user asks a question, the question is sent from the device (smart glasses) to the server. The server uses a generative AI model to analyze the question and generate an appropriate response. The generated response is sent to the user's smart glasses, and the virtual character presents the answer in voice or text.

[0659] Data processing and computation

[0660] The server-side processing includes the following elements:

[0661] Hardware: Servers, smart glasses, terminals.

[0662] Software: Generative AI models (e.g., GPT-3), Flask (server-side application framework), PyTorch (machine learning framework).

[0663] By using a generative AI model, natural and appropriate responses to user questions are generated. For example, if a user asks "I want to know more about this product" through smart glasses, the server receives the question as text data, and the generative AI model analyzes it. Based on the analysis results, it then generates a detailed product description and sends it back to the user.

[0664] Specific example

[0665] For example, if a user requests the creation of a virtual character described as "a 20-year-old male with short hair and a low voice," the server will generate the character using the following prompt message.

[0666] Prompt message:

[0667] A 20-year-old male with short hair and a low voice. He works as a customer support agent and excels at inventory management and product descriptions.

[0668] Input example:

[0669] "I'd like to know more about this product."

[0670] Expected output:

[0671] "This product is made from high-quality materials and is highly durable. It is especially suitable for everyday use. Furthermore, we currently have limited stock, so we recommend purchasing it as soon as possible."

[0672] This allows users to obtain detailed information about products in real time within the virtual store, and also makes the shopping experience more interactive and satisfying.

[0673] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0674] Step 1:

[0675] A user requests the creation of a virtual character using their device. The user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The input data consists of specific setting information such as gender and age, and based on this, the data necessary for creating the virtual character is collected.

[0676] Step 2:

[0677] The server passes the received parameters to the generating AI model and begins generating the virtual character. The generating AI model generates a 3D model, voice data, and personality settings based on the received parameters. In this process, the generating AI model processes the data based on the input parameters (gender, age, hairstyle, voice tone) to generate each element of the virtual character.

[0678] Step 3:

[0679] The generated virtual character data is sent from the server to the terminal. The terminal uses this data to convert the virtual character into a displayable format and presents it to the user. The output data includes the generated character's 3D model and audio data, as well as the specific actions taken to visualize and vocalize it.

[0680] Step 4:

[0681] Users ask questions while browsing products in a virtual store using smart glasses. These questions are entered into the device as voice or text and sent to the server via the smart glasses. This input data includes the user's question, and the following processing is performed based on that content.

[0682] Step 5:

[0683] The server inputs the received question into a generative AI model and generates an appropriate response. The generative AI model uses NLP (Neuro-Linguistic Programming) techniques to analyze the question and generate a response that matches the tone and personality of the configured virtual character. The input data is the user's question, and the output data is the appropriate response. The generative AI model processes and calculates the relationships between this data to create a natural response.

[0684] Step 6:

[0685] The generated response is sent from the server to the terminal and presented to the user through smart glasses. The terminal displays the received data as audio or text, and presents it to the user in the form of a virtual character actually providing the answer. This process includes specific output actions using audio playback devices and displays.

[0686] Step 7:

[0687] User question and answer history is stored on the server and used for the growth and skill development of the virtual character. The server uses this historical data to execute algorithms that change the character's characteristics, providing a more realistic experience. The stored data is a history of past interactions, and includes actions that cause the character to grow and change based on that history.

[0688] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0689] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and even trade them as digital assets. Furthermore, by combining it with an emotion engine, it provides interactions that respond to the user's emotions.

[0690] Generating virtual text

[0691] The user uses their device to request the generation of a virtual character. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which uses a generation AI to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[0692] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[0693] Using an Emotion Engine

[0694] The device sends user input (text, voice, video, etc.) to the server, which uses an emotion engine to analyze it and recognize the user's emotions. The emotion engine grasps the user's emotional state, such as whether they are happy, sad, or angry, in real time.

[0695] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's level of fatigue (a negative emotion) from that text.

[0696] Communication and response

[0697] The server generates responses from the virtual character based on the emotions recognized by the emotion engine. These responses are tailored to the user's emotions, enabling more empathetic dialogue.

[0698] Specific example: A virtual character responds to a tired user with a message like, "That must have been tough. You should take a break."

[0699] Development and changes in characteristics

[0700] The server changes the growth and characteristics of the virtual character based on the user's emotional data. For example, it adjusts the character's personality to be more supportive when the user is sad.

[0701] Specific example: For users who frequently post sad messages, the character will grow to use more comforting words.

[0702] Developments in the metaverse and live events

[0703] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources. By joining the event from their device, users and other participants can interact in real time.

[0704] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0705] Transactions as digital assets

[0706] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[0707] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0708] By introducing an emotion engine, it becomes possible to provide virtual character experiences that are based on the user's emotions, offering deeper empathy and a greater sense of realism.

[0709] The following describes the processing flow.

[0710] Virtual character generation and the use of emotion engines

[0711] Step 1:

[0712] The user uses their device to request the generation of a virtual character. The user enters parameters such as gender, age, hairstyle, and voice tone.

[0713] Step 2:

[0714] The terminal sends these input parameters to the server. The data is sent in a format such as JSON.

[0715] Step 3:

[0716] The server analyzes the received parameters and activates the generation AI to create a virtual character. The AI ​​generates the appearance, voice, and personality based on the specified parameters.

[0717] Step 4:

[0718] The server sends the generated virtual character data to the user's terminal. This data includes a 3D model, voice data, and initial settings.

[0719] Communication and Emotion Recognition

[0720] Step 5:

[0721] The user uses their device to ask a virtual character a question via message or voice. The entered message or voice data is sent from the device to the server.

[0722] Step 6:

[0723] The server sends received messages to the emotion engine, which analyzes the user's emotional state. The emotion engine recognizes the user's emotions from input data such as text, audio, and video.

[0724] Step 7:

[0725] The server executes an algorithm that generates a response based on the recognized emotions. NLP techniques are used to create a response that matches the user's emotions.

[0726] Step 8:

[0727] The server sends the generated response to the terminal. The message or audio data is displayed or played on the terminal.

[0728] Emotion-based character development

[0729] Step 9:

[0730] The server adjusts the virtual character's characteristics and personality based on data from the emotion engine. This allows the character to evolve in accordance with the user's emotions.

[0731] Specific example: If a user frequently posts sad messages, the character will start using more comforting words.

[0732] Developments in the metaverse and live events

[0733] Step 10:

[0734] A user requests to host a live event. They send detailed information, including the date, time, and content, from their device to the server.

[0735] Step 11:

[0736] The server receives the request and begins preparing for the live event. It reserves and configures the necessary resources.

[0737] Step 12:

[0738] Users access the metaverse platform from their devices and participate in live events. Other users can also participate simultaneously.

[0739] Step 13:

[0740] The server performs virtual character actions in real time and delivers them to participating users' devices. Users can send reactions and requests in real time.

[0741] Transactions as digital assets

[0742] Step 14:

[0743] The user requests to list their created virtual character as an NFT. This information is sent from the terminal to the server.

[0744] Step 15:

[0745] The server receives the request and converts the virtual character into an NFT. Blockchain technology is used to generate the NFT and record ownership information.

[0746] Step 16:

[0747] The server posts the generated NFT on the marketplace. It is made public on the marketplace along with the virtual character's information.

[0748] Step 17:

[0749] Other users browse the marketplace through their devices and purchase the NFTs they want. The purchase information is sent to the server.

[0750] Step 18:

[0751] The server confirms the purchase and transfers ownership on the blockchain. The information of the original and new owners is updated.

[0752] The above describes the specific processing steps of the program for implementing the present invention. By introducing an emotion engine, interaction based on the user's emotions becomes possible, providing a virtual character experience with deeper empathy and realism.

[0753] (Example 2)

[0754] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0755] In the modern era, the creation and interaction of virtual characters have attracted much attention. However, conventional systems have lacked responses and growth that respond to user emotions, and have been unable to effectively facilitate interaction in virtual spaces or transactions as digital assets. As a result, there are challenges such as limited user experiences and difficulty in forming deep connections with virtual characters.

[0756] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0757] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's emotional data in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for using an emotion engine that analyzes the user's input data to recognize emotions; and means for generating the virtual character using a generative AI model. This enables responses and growth based on the user's emotions, interaction in a virtual space, and trading as a digital asset.

[0758] A "user" is an individual or group that uses the system to create, develop, trade, or otherwise interact with virtual characters.

[0759] A "virtual character" is a digital character generated by a server using a generative AI model and emotion engine based on parameters entered by the user.

[0760] A "generative AI model" is a type of artificial intelligence technology used to generate virtual characters based on parameters input by the user.

[0761] An "emotion engine" is a technology that analyzes user input data (text, audio, video, etc.) and recognizes the user's emotions.

[0762] "Communication methods" refer to technologies that enable virtual characters and users to exchange information in a two-way manner.

[0763] "Growth method" refers to a technology that changes and develops the characteristics of a virtual character based on the user's emotional data.

[0764] A "virtual space" is a digital environment in which virtual characters and users interact.

[0765] "Digital assets" refer to virtual characters that can be traded as digital possessions in forms such as NFTs.

[0766] Blockchain is a distributed ledger technology used for managing ownership and trading digital assets.

[0767] A "live event" is an event in which a virtual character performs and interacts with users and other users in real time.

[0768] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and even trade them as digital assets. Furthermore, by combining it with an emotion engine, it provides interactions that respond to the user's emotions.

[0769] Generating virtual text

[0770] The user requests the generation of a virtual character using a dedicated application on their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The server uses a generation AI model to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[0771] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[0772] Using an Emotion Engine

[0773] The device sends user input data (text, audio, video, etc.) to the server. The server uses an emotion engine to analyze the input data and recognize the user's emotions. The emotion engine understands the user's emotional state, such as being happy, sad, or angry, in real time.

[0774] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's level of fatigue (a negative emotion) from that text.

[0775] Communication and response

[0776] The server generates responses from the virtual character based on the emotions recognized by the emotion engine. These responses are tailored to the user's emotions, enabling more empathetic dialogue.

[0777] Specific example: A virtual character responds to a tired user with a message like, "That must have been tough. You should take a break."

[0778] Development and changes in characteristics

[0779] The server changes the growth and characteristics of the virtual character based on the user's emotional data. For example, it adjusts the character's personality to be more supportive when the user is sad.

[0780] Specific example: For users who frequently post sad messages, the character will grow to use more comforting words.

[0781] Developments in the metaverse and live events

[0782] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources. By joining the event from their device, users and other participants can interact in real time.

[0783] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0784] Transactions as digital assets

[0785] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[0786] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0787] Thus, by introducing an emotion engine, it becomes possible to have interactions based on the user's emotions, providing users with a more empathetic and realistic virtual character experience.

[0788] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0789] Step 1:

[0790] The user launches a dedicated application and selects to generate a virtual character.

[0791] Input: Parameters such as gender, age, hairstyle, and voice tone.

[0792] Specific operation: Enter the parameters into the form within the application and press the submit button.

[0793] Step 2:

[0794] The terminal sends the parameters entered by the user to the server.

[0795] Input: Parameter data entered by the user.

[0796] Output: Parameter data included in the HTTP request.

[0797] Specific operation: When the submit button is pressed, an HTTP request is generated and parameter data is sent to the server's API endpoint.

[0798] Step 3:

[0799] The server uses a generative AI model to generate a virtual character based on the parameters sent to it.

[0800] Input: Parameter data sent to the server.

[0801] Output: Data of the generated virtual character (3D model, voice data, personality settings).

[0802] Specific operation: The AI ​​generator is given prompt text such as "Gender: Male, Age: 20, Short hair, Low voice," and a virtual character is generated based on this. The generated data is serialized in JSON format and sent back to the terminal.

[0803] Step 4:

[0804] The terminal receives the generated virtual character data and displays it to the user.

[0805] Input: Character data sent from the server.

[0806] Output: A virtual character displayed to the user.

[0807] Specific operation: Parses received data and displays / plays 3D models and audio within the application.

[0808] Step 5:

[0809] Users interact with virtual characters by inputting text, voice, video, and other information.

[0810] Input: User's text, audio, and video data.

[0811] Output: Input data sent from the terminal to the server.

[0812] Specific operation: Input data using a microphone, camera, and keyboard, and send it to the server in real time.

[0813] Step 6:

[0814] The server uses an emotion engine to analyze the input data and recognize the user's emotions.

[0815] Input: Text, audio, and video data sent by the user.

[0816] Output: Sentiment data of recognized users.

[0817] Specific operation: The emotion engine performs text analysis, speech analysis, and emotion recognition algorithms, and records the user's emotional state in a database.

[0818] Step 7:

[0819] The server generates responses from the virtual character based on the emotional data recognized by the emotion engine.

[0820] Input: Emotional data generated by the emotion engine.

[0821] Output: Virtual character response data.

[0822] Specific operation: Based on emotion data and character personality settings, a dialogue generation model is used to generate a response. The generated text and audio data are sent back to the terminal as an HTTP response.

[0823] Step 8:

[0824] The terminal displays the response data to the user.

[0825] Input: Response data sent from the server.

[0826] Output: Text displayed to the user or audio played.

[0827] Specific actions: Text responses are displayed in the chat window, and voice responses are played through the speaker.

[0828] Step 9:

[0829] The server adjusts the characteristics and behavior of the virtual character based on the user's emotional data.

[0830] Input: Past user sentiment data.

[0831] Output: Updated virtual character settings.

[0832] Specific operation: Retrieve emotional data from the database and update the character's behavior patterns based on the analysis results.

[0833] Step 10:

[0834] Users perform actions to allow their virtual characters to interact with other users in the virtual space.

[0835] Input: Event request data.

[0836] Output: Live event setup and resource reservation.

[0837] Specific operation: The user sets the event date and details within the app and sends a request. The server uses a reservation system to secure the necessary resources and register the event details.

[0838] Step 11:

[0839] Based on NFT requests from users, the server generates virtual characters as digital assets and makes them tradable.

[0840] Input: NFT request data submitted by the user.

[0841] Output: The generated NFT and its listing information on the marketplace.

[0842] Specific operation: Generate NFTs using blockchain technology and register ownership information on the blockchain. Then, list the NFTs using a marketplace API and enable trading.

[0843] In this way, through a series of processing steps, users can generate virtual characters, experience emotion-based interactions, and engage in activities and transactions as digital assets in a virtual space.

[0844] (Application Example 2)

[0845] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0846] Traditional virtual character systems were limited to simply generating characters and engaging in static interactions with users. They lacked the ability to respond to user emotions, dynamically evolve characters, or even trade them as digital assets. As a result, these systems had limitations in terms of improving user experience and commercial viability.

[0847] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for generating a virtual character based on parameters input by the user, means for the virtual character and the user to communicate bidirectionally, means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character, means for the virtual character to analyze the user's emotions using an emotion engine and generate a response from the virtual character, and means for controlling the growth of the virtual character based on the results of interaction with the virtual character. This enables dynamic growth of the virtual character and trading as a digital asset while providing interaction that responds to the user's emotions.

[0848] A "user" is an end-user who uses the system to generate virtual characters and interact with them.

[0849] "Parameters" are items used by users to specify the attributes and characteristics of a virtual character. Specifically, these include gender, age, hairstyle, voice tone, and so on.

[0850] A "virtual character" is a digital character generated using AI based on user input. This includes 3D models, voice data, and personality settings.

[0851] "Two-way communication" refers to a dialogue-based interaction where the user and the virtual character exchange information with each other. This can be done using text, audio, video, etc.

[0852] "Growth" refers to the process by which a virtual character evolves, changing its characteristics and personality based on user interactions and emotional data.

[0853] A "virtual space" is a simulated three-dimensional space generated through the internet or other digital networks. It is a place where users and virtual characters engage in activities and interactions.

[0854] An "emotion engine" is a software module that analyzes user input (text, voice, video, etc.) to recognize their emotional state.

[0855] "Digital assets" are digital objects that exist electronically, have an identifiable owner, and possess economic value. In particular, they refer to virtual characters.

[0856] "Transactions" refer to activities such as buying, selling, and exchanging virtual characters, which are generated as digital assets. These are primarily conducted using marketplaces and blockchain technology.

[0857] A "live event" is an event held in real time in a virtual space or other digital platform. It allows a large number of users to participate and interact simultaneously.

[0858] Blockchain is a system that uses distributed ledger technology to manage transaction information and ownership information of digital assets. It has the characteristic of preventing fraudulent tampering.

[0859] This invention relates to a system that generates a virtual character based on parameters entered by a user and enables two-way communication using an emotion engine. This system allows for the growth of the virtual character, interaction in a virtual space, and trading of digital assets.

[0860] System Configuration

[0861] This system consists of the following main elements.

[0862] 1. User terminal

[0863] 2. Server

[0864] 3. Emotional Engine

[0865] 4. Virtual Space Platform

[0866] 5. Blockchain Technology

[0867] Main Features

[0868] 1. Generating virtual characters

[0869] The user uses a device to input parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to a server, which then generates a virtual character using a generative AI model. This character includes a 3D model, voice data, and personality settings.

[0870] Specific example: If a user specifies "25-year-old male, short hair, deep voice," the server generates a virtual character that matches these criteria and sends that data to the user's terminal.

[0871] 2. Interaction using an emotion engine

[0872] The terminal sends text or voice input from the user to the server, which uses an emotion engine to analyze the user's emotional state in real time. The emotion engine recognizes the user's emotions, and a virtual character generates a response corresponding to those emotions.

[0873] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's fatigue (a negative emotion) from the text and responds with something like, "That must have been tough. You should take a break."

[0874] 3. Growth and changes in the characteristics of virtual characters

[0875] Based on user emotion data and interaction results, the server adaptively changes the characteristics and personality of the virtual character.

[0876] Specific example: If the user frequently makes sad inputs, the character will grow to use more comforting words.

[0877] 4. Interaction and live events in virtual space

[0878] Users can have their virtual characters interact with other users in the virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources.

[0879] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0880] 5. Transactions as digital assets

[0881] To trade virtual characters as digital assets, users request the creation of NFTs (Non-Fiber Capture) versions of their characters from their devices. The server uses blockchain technology to generate the NFTs and records their ownership information.

[0882] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0883] Hardware and software to be used

[0884] Hardware:

[0885] User devices (smartphones, smart glasses, head-mounted displays)

[0886] server

[0887] software:

[0888] Generative AI models (such as OpenAI)

[0889] Emotion engine (TextBlob, etc.)

[0890] Virtual space platform

[0891] Blockchain technology

[0892] Example of a prompt

[0893] 1. "Create a 25-year-old male with short hair and a deep voice."

[0894] 2. “I am feeling a bit tired today.”

[0895] 3. "Today, let's have a fun conversation."

[0896] Based on the above, the present invention provides a virtual character system that enables interaction in accordance with the user's emotions and realizes the trading of commercially valuable digital assets.

[0897] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0898] Step 1:

[0899] The user requests the generation of a virtual character using their device. Specifically, they input parameters such as gender, age, hairstyle, and voice tone, and the device sends this data to the server. For example, input parameters might include "25-year-old male, short hair, deep voice." The server receives this input data and passes it to the generation AI model. The generation AI model generates a virtual character based on the specified parameters. As output, it generates character data including a 3D model, voice data, and personality settings, and sends this to the device.

[0900] Step 2:

[0901] The device receives input (text, voice) from the user. When the user enters text such as "I'm tired today," this input data is sent to the server. The server analyzes this text input using an emotion engine (such as TextBlob). The emotion engine recognizes the user's emotional state from the text and generates an analysis result such as "fatigue (negative emotion)." This analysis result is used in the next step.

[0902] Step 3:

[0903] The server generates a virtual character response based on the analysis results of the emotion engine. Taking the analysis result "fatigue (negative emotion)" as input, the server generates the prompt response "That must have been tough." This response is processed as voice data for the virtual character and sent to the terminal. The terminal plays this voice data and provides feedback to the user.

[0904] Step 4:

[0905] Based on the results of user interactions, the server controls the growth of the virtual character. For example, if the user frequently says "I'm tired," the server processes the data to help the character grow by using more comforting words. Specifically, the server updates the character's personality settings and generates new response patterns based on the user's emotional history. This changes the character's personality and response characteristics, causing the character to "grow."

[0906] Step 5:

[0907] Users can interact with other users in a virtual space through their terminals using their virtual characters. When a user requests a live event, the server reserves the necessary resources and sets up the event. Once the event starts, the server manages interactions in real time and facilitates communication between participants. The server takes a user request, such as "Sing this song at next week's live event," as input and generates event settings and real-time interaction management as output.

[0908] Step 6:

[0909] Users can trade virtual characters as digital assets. When a user requests to convert a character into an NFT from their device, the server generates the NFT using blockchain technology. Specifically, it encrypts the character's ownership information and records it on the blockchain. In this process, the server receives character data as input, generates an NFT as output, and lists it on the marketplace. When a user expresses interest in purchasing, the server transfers ownership using blockchain technology.

[0910] Through the above processing steps, a virtual character system capable of interacting with users in accordance with their emotions is realized.

[0911] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0912] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0913] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0914] [Third Embodiment]

[0915] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0916] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0917] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0918] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0919] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0920] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0921] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0922] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0923] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0924] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0925] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0926] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the headset terminal 314 will be referred to as the "terminal".

[0927] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and further trade them as digital assets. Specific embodiments of this system are described below.

[0928] Generating virtual text

[0929] The user requests the generation of a virtual character using their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which uses a generation AI to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[0930] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[0931] Communication and development

[0932] Users can communicate interactively with virtual characters generated through their devices. When a user asks a question via text message or voice input, the device sends the message to a server. The server uses NLP (Natural Language Processing) technology to analyze the user's intent, generate an appropriate response, and send it to the device.

[0933] Furthermore, based on the user's communication history, the server executes an algorithm that automatically develops and changes the virtual character's personality and skills. This allows the virtual character to evolve into a more realistic presence.

[0934] Specific example: When a user asks the character, "What did you do today?", the server uses an NLP algorithm to generate a response, "I was practicing a new dance today," and sends it to the terminal.

[0935] Developments in the metaverse and live events

[0936] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves the necessary resources and sets up the event. By joining the event from their device, users and other participants can interact in real time.

[0937] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[0938] Transactions as digital assets

[0939] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[0940] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[0941] In this way, this system comprehensively supports the creation, development, interaction, and trading of virtual characters, providing users with a new entertainment experience.

[0942] The following describes the processing flow.

[0943] Generating virtual text

[0944] Step 1:

[0945] The user uses their device to request the generation of a virtual character. The user enters parameters such as gender, age, hairstyle, and voice tone.

[0946] Step 2:

[0947] The terminal sends these input parameters to the server. The data is sent in a format such as JSON.

[0948] Step 3:

[0949] The server analyzes the received parameters and activates the generation AI to create a virtual character. The AI ​​generates the appearance, voice, and personality based on the specified parameters.

[0950] Step 4:

[0951] The server sends the generated virtual character data to the user's terminal. This data includes a 3D model, voice data, and initial settings.

[0952] Communication and development

[0953] Step 5:

[0954] The user uses their device to ask a virtual character a question via message or voice. The entered message or voice data is sent from the device to the server.

[0955] Step 6:

[0956] The server analyzes the received message and uses NLP techniques to understand the user's intent. It then executes an algorithm to generate a corresponding response.

[0957] Step 7:

[0958] The server sends the generated response to the terminal. The message or audio data is displayed or played on the terminal.

[0959] Step 8:

[0960] The server executes a training algorithm that adjusts the virtual character's skills and personality based on user actions and messages. This causes the virtual character to grow and change.

[0961] Developments in the metaverse and live events

[0962] Step 9:

[0963] A user requests to host a live event. They send detailed information, including the date, time, and content, from their device to the server.

[0964] Step 10:

[0965] The server receives the request and begins preparing for the live event. It reserves and configures the necessary resources.

[0966] Step 11:

[0967] Users access the metaverse platform from their devices and participate in live events. Other users can also participate simultaneously.

[0968] Step 12:

[0969] The server performs virtual character actions in real time and delivers them to participating users' devices. Users can send reactions and requests in real time.

[0970] Transactions as digital assets

[0971] Step 13:

[0972] The user requests to list their created virtual character as an NFT. This information is sent from the terminal to the server.

[0973] Step 14:

[0974] The server receives the request and converts the virtual character into an NFT. Blockchain technology is used to generate the NFT and record ownership information.

[0975] Step 15:

[0976] The server posts the generated NFT on the marketplace. It is made public on the marketplace along with the virtual character's information.

[0977] Step 16:

[0978] Other users browse the marketplace through their devices and purchase the NFTs they want. The purchase information is sent to the server.

[0979] Step 17:

[0980] The server confirms the purchase and transfers ownership on the blockchain. The information of the original and new owners is updated.

[0981] The above describes the specific processing steps of the program for implementing the present invention.

[0982] (Example 1)

[0983] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0984] Traditional virtual character generation systems required numerous manual operations for character creation and growth, placing a significant burden on users. Furthermore, they lacked an integrated system for comprehensively managing communication with characters, interaction within the virtual space, and trading of characters as digital assets. Additionally, there was a lack of appropriate means to securely and reliably manage ownership of the generated virtual characters.

[0985] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0986] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for using an AI model that generates the virtual character as character data including a 3D model, voice data, and personality settings based on user-specified parameters; means for analyzing the user's message using natural language processing technology and generating an appropriate response; and means for registering the virtual character as an NFT on the blockchain and managing ownership. This makes it possible to consistently perform everything from the generation to growth, interaction, and trading of virtual characters.

[0987] A "virtual character" is a virtual person or entity that is generated based on parameters entered by the user.

[0988] A "user" is an individual or legal entity that uses this system to generate a virtual character and communicate with that character.

[0989] "Parameters" refer to specific information such as gender, age, hairstyle, and voice tone that is necessary for creating and configuring a virtual character.

[0990] A "generative AI model" is an artificial intelligence model used to generate virtual characters based on parameters specified by the user.

[0991] A "server" is a central computing resource and processing unit used for generating, managing, developing, interacting with, and trading virtual characters.

[0992] A "terminal" refers to a device used by a user to request the creation of a virtual character and to check and manipulate the results; examples include personal computers and smartphones.

[0993] "Natural language processing" is the technology that allows computers to understand, analyze, and generate appropriate responses to human language.

[0994] "Two-way communication" refers to the interaction between users and virtual characters through text and voice.

[0995] "Growth" refers to the change and development of a virtual character's personality and skills based on user input and actions.

[0996] A "virtual space" is a digital place or environment that uses 3D graphics and allows users to interact with each other on the internet.

[0997] "Digital assets" refer to assets that exist in digital form, including virtual characters, and can be bought, sold, and owned.

[0998] "NFT" stands for Non-Fungible Token, and it is a technology based on blockchain technology that guarantees the uniqueness and ownership of digital assets.

[0999] Blockchain is a distributed digital ledger technology used to securely record and manage transaction information and ownership information of digital assets.

[1000] Modes for carrying out the invention

[1001] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and further trade them as digital assets.

[1002] Generating virtual text

[1003] The user requests the generation of a virtual character using their device. The user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The server uses a generation AI model (e.g., OpenAI's GPT-3 or DALL-E) to generate a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings. The completed virtual character data is sent to the user's device and displayed on it.

[1004] Specific example: When a user specifies "20-year-old male, short hair, low voice," the server sends the prompt message "Generate a 20-year-old male character. Features are short hair and a low voice" to the AI ​​model. The generated character data is then sent back to the device and displayed on the screen.

[1005] Communication and development

[1006] Users can communicate interactively with virtual characters generated through their devices. When a user asks a question via text message or voice input, the device sends the message to a server. The server uses natural language processing (NLP) techniques (e.g., GPT-3 or BERT) to analyze the user's intent, generate an appropriate response, and send it to the device.

[1007] Furthermore, based on the user's communication history, the server executes an algorithm that automatically develops and changes the virtual character's personality and skills. This allows the virtual character to evolve into a more realistic presence.

[1008] Specific example: When a user asks the character, "What did you do today?", the server uses an NLP algorithm to generate a response, "I was practicing a new dance today," and sends it to the terminal.

[1009] Developments in the metaverse and live events

[1010] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves the necessary resources and sets up the event. By joining the event from their device, users and other participants can interact in real time.

[1011] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[1012] Transactions as digital assets

[1013] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology (e.g., Ethereum) and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[1014] Specific example: If a user wants to sell a virtual character they have created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[1015] In this way, this system comprehensively supports the creation, development, interaction, and trading of virtual characters, providing users with a new entertainment experience.

[1016] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1017] Program processing flow

[1018] Generating virtual text

[1019] Step 1:

[1020] The user requests the generation of a virtual character using a terminal. The user inputs parameters such as gender, age, hairstyle, and voice tone. The input to this process is the various parameters specified by the user, and the output is a dataset of those parameters.

[1021] Specific operation: The user enters parameters such as "20-year-old male, short hair, low voice" into the input field on the terminal screen and presses the "Generate" button.

[1022] Step 2:

[1023] The terminal sends the entered parameters to the server. The input to this process is a dataset of parameters entered by the user, and the output is a request message containing those parameters.

[1024] Specific operation: The terminal converts the user's input into a JSON-formatted request and sends it to the server using a REST API.

[1025] Step 3:

[1026] The server sends prompt messages to the generating AI model (e.g., OpenAI's GPT-3 or DALL-E) to instruct it to generate a virtual character. The process's input is a request message containing parameters, and its output is prompt messages sent to the generating AI model.

[1027] Specific operation: The server sends the prompt message "Generate a 20-year-old male character. The characteristics are short hair and a low voice" to the generation AI model based on the parameters "20-year-old male, short hair, low voice".

[1028] Step 4:

[1029] The generative AI model generates a virtual character, including a 3D model, voice data, and personality settings, based on prompt text. The input to the process is prompt text, and the output is a set of character data.

[1030] Specific operation: The generated AI model renders a 3D model of the character based on the given parameters, generates audio data, and outputs personality settings in JSON format.

[1031] Step 5:

[1032] The server receives the generated character data and sends it to the user's terminal. The process's input is a set of character data, and its output is a response message to send to the terminal.

[1033] Specific operation: The server reformats the character data along with the user's unique terminal identifier and sends it to the terminal.

[1034] Step 6:

[1035] The terminal interprets the received character data and displays it to the user. The process's input is character data sent from the server, and its output is a virtual character displayed on the screen.

[1036] Specific operation: The device renders a 3D model of the character, plays audio data, applies personality settings, and displays it to the user.

[1037] Communication and development

[1038] Step 1:

[1039] Users communicate with a virtual character via text messages or voice input. The process's input is the user's message, and its output is the data of the input message.

[1040] Specific action: The user types "What did you do today?" into the chat box on their device and presses the send button.

[1041] Step 2:

[1042] The terminal receives user messages and sends them to the server. The process's input is the user's message, and its output is the request message to be sent to the server.

[1043] Specific operation: The terminal retrieves the user's message as text data and converts it into a request message to send to the server.

[1044] Step 3:

[1045] The server uses natural language processing (NLP) techniques to analyze the user's intent. The process's input is the user's message, and its output is the analysis result.

[1046] Specific operation: The server uses an NLP model (e.g., GPT-3 or BERT) to generate a prompt message such as "The user asked 'What did you do today?'. How would you answer as a character?" and sends it to the model.

[1047] Step 4:

[1048] The server generates an appropriate response and sends it to the terminal. The process's input is the parsing result, and its output is the response message.

[1049] Specific operation: The server reformats the response "I was practicing a new dance today" returned by the NLP model and sends it to the terminal.

[1050] Step 5:

[1051] The terminal displays the received response to the user, and if it is to be played back as audio, it uses speech synthesis. The input to the process is the response message sent from the server, and the output is the displayed text or the played audio.

[1052] Specific operation: The terminal displays the response message in a text box, generates speech using a speech synthesis engine, and plays it through the speaker.

[1053] Step 6:

[1054] The server analyzes the user's communication history and applies algorithms to improve the virtual character's personality and skills. The input to the process is the communication history, and the output is updated character personality or skill data.

[1055] Specific operation: The server analyzes the dialogue history, updates the character's personality parameters and skill values, and saves them to the database.

[1056] Developments in the metaverse and live events

[1057] Step 1:

[1058] Users request to host live events to allow their virtual characters to interact with other users in a virtual space. The process's input is the user's event request, and its output is the request data.

[1059] Specific action: The user uses the terminal interface to enter a request such as, "Please sing this song at next week's live event."

[1060] Step 2:

[1061] The server reserves the necessary resources and configures events. The process's input is user request data, and its output is event configuration data.

[1062] Specific operation: The server receives a request, reserves resources within the virtual space (server configuration, network bandwidth, etc.), and configures the event.

[1063] Step 3:

[1064] By joining an event from a device, users and other participants can interact in real time. The process's input is event configuration data, and its output is interaction data.

[1065] Specific operation: The device displays the event participation interface, and when the user clicks the participate button, real-time interaction with other participants begins.

[1066] Transactions as digital assets

[1067] Step 1:

[1068] The user requests the creation of an NFT of a virtual character. The process's input is the user's request, and its output is the request data.

[1069] Specific operation: The user uses the terminal interface to enter a request saying, "Please register this character as an NFT."

[1070] Step 2:

[1071] The server generates NFTs using blockchain technology and records their ownership information. The process's input is request data, and its output is NFT data and ownership information.

[1072] Specific operation: The server accesses the blockchain network, generates an NFT based on the character information, and records ownership information on the blockchain.

[1073] Step 3:

[1074] The server lists the generated NFTs on a marketplace, allowing other users to trade them. The input to the process is the NFT data, and the output is the marketplace list.

[1075] Specific operation: The server registers the generated NFT on the digital marketplace and makes it viewable.

[1076] Step 4:

[1077] Users conduct transactions with other users on the marketplace. The input to the process is the marketplace list, and the output is transaction data.

[1078] Specific operation: A user sells a character NFT on a marketplace, and another user purchases it.

[1079] Step 5:

[1080] After a transaction is completed, the server updates ownership on the blockchain and transfers ownership to the new owner. The input to the process is the transaction data, and the output is the updated ownership information.

[1081] Specific operation: The server accesses the blockchain network and executes a transaction to transfer ownership of the NFT to the new buyer once the transaction is complete.

[1082] (Application Example 1)

[1083] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1084] Traditional virtual character systems offered character generation, two-way communication, character development, interaction in virtual spaces, and trading as digital assets. However, these systems had limited practicality within virtual stores, particularly in areas like customer support. New features are needed to meet the needs of users seeking more realistic and interactive experiences.

[1085] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1086] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for making the virtual character function as a customer support agent using smart glasses; and means for using a generative AI model for the customer support agent to generate responses to user questions. This makes it possible to provide realistic and interactive customer support within a virtual store.

[1087] A "user" is anyone who operates the system, creates, manipulates, or trades virtual characters.

[1088] "Parameters" refer to setting information such as gender, age, hairstyle, and voice tone that users input when creating a virtual character.

[1089] A "virtual character" is a digital person or character generated based on user input, and it can be used for communication, nurturing, interaction in a virtual space, and trading as a digital asset.

[1090] "Communication" refers to the act of two-way information exchange between a virtual character and a user, which takes place through text messages or voice input.

[1091] "Characteristics" refer to elements that make up a virtual character, such as its personality, skills, and appearance.

[1092] A "virtual space" refers to a 3D environment or other digital environment created by a computer system.

[1093] "Digital assets" refer to items and characters that exist in digital form and can be owned and traded.

[1094] "Smart glasses" are visual devices equipped with internet connectivity and augmented reality capabilities that allow users to display information and perform actions while wearing them.

[1095] A "customer support agent" is a virtual character whose role is to provide support when users make inquiries about products or services within a virtual store.

[1096] A "generative AI model" refers to algorithms and software that utilize artificial intelligence technology to generate text and dialogue.

[1097] A "response" refers to the content of the reply generated by a customer support agent in response to a user's question.

[1098] Modes for carrying out the invention

[1099] This invention relates to a system for generating virtual characters and utilizing them as customer support agents in virtual stores. Specific embodiments are described below.

[1100] Generating virtual text

[1101] A user requests the generation of a virtual character using their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which then uses a generation AI model to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[1102] Activities as a customer support agent

[1103] The virtual character acts as a customer support agent while the user is browsing products in a virtual store using smart glasses. When the user asks a question, the question is sent from the device (smart glasses) to the server. The server uses a generative AI model to analyze the question and generate an appropriate response. The generated response is sent to the user's smart glasses, and the virtual character presents the answer in voice or text.

[1104] Data processing and computation

[1105] The server-side processing includes the following elements:

[1106] Hardware: Servers, smart glasses, terminals.

[1107] Software: Generative AI models (e.g., GPT-3), Flask (server-side application framework), PyTorch (machine learning framework).

[1108] By using a generative AI model, natural and appropriate responses to user questions are generated. For example, if a user asks "I want to know more about this product" through smart glasses, the server receives the question as text data, and the generative AI model analyzes it. Based on the analysis results, it then generates a detailed product description and sends it back to the user.

[1109] Specific example

[1110] For example, if a user requests the creation of a virtual character described as "a 20-year-old male with short hair and a low voice," the server will generate the character using the following prompt message.

[1111] Prompt message:

[1112] A 20-year-old male with short hair and a low voice. He works as a customer support agent and excels at inventory management and product descriptions.

[1113] Input example:

[1114] "I'd like to know more about this product."

[1115] Expected output:

[1116] "This product is made from high-quality materials and is highly durable. It is especially suitable for everyday use. Furthermore, we currently have limited stock, so we recommend purchasing it as soon as possible."

[1117] This allows users to obtain detailed information about products in real time within the virtual store, and also makes the shopping experience more interactive and satisfying.

[1118] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1119] Step 1:

[1120] A user requests the creation of a virtual character using their device. The user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The input data consists of specific setting information such as gender and age, and based on this, the data necessary for creating the virtual character is collected.

[1121] Step 2:

[1122] The server passes the received parameters to the generating AI model and begins generating the virtual character. The generating AI model generates a 3D model, voice data, and personality settings based on the received parameters. In this process, the generating AI model processes the data based on the input parameters (gender, age, hairstyle, voice tone) to generate each element of the virtual character.

[1123] Step 3:

[1124] The generated virtual character data is sent from the server to the terminal. The terminal uses this data to convert the virtual character into a displayable format and presents it to the user. The output data includes the generated character's 3D model and audio data, as well as the specific actions taken to visualize and vocalize it.

[1125] Step 4:

[1126] Users ask questions while browsing products in a virtual store using smart glasses. These questions are entered into the device as voice or text and sent to the server via the smart glasses. This input data includes the user's question, and the following processing is performed based on that content.

[1127] Step 5:

[1128] The server inputs the received question into a generative AI model and generates an appropriate response. The generative AI model uses NLP (Neuro-Linguistic Programming) techniques to analyze the question and generate a response that matches the tone and personality of the configured virtual character. The input data is the user's question, and the output data is the appropriate response. The generative AI model processes and calculates the relationships between this data to create a natural response.

[1129] Step 6:

[1130] The generated response is sent from the server to the terminal and presented to the user through smart glasses. The terminal displays the received data as audio or text, and presents it to the user in the form of a virtual character actually providing the answer. This process includes specific output actions using audio playback devices and displays.

[1131] Step 7:

[1132] User question and answer history is stored on the server and used for the growth and skill development of the virtual character. The server uses this historical data to execute algorithms that change the character's characteristics, providing a more realistic experience. The stored data is a history of past interactions, and includes actions that cause the character to grow and change based on that history.

[1133] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1134] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and even trade them as digital assets. Furthermore, by combining it with an emotion engine, it provides interactions that respond to the user's emotions.

[1135] Generating virtual text

[1136] The user uses their device to request the generation of a virtual character. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which uses a generation AI to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[1137] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[1138] Using an Emotion Engine

[1139] The device sends user input (text, voice, video, etc.) to the server, which uses an emotion engine to analyze it and recognize the user's emotions. The emotion engine grasps the user's emotional state, such as whether they are happy, sad, or angry, in real time.

[1140] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's level of fatigue (a negative emotion) from that text.

[1141] Communication and response

[1142] The server generates responses from the virtual character based on the emotions recognized by the emotion engine. These responses are tailored to the user's emotions, enabling more empathetic dialogue.

[1143] Specific example: A virtual character responds to a tired user with a message like, "That must have been tough. You should take a break."

[1144] Development and changes in characteristics

[1145] The server changes the growth and characteristics of the virtual character based on the user's emotional data. For example, it adjusts the character's personality to be more supportive when the user is sad.

[1146] Specific example: For users who frequently post sad messages, the character will grow to use more comforting words.

[1147] Developments in the metaverse and live events

[1148] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources. By joining the event from their device, users and other participants can interact in real time.

[1149] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[1150] Transactions as digital assets

[1151] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[1152] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[1153] By introducing an emotion engine, it becomes possible to provide virtual character experiences that are based on the user's emotions, offering deeper empathy and a greater sense of realism.

[1154] The following describes the processing flow.

[1155] Virtual character generation and the use of emotion engines

[1156] Step 1:

[1157] The user uses their device to request the generation of a virtual character. The user enters parameters such as gender, age, hairstyle, and voice tone.

[1158] Step 2:

[1159] The terminal sends these input parameters to the server. The data is sent in a format such as JSON.

[1160] Step 3:

[1161] The server analyzes the received parameters and activates the generation AI to create a virtual character. The AI ​​generates the appearance, voice, and personality based on the specified parameters.

[1162] Step 4:

[1163] The server sends the generated virtual character data to the user's terminal. This data includes a 3D model, voice data, and initial settings.

[1164] Communication and Emotion Recognition

[1165] Step 5:

[1166] The user uses their device to ask a virtual character a question via message or voice. The entered message or voice data is sent from the device to the server.

[1167] Step 6:

[1168] The server sends received messages to the emotion engine, which analyzes the user's emotional state. The emotion engine recognizes the user's emotions from input data such as text, audio, and video.

[1169] Step 7:

[1170] The server executes an algorithm that generates a response based on the recognized emotions. NLP techniques are used to create a response that matches the user's emotions.

[1171] Step 8:

[1172] The server sends the generated response to the terminal. The message or audio data is displayed or played on the terminal.

[1173] Emotion-based character development

[1174] Step 9:

[1175] The server adjusts the virtual character's characteristics and personality based on data from the emotion engine. This allows the character to evolve in accordance with the user's emotions.

[1176] Specific example: If a user frequently posts sad messages, the character will start using more comforting words.

[1177] Developments in the metaverse and live events

[1178] Step 10:

[1179] A user requests to host a live event. They send detailed information, including the date, time, and content, from their device to the server.

[1180] Step 11:

[1181] The server receives the request and begins preparing for the live event. It reserves and configures the necessary resources.

[1182] Step 12:

[1183] Users access the metaverse platform from their devices and participate in live events. Other users can also participate simultaneously.

[1184] Step 13:

[1185] The server performs virtual character actions in real time and delivers them to participating users' devices. Users can send reactions and requests in real time.

[1186] Transactions as digital assets

[1187] Step 14:

[1188] The user requests to list their created virtual character as an NFT. This information is sent from the terminal to the server.

[1189] Step 15:

[1190] The server receives the request and converts the virtual character into an NFT. Blockchain technology is used to generate the NFT and record ownership information.

[1191] Step 16:

[1192] The server posts the generated NFT on the marketplace. It is made public on the marketplace along with the virtual character's information.

[1193] Step 17:

[1194] Other users browse the marketplace through their devices and purchase the NFTs they want. The purchase information is sent to the server.

[1195] Step 18:

[1196] The server confirms the purchase and transfers ownership on the blockchain. The information of the original and new owners is updated.

[1197] The above describes the specific processing steps of the program for implementing the present invention. By introducing an emotion engine, interaction based on the user's emotions becomes possible, providing a virtual character experience with deeper empathy and realism.

[1198] (Example 2)

[1199] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1200] In the modern era, the creation and interaction of virtual characters have attracted much attention. However, conventional systems have lacked responses and growth that respond to user emotions, and have been unable to effectively facilitate interaction in virtual spaces or transactions as digital assets. As a result, there are challenges such as limited user experiences and difficulty in forming deep connections with virtual characters.

[1201] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1202] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's emotional data in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for using an emotion engine that analyzes the user's input data to recognize emotions; and means for generating the virtual character using a generative AI model. This enables responses and growth based on the user's emotions, interaction in a virtual space, and trading as a digital asset.

[1203] A "user" is an individual or group that uses the system to create, develop, trade, or otherwise interact with virtual characters.

[1204] A "virtual character" is a digital character generated by a server using a generative AI model and emotion engine based on parameters entered by the user.

[1205] A "generative AI model" is a type of artificial intelligence technology used to generate virtual characters based on parameters input by the user.

[1206] An "emotion engine" is a technology that analyzes user input data (text, audio, video, etc.) and recognizes the user's emotions.

[1207] "Communication methods" refer to technologies that enable virtual characters and users to exchange information in a two-way manner.

[1208] "Growth method" refers to a technology that changes and develops the characteristics of a virtual character based on the user's emotional data.

[1209] A "virtual space" is a digital environment in which virtual characters and users interact.

[1210] "Digital assets" refer to virtual characters that can be traded as digital possessions in forms such as NFTs.

[1211] Blockchain is a distributed ledger technology used for managing ownership and trading digital assets.

[1212] A "live event" is an event in which a virtual character performs and interacts with users and other users in real time.

[1213] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and even trade them as digital assets. Furthermore, by combining it with an emotion engine, it provides interactions that respond to the user's emotions.

[1214] Generating virtual text

[1215] The user requests the generation of a virtual character using a dedicated application on their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The server uses a generation AI model to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[1216] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[1217] Using an Emotion Engine

[1218] The device sends user input data (text, audio, video, etc.) to the server. The server uses an emotion engine to analyze the input data and recognize the user's emotions. The emotion engine understands the user's emotional state, such as being happy, sad, or angry, in real time.

[1219] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's level of fatigue (a negative emotion) from that text.

[1220] Communication and response

[1221] The server generates responses from the virtual character based on the emotions recognized by the emotion engine. These responses are tailored to the user's emotions, enabling more empathetic dialogue.

[1222] Specific example: A virtual character responds to a tired user with a message like, "That must have been tough. You should take a break."

[1223] Development and changes in characteristics

[1224] The server changes the growth and characteristics of the virtual character based on the user's emotional data. For example, it adjusts the character's personality to be more supportive when the user is sad.

[1225] Specific example: For users who frequently post sad messages, the character will grow to use more comforting words.

[1226] Developments in the metaverse and live events

[1227] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources. By joining the event from their device, users and other participants can interact in real time.

[1228] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[1229] Transactions as digital assets

[1230] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[1231] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[1232] Thus, by introducing an emotion engine, it becomes possible to have interactions based on the user's emotions, providing users with a more empathetic and realistic virtual character experience.

[1233] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1234] Step 1:

[1235] The user launches a dedicated application and selects to generate a virtual character.

[1236] Input: Parameters such as gender, age, hairstyle, and voice tone.

[1237] Specific operation: Enter the parameters into the form within the application and press the submit button.

[1238] Step 2:

[1239] The terminal sends the parameters entered by the user to the server.

[1240] Input: Parameter data entered by the user.

[1241] Output: Parameter data included in the HTTP request.

[1242] Specific operation: When the submit button is pressed, an HTTP request is generated and parameter data is sent to the server's API endpoint.

[1243] Step 3:

[1244] The server uses a generative AI model to generate a virtual character based on the parameters sent to it.

[1245] Input: Parameter data sent to the server.

[1246] Output: Data of the generated virtual character (3D model, voice data, personality settings).

[1247] Specific operation: The AI ​​generator is given prompt text such as "Gender: Male, Age: 20, Short hair, Low voice," and a virtual character is generated based on this. The generated data is serialized in JSON format and sent back to the terminal.

[1248] Step 4:

[1249] The terminal receives the generated virtual character data and displays it to the user.

[1250] Input: Character data sent from the server.

[1251] Output: A virtual character displayed to the user.

[1252] Specific operation: Parses received data and displays / plays 3D models and audio within the application.

[1253] Step 5:

[1254] Users interact with virtual characters by inputting text, voice, video, and other information.

[1255] Input: User's text, audio, and video data.

[1256] Output: Input data sent from the terminal to the server.

[1257] Specific operation: Input data using a microphone, camera, and keyboard, and send it to the server in real time.

[1258] Step 6:

[1259] The server uses an emotion engine to analyze the input data and recognize the user's emotions.

[1260] Input: Text, audio, and video data sent by the user.

[1261] Output: Sentiment data of recognized users.

[1262] Specific operation: The emotion engine performs text analysis, speech analysis, and emotion recognition algorithms, and records the user's emotional state in a database.

[1263] Step 7:

[1264] The server generates responses from the virtual character based on the emotional data recognized by the emotion engine.

[1265] Input: Emotional data generated by the emotion engine.

[1266] Output: Virtual character response data.

[1267] Specific operation: Based on emotion data and character personality settings, a dialogue generation model is used to generate a response. The generated text and audio data are sent back to the terminal as an HTTP response.

[1268] Step 8:

[1269] The terminal displays the response data to the user.

[1270] Input: Response data sent from the server.

[1271] Output: Text displayed to the user or audio played.

[1272] Specific actions: Text responses are displayed in the chat window, and voice responses are played through the speaker.

[1273] Step 9:

[1274] The server adjusts the characteristics and behavior of the virtual character based on the user's emotional data.

[1275] Input: Past user sentiment data.

[1276] Output: Updated virtual character settings.

[1277] Specific operation: Retrieve emotional data from the database and update the character's behavior patterns based on the analysis results.

[1278] Step 10:

[1279] Users perform actions to allow their virtual characters to interact with other users in the virtual space.

[1280] Input: Event request data.

[1281] Output: Live event setup and resource reservation.

[1282] Specific operation: The user sets the event date and details within the app and sends a request. The server uses a reservation system to secure the necessary resources and register the event details.

[1283] Step 11:

[1284] Based on NFT requests from users, the server generates virtual characters as digital assets and makes them tradable.

[1285] Input: NFT request data submitted by the user.

[1286] Output: The generated NFT and its listing information on the marketplace.

[1287] Specific operation: Generate NFTs using blockchain technology and register ownership information on the blockchain. Then, list the NFTs using a marketplace API and enable trading.

[1288] In this way, through a series of processing steps, users can generate virtual characters, experience emotion-based interactions, and engage in activities and transactions as digital assets in a virtual space.

[1289] (Application Example 2)

[1290] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1291] Traditional virtual character systems were limited to simply generating characters and engaging in static interactions with users. They lacked the ability to respond to user emotions, dynamically evolve characters, or even trade them as digital assets. As a result, these systems had limitations in terms of improving user experience and commercial viability.

[1292] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for generating a virtual character based on parameters input by the user, means for the virtual character and the user to communicate bidirectionally, means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character, means for the virtual character to analyze the user's emotions using an emotion engine and generate a response from the virtual character, and means for controlling the growth of the virtual character based on the results of interaction with the virtual character. This enables dynamic growth of the virtual character and trading as a digital asset while providing interaction that responds to the user's emotions.

[1293] A "user" is an end-user who uses the system to generate virtual characters and interact with them.

[1294] "Parameters" are items used by users to specify the attributes and characteristics of a virtual character. Specifically, these include gender, age, hairstyle, voice tone, and so on.

[1295] A "virtual character" is a digital character generated using AI based on user input. This includes 3D models, voice data, and personality settings.

[1296] "Two-way communication" refers to a dialogue-based interaction where the user and the virtual character exchange information with each other. This can be done using text, audio, video, etc.

[1297] "Growth" refers to the process by which a virtual character evolves, changing its characteristics and personality based on user interactions and emotional data.

[1298] A "virtual space" is a simulated three-dimensional space generated through the internet or other digital networks. It is a place where users and virtual characters engage in activities and interactions.

[1299] An "emotion engine" is a software module that analyzes user input (text, voice, video, etc.) to recognize their emotional state.

[1300] "Digital assets" are digital objects that exist electronically, have an identifiable owner, and possess economic value. In particular, they refer to virtual characters.

[1301] "Transactions" refer to activities such as buying, selling, and exchanging virtual characters, which are generated as digital assets. These are primarily conducted using marketplaces and blockchain technology.

[1302] A "live event" is an event held in real time in a virtual space or other digital platform. It allows a large number of users to participate and interact simultaneously.

[1303] Blockchain is a system that uses distributed ledger technology to manage transaction information and ownership information of digital assets. It has the characteristic of preventing fraudulent tampering.

[1304] This invention relates to a system that generates a virtual character based on parameters entered by a user and enables two-way communication using an emotion engine. This system allows for the growth of the virtual character, interaction in a virtual space, and trading of digital assets.

[1305] System Configuration

[1306] This system consists of the following main elements.

[1307] 1. User terminal

[1308] 2. Server

[1309] 3. Emotional Engine

[1310] 4. Virtual Space Platform

[1311] 5. Blockchain Technology

[1312] Main Features

[1313] 1. Generating virtual characters

[1314] The user uses a device to input parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to a server, which then generates a virtual character using a generative AI model. This character includes a 3D model, voice data, and personality settings.

[1315] Specific example: If a user specifies "25-year-old male, short hair, deep voice," the server generates a virtual character that matches these criteria and sends that data to the user's terminal.

[1316] 2. Interaction using an emotion engine

[1317] The terminal sends text or voice input from the user to the server, which uses an emotion engine to analyze the user's emotional state in real time. The emotion engine recognizes the user's emotions, and a virtual character generates a response corresponding to those emotions.

[1318] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's fatigue (a negative emotion) from the text and responds with something like, "That must have been tough. You should take a break."

[1319] 3. Growth and changes in the characteristics of virtual characters

[1320] Based on user emotion data and interaction results, the server adaptively changes the characteristics and personality of the virtual character.

[1321] Specific example: If the user frequently makes sad inputs, the character will grow to use more comforting words.

[1322] 4. Interaction and live events in virtual space

[1323] Users can have their virtual characters interact with other users in the virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources.

[1324] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[1325] 5. Transactions as digital assets

[1326] To trade virtual characters as digital assets, users request the creation of NFTs (Non-Fiber Capture) versions of their characters from their devices. The server uses blockchain technology to generate the NFTs and records their ownership information.

[1327] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[1328] Hardware and software to be used

[1329] Hardware:

[1330] User devices (smartphones, smart glasses, head-mounted displays)

[1331] server

[1332] software:

[1333] Generative AI models (such as OpenAI)

[1334] Emotion engine (TextBlob, etc.)

[1335] Virtual space platform

[1336] Blockchain technology

[1337] Example of a prompt

[1338] 1. "Create a 25-year-old male with short hair and a deep voice."

[1339] 2. “I am feeling a bit tired today.”

[1340] 3. "Today, let's have a fun conversation."

[1341] Based on the above, the present invention provides a virtual character system that enables interaction in accordance with the user's emotions and realizes the trading of commercially valuable digital assets.

[1342] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1343] Step 1:

[1344] The user requests the generation of a virtual character using their device. Specifically, they input parameters such as gender, age, hairstyle, and voice tone, and the device sends this data to the server. For example, input parameters might include "25-year-old male, short hair, deep voice." The server receives this input data and passes it to the generation AI model. The generation AI model generates a virtual character based on the specified parameters. As output, it generates character data including a 3D model, voice data, and personality settings, and sends this to the device.

[1345] Step 2:

[1346] The device receives input (text, voice) from the user. When the user enters text such as "I'm tired today," this input data is sent to the server. The server analyzes this text input using an emotion engine (such as TextBlob). The emotion engine recognizes the user's emotional state from the text and generates an analysis result such as "fatigue (negative emotion)." This analysis result is used in the next step.

[1347] Step 3:

[1348] The server generates a virtual character response based on the analysis results of the emotion engine. Taking the analysis result "fatigue (negative emotion)" as input, the server generates the prompt response "That must have been tough." This response is processed as voice data for the virtual character and sent to the terminal. The terminal plays this voice data and provides feedback to the user.

[1349] Step 4:

[1350] Based on the results of user interactions, the server controls the growth of the virtual character. For example, if the user frequently says "I'm tired," the server processes the data to help the character grow by using more comforting words. Specifically, the server updates the character's personality settings and generates new response patterns based on the user's emotional history. This changes the character's personality and response characteristics, causing the character to "grow."

[1351] Step 5:

[1352] Users can interact with other users in a virtual space through their terminals using their virtual characters. When a user requests a live event, the server reserves the necessary resources and sets up the event. Once the event starts, the server manages interactions in real time and facilitates communication between participants. The server takes a user request, such as "Sing this song at next week's live event," as input and generates event settings and real-time interaction management as output.

[1353] Step 6:

[1354] Users can trade virtual characters as digital assets. When a user requests to convert a character into an NFT from their device, the server generates the NFT using blockchain technology. Specifically, it encrypts the character's ownership information and records it on the blockchain. In this process, the server receives character data as input, generates an NFT as output, and lists it on the marketplace. When a user expresses interest in purchasing, the server transfers ownership using blockchain technology.

[1355] Through the above processing steps, a virtual character system capable of interacting with users in accordance with their emotions is realized.

[1356] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1357] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1358] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1359] [Fourth Embodiment]

[1360] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1361] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1362] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1363] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1364] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1365] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1366] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1367] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1368] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1369] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1370] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1371] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1372] Next, the specific processing performed by the specific processing unit 290 of the data processing device 12 will be described. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1373] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and further trade them as digital assets. Specific embodiments of this system are described below.

[1374] Generating virtual text

[1375] The user requests the generation of a virtual character using their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which uses a generation AI to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[1376] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[1377] Communication and development

[1378] Users can communicate interactively with virtual characters generated through their devices. When a user asks a question via text message or voice input, the device sends the message to a server. The server uses NLP (Natural Language Processing) technology to analyze the user's intent, generate an appropriate response, and send it to the device.

[1379] Furthermore, based on the user's communication history, the server executes an algorithm that automatically develops and changes the virtual character's personality and skills. This allows the virtual character to evolve into a more realistic presence.

[1380] Specific example: When a user asks the character, "What did you do today?", the server uses an NLP algorithm to generate a response, "I was practicing a new dance today," and sends it to the terminal.

[1381] Developments in the metaverse and live events

[1382] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves the necessary resources and sets up the event. By joining the event from their device, users and other participants can interact in real time.

[1383] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[1384] Transactions as digital assets

[1385] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[1386] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[1387] In this way, this system comprehensively supports the creation, development, interaction, and trading of virtual characters, providing users with a new entertainment experience.

[1388] The following describes the processing flow.

[1389] Generating virtual text

[1390] Step 1:

[1391] The user uses their device to request the generation of a virtual character. The user enters parameters such as gender, age, hairstyle, and voice tone.

[1392] Step 2:

[1393] The terminal sends these input parameters to the server. The data is sent in a format such as JSON.

[1394] Step 3:

[1395] The server analyzes the received parameters and activates the generation AI to create a virtual character. The AI ​​generates the appearance, voice, and personality based on the specified parameters.

[1396] Step 4:

[1397] The server sends the generated virtual character data to the user's terminal. This data includes a 3D model, voice data, and initial settings.

[1398] Communication and development

[1399] Step 5:

[1400] The user uses their device to ask a virtual character a question via message or voice. The entered message or voice data is sent from the device to the server.

[1401] Step 6:

[1402] The server analyzes the received message and uses NLP techniques to understand the user's intent. It then executes an algorithm to generate a corresponding response.

[1403] Step 7:

[1404] The server sends the generated response to the terminal. The message or audio data is displayed or played on the terminal.

[1405] Step 8:

[1406] The server executes a training algorithm that adjusts the virtual character's skills and personality based on user actions and messages. This causes the virtual character to grow and change.

[1407] Developments in the metaverse and live events

[1408] Step 9:

[1409] A user requests to host a live event. They send detailed information, including the date, time, and content, from their device to the server.

[1410] Step 10:

[1411] The server receives the request and begins preparing for the live event. It reserves and configures the necessary resources.

[1412] Step 11:

[1413] Users access the metaverse platform from their devices and participate in live events. Other users can also participate simultaneously.

[1414] Step 12:

[1415] The server performs virtual character actions in real time and delivers them to participating users' devices. Users can send reactions and requests in real time.

[1416] Transactions as digital assets

[1417] Step 13:

[1418] The user requests to list their created virtual character as an NFT. This information is sent from the terminal to the server.

[1419] Step 14:

[1420] The server receives the request and converts the virtual character into an NFT. Blockchain technology is used to generate the NFT and record ownership information.

[1421] Step 15:

[1422] The server posts the generated NFT on the marketplace. It is made public on the marketplace along with the virtual character's information.

[1423] Step 16:

[1424] Other users browse the marketplace through their devices and purchase the NFTs they want. The purchase information is sent to the server.

[1425] Step 17:

[1426] The server confirms the purchase and transfers ownership on the blockchain. The information of the original and new owners is updated.

[1427] The above describes the specific processing steps of the program for implementing the present invention.

[1428] (Example 1)

[1429] Next, we will describe Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1430] Traditional virtual character generation systems required numerous manual operations for character creation and growth, placing a significant burden on users. Furthermore, they lacked an integrated system for comprehensively managing communication with characters, interaction within the virtual space, and trading of characters as digital assets. Additionally, there was a lack of appropriate means to securely and reliably manage ownership of the generated virtual characters.

[1431] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1432] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for using an AI model that generates the virtual character as character data including a 3D model, voice data, and personality settings based on user-specified parameters; means for analyzing the user's message using natural language processing technology and generating an appropriate response; and means for registering the virtual character as an NFT on the blockchain and managing ownership. This makes it possible to consistently perform everything from the generation to growth, interaction, and trading of virtual characters.

[1433] A "virtual character" is a virtual person or entity that is generated based on parameters entered by the user.

[1434] A "user" is an individual or legal entity that uses this system to generate a virtual character and communicate with that character.

[1435] "Parameters" refer to specific information such as gender, age, hairstyle, and voice tone that is necessary for creating and configuring a virtual character.

[1436] A "generative AI model" is an artificial intelligence model used to generate virtual characters based on parameters specified by the user.

[1437] A "server" is a central computing resource and processing unit used for generating, managing, developing, interacting with, and trading virtual characters.

[1438] A "terminal" refers to a device used by a user to request the creation of a virtual character and to check and manipulate the results; examples include personal computers and smartphones.

[1439] "Natural language processing" is the technology that allows computers to understand, analyze, and generate appropriate responses to human language.

[1440] "Two-way communication" refers to the interaction between users and virtual characters through text and voice.

[1441] "Growth" refers to the change and development of a virtual character's personality and skills based on user input and actions.

[1442] A "virtual space" is a digital place or environment that uses 3D graphics and allows users to interact with each other on the internet.

[1443] "Digital assets" refer to assets that exist in digital form, including virtual characters, and can be bought, sold, and owned.

[1444] "NFT" stands for Non-Fungible Token, and it is a technology based on blockchain technology that guarantees the uniqueness and ownership of digital assets.

[1445] Blockchain is a distributed digital ledger technology used to securely record and manage transaction information and ownership information of digital assets.

[1446] Modes for carrying out the invention

[1447] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and further trade them as digital assets.

[1448] Generating virtual text

[1449] The user requests the generation of a virtual character using their device. The user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The server uses a generation AI model (e.g., OpenAI's GPT-3 or DALL-E) to generate a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings. The completed virtual character data is sent to the user's device and displayed on it.

[1450] Specific example: When a user specifies "20-year-old male, short hair, low voice," the server sends the prompt message "Generate a 20-year-old male character. Features are short hair and a low voice" to the AI ​​model. The generated character data is then sent back to the device and displayed on the screen.

[1451] Communication and development

[1452] Users can communicate interactively with virtual characters generated through their devices. When a user asks a question via text message or voice input, the device sends the message to a server. The server uses natural language processing (NLP) techniques (e.g., GPT-3 or BERT) to analyze the user's intent, generate an appropriate response, and send it to the device.

[1453] Furthermore, based on the user's communication history, the server executes an algorithm that automatically develops and changes the virtual character's personality and skills. This allows the virtual character to evolve into a more realistic presence.

[1454] Specific example: When a user asks the character, "What did you do today?", the server uses an NLP algorithm to generate a response, "I was practicing a new dance today," and sends it to the terminal.

[1455] Developments in the metaverse and live events

[1456] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves the necessary resources and sets up the event. By joining the event from their device, users and other participants can interact in real time.

[1457] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[1458] Transactions as digital assets

[1459] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology (e.g., Ethereum) and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[1460] Specific example: If a user wants to sell a virtual character they have created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[1461] In this way, this system comprehensively supports the creation, development, interaction, and trading of virtual characters, providing users with a new entertainment experience.

[1462] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1463] Program processing flow

[1464] Generating virtual text

[1465] Step 1:

[1466] The user requests the generation of a virtual character using a terminal. The user inputs parameters such as gender, age, hairstyle, and voice tone. The input to this process is the various parameters specified by the user, and the output is a dataset of those parameters.

[1467] Specific operation: The user enters parameters such as "20-year-old male, short hair, low voice" into the input field on the terminal screen and presses the "Generate" button.

[1468] Step 2:

[1469] The terminal sends the entered parameters to the server. The input to this process is a dataset of parameters entered by the user, and the output is a request message containing those parameters.

[1470] Specific operation: The terminal converts the user's input into a JSON-formatted request and sends it to the server using a REST API.

[1471] Step 3:

[1472] The server sends prompt messages to the generating AI model (e.g., OpenAI's GPT-3 or DALL-E) to instruct it to generate a virtual character. The process's input is a request message containing parameters, and its output is prompt messages sent to the generating AI model.

[1473] Specific operation: The server sends the prompt message "Generate a 20-year-old male character. The characteristics are short hair and a low voice" to the generation AI model based on the parameters "20-year-old male, short hair, low voice".

[1474] Step 4:

[1475] The generative AI model generates a virtual character, including a 3D model, voice data, and personality settings, based on prompt text. The input to the process is prompt text, and the output is a set of character data.

[1476] Specific operation: The generated AI model renders a 3D model of the character based on the given parameters, generates audio data, and outputs personality settings in JSON format.

[1477] Step 5:

[1478] The server receives the generated character data and sends it to the user's terminal. The process's input is a set of character data, and its output is a response message to send to the terminal.

[1479] Specific operation: The server reformats the character data along with the user's unique terminal identifier and sends it to the terminal.

[1480] Step 6:

[1481] The terminal interprets the received character data and displays it to the user. The process's input is character data sent from the server, and its output is a virtual character displayed on the screen.

[1482] Specific operation: The device renders a 3D model of the character, plays audio data, applies personality settings, and displays it to the user.

[1483] Communication and development

[1484] Step 1:

[1485] Users communicate with a virtual character via text messages or voice input. The process's input is the user's message, and its output is the data of the input message.

[1486] Specific action: The user types "What did you do today?" into the chat box on their device and presses the send button.

[1487] Step 2:

[1488] The terminal receives user messages and sends them to the server. The process's input is the user's message, and its output is the request message to be sent to the server.

[1489] Specific operation: The terminal retrieves the user's message as text data and converts it into a request message to send to the server.

[1490] Step 3:

[1491] The server uses natural language processing (NLP) techniques to analyze the user's intent. The process's input is the user's message, and its output is the analysis result.

[1492] Specific operation: The server uses an NLP model (e.g., GPT-3 or BERT) to generate a prompt message such as "The user asked 'What did you do today?'. How would you answer as a character?" and sends it to the model.

[1493] Step 4:

[1494] The server generates an appropriate response and sends it to the terminal. The process's input is the parsing result, and its output is the response message.

[1495] Specific operation: The server reformats the response "I was practicing a new dance today" returned by the NLP model and sends it to the terminal.

[1496] Step 5:

[1497] The terminal displays the received response to the user, and if it is to be played back as audio, it uses speech synthesis. The input to the process is the response message sent from the server, and the output is the displayed text or the played audio.

[1498] Specific operation: The terminal displays the response message in a text box, generates speech using a speech synthesis engine, and plays it through the speaker.

[1499] Step 6:

[1500] The server analyzes the user's communication history and applies algorithms to improve the virtual character's personality and skills. The input to the process is the communication history, and the output is updated character personality or skill data.

[1501] Specific operation: The server analyzes the dialogue history, updates the character's personality parameters and skill values, and saves them to the database.

[1502] Developments in the metaverse and live events

[1503] Step 1:

[1504] Users request to host live events to allow their virtual characters to interact with other users in a virtual space. The process's input is the user's event request, and its output is the request data.

[1505] Specific action: The user uses the terminal interface to enter a request such as, "Please sing this song at next week's live event."

[1506] Step 2:

[1507] The server reserves the necessary resources and configures events. The process's input is user request data, and its output is event configuration data.

[1508] Specific operation: The server receives a request, reserves resources within the virtual space (server configuration, network bandwidth, etc.), and configures the event.

[1509] Step 3:

[1510] By joining an event from a device, users and other participants can interact in real time. The process's input is event configuration data, and its output is interaction data.

[1511] Specific operation: The device displays the event participation interface, and when the user clicks the participate button, real-time interaction with other participants begins.

[1512] Transactions as digital assets

[1513] Step 1:

[1514] The user requests the creation of an NFT of a virtual character. The process's input is the user's request, and its output is the request data.

[1515] Specific operation: The user uses the terminal interface to enter a request saying, "Please register this character as an NFT."

[1516] Step 2:

[1517] The server generates NFTs using blockchain technology and records their ownership information. The process's input is request data, and its output is NFT data and ownership information.

[1518] Specific operation: The server accesses the blockchain network, generates an NFT based on the character information, and records ownership information on the blockchain.

[1519] Step 3:

[1520] The server lists the generated NFTs on a marketplace, allowing other users to trade them. The input to the process is the NFT data, and the output is the marketplace list.

[1521] Specific operation: The server registers the generated NFT on the digital marketplace and makes it viewable.

[1522] Step 4:

[1523] Users conduct transactions with other users on the marketplace. The input to the process is the marketplace list, and the output is transaction data.

[1524] Specific operation: A user sells a character NFT on a marketplace, and another user purchases it.

[1525] Step 5:

[1526] After a transaction is completed, the server updates ownership on the blockchain and transfers ownership to the new owner. The input to the process is the transaction data, and the output is the updated ownership information.

[1527] Specific operation: The server accesses the blockchain network and executes a transaction to transfer ownership of the NFT to the new buyer once the transaction is complete.

[1528] (Application Example 1)

[1529] Next, we will explain Application Example 1. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1530] Traditional virtual character systems offered character generation, two-way communication, character development, interaction in virtual spaces, and trading as digital assets. However, these systems had limited practicality within virtual stores, particularly in areas like customer support. New features are needed to meet the needs of users seeking more realistic and interactive experiences.

[1531] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1532] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for making the virtual character function as a customer support agent using smart glasses; and means for using a generative AI model for the customer support agent to generate responses to user questions. This makes it possible to provide realistic and interactive customer support within a virtual store.

[1533] A "user" is anyone who operates the system, creates, manipulates, or trades virtual characters.

[1534] "Parameters" refer to setting information such as gender, age, hairstyle, and voice tone that users input when creating a virtual character.

[1535] A "virtual character" is a digital person or character generated based on user input, and it can be used for communication, nurturing, interaction in a virtual space, and trading as a digital asset.

[1536] "Communication" refers to the act of two-way information exchange between a virtual character and a user, which takes place through text messages or voice input.

[1537] "Characteristics" refer to elements that make up a virtual character, such as its personality, skills, and appearance.

[1538] A "virtual space" refers to a 3D environment or other digital environment created by a computer system.

[1539] "Digital assets" refer to items and characters that exist in digital form and can be owned and traded.

[1540] "Smart glasses" are visual devices equipped with internet connectivity and augmented reality capabilities that allow users to display information and perform actions while wearing them.

[1541] A "customer support agent" is a virtual character whose role is to provide support when users make inquiries about products or services within a virtual store.

[1542] A "generative AI model" refers to algorithms and software that utilize artificial intelligence technology to generate text and dialogue.

[1543] A "response" refers to the content of the reply generated by a customer support agent in response to a user's question.

[1544] Modes for carrying out the invention

[1545] This invention relates to a system for generating virtual characters and utilizing them as customer support agents in virtual stores. Specific embodiments are described below.

[1546] Generating virtual text

[1547] A user requests the generation of a virtual character using their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which then uses a generation AI model to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[1548] Activities as a customer support agent

[1549] The virtual character acts as a customer support agent while the user is browsing products in a virtual store using smart glasses. When the user asks a question, the question is sent from the device (smart glasses) to the server. The server uses a generative AI model to analyze the question and generate an appropriate response. The generated response is sent to the user's smart glasses, and the virtual character presents the answer in voice or text.

[1550] Data processing and computation

[1551] The server-side processing includes the following elements:

[1552] Hardware: Servers, smart glasses, terminals.

[1553] Software: Generative AI models (e.g., GPT-3), Flask (server-side application framework), PyTorch (machine learning framework).

[1554] By using a generative AI model, natural and appropriate responses to user questions are generated. For example, if a user asks "I want to know more about this product" through smart glasses, the server receives the question as text data, and the generative AI model analyzes it. Based on the analysis results, it then generates a detailed product description and sends it back to the user.

[1555] Specific example

[1556] For example, if a user requests the creation of a virtual character described as "a 20-year-old male with short hair and a low voice," the server will generate the character using the following prompt message.

[1557] Prompt message:

[1558] A 20-year-old male with short hair and a low voice. He works as a customer support agent and excels at inventory management and product descriptions.

[1559] Input example:

[1560] "I'd like to know more about this product."

[1561] Expected output:

[1562] "This product is made from high-quality materials and is highly durable. It is especially suitable for everyday use. Furthermore, we currently have limited stock, so we recommend purchasing it as soon as possible."

[1563] This allows users to obtain detailed information about products in real time within the virtual store, and also makes the shopping experience more interactive and satisfying.

[1564] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1565] Step 1:

[1566] A user requests the creation of a virtual character using their device. The user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The input data consists of specific setting information such as gender and age, and based on this, the data necessary for creating the virtual character is collected.

[1567] Step 2:

[1568] The server passes the received parameters to the generating AI model and begins generating the virtual character. The generating AI model generates a 3D model, voice data, and personality settings based on the received parameters. In this process, the generating AI model processes the data based on the input parameters (gender, age, hairstyle, voice tone) to generate each element of the virtual character.

[1569] Step 3:

[1570] The generated virtual character data is sent from the server to the terminal. The terminal uses this data to convert the virtual character into a displayable format and presents it to the user. The output data includes the generated character's 3D model and audio data, as well as the specific actions taken to visualize and vocalize it.

[1571] Step 4:

[1572] Users ask questions while browsing products in a virtual store using smart glasses. These questions are entered into the device as voice or text and sent to the server via the smart glasses. This input data includes the user's question, and the following processing is performed based on that content.

[1573] Step 5:

[1574] The server inputs the received question into a generative AI model and generates an appropriate response. The generative AI model uses NLP (Neuro-Linguistic Programming) techniques to analyze the question and generate a response that matches the tone and personality of the configured virtual character. The input data is the user's question, and the output data is the appropriate response. The generative AI model processes and calculates the relationships between this data to create a natural response.

[1575] Step 6:

[1576] The generated response is sent from the server to the terminal and presented to the user through smart glasses. The terminal displays the received data as audio or text, and presents it to the user in the form of a virtual character actually providing the answer. This process includes specific output actions using audio playback devices and displays.

[1577] Step 7:

[1578] User question and answer history is stored on the server and used for the growth and skill development of the virtual character. The server uses this historical data to execute algorithms that change the character's characteristics, providing a more realistic experience. The stored data is a history of past interactions, and includes actions that cause the character to grow and change based on that history.

[1579] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1580] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and even trade them as digital assets. Furthermore, by combining it with an emotion engine, it provides interactions that respond to the user's emotions.

[1581] Generating virtual text

[1582] The user uses their device to request the generation of a virtual character. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server, which uses a generation AI to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[1583] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[1584] Using an Emotion Engine

[1585] The device sends user input (text, voice, video, etc.) to the server, which uses an emotion engine to analyze it and recognize the user's emotions. The emotion engine grasps the user's emotional state, such as whether they are happy, sad, or angry, in real time.

[1586] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's level of fatigue (a negative emotion) from that text.

[1587] Communication and response

[1588] The server generates responses from the virtual character based on the emotions recognized by the emotion engine. These responses are tailored to the user's emotions, enabling more empathetic dialogue.

[1589] Specific example: A virtual character responds to a tired user with a message like, "That must have been tough. You should take a break."

[1590] Development and changes in characteristics

[1591] The server changes the growth and characteristics of the virtual character based on the user's emotional data. For example, it adjusts the character's personality to be more supportive when the user is sad.

[1592] Specific example: For users who frequently post sad messages, the character will grow to use more comforting words.

[1593] Developments in the metaverse and live events

[1594] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources. By joining the event from their device, users and other participants can interact in real time.

[1595] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[1596] Transactions as digital assets

[1597] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[1598] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[1599] By introducing an emotion engine, it becomes possible to provide virtual character experiences that are based on the user's emotions, offering deeper empathy and a greater sense of realism.

[1600] The following describes the processing flow.

[1601] Virtual character generation and the use of emotion engines

[1602] Step 1:

[1603] The user uses their device to request the generation of a virtual character. The user enters parameters such as gender, age, hairstyle, and voice tone.

[1604] Step 2:

[1605] The terminal sends these input parameters to the server. The data is sent in a format such as JSON.

[1606] Step 3:

[1607] The server analyzes the received parameters and activates the generation AI to create a virtual character. The AI ​​generates the appearance, voice, and personality based on the specified parameters.

[1608] Step 4:

[1609] The server sends the generated virtual character data to the user's terminal. This data includes a 3D model, voice data, and initial settings.

[1610] Communication and Emotion Recognition

[1611] Step 5:

[1612] The user uses their device to ask a virtual character a question via message or voice. The entered message or voice data is sent from the device to the server.

[1613] Step 6:

[1614] The server sends received messages to the emotion engine, which analyzes the user's emotional state. The emotion engine recognizes the user's emotions from input data such as text, audio, and video.

[1615] Step 7:

[1616] The server executes an algorithm that generates a response based on the recognized emotions. NLP techniques are used to create a response that matches the user's emotions.

[1617] Step 8:

[1618] The server sends the generated response to the terminal. The message or audio data is displayed or played on the terminal.

[1619] Emotion-based character development

[1620] Step 9:

[1621] The server adjusts the virtual character's characteristics and personality based on data from the emotion engine. This allows the character to evolve in accordance with the user's emotions.

[1622] Specific example: If a user frequently posts sad messages, the character will start using more comforting words.

[1623] Developments in the metaverse and live events

[1624] Step 10:

[1625] A user requests to host a live event. They send detailed information, including the date, time, and content, from their device to the server.

[1626] Step 11:

[1627] The server receives the request and begins preparing for the live event. It reserves and configures the necessary resources.

[1628] Step 12:

[1629] Users access the metaverse platform from their devices and participate in live events. Other users can also participate simultaneously.

[1630] Step 13:

[1631] The server performs virtual character actions in real time and delivers them to participating users' devices. Users can send reactions and requests in real time.

[1632] Transactions as digital assets

[1633] Step 14:

[1634] The user requests to list their created virtual character as an NFT. This information is sent from the terminal to the server.

[1635] Step 15:

[1636] The server receives the request and converts the virtual character into an NFT. Blockchain technology is used to generate the NFT and record ownership information.

[1637] Step 16:

[1638] The server posts the generated NFT on the marketplace. It is made public on the marketplace along with the virtual character's information.

[1639] Step 17:

[1640] Other users browse the marketplace through their devices and purchase the NFTs they want. The purchase information is sent to the server.

[1641] Step 18:

[1642] The server confirms the purchase and transfers ownership on the blockchain. The information of the original and new owners is updated.

[1643] The above describes the specific processing steps of the program for implementing the present invention. By introducing an emotion engine, interaction based on the user's emotions becomes possible, providing a virtual character experience with deeper empathy and realism.

[1644] (Example 2)

[1645] Next, we will describe Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1646] In the modern era, the creation and interaction of virtual characters have attracted much attention. However, conventional systems have lacked responses and growth that respond to user emotions, and have been unable to effectively facilitate interaction in virtual spaces or transactions as digital assets. As a result, there are challenges such as limited user experiences and difficulty in forming deep connections with virtual characters.

[1647] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1648] In this invention, the server includes means for generating a virtual character based on parameters input by a user; means for the virtual character and the user to communicate bidirectionally; means for changing the characteristics of the virtual character based on the user's emotional data in order to grow the virtual character; means for allowing the virtual character to interact with other users in a virtual space; means for generating the virtual character as a digital asset and making it tradable; means for using an emotion engine that analyzes the user's input data to recognize emotions; and means for generating the virtual character using a generative AI model. This enables responses and growth based on the user's emotions, interaction in a virtual space, and trading as a digital asset.

[1649] A "user" is an individual or group that uses the system to create, develop, trade, or otherwise interact with virtual characters.

[1650] A "virtual character" is a digital character generated by a server using a generative AI model and emotion engine based on parameters entered by the user.

[1651] A "generative AI model" is a type of artificial intelligence technology used to generate virtual characters based on parameters input by the user.

[1652] An "emotion engine" is a technology that analyzes user input data (text, audio, video, etc.) and recognizes the user's emotions.

[1653] "Communication methods" refer to technologies that enable virtual characters and users to exchange information in a two-way manner.

[1654] "Growth method" refers to a technology that changes and develops the characteristics of a virtual character based on the user's emotional data.

[1655] A "virtual space" is a digital environment in which virtual characters and users interact.

[1656] "Digital assets" refer to virtual characters that can be traded as digital possessions in forms such as NFTs.

[1657] Blockchain is a distributed ledger technology used for managing ownership and trading digital assets.

[1658] A "live event" is an event in which a virtual character performs and interacts with users and other users in real time.

[1659] This invention relates to a system that enables users to generate virtual characters using AI technology, make those characters active in a virtual space, and even trade them as digital assets. Furthermore, by combining it with an emotion engine, it provides interactions that respond to the user's emotions.

[1660] Generating virtual text

[1661] The user requests the generation of a virtual character using a dedicated application on their device. During this process, the user inputs parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to the server. The server uses a generation AI model to create a virtual character based on the input parameters. This character includes a 3D model, voice data, and personality settings.

[1662] Specific example: If a user specifies "20-year-old male, short hair, low voice," the server generates a virtual character that matches these specifications and sends that data to the user's terminal.

[1663] Using an Emotion Engine

[1664] The device sends user input data (text, audio, video, etc.) to the server. The server uses an emotion engine to analyze the input data and recognize the user's emotions. The emotion engine understands the user's emotional state, such as being happy, sad, or angry, in real time.

[1665] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's level of fatigue (a negative emotion) from that text.

[1666] Communication and response

[1667] The server generates responses from the virtual character based on the emotions recognized by the emotion engine. These responses are tailored to the user's emotions, enabling more empathetic dialogue.

[1668] Specific example: A virtual character responds to a tired user with a message like, "That must have been tough. You should take a break."

[1669] Development and changes in characteristics

[1670] The server changes the growth and characteristics of the virtual character based on the user's emotional data. For example, it adjusts the character's personality to be more supportive when the user is sad.

[1671] Specific example: For users who frequently post sad messages, the character will grow to use more comforting words.

[1672] Developments in the metaverse and live events

[1673] Users can have their virtual characters interact with other users in a virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources. By joining the event from their device, users and other participants can interact in real time.

[1674] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[1675] Transactions as digital assets

[1676] To make virtual characters tradable as digital assets, users request the character to be converted into an NFT from their device. The server generates the NFT using blockchain technology and records its ownership information. The server then lists the generated NFT on a marketplace, allowing other users to trade it.

[1677] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[1678] Thus, by introducing an emotion engine, it becomes possible to have interactions based on the user's emotions, providing users with a more empathetic and realistic virtual character experience.

[1679] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1680] Step 1:

[1681] The user launches a dedicated application and selects to generate a virtual character.

[1682] Input: Parameters such as gender, age, hairstyle, and voice tone.

[1683] Specific operation: Enter the parameters into the form within the application and press the submit button.

[1684] Step 2:

[1685] The terminal sends the parameters entered by the user to the server.

[1686] Input: Parameter data entered by the user.

[1687] Output: Parameter data included in the HTTP request.

[1688] Specific operation: When the submit button is pressed, an HTTP request is generated and parameter data is sent to the server's API endpoint.

[1689] Step 3:

[1690] The server uses a generative AI model to generate a virtual character based on the parameters sent to it.

[1691] Input: Parameter data sent to the server.

[1692] Output: Data of the generated virtual character (3D model, voice data, personality settings).

[1693] Specific operation: The AI ​​generator is given prompt text such as "Gender: Male, Age: 20, Short hair, Low voice," and a virtual character is generated based on this. The generated data is serialized in JSON format and sent back to the terminal.

[1694] Step 4:

[1695] The terminal receives the generated virtual character data and displays it to the user.

[1696] Input: Character data sent from the server.

[1697] Output: A virtual character displayed to the user.

[1698] Specific operation: Parses received data and displays / plays 3D models and audio within the application.

[1699] Step 5:

[1700] Users interact with virtual characters by inputting text, voice, video, and other information.

[1701] Input: User's text, audio, and video data.

[1702] Output: Input data sent from the terminal to the server.

[1703] Specific operation: Input data using a microphone, camera, and keyboard, and send it to the server in real time.

[1704] Step 6:

[1705] The server uses an emotion engine to analyze the input data and recognize the user's emotions.

[1706] Input: Text, audio, and video data sent by the user.

[1707] Output: Sentiment data of recognized users.

[1708] Specific operation: The emotion engine performs text analysis, speech analysis, and emotion recognition algorithms, and records the user's emotional state in a database.

[1709] Step 7:

[1710] The server generates responses from the virtual character based on the emotional data recognized by the emotion engine.

[1711] Input: Emotional data generated by the emotion engine.

[1712] Output: Virtual character response data.

[1713] Specific operation: Based on emotion data and character personality settings, a dialogue generation model is used to generate a response. The generated text and audio data are sent back to the terminal as an HTTP response.

[1714] Step 8:

[1715] The terminal displays the response data to the user.

[1716] Input: Response data sent from the server.

[1717] Output: Text displayed to the user or audio played.

[1718] Specific actions: Text responses are displayed in the chat window, and voice responses are played through the speaker.

[1719] Step 9:

[1720] The server adjusts the characteristics and behavior of the virtual character based on the user's emotional data.

[1721] Input: Past user sentiment data.

[1722] Output: Updated virtual character settings.

[1723] Specific operation: Retrieve emotional data from the database and update the character's behavior patterns based on the analysis results.

[1724] Step 10:

[1725] Users perform actions to allow their virtual characters to interact with other users in the virtual space.

[1726] Input: Event request data.

[1727] Output: Live event setup and resource reservation.

[1728] Specific operation: The user sets the event date and details within the app and sends a request. The server uses a reservation system to secure the necessary resources and register the event details.

[1729] Step 11:

[1730] Based on NFT requests from users, the server generates virtual characters as digital assets and makes them tradable.

[1731] Input: NFT request data submitted by the user.

[1732] Output: The generated NFT and its listing information on the marketplace.

[1733] Specific operation: Generate NFTs using blockchain technology and register ownership information on the blockchain. Then, list the NFTs using a marketplace API and enable trading.

[1734] In this way, through a series of processing steps, users can generate virtual characters, experience emotion-based interactions, and engage in activities and transactions as digital assets in a virtual space.

[1735] (Application Example 2)

[1736] Next, we will explain application example 2. In the following explanation, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1737] Traditional virtual character systems were limited to simply generating characters and engaging in static interactions with users. They lacked the ability to respond to user emotions, dynamically evolve characters, or even trade them as digital assets. As a result, these systems had limitations in terms of improving user experience and commercial viability.

[1738] In Application Example 2, the specific processing performed by the specific processing unit 290 of the data processing device 12 is realized by the following means. In this invention, the server includes means for generating a virtual character based on parameters input by the user, means for the virtual character and the user to communicate bidirectionally, means for changing the characteristics of the virtual character based on the user's input in order to grow the virtual character, means for the virtual character to analyze the user's emotions using an emotion engine and generate a response from the virtual character, and means for controlling the growth of the virtual character based on the results of interaction with the virtual character. This enables dynamic growth of the virtual character and trading as a digital asset while providing interaction that responds to the user's emotions.

[1739] A "user" is an end-user who uses the system to generate virtual characters and interact with them.

[1740] "Parameters" are items used by users to specify the attributes and characteristics of a virtual character. Specifically, these include gender, age, hairstyle, voice tone, and so on.

[1741] A "virtual character" is a digital character generated using AI based on user input. This includes 3D models, voice data, and personality settings.

[1742] "Two-way communication" refers to a dialogue-based interaction where the user and the virtual character exchange information with each other. This can be done using text, audio, video, etc.

[1743] "Growth" refers to the process by which a virtual character evolves, changing its characteristics and personality based on user interactions and emotional data.

[1744] A "virtual space" is a simulated three-dimensional space generated through the internet or other digital networks. It is a place where users and virtual characters engage in activities and interactions.

[1745] An "emotion engine" is a software module that analyzes user input (text, voice, video, etc.) to recognize their emotional state.

[1746] "Digital assets" are digital objects that exist electronically, have an identifiable owner, and possess economic value. In particular, they refer to virtual characters.

[1747] "Transactions" refer to activities such as buying, selling, and exchanging virtual characters, which are generated as digital assets. These are primarily conducted using marketplaces and blockchain technology.

[1748] A "live event" is an event held in real time in a virtual space or other digital platform. It allows a large number of users to participate and interact simultaneously.

[1749] Blockchain is a system that uses distributed ledger technology to manage transaction information and ownership information of digital assets. It has the characteristic of preventing fraudulent tampering.

[1750] This invention relates to a system that generates a virtual character based on parameters entered by a user and enables two-way communication using an emotion engine. This system allows for the growth of the virtual character, interaction in a virtual space, and trading of digital assets.

[1751] System Configuration

[1752] This system consists of the following main elements.

[1753] 1. User terminal

[1754] 2. Server

[1755] 3. Emotional Engine

[1756] 4. Virtual Space Platform

[1757] 5. Blockchain Technology

[1758] Main Features

[1759] 1. Generating virtual characters

[1760] The user uses a device to input parameters such as gender, age, hairstyle, and voice tone. The device sends these parameters to a server, which then generates a virtual character using a generative AI model. This character includes a 3D model, voice data, and personality settings.

[1761] Specific example: If a user specifies "25-year-old male, short hair, deep voice," the server generates a virtual character that matches these criteria and sends that data to the user's terminal.

[1762] 2. Interaction using an emotion engine

[1763] The terminal sends text or voice input from the user to the server, which uses an emotion engine to analyze the user's emotional state in real time. The emotion engine recognizes the user's emotions, and a virtual character generates a response corresponding to those emotions.

[1764] Specific example: When a user types "I'm tired today," the emotion engine recognizes the user's fatigue (a negative emotion) from the text and responds with something like, "That must have been tough. You should take a break."

[1765] 3. Growth and changes in the characteristics of virtual characters

[1766] Based on user emotion data and interaction results, the server adaptively changes the characteristics and personality of the virtual character.

[1767] Specific example: If the user frequently makes sad inputs, the character will grow to use more comforting words.

[1768] 4. Interaction and live events in virtual space

[1769] Users can have their virtual characters interact with other users in the virtual space. When a user requests to host a live event, the server reserves and configures the necessary resources.

[1770] Specific example: If a user requests, "Please sing this song at next week's live event," the server records that information and reflects it in the live event schedule.

[1771] 5. Transactions as digital assets

[1772] To trade virtual characters as digital assets, users request the creation of NFTs (Non-Fiber Capture) versions of their characters from their devices. The server uses blockchain technology to generate the NFTs and records their ownership information.

[1773] Specific example: If a user wants to sell a virtual character they've created, the server registers the character as an NFT and lists it on the marketplace. When another user wishes to purchase it, ownership is transferred using blockchain technology.

[1774] Hardware and software to be used

[1775] Hardware:

[1776] User devices (smartphones, smart glasses, head-mounted displays)

[1777] server

[1778] software:

[1779] Generative AI models (such as OpenAI)

[1780] Emotion engine (TextBlob, etc.)

[1781] Virtual space platform

[1782] Blockchain technology

[1783] Example of a prompt

[1784] 1. "Create a 25-year-old male with short hair and a deep voice."

[1785] 2. “I am feeling a bit tired today.”

[1786] 3. "Today, let's have a fun conversation."

[1787] Based on the above, the present invention provides a virtual character system that enables interaction in accordance with the user's emotions and realizes the trading of commercially valuable digital assets.

[1788] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1789] Step 1:

[1790] The user requests the generation of a virtual character using their device. Specifically, they input parameters such as gender, age, hairstyle, and voice tone, and the device sends this data to the server. For example, input parameters might include "25-year-old male, short hair, deep voice." The server receives this input data and passes it to the generation AI model. The generation AI model generates a virtual character based on the specified parameters. As output, it generates character data including a 3D model, voice data, and personality settings, and sends this to the device.

[1791] Step 2:

[1792] The device receives input (text, voice) from the user. When the user enters text such as "I'm tired today," this input data is sent to the server. The server analyzes this text input using an emotion engine (such as TextBlob). The emotion engine recognizes the user's emotional state from the text and generates an analysis result such as "fatigue (negative emotion)." This analysis result is used in the next step.

[1793] Step 3:

[1794] The server generates a virtual character response based on the analysis results of the emotion engine. Taking the analysis result "fatigue (negative emotion)" as input, the server generates the prompt response "That must have been tough." This response is processed as voice data for the virtual character and sent to the terminal. The terminal plays this voice data and provides feedback to the user.

[1795] Step 4:

[1796] Based on the results of user interactions, the server controls the growth of the virtual character. For example, if the user frequently says "I'm tired," the server processes the data to help the character grow by using more comforting words. Specifically, the server updates the character's personality settings and generates new response patterns based on the user's emotional history. This changes the character's personality and response characteristics, causing the character to "grow."

[1797] Step 5:

[1798] Users can interact with other users in a virtual space through their terminals using their virtual characters. When a user requests a live event, the server reserves the necessary resources and sets up the event. Once the event starts, the server manages interactions in real time and facilitates communication between participants. The server takes a user request, such as "Sing this song at next week's live event," as input and generates event settings and real-time interaction management as output.

[1799] Step 6:

[1800] Users can trade virtual characters as digital assets. When a user requests to convert a character into an NFT from their device, the server generates the NFT using blockchain technology. Specifically, it encrypts the character's ownership information and records it on the blockchain. In this process, the server receives character data as input, generates an NFT as output, and lists it on the marketplace. When a user expresses interest in purchasing, the server transfers ownership using blockchain technology.

[1801] Through the above processing steps, a virtual character system capable of interacting with users in accordance with their emotions is realized.

[1802] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the controlled object 443 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1803] Data generation model 58 is a type of so-called generative AI (Artificial Intelligence). One example of data generation model 58 is ChatGPT (Internet search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search) <url: https: gemini.google.com ?hl="ja">Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1804] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the robot 414.

[1805] Furthermore, the emotion identification model 59, acting as an emotion engine, may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to a specific mapping, which is an emotion map (see Figure 9). Similarly, the emotion identification model 59 may also determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1806] Figure 9 shows an emotion map 400 in which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. The closer to the center of the concentric circles, the more primitive the emotions are located. Further out of the concentric circles, emotions representing states and actions arising from mental states are located. Emotion is a concept that includes feelings and mental states. On the left side of the concentric circles, emotions that are generally generated from reactions occurring in the brain are located. On the right side of the concentric circles, emotions that are generally induced by situational judgment are located. Above and below the concentric circles, emotions that are generally generated from reactions occurring in the brain and induced by situational judgment are located. In addition, the emotion of "pleasure" is located on the upper side of the concentric circles, and the emotion of "displeasure" is located on the lower side. Thus, in the emotion map 400, multiple emotions are mapped based on the structure in which emotions arise, and emotions that are likely to occur simultaneously are mapped close together.

[1807] These emotions are distributed at the 3 o'clock position on the Emotion Map 400, and usually fluctuate between feelings of security and anxiety. In the right half of the Emotion Map 400, situational awareness takes precedence over internal feelings, resulting in a calm impression.

[1808] The inside of the Emotion Map 400 represents inner thoughts, while the outside represents actions. Therefore, the further you go from the outside of the Emotion Map 400, the more visible (expressed in actions) your emotions become.

[1809] Here, human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. Similarly, in robots, cars, motorcycles, etc., emotions can be created based on various balances, such as posture and battery level. When these balances deviate from the ideal, it results in discomfort, and when they approach the ideal, it results in pleasure. The emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on a system for analyzing brain physiological signals of speech emotion recognition and emotion, Tokushima University, doctoral dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map contains emotions belonging to a region called "response," where sensation is dominant. The right half of the emotion map contains emotions belonging to a region called "situation," where situational awareness is dominant.

[1810] The emotion map defines two emotions that promote learning. One is the emotion around the middle of the negative "repentance" and "reflection" on the situation side. In other words, it is when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is the emotion around the positive "desire" on the reaction side. In other words, it is when the robot has positive feelings such as "I want more" or "I want to know more."

[1811] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​representing each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple training data sets, which are combinations of user input and emotion values ​​representing each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions located close together have similar values, as shown in the emotion map 900 in Figure 10. Figure 10 shows an example where multiple emotions such as "reassured," "calm," and "confident" have similar emotion values.

[1812] The above description primarily focuses on the functions of the data processing device 12 in relation to this disclosure. However, the system related to this disclosure is not necessarily implemented on a server. The system related to this disclosure may be implemented as a general information processing system. This disclosure may be implemented, for example, as a software program that runs on a personal computer or as an application that runs on a smartphone. The method related to this disclosure may be provided to users in SaaS (Software as a Service) format.

[1813] In the above embodiment, an example was given in which a specific process is performed by a single computer 22. However, the technology of this disclosure is not limited thereto, and a distributed processing of the specific process may be performed by multiple computers, including computer 22. For example, a data generation model 58 may be provided in an external device of the data processing device 12, and the external device may generate data according to the input data.

[1814] In the above embodiment, an example was given in which the specific processing program 56 is stored in the storage 32, but the technology of this disclosure is not limited thereto. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-temporary storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-temporary storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes specific processing according to the specific processing program 56.

[1815] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1816] Furthermore, it is not necessary to store the entirety of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store the entirety of the specific processing program 56 in the storage 32; it is acceptable to store only a portion of the specific processing program 56.

[1817] The following types of processors can be used as hardware resources to perform specific processing. Examples of processors include a CPU, a general-purpose processor that functions as a hardware resource to perform specific processing by executing software, i.e., a program. Other examples of processors include dedicated electrical circuits, such as FPGAs (Field-Programmable Gate Arrays), PLDs (Programmable Logic Devices), or ASICs (Application Specific Integrated Circuits), which have circuit configurations specifically designed to perform specific processing. All of these processors have built-in or connected memory, and all of them perform specific processing by using memory.

[1818] The hardware resource that performs a specific process may consist of one of these various processors, or it may consist of a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Alternatively, the hardware resource that performs a specific process may consist of a single processor.

[1819] Examples of configurations using a single processor include, firstly, a configuration in which one or more CPUs and software are combined to form a single processor, and this processor functions as a hardware resource that performs a specific process. Secondly, there is a configuration using a processor that realizes the functions of the entire system, including multiple hardware resources that perform a specific process, on a single IC chip, as exemplified by SoCs (System-on-a-chip). In this way, a specific process is realized using one or more of the above types of processors as hardware resources.

[1820] Furthermore, the hardware structure of these various processors can more specifically utilize electrical circuits that combine circuit elements such as semiconductor devices. Also, the specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps can be deleted, new steps added, or the processing order rearranged, as long as it does not deviate from the main purpose.

[1821] The descriptions and illustrations presented above are detailed explanations of the technical aspects of this disclosure and are merely examples of the technical aspects. For example, the above descriptions of the structure, function, operation, and effect are examples of the structure, function, operation, and effect of the technical aspects of this disclosure. Therefore, it goes without saying that you may delete unnecessary parts, add new elements, or replace elements in the descriptions and illustrations presented above, as long as you do not deviate from the essence of the technical aspects of this disclosure. Furthermore, in order to avoid confusion and facilitate understanding of the technical aspects of this disclosure, explanations of common technical knowledge and the like that do not require special explanation to enable the implementation of the technical aspects of this disclosure have been omitted from the descriptions and illustrations presented above.

[1822] All documents, patent applications, and technical standards described herein are incorporated by reference to the same extent as if each individual document, patent application, and technical standard were specifically and individually noted to be incorporated by reference.

[1823] The following is further disclosed regarding the embodiments described above.

[1824] (Claim 1)

[1825] A means for generating a virtual character based on parameters entered by the user,

[1826] A means for the virtual character and the user to communicate bidirectionally,

[1827] In order to grow the virtual character, means for changing the characteristics of the virtual character based on the user's input,

[1828] A means for allowing the aforementioned virtual character to interact with other users in a virtual space,

[1829] A means for generating the aforementioned virtual character as a digital asset and making it tradable,

[1830] A system that includes this.

[1831] (Claim 2)

[1832] The system according to claim 1, further comprising means for the virtual character to perform a live event and interact with the user and other users in real time.

[1833] (Claim 3)

[1834] The system according to claim 1, comprising means for converting the virtual character into a digital asset and managing its ownership on a blockchain.

[1835] "Example 1"

[1836] (Claim 1)

[1837] A means for generating a virtual character based on parameters entered by the user,

[1838] A means for the virtual character and the user to communicate bidirectionally,

[1839] In order to grow the virtual character, means for changing the characteristics of the virtual character based on the user's input,

[1840] A means for allowing the aforementioned virtual character to interact with other users in a virtual space,

[1841] A means for generating the aforementioned virtual character as a digital asset and making it tradable,

[1842] A means of using an AI model that generates the aforementioned virtual character as character data including a 3D model, voice data, and personality settings based on user-specified parameters,

[1843] A means for analyzing user messages using natural language processing technology and generating appropriate responses,

[1844] A means of registering the aforementioned virtual character as an NFT on the blockchain and managing its ownership,

[1845] A system that includes this.

[1846] (Claim 2)

[1847] The system according to claim 1, further comprising means for the virtual character to perform a live event and interact with the user and other users in real time.

[1848] (Claim 3)

[1849] The system according to claim 1, comprising means for converting the virtual character into a digital asset and managing its ownership on a blockchain.

[1850] "Application Example 1"

[1851] (Claim 1)

[1852] A means for generating a virtual character based on parameters entered by the user,

[1853] A means for the virtual character and the user to communicate bidirectionally,

[1854] In order to grow the virtual character, means for changing the characteristics of the virtual character based on the user's input,

[1855] A means for allowing the aforementioned virtual character to interact with other users in a virtual space,

[1856] A means for generating the aforementioned virtual character as a digital asset and making it tradable,

[1857] A means of making the virtual character function as a customer support agent using smart glasses,

[1858] The means by which the customer support agent uses a generative AI model to generate responses to user questions,

[1859] A system that includes this.

[1860] (Claim 2)

[1861] The system according to claim 1, further comprising means for the virtual character to perform a live event and interact with the user and other users in real time.

[1862] (Claim 3)

[1863] The system according to claim 1, comprising means for converting the virtual character into a digital asset and managing its ownership on a blockchain.

[1864] "Example 2 of combining an emotion engine"

[1865] (Claim 1)

[1866] A means for generating a virtual character based on parameters entered by the user,

[1867] A means for the virtual character and the user to communicate bidirectionally,

[1868] In order to develop the virtual character, means for changing the characteristics of the virtual character based on the user's emotional data,

[1869] A means for allowing the aforementioned virtual character to interact with other users in a virtual space,

[1870] A means for generating the aforementioned virtual character as a digital asset and making it tradable,

[1871] A means of using an emotion engine that analyzes the user's input data to recognize emotions,

[1872] Means for generating the virtual character using a generative AI model,

[1873] A system that includes this.

[1874] (Claim 2)

[1875] The system according to claim 1, further comprising means for the virtual character to perform a live event and interact with the user and other users in real time.

[1876] (Claim 3)

[1877] The system according to claim 1, comprising means for converting the virtual character into a digital asset and managing its ownership on a blockchain.

[1878] "Application example 2 when combining with an emotional engine"

[1879] (Claim 1)

[1880] A means for generating a virtual character based on parameters entered by the user,

[1881] A means for the virtual character and the user to communicate bidirectionally,

[1882] In order to grow the virtual character, means for changing the characteristics of the virtual character based on the user's input,

[1883] A means for allowing the aforementioned virtual character to interact with other users in a virtual space,

[1884] ...

Claims

1. A means for generating a virtual character based on parameters entered by the user, A means for the virtual character and the user to communicate bidirectionally, In order to grow the virtual character, means for changing the characteristics of the virtual character based on the user's input, A means for allowing the aforementioned virtual character to interact with other users in a virtual space, A means for generating the aforementioned virtual character as a digital asset and making it tradable, A system that includes this.

2. The system according to claim 1, further comprising means for the virtual character to perform a live event and interact with the user and other users in real time.

3. The system according to claim 1, comprising means for converting the virtual character into a digital asset and managing its ownership on a blockchain.

Images