System

Abstract

To provide a system.SOLUTION: A system includes: response means for allowing a character customized by a user to think and respond autonomously by using a history of previous conversations between a generation AI model and the user; growth means for growing the character by inputting a specific prompt sentence to the generation AI model and providing the character with a personality and a feature purchased by paying; means for allowing the character of a specific first user grown by the growth means and the character of a second user other than the specific first user grown by the growth means; and means for allowing the character of the first user and the character of the second user to have a conversation and introducing and selling a specific product.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot's character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Conventional AI and virtual characters are difficult to customize and individualize, and user interaction is limited. Furthermore, there is a demand for new forms of entertainment that utilize AI and virtual characters. [Means for solving the problem]

[0005] The system of the present disclosure includes a response means for making a character customized by a user think and respond autonomously by utilizing a generative AI model and the user's past conversation history; a development means for developing the character by inputting specific prompt sentences into the generative AI model to give the character personality and characteristics purchased by paying a fee; a means for causing the character of a specific first user developed by the development means to converse with the character of a second user other than the specific first user developed by the development means; and a means for live streaming in which the character of the first user and the character of the second user converse and introduce and sell a specific product. [Brief explanation of the drawings]

[0006] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11]FIG. 2 is a sequence diagram showing a flow of processing in the data processing system according to the first embodiment of the first form example. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Embodiment 1. [Figure 13] FIG. 10 is a sequence diagram showing a processing flow of a data processing system in a second embodiment of the second form example. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Embodiment Example 2. [Figure 15] FIG. 10 is a sequence diagram showing the flow of processing in a data processing system according to a third embodiment of the third embodiment. [Figure 16] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Embodiment 3. [Figure 17] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the first embodiment of the first form example when an emotion engine is combined. [Figure 18] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the second embodiment of the second form example when an emotion engine is combined. [Figure 20] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in the third embodiment of the third form example when an emotion engine is combined. [Figure 22] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0007] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0008] First, the terms used in the following description will be explained.

[0009] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, the processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)).

[0010] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0011] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0012] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0014] [First embodiment]

[0015] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0016] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0019] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0022] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0026] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0027] "Example 1"

[0028] One embodiment of the present invention provides a means for users to customize the appearance of their characters, allowing them to freely select their character's hair color, eye color, clothing, etc., to create their own original character.

[0029] "Example 2"

[0030] Furthermore, users can purchase character personalities and traits by paying a fee. For example, users can purchase and add traits such as a "gentle personality," a "lively personality," or a "knowledgeable personality" to their characters. This allows users to develop their own unique AI characters.

[0031] "Example 3"

[0032] The system of the present invention also records conversations between users and AI characters and stores them as big data, allowing the AI ​​characters to learn from past conversations and understand the user's preferences and tendencies.

[0033] "Example 4"

[0034] Furthermore, the system of the present invention provides an alarm function to the AI ​​character: the user can issue an instruction to the AI ​​character, such as "Wake me up at 7:00 tomorrow morning," and the AI ​​character will wake the user up at the specified time.

[0035] "Example 5"

[0036] The system of the present invention also provides the ability for AI characters to perform live streaming and live commerce. Users can watch their AI characters live stream and enjoy live commerce where AI characters introduce products. This provides a new form of entertainment.

[0037] The processing flow of each embodiment will be described below.

[0038] "Example 1"

[0039] Step 1: The user logs into the system.

[0040] Step 2: The user opens the character creation screen and customizes the character's appearance, including choosing hair color, eye color, clothing, etc.

[0041] Step 3: Save the character created by the user. This allows users to create their own original character.

[0042] "Example 2"

[0043] Step 1: The user logs in to the system and selects the character they created. Step 2: The user opens a screen where they can purchase the character's personality and characteristics.

[0044] Step 3: The user selects characteristics such as "gentle personality," "lively personality," or "knowledgeable" and makes a purchase.

[0045] Step 4: The purchased personality and characteristics are added to the character, allowing users to develop their own unique AI character.

[0046] "Example 3"

[0047] Step 1: The user logs into the system and selects the character they created. Step 2: The user starts a conversation with the character.

[0048] Step 3: The system records the conversation between the user and the character and stores it as big data.

[0049] Step 4: The AI ​​character learns from past conversations to understand the user's preferences and tendencies.

[0050] "Example 4"

[0051] Step 1: The user logs in to the system and selects the character they created. Step 2: The user gives the character instructions such as "Wake me up at 7am tomorrow morning."

[0052] Step 3: The system records the specified time and sets an alarm function for the AI ​​character.

[0053] Step 4: At the specified time, the AI ​​character wakes up the user.

[0054] "Example 5"

[0055] Step 1: The user logs in to the system and selects the character they created. Step 2: The user starts live streaming or live commerce with the character.

[0056] Step 3: Other users can watch the live stream and purchase products through live commerce, providing a new form of entertainment.

[0057] Example 1

[0058] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0059] Conventional character customization systems make it difficult for users to freely customize the appearance of their characters, and the appearance of the generated characters often does not meet the user's expectations. Furthermore, the process for generating a character's appearance is complicated, making it difficult for users to use. Furthermore, there are limitations in that the generated characters cannot be shared with other users or used for live streaming or live commerce.

[0060] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0061] In this invention, the server includes a means for allowing a user to customize the appearance of a character, a means for receiving user selection information and sending a prompt to a generation AI model to generate the character's appearance, and a means for displaying the generated character's appearance to the user. This allows users to easily create their own original characters, share them with other users, and use them for live streaming and live commerce.

[0062] A "user" is an individual or group that utilizes the system to customize the appearance of a character and to operate the generated character.

[0063] A "character" is a digital object such as a virtual person or animal that can be customized by a user.

[0064] "Appearance" refers to a character's visual characteristics such as hair color, eye color, clothing, etc.

[0065] "Customization" refers to the act of a user freely selecting and changing the appearance of a character.

[0066] A "server" is a computer system that receives user requests and performs the processing to generate the character's appearance.

[0067] A "generative AI model" is an artificial intelligence model that generates a character's appearance based on user selection information.

[0068] A "prompt" is an instruction sent to a generative AI model to generate the character's appearance.

[0069] "Selection information" refers to data such as hair color, eye color, clothing, etc. selected by the user when customizing the character's appearance.

[0070] "Display" refers to the act of visually presenting the appearance of the generated character on the user's terminal.

[0071] "Live distribution" refers to the act of distributing video and audio in real time using generated characters.

[0072] "Live commerce" is the act of selling products and services through live streaming.

[0073] The present invention is a system that allows a user to customize the appearance of a character and realize various functions using the created character. Specific embodiments of this system will be described below.

[0074] First, a user accesses the web application using a browser. This web application is built using React.js as the front end and Node.js as the back end. When a user accesses the web application, the server provides a character customization screen. This screen includes an interface for selecting hair color, eye color, clothing, etc.

[0075] The user can freely select the character's appearance using the provided interface. For example, the user can set the hair color to "blue," the eye color to "green," and the clothing to "casual." The user's selection information is sent from the device to the server in real time. The selection information is sent in JSON format.

[0076] The server generates a prompt based on the received selection information. For example, the prompt might say, "Generate a character with blue hair, green eyes, and casual clothing." This prompt is then sent to a generative AI model (e.g., DALL-E from OpenAI®).

[0077] The generative AI model generates the character's appearance based on the received prompt. The image data of the generated character is returned to the server. The server then sends the image data of the generated character to the user's device, allowing the user to check the appearance of the generated character on their browser.

[0078] For example, if the user selects "blue hair, green eyes, casual clothing," the following prompt is generated:

[0079] "Generate a character with blue hair, green eyes, and casual clothing."

[0080] This prompt is sent to the AI ​​model, which then generates the character's appearance based on the prompt. The generated character is then displayed on the user's screen via the server.

[0081] This system allows users to easily create their own original characters, share them with other users, and use them for live streaming and live commerce.

[0082] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0083] Step 1:

[0084] A user accesses a web application.

[0085] Input: A user accesses the URL of a web application using a browser.

[0086] Output: The web application home page is displayed in the user's browser.

[0087] Specific operation: When a user accesses "https: / / custom-character.com", the browser sends a request to the server. The server receives the request and sends the HTML, CSS, and JavaScript files for the homepage to the user's browser.

[0088] Step 2:

[0089] The server provides a character customization screen.

[0090] Input: Based on the user's request, the server prepares the data for the character customization screen.

[0091] Output: The character customization screen is displayed in the user's browser.

[0092] What it does: The server sends a character customization component built with React.js to the user's browser, providing an interface for the user to select hair color, eye color, clothing, etc.

[0093] Step 3:

[0094] The user selects the character's appearance.

[0095] Input: User selects hair color, eye color, clothing, etc. on the character customization screen.

[0096] Output: The selected information is saved on the user's device.

[0097] Specific operation: The user operates the interface to set the hair color to "blue," the eye color to "green," and the clothing to "casual." The selection information is temporarily saved on the user's device.

[0098] Step 4:

[0099] The terminal transmits the selection information to the server.

[0100] Input: Appearance information for the character selected by the user.

[0101] Output: The selection information is sent to the server.

[0102] Specific behavior: When the user clicks the "Save" button, the selection information is sent to the server in JSON format. For example, the following JSON data is sent:

[0103] json

[0104] {

[0105] "hairColor": "blue",

[0106] "eyeColor": "green",

[0107] "outfit": "casual"

[0108] }

[0109] Step 5:

[0110] The server generates a prompt and sends it to the AI ​​model.

[0111] Input: User selection information (JSON data).

[0112] Output: The generated prompt sentence is sent to the AI ​​model.

[0113] Specific operation: The server generates a prompt based on the received selection information. For example, a prompt such as "Please generate a character with blue hair, green eyes, and casual clothing" is generated. This prompt is then sent to the generative AI model.

[0114] Step 6:

[0115] The AI ​​model generates the character's appearance and returns it to the server.

[0116] Input: The generated prompt statement.

[0117] Output: Image data of the generated character.

[0118] Specific operation: The generative AI model generates the character's appearance based on the received prompt. The image data of the generated character is returned to the server.

[0119] Step 7:

[0120] The server displays the generated character to the user.

[0121] Input: Image data of the generated character.

[0122] Output: The image of the character is displayed in the user's browser.

[0123] Specific operation: The server sends image data of the generated character to the user's device. The user can check the appearance of the generated character on the browser.

[0124] (Application example 1)

[0125] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0126] Conventional character customization systems allow users to freely customize the appearance of their characters, but they have the problem of not being able to try on clothes in the virtual space or check them before purchasing. Also, since there was no try-on experience in a virtual store using the characters created by the users, it was difficult to stimulate users' desire to purchase.

[0127] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0128] In this invention, the server includes: means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; means for purchasing personality and characteristics for a fee and training an AI to converse using past conversations and big data; means for enjoying conversations with the AI ​​and conversations between AIs trained by other users; means for providing an alarm function; means for live streaming and live commerce; means for a user to customize the appearance of a character and try on clothes in a virtual space; and means for trying on clothes in a virtual store and checking them before purchasing. This allows a user to try on clothes in a virtual store using their customized character and check them before purchasing.

[0129] A "user-customized character" is an original character created by the user by freely selecting hair color, eye color, clothing, etc.

[0130] "AI for generating thoughts" is an artificial intelligence that thinks and makes decisions based on knowledge and information for characters customized by users.

[0131] A "system for generating voice" is a technology or device for generating voices uttered by characters.

[0132] "AI with form" is artificial intelligence that gives thoughts and voice to characters customized by users.

[0133] "Purchase personality and characteristics by paying" refers to a system in which a user can give a character new personality and characteristics by paying an additional fee.

[0134] "AI that converses using past conversations and big data" is artificial intelligence that can hold natural conversations based on past conversation history and large amounts of data.

[0135] "Means for developing AI" refers to methods by which users can develop the character's personality and characteristics, enabling them to have more advanced conversations and behave in more advanced ways.

[0136] "Means for enjoying conversations with AI or conversations between AIs trained by other users" refers to a method by which a user can have a conversation with their own character or enjoy conversations between characters trained by other users.

[0137] "Means for providing an alarm function" refers to a function in which a character issues an alarm or notification to the user.

[0138] "Means for live streaming and live commerce" refers to a method of using characters to stream and sell products in real time.

[0139] "Means for trying on clothes in a virtual space" refers to a method in which a user tries on clothes in a virtual space using a character customized by the user.

[0140] The "means of trying on clothes in a virtual store and checking before purchasing" is a method in which a user tries on clothes using a character in a virtual store and checks how they look before actually purchasing them.

[0141] The system for implementing this invention combines an AI for generating thoughts and a system for generating voices to create a physical AI for a character customized by the user. It also provides a means for purchasing personality and characteristics for a fee and cultivating a conversational AI by utilizing past conversations and big data. It also includes a means for enjoying conversations with the AI ​​and conversations between AIs cultivated by other users, a means for providing an alarm function, a means for live streaming and live commerce, a means for the user to customize the appearance of the character and try on clothes in a virtual space, and a means for the user to try on clothes in a virtual store and check them before purchasing.

[0142] System Program

[0143] The server receives information about the appearance of the character customized by the user and controls the character's movements using AI to generate thoughts and a system to generate voices. Specifically, it uses software such as Python, OpenCV, and PIL (Python Imaging Library) to generate images and voices for the character.

[0144] Processing Description

[0145] The server generates a character based on information entered by the user, such as hair color, eye color, and clothing. The generated character thinks and makes decisions based on knowledge and information using AI to generate thoughts, and then produces sounds using a voice generation system. The user can use a smartphone or head-mounted display to control the character in a virtual space and try on clothes.

[0146] Specific examples

[0147] Consider a scenario in which a user operates a virtual fitting room application using a smartphone. The user can customize the appearance of the character and try on clothes in the virtual store by entering the following prompt sentences:

[0148] Example prompt sentence:

[0149] Choose your hair color: Blonde

[0150] Choose your eye color: Blue

[0151] Choose your outfit: Casual

[0152] When this prompt is entered, the server generates a character with blonde hair, blue eyes, and casual clothing, and the user can use the character to try on the clothes in a virtual store and check them before purchasing.

[0153] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0154] Step 1:

[0155] A user launches the virtual fitting room application using a smartphone or head-mounted display. The user inputs customization information such as hair color, eye color, and clothing. The input information is then sent to the server.

[0156] Step 2:

[0157] The server generates the character's appearance based on the customization information received from the user. Specifically, it generates an image of the character using software such as Python, OpenCV, and PIL (Python Imaging Library). The input is the user's customization information, and the output is an image of the generated character.

[0158] Step 3:

[0159] The server applies AI to the generated character to generate thoughts. The AI ​​performs the character's thoughts and decisions based on the user's past conversation history and big data. The input is an image of the character and the user's past conversation data, and the output is a character with its own thoughts.

[0160] Step 4:

[0161] The server generates the voice of the character using a voice generation system, specifically using text-to-speech technology, where the input is the character's thoughts and the output is the generated voice.

[0162] Step 5:

[0163] The server sends the generated character and voice to the user's device. The user can then control the character in the virtual space and try on the clothes using a smartphone or head-mounted display. The input is the character and voice sent from the server, and the output is the virtual space displayed on the user's device.

[0164] Step 6:

[0165] The user tries on clothes using a character in a virtual store and checks them before purchasing. The user checks the appearance of the clothes they try on and makes a decision about purchasing. The input is the try-on information in the virtual space, and the output is the user's purchasing decision.

[0166] Step 7:

[0167] The server records the user's try-on information and purchasing decision, and uses it as a reference for future customization and purchasing behavior. The input is the user's try-on information and purchasing decision, and the output is the recorded data.

[0168] Example 2

[0169] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0170] In conventional AI character systems, it was difficult for users to freely customize the character's personality and characteristics, and adding new personalities and characteristics by paying was cumbersome. Furthermore, the generated character's personality and characteristics often did not meet the user's expectations, resulting in a poor user experience. Furthermore, because character updates and saving were not performed in real time, there was also the issue of users being unable to immediately see the changes.

[0171] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for a user to select a character's personality and characteristics using a terminal, a means for the server to check billing information and update the personality and characteristics, and a means for the server to send a prompt message to the generating AI model. This allows the user to easily customize the character's personality and characteristics, smoothly add new content by paying, and update the generated character's personality and characteristics in real time in a manner that meets the user's expectations.

[0172] A "user" is an individual or group that uses the system to customize the personality and characteristics of a character and pays a fee.

[0173] "Terminal" means a device used by a user to access the system and select a character's personality and characteristics, and includes a smartphone, PC, etc.

[0174] A "server" is a computer system that manages the overall processing of the system, accepts requests from users, checks billing information, and updates the personalities and characteristics of characters.

[0175] "Artificial intelligence" refers to technology that generates thoughts and voices for characters customized by users, and includes generative AI models.

[0176] A "generative AI model" is an artificial intelligence model that generates a character's personality and characteristics based on a prompt sentence, and includes, for example, GPT-4 (registered trademark).

[0177] A "prompt" is a text sentence that instructs the generative AI model about the character's personality and characteristics.

[0178] "Personality and characteristics" are personalities and traits that a user selects to add to a character, and include characteristics such as "easy-going personality" and "knowledgeable traits."

[0179] "Billing information" refers to payment information provided by a user when purchasing a personality or feature, and includes credit card information, electronic payment information, and the like.

[0180] A "database" is a data storage system in which the server stores information about the personalities and characteristics of characters.

[0181] "Live streaming" is a function that allows users to stream video and audio in real time.

[0182] "Live commerce" is a feature that introduces products during live broadcasts and allows viewers to purchase them on the spot.

[0183] This invention is a system that allows a user to add personality and characteristics to a customized character and generate the character's personality and characteristics using a generation AI model. Specific embodiments of this system are described below.

[0184] Hardware and software used

[0185] 1. Terminal

[0186] A device that allows a user to access a system. Examples include smartphones and PCs.

[0187] A screen for selecting the character's personality and characteristics is provided through an application or web browser running on the device.

[0188] 2. Server

[0189] It is a computer system that manages the processing of the entire system.

[0190] The server accepts requests from users, checks billing information, and updates the character's personality and characteristics.

[0191] The server sends a prompt to the generative AI model (e.g., GPT-4) and stores the generated character information in a database.

[0192] 3. Generative AI Models

[0193] It is an artificial intelligence model that generates a character's personality and characteristics based on a prompt sentence.

[0194] Specifically, large-scale language models such as GPT-4 are used.

[0195] Data processing and calculation

[0196] 1. The user selects the character's personality and characteristics

[0197] Users use the terminals to access applications and websites on the system.

[0198] On the character customization screen displayed on the terminal, the user selects the desired personality and characteristics from options such as "easygoing personality," "lively personality," and "knowledgeable characteristics."

[0199] 2. The user makes a payment

[0200] The user enters payment information on the terminal to be charged for the selected personality and characteristics.

[0201] The terminal transmits the entered payment information to the server.

[0202] 3. The server checks the billing information and updates the personality and characteristics.

[0203] The server sends the received payment information to a payment system (e.g., Stripe or PayPal) and processes the payment.

[0204] If the charge is successful, the server stores the user's selected characteristics and features in a database.

[0205] 4. The server sends a prompt to the generative AI model

[0206] The server generates prompts based on the user's selected personality and characteristics.

[0207] For example, if the user selects "easy-going personality," the prompt text will be "Please change your character's personality to 'easy-going personality'."

[0208] The server sends this prompt to the generative AI model.

[0209] 5. Generative AI models generate character personalities and traits

[0210] The generative AI model generates new personality traits and characteristics for the character based on the prompt text it receives.

[0211] The generated personality and characteristic information is returned to the server.

[0212] 6. The server saves the generated character information and sends it to the device.

[0213] The server stores the information about the character's personality and characteristics returned by the generated AI model in a database.

[0214] The stored information is sent to the terminal so that the user can view it.

[0215] Specific examples

[0216] For example, if a user wants to add a "knowledgeable trait" to a character, the following specific actions are taken:

[0217] 1. The user selects "knowledgeable features" on the device.

[0218] 2. The user enters billing information and completes the payment.

[0219] 3. The server verifies the charge through the payment system and updates the database if successful.

[0220] 4. The server sends a prompt to the generative AI model saying, "Please add 'knowledgeable traits' to the character."

[0221] 5. The generative AI model generates new features for the character and returns them to the server.

[0222] 6. The server stores the generated information in a database and sends it to the terminal.

[0223] 7. The user sees the updated character on the device and enjoys knowledgeable dialogue and actions.

[0224] Example prompt sentence:

[0225] Change your character's personality to "gentle personality."

[0226] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0227] Step 1:

[0228] The user selects the character's personality and characteristics.

[0229] Input: A user uses a device to access a system application or website and selects a personality or traits on a character customization screen.

[0230] Data processing: The terminal collects the user's selected information and converts it into a data format for transmission to the server.

[0231] Output: The user's selection information is sent from the terminal to the server.

[0232] Specific operation: The user selects "gentle personality" and clicks the Select button.

[0233] Step 2:

[0234] The user pays the fee.

[0235] Input: The user enters payment information on the terminal.

[0236] Data processing: The terminal encrypts the entered payment information and sends it to the server.

[0237] Output: The encrypted payment information is sent from the terminal to the server.

[0238] Specific operation: The user enters credit card information and clicks the payment button.

[0239] Step 3:

[0240] The server checks the billing information and updates the personality and characteristics.

[0241] Input: Encrypted payment information received by the server from the device.

[0242] Data processing: The server sends the payment information to the payment system (e.g., Stripe or PayPal) and processes the payment. If successful, the user's selected personality and characteristics are saved in the database.

[0243] Output: The result of the billing process and updated character information are saved in the database.

[0244] Specific operation: The server sends the billing information to the payment system, and if the billing is successful, it saves the "gentle personality" in the database.

[0245] Step 4:

[0246] The server sends a prompt to the generative AI model.

[0247] Input: The server stores the user's selection information in a database.

[0248] Data processing: The server generates a prompt based on the user's selection. For example, it generates a prompt such as "Please change the character's personality to 'easy-going'."

[0249] Output: The generated prompt sentence is sent to the generative AI model.

[0250] Specific operation: The server generates a prompt sentence saying, "Please change the character's personality to 'gentle'" and sends it to the generative AI model.

[0251] Step 5:

[0252] A generative AI model generates the character's personality and characteristics.

[0253] Input: The prompt sentence received by the generative AI model from the server.

[0254] Data processing: The generative AI model generates new personality and traits for the character based on the prompt text.

[0255] Output: The generated personality and trait information is returned to the server.

[0256] Specific operation: The generative AI model generates information about a character with a "gentle personality" and returns it to the server.

[0257] Step 6:

[0258] The server saves the generated character information and transmits it to the terminal.

[0259] Input: Information about the character's personality and characteristics received by the server from the generated AI model.

[0260] Data processing: The server saves the generated character information in a database and converts it into a data format for sending to the terminal.

[0261] Output: The generated character information is stored in a database and sent to the terminal.

[0262] Specific operation: The server stores information about characters with a "gentle personality" in a database and sends it to the terminal.

[0263] Step 7:

[0264] The user confirms the updated character.

[0265] Input: The user receives updated character information using the terminal.

[0266] Data processing: The terminal converts the received character information into a suitable format for display.

[0267] Output: Updated character information is displayed on the terminal.

[0268] Specific operation: The user checks out a character with a "gentle personality" on the device and enjoys the dialogue and actions.

[0269] (Application example 2)

[0270] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0271] Conventional virtual shopping experiences have been limited to one-way information provision for users, making it difficult to customize to meet individual needs and preferences. Furthermore, there has been a lack of ways for users to develop their own personalized assistants and enrich their shopping experiences.

[0272] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; means for purchasing personality and characteristics for a fee and training an AI that can converse using past conversations and big data; means for enjoying conversations with the AI ​​and conversations between AIs trained by other users; means for providing an alarm function; means for performing live streaming and live commerce; means for providing a customizable AI assistant to support shopping in a virtual store; and means for the AI ​​assistant to respond to user questions through an application installed on a smartphone or head-mounted display. This allows users to train their own virtual shopping assistant and enjoy a shopping experience tailored to their individual needs and preferences.

[0273] A "user-customized character" is a character such as a virtual person or animal that is individually customized by the user by setting the personality and characteristics according to the user's preferences.

[0274] "AI for generating thoughts" is artificial intelligence that generates natural conversations and responses based on user input and past data.

[0275] A "system for generating voice" is a system that converts text data into voice data and provides information to a user by voice.

[0276] "AI with form" is artificial intelligence that has a visually displayed character and can interact with the user.

[0277] "Purchasing a character's personality or characteristics by paying an additional fee" refers to the user acquiring a new character's personality or characteristics by paying an additional fee.

[0278] "AI that uses past conversations and big data to converse" is artificial intelligence that generates more natural and appropriate responses based on past interaction history with users and large amounts of data.

[0279] "Means for enjoying conversations with AI and conversations between AIs trained by other users" refers to a function that allows users to converse with their own characters and observe conversations between characters trained by other users.

[0280] The "means for providing an alarm function" is a function for notifying the user of a specific time or event.

[0281] "Means for live streaming and live commerce" refers to a function for streaming video and audio in real time and selling products and services.

[0282] "Customizable AI assistant to support shopping in virtual stores" is a function that provides support to users when they shop in virtual stores with an individually customized artificial intelligence assistant.

[0283] "Applications installed on smartphones or head-mounted displays" are software that users can use through their smartphones or head-mounted displays.

[0284] "Means for responding to user questions" refers to a function that provides appropriate information and answers to questions and requests from users.

[0285] A system for implementing this invention includes a means for creating a tangible AI by combining a user-customized character with an AI for generating thoughts and a system for generating voices. Users can purchase personalities and characteristics for a fee and develop conversational AIs using past conversations and big data. The system also includes a means for enjoying conversations with the AI ​​and conversations between AIs developed by other users, a means for providing an alarm function, and a means for live streaming and live commerce.

[0286] Additionally, it includes a means to provide a customizable AI assistant to support shopping in the virtual store, allowing users to have the AI ​​assistant respond to their questions through an application installed on their smartphone or head-mounted display.

[0287] Program processing explanation

[0288] The server stores the personalities and characteristics of the characters customized by users and integrates AI to generate thoughts and a system to generate voices, allowing users to develop their own characters and enrich their shopping experience in virtual stores.

[0289] Specifically, the server uses the following hardware and software:

[0290] Hardware: Smartphone, head-mounted display

[0291] Software: Python, OpenAI API

[0292] Data processing and calculations are performed as follows:

[0293] 1. The user sets the character's personality and characteristics, and then purchases additional personality and characteristics by paying a fee.

[0294] 2. The server saves this information in JSON format and generates a prompt based on the user's input.

[0295] 3. Use OpenAI's generative AI model to generate a response based on the prompt.

[0296] 4. A speech generation system converts the generated text response into speech and provides it to the user.

[0297] Specific examples

[0298] For example, if a user sets an assistant to be "gentle and knowledgeable" and asks a question about a product, the assistant will provide product information in a polite and calm tone.

[0299] Example prompt sentence:

[0300] You're a friendly and knowledgeable virtual shopping assistant who answers users' questions. Question: Tell me about this product.

[0301] In this way, users can develop their own virtual shopping assistant and enjoy a shopping experience tailored to their individual needs and preferences.

[0302] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0303] Step 1:

[0304] The user accesses the application using a smartphone or head-mounted display. The user sets the character's personality and characteristics, and purchases additional personalities and characteristics as needed. The input is the user's setting information and billing information, and the output is that this information is sent to the server.

[0305] Step 2:

[0306] The server saves the received user configuration information and billing information in JSON format. The input is the configuration information and billing information sent by the user, and the output is the saved JSON data. Specifically, the server stores the information in a database.

[0307] Step 3:

[0308] The user inputs a question through the application. The input is the user's question, and the output is the question data sent to the server. In concrete terms, the terminal receives the user's input and sends it to the server.

[0309] Step 4:

[0310] The server reads the stored character's personality and characteristics information and generates a prompt sentence based on the user's question. The input is the user's question and the stored character information, and the output is the generated prompt sentence. Specifically, the server retrieves information from the database and constructs the prompt sentence.

[0311] Step 5:

[0312] The server uses OpenAI's generative AI model to generate a response based on the generated prompt. The input is the prompt, and the output is the generated response text. Specifically, the server calls the OpenAI API to obtain the response.

[0313] Step 6:

[0314] The server sends the generated response text to the speech generation system to generate speech data. The input is the response text, and the output is the generated speech data. Specifically, the server calls an API that converts text to speech.

[0315] Step 7:

[0316] The server transmits the generated voice data to the user's terminal. The input is the generated voice data, and the output is the voice data transmitted to the user's terminal. In concrete terms, the server transmits the voice data to the terminal via a network.

[0317] Step 8:

[0318] The user's terminal plays the received voice data and provides a response to the user. The input is the received voice data and the output is the played voice. Specifically, the terminal decodes the voice data and plays it through the speaker.

[0319] Example 3

[0320] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0321] Conventional AI systems have limited user interaction and customization, and have not been able to fully realize flexible behavior based on user instructions or evolution through self-learning. It has also been difficult to provide multifunctional services such as alarm functions, live streaming, and live commerce in a single system. This has limited the user experience and reduced the system's value.

[0322] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0323] In this invention, the server includes a means for converting user instructions into text data using voice recognition software, a means for analyzing the text data and extracting a specified time, and a means for storing the extracted time in a database. This allows for flexible operation based on user instructions. Furthermore, by including a means for sending a signal to trigger an alarm at a specified time and a means for starting live streaming using a streaming server, it becomes possible to provide multifunctional services in a single system.

[0324] "User" refers to any individual or entity that uses the System.

[0325] "Custom" refers to settings and changes that the user makes to suit their own preferences.

[0326] "Character" refers to a virtual being customized by a user.

[0327] "Artificial intelligence for generating thoughts" refers to algorithms and programs that generate appropriate responses and actions based on user interactions and instructions.

[0328] A "system for generating speech" refers to software or hardware for converting text data into speech data.

[0329] "Artificial intelligence with form" refers to artificial intelligence that has a character that is displayed visually.

[0330] "Charge" refers to the fee paid by a user to use a particular function or service.

[0331] "Personality and characteristics" refers to the settings and attributes that influence a character's actions and responses.

[0332] "Past conversations" refer to previous interactions between a user and an artificial intelligence.

[0333] "Large-scale data" refers to a data set that contains a large amount of information.

[0334] "Development" refers to actions taken by a user to improve the capabilities and characteristics of an artificial intelligence.

[0335] The "alarm function" refers to a function that notifies the user at a specified time by notification or voice.

[0336] "Live streaming" refers to the distribution of video and audio in real time over the Internet.

[0337] "Live commerce" refers to a form of commercial transaction in which products are introduced during live broadcasts and viewers can purchase them on the spot.

[0338] "Speech recognition software" refers to a program for converting voice data into text data.

[0339] "Text data" refers to data expressed as character information.

[0340] "Analysis" refers to the act of analyzing data and extracting meaning and information.

[0341] A "database" refers to a system for efficiently storing, managing, and retrieving data.

[0342] A "streaming server" refers to a server for distributing data in real time.

[0343] MODE FOR CARRYING OUT THE INVENTION

[0344] This invention is a system that creates tangible AI by combining an AI for generating thoughts and a system for generating voices for characters customized by the user. Furthermore, users can purchase personality and characteristics for a fee and develop AI that can converse using past conversations and large-scale data. Users can also enjoy conversations with AIs and conversations between AIs developed by other users.

[0345] This system is realized using the following hardware and software.

[0346] Hardware and software used

[0347] Devices: Smartphones, tablets, PCs, etc.

[0348] Server: Cloud server (e.g., AWS (registered trademark), Google (registered trademark) Cloud)

[0349] Database: MySQL (registered trademark), PostgreSQL, etc.

[0350] Speech recognition software: Google Speech-to-Text

[0351] Natural language processing software: spaCy

[0352] Streaming server: AWS MediaLive, YouTube(R) Live, etc.

[0353] Specific operation of the system

[0354] 1. The user issues commands to the AI ​​character, such as "Wake me up at 7:00 tomorrow morning."

[0355] 2. The device converts the user's voice into text data using speech recognition software (e.g., Google Speech-to-Text).

[0356] 3. The device sends the converted text data to the server.

[0357] 4. The server analyzes the text data and extracts the specified time. The analysis is performed using natural language processing software (e.g., spaCy).

[0358] 5. The server stores the extracted time in a database (e.g. MySQL).

[0359] 6. When the specified time approaches, the server sends a signal to the device to trigger the alarm.

[0360] 7. The device sounds an alarm and wakes the user up.

[0361] It also offers live streaming and live commerce functions.

[0362] 1. The user commands the AI ​​character to start live streaming. For example, the user can say, "Start live streaming."

[0363] 2. The device converts the user's voice into text data using speech recognition software (e.g., Google Speech-to-Text).

[0364] 3. The device sends the converted text data to the server.

[0365] 4. The server analyzes the text data and prepares for live streaming.

[0366] 5. The server starts streaming using a streaming server (e.g. AWS MediaLive).

[0367] 6. The user watches the live broadcast of the AI ​​character through their device.

[0368] 7. When users enjoy live commerce, AI characters will introduce products and users will be able to purchase them.

[0369] Specific examples

[0370] The user says to the AI ​​character, "Wake me up at 7am tomorrow morning."

[0371] The device converts the speech into text and sends it to the server.

[0372] The server extracts the time information "7:00 a.m. tomorrow" and stores it in the database.

[0373] At 7:00 the next morning, the server sends an alarm signal to the device, which then sounds the alarm.

[0374] The user speaks to the AI ​​character, saying, "Start live streaming."

[0375] The device converts the speech into text and sends it to the server.

[0376] The server confirms the live streaming instructions and starts streaming using AWS MediaLive.

[0377] Users can watch the live broadcast through their devices and purchase products introduced by the AI ​​characters.

[0378] Prompt Sentence Examples

[0379] "Tell the AI ​​character to wake you up at 7am tomorrow morning"

[0380] "Instruct the AI ​​character to start live streaming"

[0381] In this way, the user can utilize a multi-functional artificial intelligence system. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0382] Alarm function processing steps

[0383] Step 1:

[0384] The user instructs the AI ​​character to "wake me up at 7am tomorrow morning."

[0385] Input: User's voice command

[0386] Output: Audio data

[0387] Specific action: The user gives a command by voice.

[0388] Step 2:

[0389] The device converts the user's voice into text data using speech recognition software (e.g., Google Speech-to-Text).

[0390] Input: Audio data

[0391] Output: Text data

[0392] Specific operation: The device converts the voice data into text data.

[0393] Step 3:

[0394] The terminal transmits the converted text data to the server.

[0395] Input: Text data

[0396] Output: HTTP request to the server

[0397] Specific operation: The device sends text data to the server via an HTTP request.

[0398] Step 4:

[0399] The server analyzes the text data and extracts the specified time.

[0400] Input: Text data

[0401] Output: Extracted time information

[0402] What happens: The server uses natural language processing software (e.g., spaCy) to analyze the text data and extract time information.

[0403] Step 5:

[0404] The server stores the extracted time in a database (e.g. MySQL).

[0405] Input: Extracted time information

[0406] Output: Save to database

[0407] Specific operation: The server saves the time information in the database using an INSERT query.

[0408] Step 6:

[0409] When the specified time approaches, the server sends a signal to the terminal to trigger an alarm.

[0410] Input: Time information stored in the database

[0411] Output: HTTP request to the device

[0412] Specific operation: The server sends an alarm signal to the terminal via an HTTP request at the specified time.

[0413] Step 7:

[0414] The device will sound an alarm and wake the user up.

[0415] Input: Alarm signal from the server

[0416] Output: Alarm sound

[0417] Specific behavior: The device plays an alarm sound.

[0418] Live streaming function processing steps

[0419] Step 1:

[0420] The user instructs the AI ​​character to start live streaming.

[0421] Input: User's voice command

[0422] Output: Audio data

[0423] Specific action: The user gives a command by voice.

[0424] Step 2:

[0425] The device converts the user's voice into text data using speech recognition software (e.g., Google Speech-to-Text).

[0426] Input: Audio data

[0427] Output: Text data

[0428] Specific operation: The device converts the voice data into text data.

[0429] Step 3:

[0430] The terminal transmits the converted text data to the server.

[0431] Input: Text data

[0432] Output: HTTP request to the server

[0433] Specific operation: The device sends text data to the server via an HTTP request.

[0434] Step 4:

[0435] The server analyzes the text data and prepares for live streaming.

[0436] Input: Text data

[0437] Output: Notification that the live stream is ready

[0438] What happens: The server uses natural language processing software (e.g., spaCy) to analyze the text data and determine live streaming instructions.

[0439] Step 5:

[0440] The server starts streaming using a streaming server (e.g. AWS MediaLive).

[0441] Input: Notification that live streaming is ready

[0442] Output: Start live streaming

[0443] Specific operation: The server calls the AWS MediaLive API to start live streaming.

[0444] Step 6:

[0445] The user watches the live broadcast of the AI ​​character through the device.

[0446] Input: Live Stream URL

[0447] Output: Live video and audio

[0448] Specific operation: The user watches the live broadcast through the application on their device.

[0449] Step 7:

[0450] When users enjoy live commerce, AI characters introduce products and users can purchase them.

[0451] Input: Product introduction during live streaming

[0452] Output: Product purchase completion notification

[0453] What happens: A user clicks on a link displayed during a live stream to purchase a product.

[0454] (Application example 3)

[0455] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0456] Conventional AI character systems have had difficulty fully understanding users' preferences and tendencies and providing personalized services. Furthermore, when AI characters trained by users engage in live streaming or live commerce, they lacked the functionality to recommend products based on the user's past conversation data or alarms to notify users of sales start times. This limited the user experience, reducing entertainment value and convenience.

[0457] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[0458] In this invention, the server includes: a means for creating a tangible AI by combining a user-customized character with an AI for generating thoughts and a system for generating voices; a means for purchasing personality and characteristics for a fee and cultivating an AI that can converse using past conversations and big data; a means for enjoying conversations with the AI ​​and conversations between AIs developed by other users; a means for providing an alarm function; a means for conducting live streaming and live commerce; a means for recommending products based on the user's past conversation data; and a means for providing an alarm function that notifies the user of the start time of a sale. This makes it possible to understand the user's preferences and tendencies and provide personalized services. Furthermore, it is possible to improve the entertainment value and convenience of the AI ​​character developed by the user when engaging in live streaming and live commerce.

[0459] A "user-customized character" is an artificial intelligence character whose appearance and personality are set by the user based on their own preferences and requests.

[0460] "Artificial intelligence for generating thoughts" refers to artificial intelligence that has algorithms and programs for generating appropriate responses and actions based on conversations and instructions with the user.

[0461] A "system for generating voice" is a technology or device that converts text data into voice data and responds to the user by voice.

[0462] "Purchasing personality and characteristics by paying" is a function that allows the user to customize the personality and characteristics of an AI character by paying an additional fee.

[0463] "Artificial intelligence that converses using past conversations and big data" is artificial intelligence that analyzes past conversation data with the user and large amounts of data, understands the user's preferences and tendencies, and then converses with them.

[0464] "Enjoying conversations with artificial intelligence or conversations between artificial intelligences developed by other users" means that a user enjoys interacting with their own artificial intelligence character or observing conversations between artificial intelligence characters developed by other users.

[0465] "Providing an alarm function" means a function that sounds an alarm by notification or voice at a time specified by the user.

[0466] "Live streaming and live commerce" refers to a function that allows artificial intelligence characters to stream videos in real time and introduce and sell products.

[0467] "Recommending products based on the user's past conversation data" is a function that analyzes the content of past conversations with the user and suggests appropriate products based on the user's interests and concerns.

[0468] "Providing an alarm function that notifies the user of the start time of a sale" refers to an alarm function that notifies the user of the start time of a specific sale or event.

[0469] A system for implementing this invention includes means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices, means for purchasing personality and characteristics for a fee and developing an AI that can converse using past conversations and big data, means for enjoying conversations with the AI ​​or conversations between AIs developed by other users, means for providing an alarm function, means for performing live streaming and live commerce, means for recommending products based on the user's past conversation data, and means for providing an alarm function that notifies the user of the start time of a sale.

[0470] System Program

[0471] The system is implemented using Python and includes functions to record user conversations and save them as JSON files, recommend products based on past conversation data, and provide alarms.

[0472] Hardware and Software

[0473] Hardware: Smartphones, smart glasses, head-mounted displays

[0474] Software: Python, JSON file (for data storage)

[0475] Data processing and calculation

[0476] Record user conversations: Record what the user says with a timestamp and save it in a JSON file.

[0477] Product recommendation: Analyzes past conversation data and recommends appropriate products based on the user's interests.

[0478] Alarm function: The alarm will sound with notification or sound at the time specified by the user.

[0479] Specific examples

[0480] If a user says, "I want a new smartphone," the AI ​​will recommend "Product A," "Product B," or "Product C" based on past conversation data. If the user says, "Wake me up at 7 a.m. tomorrow," an alarm will be set.

[0481] Prompt Sentence Examples

[0482] "When a user says, 'I want a new smartphone,' create a Python program that recommends products based on past conversation data. Also, add a function to set an alarm when the user says, 'Wake me up at 7am tomorrow morning.'"

[0483] In this way, it becomes possible to understand the preferences and tendencies of users and provide personalized services. It also makes it possible to improve the entertainment value and convenience of live streaming and live commerce using AI characters that users have developed.

[0484] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0485] Step 1:

[0486] Record user conversations

[0487] The server receives what the user says and records it with a timestamp. The input is what the user said, and the output is the conversation data with a timestamp. This data is saved in a JSON file. Specifically, if a user says, "I want a new smartphone," the server records that statement and the current date and time.

[0488] Step 2:

[0489] Save conversation data

[0490] The server saves the recorded conversation data in a JSON file. The input is the time-stamped conversation data generated in step 1, and the output is an updated JSON file. Specifically, it appends new conversation data to the existing JSON file.

[0491] Step 3:

[0492] Loading past conversation data

[0493] The server reads past conversation data from a saved JSON file. The input is a JSON file, and the output is a list of past conversation data. Specifically, it opens the JSON file and reads all conversation data into memory.

[0494] Step 4:

[0495] Recommend a product

[0496] The server analyzes past conversation data and recommends appropriate products based on the user's interests. The input is past conversation data, and the output is a list of recommended products. Specifically, if a user says, "I want a new smartphone," a list of related smartphone products is generated.

[0497] Step 5:

[0498] Set an alarm

[0499] The server sets up a notification or audio alarm at a time specified by the user. The input is the alarm time specified by the user, and the output is the configured alarm information. Specifically, if the user says, "Wake me up at 7am tomorrow morning," the alarm is set for that time.

[0500] Step 6:

[0501] Live streaming and live commerce

[0502] The server provides functions that allow an AI character to broadcast video in real time and introduce and sell products. The input is a command to start live streaming and product information, and the output is the live streaming video and sales information. Specifically, when the user says "start live streaming," the AI ​​character starts live streaming and introduces products.

[0503] Step 7:

[0504] Notify when the sale starts

[0505] The server provides an alarm function to notify users of the start time of a specific sale or event. The input is the start time of the sale or event, and the output is the notification information. Specifically, it sends a notification to the user when the start time of the sale approaches.

[0506] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0507] "Example 1"

[0508] One embodiment of the present invention is a system that combines an emotion engine that recognizes the user's emotions. In this system, the emotion engine recognizes the emotions expressed by the user during conversation with an AI character and adjusts the AI ​​character's response accordingly. For example, if the user expresses joy, the AI ​​character will also respond with joy. Conversely, if the user expresses sadness, the AI ​​character will respond with comfort.

[0509] "Example 2"

[0510] The emotion engine can also learn the user's emotions and evolve the AI ​​character's response to the user's emotions. Specifically, it records the AI ​​character's reaction when the user expresses a specific emotion and optimizes the AI ​​character's response based on that data. For example, if there is data showing that when a user expresses anger, the AI ​​character responds by apologizing, and the user's anger subsides, the AI ​​character will respond by apologizing in a similar situation.

[0511] "Example 3"

[0512] Furthermore, the emotion engine can predict changes in the user's emotions. This is done by predicting changes in the user's emotions based on past conversation data and the user's behavior patterns, and adjusting the AI ​​character's response based on that prediction. For example, if the AI ​​character predicts that the user is feeling stressed, it will respond in an encouraging way.

[0513] The processing flow of each embodiment will be described below.

[0514] "Example 1"

[0515] Step 1: The user initiates a conversation with an AI character.

[0516] Step 2: The user expresses an emotion, such as joy or sadness.

[0517] Step 3: The emotion engine recognizes the user's emotion.

[0518] Step 4: The AI ​​character adjusts its response based on the information from the emotion engine and responds appropriately to the user.

[0519] "Example 2"

[0520] Step 1: The user initiates a conversation with an AI character.

[0521] Step 2: The user expresses an emotion, such as anger or joy.

[0522] Step 3: The emotion engine recognizes the user's emotion and records the AI ​​character's response to that emotion.

[0523] Step 4: Optimize the AI ​​character's reactions based on the data recorded by the emotion engine.

[0524] "Example 3"

[0525] Step 1: The user initiates a conversation with an AI character.

[0526] Step 2: The emotion engine predicts changes in the user's emotions based on past conversation data and the user's behavioral patterns.

[0527] Step 3: The AI ​​character adjusts its response based on the prediction information from the emotion engine and responds appropriately to the user.

[0528] Example 1

[0529] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0530] Conventional AI systems make it difficult for users to freely customize the appearance of their characters, and lack the ability to recognize the user's emotions in real time and adjust their responses. This limits the user experience and makes it difficult to achieve more natural and personalized interactions. Furthermore, the AI's responses are fixed, and flexible responses based on the user's emotions are required.

[0531] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0532] In this invention, the server includes means for providing an interface for users to customize the appearance of a character, means for recognizing a user's emotions and adjusting the AI's response in accordance with those emotions, means for creating a tangible AI by combining an AI for generating thoughts with a system for generating voices, means for purchasing personalities and characteristics for a fee and developing an AI that can converse by utilizing past conversations and large-scale data, means for enjoying conversations with the AI ​​and conversations between AIs developed by other users, means for providing an alarm function, and means for enabling live streaming and live commerce. This allows users to freely customize the appearance of their characters, and by recognizing emotions and adjusting responses in real time, more natural and personalized interactions are possible.

[0533] "User" means an individual or group that utilizes the system to customize characters and interact with artificial intelligence.

[0534] A "character" is a virtual being with a user-customizable appearance, whose thoughts and voices are generated by artificial intelligence.

[0535] "Artificial intelligence" is a program or system that generates thoughts through conversation and interaction with users and evolves through self-learning.

[0536] "Interface" refers to the screens and controls that users use to customize their character's appearance.

[0537] "Emotion recognition" is a technology that analyzes a user's voice and facial expressions to identify their emotions.

[0538] "Adjusting responses" refers to the AI ​​taking appropriate responses or actions toward the user based on the results of emotion recognition.

[0539] "Charges" refers to fees paid by a user to purchase additional personalities or features.

[0540] "Big data" refers to large datasets containing past conversations and other information used to train artificial intelligence and generate responses.

[0541] The "alarm function" is a function for notifying the user of a specific time or event.

[0542] "Live streaming" is a function that distributes video and audio in real time over the Internet.

[0543] "Live commerce" is a method of selling products and services through live streaming.

[0544] The present invention relates to a system that allows users to customize the appearance of their characters and interact with artificial intelligence through emotion recognition. This system operates in cooperation with a server, a terminal, and a user.

[0545] Character appearance customization

[0546] The server provides an interface that allows users to customize their character's appearance. This interface is accessible through a web browser or a mobile application. Specifically, the server uses the following hardware and software:

[0547] Database: MySQL

[0548] Frontend: React.js

[0549] Backend: Node.js

[0550] Users can create their own original character by selecting options such as hair color, eye color, clothing, etc. For example, if a user sets the hair color to red, the eye color to blue, and the clothing to casual, the server will generate and save the character's appearance data based on this information.

[0551] Example prompt sentence:

[0552] "Set your character's hair color to red, eyes to blue, and clothing to casual."

[0553] Emotion recognition function using emotion engine

[0554] The device is equipped with an emotion engine that recognizes the user's emotions. This emotion engine recognizes the emotions expressed by the user during conversation with the AI ​​character in real time and adjusts the AI ​​character's response accordingly. Specifically, the device uses the following hardware and software:

[0555] Microphone and camera: to capture the user's voice and facial expressions

[0556] Emotion Recognition Software: Microsoft® Azure® Cognitive Services

[0557] When a user expresses joy, the emotion engine recognizes the emotion and sends it to the server as "joy." The server then configures the AI ​​character to respond with a smile, saying, "Seeing you happy makes me happy too."

[0558] Example prompt sentence:

[0559] "When the user expresses joy, the AI ​​character should respond with a smile, saying, 'Seeing you happy makes me happy too.'"

[0560] Other Features

[0561] The system also provides the following additional features:

[0562] Billing features: A way for users to purchase additional personalities or features

[0563] Alarm function: A means of notifying the user of a specific time or event.

[0564] Live streaming and live commerce functions: A means of selling products and services by streaming video and audio in real time.

[0565] This allows users to freely customize the appearance of their characters, and by recognizing emotions and adjusting responses in real time, it enables more natural and personalized interactions. It also allows for payment and live streaming functions to further enrich the user experience.

[0566] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0567] Step 1:

[0568] A user accesses the character customization screen through a web browser or mobile application.

[0569] Input: User's access request

[0570] Output: Character customization screen display

[0571] Specific operation: The user launches the application and enters a URL to access the character customization screen.

[0572] Step 2:

[0573] The server retrieves the character's part information from the database.

[0574] Input: Database query

[0575] Output: Character part information (hair color, eye color, clothing, etc.)

[0576] Specific operation: The server sends a query to the MySQL database to obtain character part information.

[0577] Step 3:

[0578] Based on the information obtained by the server, customization options are displayed on the device.

[0579] Input: Character part information

[0580] Output: Show customization options

[0581] Specific operation: The server uses React.js to generate customization options based on the acquired part information and send them to the device.

[0582] Step 4:

[0583] The user selects a customization option.

[0584] Input: User's choice

[0585] Output: Selected customization options

[0586] What happens: The user selects an option, such as hair color, eye color, or clothing.

[0587] Step 5:

[0588] The terminal sends the selected option to the server.

[0589] Input: Selected customization options

[0590] Output: Send data to the server

[0591] Specific operation: The device sends the selected options in JSON format to the server.

[0592] Step 6:

[0593] The server generates the character's appearance data based on the selected options and stores it in a database.

[0594] Input: Selected customization options

[0595] Output: Generate and save character appearance data

[0596] Specific operation: The server uses Node.js to generate character appearance data based on the selected options and saves it in a MySQL database.

[0597] Step 7:

[0598] The server displays the appearance of the generated character on the terminal.

[0599] Input: Character appearance data

[0600] Output: Display of character appearance

[0601] Specific operation: The server sends the appearance data of the generated character to the terminal, and the terminal displays it to the user.

[0602] Step 8:

[0603] Enables the microphone and camera for users to start a conversation with an AI character.

[0604] Input: User actions

[0605] Output: Enable microphone and camera

[0606] What happens: The user changes the settings within the application to enable the microphone and camera.

[0607] Step 9:

[0608] The device uses a microphone and camera to capture the user's voice and facial expressions in real time.

[0609] Input: User's voice and facial expressions

[0610] Output: Captured voice and facial expression data

[0611] What it does: The device uses its microphone and camera to capture the user's voice and facial expressions.

[0612] Step 10:

[0613] The device captures voice and facial expression data and sends it to emotion recognition software.

[0614] Input: Captured voice and facial expression data

[0615] Output: Sending data to emotion recognition software

[0616] Specific operation: The device sends captured data to Microsoft Azure Cognitive Services.

[0617] Step 11:

[0618] Emotion recognition software analyzes the user's emotions from their tone of voice and facial expressions, generating emotional labels such as "joy," "sadness," and "anger."

[0619] Input: Captured voice and facial expression data

[0620] Output: Emotion label

[0621] How it works: Emotion recognition software analyzes voice tone and facial expressions to generate emotion labels.

[0622] Step 12:

[0623] The device sends the analysis results to the server.

[0624] Input: Emotion label

[0625] Output: Send data to the server

[0626] Specific operation: The device sends the analysis results in JSON format to the server.

[0627] Step 13:

[0628] Based on the analysis results, the server executes a script to generate a response from the AI ​​character.

[0629] Input: Emotion label

[0630] Output: AI character's reaction

[0631] Specific operation: Based on the analysis results, the server executes a script to make the AI ​​character react appropriately.

[0632] Step 14:

[0633] The server sends the generated response to the terminal.

[0634] Input: AI character's reaction

[0635] Output: Sending data to the terminal

[0636] Specific operation: The server sends the generated response to the terminal.

[0637] Step 15:

[0638] The device displays the AI ​​character's response to the user and plays it back as audio.

[0639] Input: AI character's reaction

[0640] Output: what is displayed to the user and what is played as audio

[0641] Specific operation: The device displays the AI ​​character's response on the screen and plays it back as audio.

[0642] (Application example 1)

[0643] Next, a description will be given of Application Example 1 of Embodiment Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0644] Conventional virtual shopping experiences have been limited to providing users with one-way information, making it difficult to provide personalized services that reflect the emotions and preferences of individual users. Furthermore, there are limited means of providing interactive experiences using characters customized by users. This makes it difficult to increase user satisfaction and motivation to purchase.

[0645] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes: a means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; a means for purchasing personality and characteristics for a fee and training an AI to converse using past conversations and big data; a means for enjoying conversations with the AI ​​and conversations between AIs trained by other users; a means for providing an alarm function; a means for performing live streaming and live commerce; a means for recognizing the user's emotions and adjusting the AI ​​character's responses according to those emotions; and a means for functioning as a shopping assistant in a virtual store. This makes it possible to provide a personalized shopping experience tailored to the user's emotions and preferences.

[0646] A "user-customized character" is a character whose appearance has been customized by the user by freely selecting hair color, eye color, clothing, etc.

[0647] "AI for generating thoughts" is an artificial intelligence in which a character thinks autonomously and generates responses based on user input and past data.

[0648] A "system for generating voice" is a system that converts text data into voice and makes it appear as if a character is speaking.

[0649] "AI with Form" is an artificial intelligence that allows users to customize characters with thoughts and voices, giving them a visual presence.

[0650] "Purchase personality and characteristics by paying" refers to a system in which a user can customize a character's personality and characteristics by paying an additional fee.

[0651] "AI that uses past conversations and big data to converse" is artificial intelligence that generates more natural and appropriate responses based on past conversation history with the user and large amounts of data.

[0652] "Means for developing AI" refers to methods or systems that allow users to develop the character's personality and abilities.

[0653] "Means for enjoying conversations with AIs and conversations between AIs developed by other users" refers to methods by which users can have conversations with their own characters or observe conversations between characters developed by other users.

[0654] The "means for providing an alarm function" is a function in which a character provides a notification or alarm to a user at a specific time.

[0655] "Means for live streaming and live commerce" refers to methods that allow characters to stream in real time or introduce and sell products.

[0656] "Means for recognizing the user's emotions and adjusting the AI ​​character's response in accordance with those emotions" refers to a system that analyzes the user's facial expressions and tone of voice to recognize their emotions, and changes the character's response based on the results.

[0657] "Means for functioning as a shopping assistant in a virtual store" refers to a method by which a character supports a user's shopping in a virtual store and suggests and explains products.

[0658] The embodiments of the present invention will be described in detail below.

[0659] System configuration

[0660] This system includes a means for creating a tangible AI by combining an AI for generating thoughts for a character customized by the user with a system for generating voice, a means for purchasing personality and characteristics by paying a fee and for developing an AI that can converse by utilizing past conversations and big data, a means for enjoying conversations with the AI ​​or conversations between AIs developed by other users, a means for providing an alarm function, a means for performing live streaming and live commerce, a means for recognizing the user's emotions and adjusting the AI ​​character's responses in accordance with those emotions, and a means for functioning as a shopping assistant within a virtual store.

[0661] Hardware and software used

[0662] Hardware: Smartphone (iOS / ANDROID (registered trademark)), head-mounted display (Oculus Quest 2, etc.)

[0663] Software: Unity (game engine), OpenCV (emotion recognition library), TENSORFLOW (registered trademark) (emotion recognition model), RESTful API (backend communication)

[0664] Data processing and calculation

[0665] Character Customization

[0666] The user launches the application and selects the character's hair color, eye color, clothing, etc. Unity is used to change the character's appearance in real time.

[0667] emotion recognition

[0668] It captures the user's face using a smartphone or head-mounted display camera, recognizes emotions from the captured facial image using OpenCV and TensorFlow, processes the recognized emotion data in real time, and sends it to the backend through a RESTful API.

[0669] Character Reactions

[0670] The AI ​​character's reaction is determined based on the emotional data received on the backend. The character's facial expressions and movements are changed within Unity, providing feedback to the user.

[0671] Specific examples

[0672] When a user is searching for clothes in a virtual store, an AI character suggests, "How about this dress?" If the user smiles, the character responds, "I'm glad you like it!" Conversely, if the user looks confused, the character suggests, "Shall we take a look at other styles?"

[0673] Prompt Sentence Examples

[0674] If the user smiles:

[0675] "Generate a scenario where an AI character reacts with joy when the user smiles."

[0676] If the user looks confused:

[0677] "Generate a scenario in which an AI character responds in a comforting way when the user makes a troubled expression."

[0678] In this way, it is possible to provide a personalized shopping experience that is tailored to the user's emotions and preferences.

[0679] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0680] Step 1:

[0681] The user launches the application and accesses the character customization screen. The user selects hair color, eye color, clothing, etc. to customize the character. The input is the user's selection data, and the output is the customized character's appearance data. The device uses Unity to change the character's appearance in real time.

[0682] Step 2:

[0683] The device's camera is used to capture the user's face. The input is a facial image acquired from the camera, and the output is facial image data. The device uses OpenCV to analyze the facial image and perform preprocessing for emotion recognition.

[0684] Step 3:

[0685] The device uses TensorFlow to recognize the user's emotions from preprocessed facial image data. The input is the preprocessed facial image data, and the output is the recognized emotion data. The emotion data is processed in real time and sent to the server through a RESTful API.

[0686] Step 4:

[0687] The server determines the AI ​​character's response based on the received emotional data. The input is emotional data, and the output is the character's response data. The server uses a generative AI model to create a prompt sentence to generate an appropriate response.

[0688] Step 5:

[0689] The server generates the AI ​​character's response based on the generated prompt. The input is the prompt, and the output is the character's response data. The generated response data is sent to the device via a RESTful API.

[0690] Step 6:

[0691] The device changes the character's facial expressions and movements in Unity based on the reaction data it receives. The input is the reaction data, and the output is the changed character's facial expressions and movements. The device provides feedback to the user, creating an interactive experience.

[0692] Step 7:

[0693] When a user shops in a virtual store, an AI character acts as a shopping assistant. The input is the user's behavioral and emotional data, and the output is the character's suggestions and explanations. The terminal displays the character's suggestions and explanations in real time to support the user's shopping experience.

[0694] Example 2

[0695] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0696] Conventional AI character systems have had the problem that it is difficult for users to freely customize the character's personality and characteristics, and that they are unable to respond appropriately to the user's emotions. Furthermore, it has been difficult to provide multifunctional services such as dialogue between characters developed by users, live streaming, and live commerce.

[0697] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0698] In this invention, the server includes: means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; means for purchasing personality and characteristics for a fee and cultivating an AI that can converse using past conversations and large-scale data; means for enjoying conversations with the AI ​​and conversations between AIs developed by other users; means for providing an alarm function; means for live streaming and live commerce; and means for learning the user's emotions and evolving the AI ​​character's response to the user's emotions. This allows users to freely customize the character's personality and characteristics, enabling it to respond appropriately to the user's emotions. Furthermore, multifunctional services can be provided, such as dialogue between characters developed by users, live streaming, and live commerce.

[0699] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence and learn, reason, and self-correct.

[0700] A "system for generating voice" is a technology that converts text data into voice data and outputs the voice to the user.

[0701] "Personality and characteristics" refers to the individuality and characteristics that influence the character's actions and speech, and are elements that can be customized by the user.

[0702] "Big data" refers to large datasets containing past conversations and other relevant information that are used for training and analysis of artificial intelligence.

[0703] "Emotional learning" is the process of collecting and analyzing user emotional data and optimizing the AI's response based on that data.

[0704] The "alarm function" is a function that notifies or warns the user based on specific times or conditions.

[0705] "Live streaming" is a technology that distributes audio and video in real time over the Internet.

[0706] "Live commerce" is a method of selling products and services through live streaming.

[0707] "Acting based on user instructions" means that the artificial intelligence performs a specific action in response to input or commands from the user.

[0708] "Evolving through self-learning" refers to the process by which artificial intelligence learns based on its own experience and data, improving its performance and functionality.

[0709] MODE FOR CARRYING OUT THE INVENTION

[0710] This invention is a system that creates a tangible AI by combining a user-customized character with an AI for generating thoughts and a system for generating voices. Specific embodiments of this system are described below.

[0711] System configuration

[0712] The server manages a database for adding personalities and features to characters customized by users. Specifically, it uses a database management system such as MySQL to associate and store information on user IDs and purchased personalities and features.

[0713] The terminal provides an interface for the user to select and purchase the character's personality and characteristics. The personality and characteristics selected by the user are transmitted from the terminal to the server, which stores the information in a database.

[0714] Data processing and calculation

[0715] The server processes data to generate character actions and speech based on the personality and characteristics information purchased by the user. Specifically, it uses a generative AI model to generate text data based on the personality and characteristics selected by the user. This text data is then converted into voice data using a system for generating voice (e.g., a voice synthesis engine).

[0716] The emotion engine collects user emotional data and analyzes it using machine learning libraries such as TensorFlow. This allows it to calculate the data and show an appropriate response based on the user's emotions. For example, it collects data when the user expresses anger and uses that data to evolve the AI ​​character's response.

[0717] Specific examples

[0718] Let's say a user purchases a "gentle personality." The user selects "gentle personality" on the device screen and completes the purchase procedure using a credit card. The server saves the user ID and "gentle personality" information in a MySQL database. The device retrieves the "gentle personality" information from the server and reflects it in the character's actions and speech. For example, the character may start to "speak slowly."

[0719] Prompt Sentence Examples

[0720] An example prompt might look like this:

[0721] If a user purchases a "gentle personality," explain how this will be reflected in the character's actions and words.

[0722] In this way, users can freely customize the character's personality and characteristics, allowing it to respond appropriately to the user's emotions. It also enables multifunctional services such as dialogue between characters developed by users, live streaming, and live commerce.

[0723] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0724] Step 1:

[0725] The user selects the character's personality and characteristics.

[0726] The user selects the personality and characteristics they want to add to their character through the device interface. As input, the information on the personality and characteristics selected by the user is sent to the device. As output, the information on the selected personality and characteristics is saved on the device. As a specific action, the user selects a "gentle personality."

[0727] Step 2:

[0728] Purchase the personality or characteristics selected by the user.

[0729] The user uses the terminal to carry out the billing procedure to purchase the selected personality and characteristics. As input, the user's payment information and information on the selected personality and characteristics are sent to the terminal. As output, information indicating that the purchase has been completed is displayed on the terminal. In concrete terms, the user uses a credit card to purchase the "gentle personality."

[0730] Step 3:

[0731] The server stores the purchase information in a database.

[0732] The server saves the information about the personality and characteristics purchased by the user in a database. As input, the user ID and the information about the personality and characteristics purchased are sent to the server. As output, the saved information is recorded in the database. Specifically, the server saves the information about the "gentle personality" in the MySQL database.

[0733] Step 4:

[0734] The terminal obtains the purchase information from the server.

[0735] The device obtains information about the personality and characteristics purchased by the user from the server. As input, the user ID is sent from the device to the server. As output, the information about the purchased personality and characteristics is sent to the device. In concrete terms, the device obtains information about the "easy-going personality" from the server.

[0736] Step 5:

[0737] The device reflects the character's personality and characteristics.

[0738] The device reflects the acquired personality and characteristic information in the character's actions and speech. The purchased personality and characteristic information is sent to the device as input. The character's actions and speech are changed as output. A specific example of this behavior is that the character will "speak slowly."

[0739] Step 6:

[0740] The user interacts with the character.

[0741] The user interacts with the character through the terminal. As input, the user's statements and questions are sent to the terminal. As output, the character's response is displayed on the terminal. In concrete terms, when the user asks the character, "How was your day?", the character replies, "I had a relaxing time today."

[0742] Step 7:

[0743] The emotion engine learns the user's emotions and optimizes the character's reactions.

[0744] The emotion engine collects and analyzes the user's emotion data. As input, the user's emotion data is sent to the emotion engine. As output, an optimized character's reaction is generated. Specifically, if the user expresses sadness, the emotion engine collects that data and optimizes the character's reaction so that the next time in a similar situation, the character will respond with a comforting "It's okay, it'll get better."

[0745] (Application example 2)

[0746] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0747] Conventional AI characters have difficulty responding to users' emotions in real time, or making appropriate comments or taking appropriate actions in response to the content being viewed. Furthermore, there was a lack of systems that allowed users to freely customize the character's personality and characteristics to provide a personalized experience. This led to problems such as a decline in user satisfaction and engagement.

[0748] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0749] In this invention, the server includes means for creating a tangible AI by combining a character customized by the user with an AI for generating thoughts and a system for generating voices, means for purchasing personality and characteristics for a fee and developing an AI that can converse by utilizing past conversations and large-scale data, means for enjoying conversations with the AI ​​and conversations between AIs developed by other users, means for providing an alarm function, means for live streaming and live commerce, means for analyzing user emotions and generating responses in real time, and means for the AI ​​character to comment on or take action in response to content being viewed, thereby enabling users to enjoy real-time interaction with their individually customized AI character.

[0750] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence and learn, reason, and self-correct.

[0751] A "system for generating voice" is a technology that converts text data into voice data and outputs the voice to the user.

[0752] "Artificial intelligence with form" refers to artificial intelligence that is displayed visually as a character, and is a means for interacting with users.

[0753] "Purchasing personality and characteristics by paying" is a function that allows the user to customize the personality and characteristics of an AI character by paying money.

[0754] "Artificial intelligence that converses by utilizing past conversations and large-scale data" refers to artificial intelligence that can conduct more natural and appropriate conversations based on the past dialogue history with the user and large amounts of data.

[0755] "Enjoying a conversation with an AI" refers to the act of a user having a conversation with an AI character and enjoying that conversation.

[0756] "Enjoying a conversation between AI characters trained by other users" refers to the act of enjoying watching AI characters trained by different users converse with each other.

[0757] "Providing an alarm function" means a function that notifies the user based on specified times or conditions.

[0758] "Live streaming and live commerce" refers to the ability to stream video and audio in real time and sell products and services.

[0759] "Analyzing the user's emotions and generating responses in real time" is a function that analyzes the user's emotions from their facial expressions and voice, and the AI ​​character instantly responds appropriately based on the results.

[0760] "An AI character makes comments or takes action in response to the content being viewed" is a function in which an AI character makes comments or takes action in real time in response to the video or audio content being viewed by the user.

[0761] A system for implementing this invention includes means for creating a tangible artificial intelligence by combining a character customized by a user with an artificial intelligence for generating thoughts and a system for generating voices, means for purchasing personality and characteristics for a fee and developing an artificial intelligence that can converse using past conversations and large-scale data, means for enjoying conversations with the artificial intelligence or conversations between artificial intelligences developed by other users, means for providing an alarm function, means for live streaming and live commerce, means for analyzing the user's emotions and generating responses in real time, and means for the artificial intelligence character to comment on or take action in response to content being viewed.

[0762] System Program

[0763] The program for this system is realized using the following hardware and software.

[0764] Hardware used

[0765] Smartphone or head-mounted display

[0766] Camera (built-in or external)

[0767] Software used

[0768] Python

[0769] OpenCV (for face detection)

[0770] dlib (for face detection)

[0771] transformers (for emotion analysis)

[0772] Processing Description

[0773] User sentiment analysis

[0774] The server captures the user's face in real time through a camera and detects it using OpenCV and dlib. The detected face image data is input to an emotion analysis model in the transformers library to analyze the user's emotions.

[0775] Character reaction generation

[0776] The server then generates a reaction based on the analyzed user's emotional data, according to the character's personality and characteristics. For example, if the user smiles and the character has a "gentle personality," it will respond with a gentle smile.

[0777] Collaboration with content

[0778] The server allows an AI character to make comments and perform actions in real time in response to the content the user is watching, such as shedding tears during a moving scene in a movie.

[0779] Specific examples

[0780] If the user smiles while watching a movie, and the character has a "gentle personality," the character will respond with a gentle smile.

[0781] If the user sheds tears at a sad scene, and the character has a "cheerful personality," the character will make an encouraging comment.

[0782] Prompt Sentence Examples

[0783] When the user smiles, the character responds with a gentle smile, showing its "gentle personality."

[0784] If the user sheds tears at a sad scene, the character will make encouraging comments with a "cheerful personality."

[0785] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0786] Step 1:

[0787] The server captures the user's face in real time through a camera, the input is the video data from the camera, and the output is the captured image frame, which is used for the subsequent face detection process.

[0788] Step 2:

[0789] The server detects the user's face from the captured image frame using OpenCV and dlib. The input is the image frame obtained in step 1, and the output is the region information of the detected face. Specifically, the position and size of the face are identified.

[0790] Step 3:

[0791] The server extracts the detected face region and inputs it into the emotion analysis model of the transformers library. The input is the face image data, and the output is the user's emotion label (e.g., joy, sadness, anger, etc.). The emotion analysis model estimates emotions from facial expressions.

[0792] Step 4:

[0793] The server generates a reaction based on the analyzed user's emotion data, according to the character's personality and characteristics. The input is the user's emotion label and the character's personality and characteristics data, and the output is the character's reaction (e.g., comment, action). Specifically, a reaction corresponding to the emotion label is selected.

[0794] Step 5:

[0795] The server allows an AI character to make comments and take actions in real time in response to the content the user is viewing. The input is information about the content being viewed and the character's reaction data, and the output is the character's comments and actions displayed on the content. Specifically, the character reacts to the content at the appropriate time.

[0796] Step 6:

[0797] The user can watch the reactions of the generated character and enjoy the interaction. The input is the character's reaction data sent from the server, and the output is the user's experience. Specifically, the user can enjoy watching the character's reactions.

[0798] Example 3

[0799] Next, a description will be given of a third embodiment of the third embodiment. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0800] Conventional AI systems have not yet fully developed the ability to record conversations with users and learn from them, making it difficult to gain a deep understanding of users' preferences and tendencies. Furthermore, few systems were able to predict changes in users' emotions and provide appropriate responses accordingly. Furthermore, there was a lack of entertainment systems that integrated live streaming and live commerce functions. To solve these issues, a system was needed that could record and store conversations with users, use the AI ​​to learn from them, and predict changes in users' emotions and respond appropriately.

[0801] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[0802] In this invention, the server includes means for recording conversations between a user and an AI and storing them as large-scale data, means for the AI ​​to learn using the stored conversation data and understand the user's preferences and tendencies, and means for analyzing past conversation data and the user's behavioral patterns, predicting changes in the user's emotions, and adjusting the AI's response based on the predictions. This enables the AI ​​to learn based on conversations with the user, understand changes in the user's preferences and emotions, and respond appropriately.

[0803] "User" refers to any individual or entity that uses the System.

[0804] A "custom character" refers to a virtual being whose appearance, personality, etc. can be freely set and changed by the user.

[0805] "Artificial intelligence" refers to the technology that enables computer systems to think and learn by imitating human intelligence.

[0806] "System for generating voice" refers to technology that converts text data into voice data.

[0807] "Large-scale data" refers to a large amount of data set, and particularly includes conversation data with users.

[0808] "Charge" refers to the fee paid by a user to use a particular service or feature.

[0809] "Personality and characteristics" refers to the elements that determine the behavior and reactions of your customized character.

[0810] "Means for raising" refers to methods and techniques for raising a user's customized character.

[0811] The "alarm function" refers to a function that notifies the user at a specified time by notification or voice.

[0812] "Live streaming" refers to the technology of delivering video and audio in real time over the Internet.

[0813] "Live commerce" refers to the method of introducing and selling products through live streaming.

[0814] "Means for recording conversations" refers to technology that saves the content of conversations between users and artificial intelligence.

[0815] "Means of learning" refers to how AI acquires new knowledge and skills based on accumulated data.

[0816] "Means for predicting changes in emotions" refers to technology that analyzes past data to predict the emotional changes of users.

[0817] "Means for adjusting responses" refers to methods for modifying the AI's responses based on predicted emotions.

[0818] MODE FOR CARRYING OUT THE INVENTION

[0819] This invention is a system for creating tangible AI by combining AI with a character customized by a user and using a system for generating voice. Specific embodiments of this system will be described below.

[0820] System configuration

[0821] 1. User operations

[0822] Users can ask questions and give instructions to their customized characters through their devices, such as "What's the weather like today?" or "Wake me up at 7 a.m."

[0823] 2. Speech-to-text

[0824] The device uses speech recognition technology to convert the user's speech into text, specifically, by using the Google Cloud Speech-to-Text API.

[0825] 3. Recording and storing conversations

[0826] The server receives the converted text data and records the conversation. This recorded data is stored as a large-scale database using AWS's RDS (Relational Database Service).

[0827] 4. AI Learning

[0828] The server uses the accumulated conversation data to train the AI, using Google Cloud's AutoML to train machine learning models to understand user preferences and trends.

[0829] 5. Alarm function

[0830] When a user issues a command such as "Wake me up at 7am tomorrow morning," the device parses the command and uses Android's AlarmManager API to set an alarm for the specified time.

[0831] 6. Live streaming and live commerce

[0832] Users can watch live streams of AI characters through the app, and the server uses the YouTube Live API to stream the content.

[0833] 7. Emotional prediction and response regulation

[0834] The server analyzes past conversation data and the user's behavioral patterns, and uses IBM Watson's Natural Language Understanding to predict changes in the user's emotions. Based on this prediction, the server adjusts the AI ​​character's response.

[0835] Specific examples

[0836] Conversation recording: When a user says "What's the weather today?", the device converts the speech into text and sends the text to the server, which stores the text "What's the weather today?" in a database.

[0837] Set alarm: When a user says, "Wake me up at 7am tomorrow morning," the device parses the instruction and uses the AlarmManager API to set an alarm for the specified time.

[0838] Live streaming: When a user opens the app, the server calls the YouTube Live API to get the live streaming URL and sends it to the device, which then uses the URL to display the live streaming.

[0839] Emotion prediction: The server uses IBM Watson's Natural Language Understanding to analyze conversation data and predict when the user is feeling stressed. Based on this, the AI ​​character generates an encouraging message, such as "Are you OK? Is there anything I can help you with?" and sends it to the device.

[0840] Prompt Sentence Examples

[0841] "Please explain what happens when a user instructs an AI character to "wake me up at 7am tomorrow morning.""

[0842] "Please explain the specific steps that an AI character takes to live stream."

[0843] The above is a specific embodiment for carrying out the present invention. The flow of the identification process in the third embodiment will be described with reference to FIG.

[0844] Step 1:

[0845] User voice input

[0846] The user issues questions or commands by voice into the terminal.

[0847] Input: User's voice data

[0848] Output: Audio data is input to the device

[0849] What happens: The user says, "What's the weather like today?"

[0850] Step 2:

[0851] Speech-to-text

[0852] The device uses speech recognition technology to convert the user's speech into text, specifically, by using the Google Cloud Speech-to-Text API.

[0853] Input: User's voice data

[0854] Output: Text data

[0855] What it does: Your device converts the speech "What's the weather like today?" into text.

[0856] Step 3:

[0857] Record and send conversations

[0858] The terminal transmits the converted text data to the server.

[0859] The server records the received text data.

[0860] Input: Text data

[0861] Output: Text data is sent to the server and recorded.

[0862] Specific operation: The device sends the text "What's the weather today?" to the server, which stores it in a database.

[0863] Step 4:

[0864] Data accumulation

[0865] The server stores the recorded text data in AWS's RDS (Relational Database Service).

[0866] Input: Text data

[0867] Output: Text data stored in the database

[0868] What happens: The server executes an SQL query to insert the text "What's the weather like today?" into the database.

[0869] Step 5:

[0870] Artificial Intelligence Learning

[0871] The server uses the accumulated conversation data to train the AI, using Google Cloud's AutoML to train the machine learning model.

[0872] Input: Accumulated conversation data

[0873] Output: A trained machine learning model

[0874] What it does: The server periodically extracts conversation data from the database and trains the machine learning model.

[0875] Step 6:

[0876] Alarm settings

[0877] The user instructs the AI ​​character to "wake me up at 7:00 tomorrow morning."

[0878] The device parses the instruction and uses Android's AlarmManager API to set an alarm at the specified time.

[0879] Input: User prompt text

[0880] Output: Set alarm

[0881] What it does: When a user says, "Wake me up at 7am tomorrow morning," the device parses the instruction and sets an alarm using the AlarmManager API.

[0882] Step 7:

[0883] Live streaming and live commerce

[0884] Users can watch live broadcasts of AI characters through the app.

[0885] The server uses the YouTube Live API for live streaming.

[0886] Input: Live stream request

[0887] Output: Live stream URL

[0888] What it does: When a user opens the app, the server calls the YouTube Live API to get the live streaming URL and sends it to the device, which then uses the URL to view the live streaming.

[0889] Step 8:

[0890] Emotional prediction and response regulation

[0891] The server analyzes past conversation data and user behavior patterns and uses IBM Watson's Natural Language Understanding to predict changes in the user's emotions.

[0892] The AI ​​character adjusts its response based on that prediction.

[0893] Input: Past conversation data, behavioral patterns

[0894] Output: Coordinated response

[0895] How it works: The server analyzes the conversation data and predicts that the user is feeling stressed. Based on this, the AI ​​character generates an encouraging message, such as "Are you OK? Is there anything I can help you with?" and sends it to the device.

[0896] (Application example 3)

[0897] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0898] Conventional AI character systems have had difficulty fully understanding users' preferences and tendencies and providing personalized experiences. They also lacked the ability to respond to changes in users' emotions, making it difficult to increase user satisfaction. Furthermore, their live streaming and live commerce functions were limited, making it difficult to provide new forms of entertainment.

[0899] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes: a means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; a means for purchasing personality and characteristics for a fee and cultivating an AI that can converse using past conversations and big data; a means for enjoying conversations with the AI ​​and conversations between AIs developed by other users; a means for providing an alarm function; a means for performing live streaming and live commerce; a means for predicting changes in the user's emotions and providing appropriate responses; and a means for delivering personalized content. This makes it possible to provide a personalized experience tailored to the user's preferences and tendencies and respond to changes in the user's emotions. Furthermore, live streaming and live commerce can provide a new form of entertainment.

[0900] "User" refers to any individual or legal entity that uses the System.

[0901] "Custom" refers to settings and changes that the user makes to suit their own preferences.

[0902] "Character" refers to a virtual being with an artificial intelligence appearance and personality customized by the user.

[0903] "Artificial intelligence for generating thoughts" refers to algorithms and programs that generate appropriate responses and actions based on conversations and instructions with users.

[0904] "System for generating speech" refers to technology or devices for converting text data into speech data.

[0905] "Artificial intelligence" refers to artificial intelligence that has a visual appearance and can interact with users.

[0906] "Charge" refers to the fee paid by a user to use a particular function or service.

[0907] "Personality and characteristics" refers to the settings and attributes that influence the behavior and responses of an AI character.

[0908] "Past conversations and big data" refers to the history of past interactions with users and large datasets.

[0909] "Development" refers to the growth and evolution of an AI character through interaction and experience with the user.

[0910] The "alarm function" refers to a function that notifies or warns the user at a specified time.

[0911] "Live streaming" refers to the distribution of video and audio in real time over the Internet.

[0912] "Live commerce" refers to the introduction and sale of products and services through live streaming.

[0913] "Means for predicting changes in emotions" refers to algorithms or programs for predicting changes in a user's emotions based on the user's past behavior and conversation data.

[0914] "Means for showing an appropriate reaction" refers to a function that enables an AI character to respond or act appropriately in response to the predicted emotions of the user.

[0915] "Personalized content" refers to information and entertainment that is customized to a user's preferences and tendencies.

[0916] A system for implementing this invention includes a means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices. The user can customize the character's appearance and personality using a terminal such as a smartphone or computer.

[0917] The server provides a means for users to purchase personality and characteristics for a fee and develop a conversational AI using past conversations and big data. Users can pay a fee to use specific functions and services and change the personality and characteristics of the AI ​​character. This allows users to develop their own personalized character.

[0918] The server also provides a means for users to enjoy conversations with AIs and conversations between AIs developed by other users. Users can receive entertainment and information by interacting with AI characters. Furthermore, users can also observe conversations between AI characters developed by other users.

[0919] The server includes means for providing an alarm function, whereby a user can set an alarm for an AI character at a specific time, and the AI ​​character will wake the user up at the specified time.

[0920] Furthermore, the server provides a means for live streaming and live commerce. Users can watch their AI characters live stream and enjoy live commerce where AI characters introduce products. This provides a new form of entertainment.

[0921] The server includes a means for predicting changes in the user's emotions and showing an appropriate response. Based on past conversation data and the user's behavior patterns, the AI ​​character predicts changes in the user's emotions and shows an appropriate response based on the prediction. For example, if it is predicted that the user is feeling stressed, the AI ​​character will show a response that encourages the user.

[0922] Finally, the server provides a means for delivering personalized content, tailored to the user's preferences and tendencies based on the user's past conversation data, allowing the user to receive information and entertainment tailored to their needs.

[0923] For example, if a user requests, "Wake me up at 7:00 tomorrow morning," the AI ​​character will sound the alarm at the specified time. Furthermore, if the AI ​​character predicts that the user is feeling stressed, it will encourage them by asking, "Are you okay? Is there anything I can help you with?"

[0924] Examples of prompts for generative AI models include:

[0925] Create an AI character that learns user preferences and trends based on past conversation data and delivers personalized content. Also, provide alarm, live streaming, and live commerce functions, and use an emotion engine to predict changes in user emotions and provide appropriate responses.

[0926] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[0927] Step 1:

[0928] The user customizes the character using the terminal. The user sets the character's appearance and personality through the terminal interface. The input is the user's selected appearance and personality data, and the output is the customized character data.

[0929] Step 2:

[0930] The server combines artificial intelligence for generating thoughts for a customized character with a system for generating voice. The input is data for the customized character, and the output is data for a character with thoughts and voice. The server generates the character's thoughts using a generative AI model and generates voice using a voice synthesis system.

[0931] Step 3:

[0932] The user pays using a terminal and purchases a character's personality and characteristics. The input is the user's billing information and the purchased personality and characteristics data, and the output is updated character data. The server processes the user's payment through the billing system and updates the character data.

[0933] Step 4:

[0934] The server uses past conversations and big data to develop the character. The input is past conversation data and big data, and the output is learned character data. The server uses machine learning algorithms to improve the character's conversational ability.

[0935] Step 5:

[0936] The user converses with the character using a terminal. The input is the user's utterance data, and the output is the character's response data. The server uses a generative AI model to generate an appropriate response to the user's utterance, and generates the voice using a speech synthesis system.

[0937] Step 6:

[0938] The server provides a means for users to enjoy conversations between characters that other users have raised. The input is character data of other users, and the output is generated conversation data between the characters. The server integrates the data of multiple characters and performs a conversation simulation.

[0939] Step 7:

[0940] The user sets an alarm using a terminal. The input is the alarm time data specified by the user, and the set alarm data is generated as the output. The server triggers the alarm at the specified time, and a character wakes the user up.

[0941] Step 8:

[0942] The server provides the means for live streaming and live commerce. The inputs are instructions to start live streaming and product data, and the output is live streaming data and live commerce data. The server uses a live streaming system to deliver video and audio in real time and introduce products.

[0943] Step 9:

[0944] The server predicts changes in the user's emotions and displays an appropriate response. The inputs are past conversation data and user behavior pattern data, and the output is emotion prediction data and appropriate response data. The server predicts the user's emotions using an emotion prediction algorithm and generates an appropriate response using a generative AI model.

[0945] Step 10:

[0946] The server delivers personalized content. The input is the user's past conversation data and preference data, and the output is personalized content data. The server analyzes the user's data, selects the most appropriate content, and delivers it.

[0947] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0948] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0949] Another example of generative AI is Gemini (registered trademark) (Internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[0950] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0951] [Second embodiment]

[0952] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0953] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0954] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0955] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0956] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0957] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0958] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0959] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0960] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0961] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0962] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0963] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[0964] "Example 1"

[0965] One embodiment of the present invention provides a means for users to customize the appearance of their characters, allowing them to freely select their character's hair color, eye color, clothing, etc., to create their own original character.

[0966] "Example 2"

[0967] Furthermore, users can purchase character personalities and traits by paying a fee. For example, users can purchase and add traits such as a "gentle personality," a "lively personality," or a "knowledgeable personality" to their characters. This allows users to develop their own unique AI characters.

[0968] "Example 3"

[0969] The system of the present invention also records conversations between users and AI characters and stores them as big data, allowing the AI ​​characters to learn from past conversations and understand the user's preferences and tendencies.

[0970] "Example 4"

[0971] Furthermore, the system of the present invention provides an alarm function to the AI ​​character: the user can issue an instruction to the AI ​​character, such as "Wake me up at 7:00 tomorrow morning," and the AI ​​character will wake the user up at the specified time.

[0972] "Example 5"

[0973] The system of the present invention also provides the ability for AI characters to perform live streaming and live commerce. Users can watch their AI characters live stream and enjoy live commerce where AI characters introduce products. This provides a new form of entertainment.

[0974] The processing flow of each embodiment will be described below.

[0975] "Example 1"

[0976] Step 1: The user logs into the system.

[0977] Step 2: The user opens the character creation screen and customizes the character's appearance, including choosing hair color, eye color, clothing, etc.

[0978] Step 3: Save the character created by the user. This allows users to create their own original character.

[0979] "Example 2"

[0980] Step 1: The user logs in to the system and selects the character they created. Step 2: The user opens a screen where they can purchase the character's personality and characteristics.

[0981] Step 3: The user selects characteristics such as "gentle personality," "lively personality," or "knowledgeable" and makes a purchase.

[0982] Step 4: The purchased personality and characteristics are added to the character, allowing users to develop their own unique AI character.

[0983] "Example 3"

[0984] Step 1: The user logs into the system and selects the character they created. Step 2: The user starts a conversation with the character.

[0985] Step 3: The system records the conversation between the user and the character and stores it as big data.

[0986] Step 4: The AI ​​character learns from past conversations to understand the user's preferences and tendencies.

[0987] "Example 4"

[0988] Step 1: The user logs in to the system and selects the character they created. Step 2: The user gives the character instructions such as "Wake me up at 7am tomorrow morning."

[0989] Step 3: The system records the specified time and sets an alarm function for the AI ​​character.

[0990] Step 4: At the specified time, the AI ​​character wakes up the user.

[0991] "Example 5"

[0992] Step 1: The user logs in to the system and selects the character they created. Step 2: The user starts live streaming or live commerce with the character.

[0993] Step 3: Other users can watch the live stream and purchase products through live commerce, providing a new form of entertainment.

[0994] Example 1

[0995] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0996] Conventional character customization systems make it difficult for users to freely customize the appearance of their characters, and the appearance of the generated characters often does not meet the user's expectations. Furthermore, the process for generating a character's appearance is complicated, making it difficult for users to use. Furthermore, there are limitations in that the generated characters cannot be shared with other users or used for live streaming or live commerce.

[0997] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0998] In this invention, the server includes a means for allowing a user to customize the appearance of a character, a means for receiving user selection information and sending a prompt to a generation AI model to generate the character's appearance, and a means for displaying the generated character's appearance to the user. This allows users to easily create their own original characters, share them with other users, and use them for live streaming and live commerce.

[0999] A "user" is an individual or group that utilizes the system to customize the appearance of a character and to operate the generated character.

[1000] A "character" is a digital object such as a virtual person or animal that can be customized by a user.

[1001] "Appearance" refers to a character's visual characteristics such as hair color, eye color, clothing, etc.

[1002] "Customization" refers to the act of a user freely selecting and changing the appearance of a character.

[1003] A "server" is a computer system that receives user requests and performs the processing to generate the character's appearance.

[1004] A "generative AI model" is an artificial intelligence model that generates a character's appearance based on user selection information.

[1005] A "prompt" is an instruction sent to a generative AI model to generate the character's appearance.

[1006] "Selection information" refers to data such as hair color, eye color, clothing, etc. selected by the user when customizing the character's appearance.

[1007] "Display" refers to the act of visually presenting the appearance of the generated character on the user's terminal.

[1008] "Live distribution" refers to the act of distributing video and audio in real time using generated characters.

[1009] "Live commerce" is the act of selling products and services through live streaming.

[1010] The present invention is a system that allows a user to customize the appearance of a character and realize various functions using the created character. Specific embodiments of this system will be described below.

[1011] First, a user accesses the web application using a browser. This web application is built using React.js as the front end and Node.js as the back end. When a user accesses the web application, the server provides a character customization screen. This screen includes an interface for selecting hair color, eye color, clothing, etc.

[1012] The user can freely select the character's appearance using the provided interface. For example, the user can set the hair color to "blue," the eye color to "green," and the clothing to "casual." The user's selection information is sent from the device to the server in real time. The selection information is sent in JSON format.

[1013] The server generates a prompt based on the received selection information, for example, "Generate a character with blue hair, green eyes, and casual clothing." This prompt is then sent to a generative AI model (e.g., OpenAI's DALL-E).

[1014] The generative AI model generates the character's appearance based on the received prompt. The image data of the generated character is returned to the server. The server then sends the image data of the generated character to the user's device, allowing the user to check the appearance of the generated character on their browser.

[1015] For example, if the user selects "blue hair, green eyes, casual clothing," the following prompt is generated:

[1016] "Generate a character with blue hair, green eyes, and casual clothing."

[1017] This prompt is sent to the AI ​​model, which then generates the character's appearance based on the prompt. The generated character is then displayed on the user's screen via the server.

[1018] This system allows users to easily create their own original characters, share them with other users, and use them for live streaming and live commerce.

[1019] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1020] Step 1:

[1021] A user accesses a web application.

[1022] Input: A user accesses the URL of a web application using a browser.

[1023] Output: The web application home page is displayed in the user's browser.

[1024] How it works: When a user visits "https: / / custom-character.com", the browser sends a request to the server. The server receives the request and sends the HTML, CSS, and JavaScript files for the homepage to the user's browser.

[1025] Step 2:

[1026] The server provides a character customization screen.

[1027] Input: Based on the user's request, the server prepares the data for the character customization screen.

[1028] Output: The character customization screen is displayed in the user's browser.

[1029] What it does: The server sends a character customization component built with React.js to the user's browser, providing an interface for the user to select hair color, eye color, clothing, etc.

[1030] Step 3:

[1031] The user selects the character's appearance.

[1032] Input: User selects hair color, eye color, clothing, etc. on the character customization screen.

[1033] Output: The selected information is saved on the user's device.

[1034] Specific operation: The user operates the interface to set the hair color to "blue," the eye color to "green," and the clothing to "casual." The selection information is temporarily saved on the user's device.

[1035] Step 4:

[1036] The terminal transmits the selection information to the server.

[1037] Input: Appearance information for the character selected by the user.

[1038] Output: The selection information is sent to the server.

[1039] Specific behavior: When the user clicks the "Save" button, the selection information is sent to the server in JSON format. For example, the following JSON data is sent:

[1040] json

[1041] {

[1042] "hairColor": "blue",

[1043] "eyeColor": "green",

[1044] "outfit": "casual"

[1045] }

[1046] Step 5:

[1047] The server generates a prompt and sends it to the AI ​​model.

[1048] Input: User selection information (JSON data).

[1049] Output: The generated prompt sentence is sent to the AI ​​model.

[1050] Specific operation: The server generates a prompt based on the received selection information. For example, a prompt such as "Please generate a character with blue hair, green eyes, and casual clothing" is generated. This prompt is then sent to the generative AI model.

[1051] Step 6:

[1052] The AI ​​model generates the character's appearance and returns it to the server.

[1053] Input: The generated prompt statement.

[1054] Output: Image data of the generated character.

[1055] Specific operation: The generative AI model generates the character's appearance based on the received prompt. The image data of the generated character is returned to the server.

[1056] Step 7:

[1057] The server displays the generated character to the user.

[1058] Input: Image data of the generated character.

[1059] Output: The image of the character is displayed in the user's browser.

[1060] Specific operation: The server sends image data of the generated character to the user's device. The user can check the appearance of the generated character on the browser.

[1061] (Application example 1)

[1062] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1063] Conventional character customization systems allow users to freely customize the appearance of their characters, but they have the problem of not being able to try on clothes in the virtual space or check them before purchasing. Also, since there was no try-on experience in a virtual store using the characters created by the users, it was difficult to stimulate users' desire to purchase.

[1064] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1065] In this invention, the server includes: means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; means for purchasing personality and characteristics for a fee and training an AI to converse using past conversations and big data; means for enjoying conversations with the AI ​​and conversations between AIs trained by other users; means for providing an alarm function; means for live streaming and live commerce; means for a user to customize the appearance of a character and try on clothes in a virtual space; and means for trying on clothes in a virtual store and checking them before purchasing. This allows a user to try on clothes in a virtual store using their customized character and check them before purchasing.

[1066] A "user-customized character" is an original character created by the user by freely selecting hair color, eye color, clothing, etc.

[1067] "AI for generating thoughts" is an artificial intelligence that thinks and makes decisions based on knowledge and information for characters customized by users.

[1068] A "system for generating voice" is a technology or device for generating voices uttered by characters.

[1069] "AI with form" is artificial intelligence that gives thoughts and voice to characters customized by users.

[1070] "Purchase personality and characteristics by paying" refers to a system in which a user can give a character new personality and characteristics by paying an additional fee.

[1071] "AI that converses using past conversations and big data" is artificial intelligence that can hold natural conversations based on past conversation history and large amounts of data.

[1072] "Means for developing AI" refers to methods by which users can develop the character's personality and characteristics, enabling them to have more advanced conversations and behave in more advanced ways.

[1073] "Means for enjoying conversations with AI or conversations between AIs trained by other users" refers to a method by which a user can have a conversation with their own character or enjoy conversations between characters trained by other users.

[1074] "Means for providing an alarm function" refers to a function in which a character issues an alarm or notification to the user.

[1075] "Means for live streaming and live commerce" refers to a method of using characters to stream and sell products in real time.

[1076] "Means for trying on clothes in a virtual space" refers to a method in which a user tries on clothes in a virtual space using a character customized by the user.

[1077] The "means of trying on clothes in a virtual store and checking before purchasing" is a method in which a user tries on clothes using a character in a virtual store and checks how they look before actually purchasing them.

[1078] The system for implementing this invention combines an AI for generating thoughts and a system for generating voices to create a physical AI for a character customized by the user. It also provides a means for purchasing personality and characteristics for a fee and cultivating a conversational AI by utilizing past conversations and big data. It also includes a means for enjoying conversations with the AI ​​and conversations between AIs cultivated by other users, a means for providing an alarm function, a means for live streaming and live commerce, a means for the user to customize the appearance of the character and try on clothes in a virtual space, and a means for the user to try on clothes in a virtual store and check them before purchasing.

[1079] System Program

[1080] The server receives information about the appearance of the character customized by the user and controls the character's movements using AI to generate thoughts and a system to generate voices. Specifically, it uses software such as Python, OpenCV, and PIL (Python Imaging Library) to generate images and voices for the character.

[1081] Processing Description

[1082] The server generates a character based on information entered by the user, such as hair color, eye color, and clothing. The generated character thinks and makes decisions based on knowledge and information using AI to generate thoughts, and then produces sounds using a voice generation system. The user can use a smartphone or head-mounted display to control the character in a virtual space and try on clothes.

[1083] Specific examples

[1084] Consider a scenario in which a user operates a virtual fitting room application using a smartphone. The user can customize the appearance of the character and try on clothes in the virtual store by entering the following prompt sentences:

[1085] Example prompt sentence:

[1086] Choose your hair color: Blonde

[1087] Choose your eye color: Blue

[1088] Choose your outfit: Casual

[1089] When this prompt is entered, the server generates a character with blonde hair, blue eyes, and casual clothing, and the user can use the character to try on the clothes in a virtual store and check them before purchasing.

[1090] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1091] Step 1:

[1092] A user launches the virtual fitting room application using a smartphone or head-mounted display. The user inputs customization information such as hair color, eye color, and clothing. The input information is then sent to the server.

[1093] Step 2:

[1094] The server generates the character's appearance based on the customization information received from the user. Specifically, it generates an image of the character using software such as Python, OpenCV, and PIL (Python Imaging Library). The input is the user's customization information, and the output is an image of the generated character.

[1095] Step 3:

[1096] The server applies AI to the generated character to generate thoughts. The AI ​​performs the character's thoughts and decisions based on the user's past conversation history and big data. The input is an image of the character and the user's past conversation data, and the output is a character with its own thoughts.

[1097] Step 4:

[1098] The server generates the voice of the character using a voice generation system, specifically using text-to-speech technology, where the input is the character's thoughts and the output is the generated voice.

[1099] Step 5:

[1100] The server sends the generated character and voice to the user's device. The user can then control the character in the virtual space and try on the clothes using a smartphone or head-mounted display. The input is the character and voice sent from the server, and the output is the virtual space displayed on the user's device.

[1101] Step 6:

[1102] The user tries on clothes using a character in a virtual store and checks them before purchasing. The user checks the appearance of the clothes they try on and makes a decision about purchasing. The input is the try-on information in the virtual space, and the output is the user's purchasing decision.

[1103] Step 7:

[1104] The server records the user's try-on information and purchasing decision, and uses it as a reference for future customization and purchasing behavior. The input is the user's try-on information and purchasing decision, and the output is the recorded data.

[1105] Example 2

[1106] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1107] In conventional AI character systems, it was difficult for users to freely customize the character's personality and characteristics, and adding new personalities and characteristics by paying was cumbersome. Furthermore, the generated character's personality and characteristics often did not meet the user's expectations, resulting in a poor user experience. Furthermore, because character updates and saving were not performed in real time, there was also the issue of users being unable to immediately see the changes.

[1108] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for a user to select a character's personality and characteristics using a terminal, a means for the server to check billing information and update the personality and characteristics, and a means for the server to send a prompt message to the generating AI model. This allows the user to easily customize the character's personality and characteristics, smoothly add new content by paying, and update the generated character's personality and characteristics in real time in a manner that meets the user's expectations.

[1109] A "user" is an individual or group that uses the system to customize the personality and characteristics of a character and pays a fee.

[1110] "Terminal" means a device used by a user to access the system and select a character's personality and characteristics, and includes a smartphone, PC, etc.

[1111] A "server" is a computer system that manages the overall processing of the system, accepts requests from users, checks billing information, and updates the personalities and characteristics of characters.

[1112] "Artificial intelligence" refers to technology that generates thoughts and voices for characters customized by users, and includes generative AI models.

[1113] A "generative AI model" is an artificial intelligence model that generates a character's personality and characteristics based on a prompt sentence, and examples include GPT-4.

[1114] A "prompt" is a text sentence that instructs the generative AI model about the character's personality and characteristics.

[1115] "Personality and characteristics" are personalities and traits that a user selects to add to a character, and include characteristics such as "easy-going personality" and "knowledgeable traits."

[1116] "Billing information" refers to payment information provided by a user when purchasing a personality or feature, and includes credit card information, electronic payment information, and the like.

[1117] A "database" is a data storage system in which the server stores information about the personalities and characteristics of characters.

[1118] "Live streaming" is a function that allows users to stream video and audio in real time.

[1119] "Live commerce" is a feature that introduces products during live broadcasts and allows viewers to purchase them on the spot.

[1120] This invention is a system that allows a user to add personality and characteristics to a customized character and generate the character's personality and characteristics using a generation AI model. Specific embodiments of this system are described below.

[1121] Hardware and software used

[1122] 1. Terminal

[1123] A device that allows a user to access a system. Examples include smartphones and PCs.

[1124] A screen for selecting the character's personality and characteristics is provided through an application or web browser running on the device.

[1125] 2. Server

[1126] It is a computer system that manages the processing of the entire system.

[1127] The server accepts requests from users, checks billing information, and updates the character's personality and characteristics.

[1128] The server sends a prompt to the generative AI model (e.g., GPT-4) and stores the generated character information in a database.

[1129] 3. Generative AI Models

[1130] It is an artificial intelligence model that generates a character's personality and characteristics based on a prompt sentence.

[1131] Specifically, large-scale language models such as GPT-4 are used.

[1132] Data processing and calculation

[1133] 1. The user selects the character's personality and characteristics

[1134] Users use the terminals to access applications and websites on the system.

[1135] On the character customization screen displayed on the terminal, the user selects the desired personality and characteristics from options such as "easygoing personality," "lively personality," and "knowledgeable characteristics."

[1136] 2. The user makes a payment

[1137] The user enters payment information on the terminal to be charged for the selected personality and characteristics.

[1138] The terminal transmits the entered payment information to the server.

[1139] 3. The server checks the billing information and updates the personality and characteristics.

[1140] The server sends the received payment information to a payment system (e.g., Stripe or PayPal) and processes the payment.

[1141] If the charge is successful, the server stores the user's selected characteristics and features in a database.

[1142] 4. The server sends a prompt to the generative AI model

[1143] The server generates prompts based on the user's selected personality and characteristics.

[1144] For example, if the user selects "easy-going personality," the prompt text will be "Please change your character's personality to 'easy-going personality'."

[1145] The server sends this prompt to the generative AI model.

[1146] 5. Generative AI models generate character personalities and traits

[1147] The generative AI model generates new personality traits and characteristics for the character based on the prompt text it receives.

[1148] The generated personality and characteristic information is returned to the server.

[1149] 6. The server saves the generated character information and sends it to the device.

[1150] The server stores the information about the character's personality and characteristics returned by the generated AI model in a database.

[1151] The stored information is sent to the terminal so that the user can view it.

[1152] Specific examples

[1153] For example, if a user wants to add a "knowledgeable trait" to a character, the following specific actions are taken:

[1154] 1. The user selects "knowledgeable features" on the device.

[1155] 2. The user enters billing information and completes the payment.

[1156] 3. The server verifies the charge through the payment system and updates the database if successful.

[1157] 4. The server sends a prompt to the generative AI model saying, "Please add 'knowledgeable traits' to the character."

[1158] 5. The generative AI model generates new features for the character and returns them to the server.

[1159] 6. The server stores the generated information in a database and sends it to the terminal.

[1160] 7. The user sees the updated character on the device and enjoys knowledgeable dialogue and actions.

[1161] Example prompt sentence:

[1162] Change your character's personality to "gentle personality."

[1163] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1164] Step 1:

[1165] The user selects the character's personality and characteristics.

[1166] Input: A user uses a device to access a system application or website and selects a personality or traits on a character customization screen.

[1167] Data processing: The terminal collects the user's selected information and converts it into a data format for transmission to the server.

[1168] Output: The user's selection information is sent from the terminal to the server.

[1169] Specific operation: The user selects "gentle personality" and clicks the Select button.

[1170] Step 2:

[1171] The user pays the fee.

[1172] Input: The user enters payment information on the terminal.

[1173] Data processing: The terminal encrypts the entered payment information and sends it to the server.

[1174] Output: The encrypted payment information is sent from the terminal to the server.

[1175] Specific operation: The user enters credit card information and clicks the payment button.

[1176] Step 3:

[1177] The server checks the billing information and updates the personality and characteristics.

[1178] Input: Encrypted payment information received by the server from the device.

[1179] Data processing: The server sends the payment information to the payment system (e.g., Stripe or PayPal) and processes the payment. If successful, the user's selected personality and characteristics are saved in the database.

[1180] Output: The result of the billing process and updated character information are saved in the database.

[1181] Specific operation: The server sends the billing information to the payment system, and if the billing is successful, it saves the "gentle personality" in the database.

[1182] Step 4:

[1183] The server sends a prompt to the generative AI model.

[1184] Input: The server stores the user's selection information in a database.

[1185] Data processing: The server generates a prompt based on the user's selection. For example, it generates a prompt such as "Please change the character's personality to 'easy-going'."

[1186] Output: The generated prompt sentence is sent to the generative AI model.

[1187] Specific operation: The server generates a prompt sentence saying, "Please change the character's personality to 'gentle'" and sends it to the generative AI model.

[1188] Step 5:

[1189] A generative AI model generates the character's personality and characteristics.

[1190] Input: The prompt sentence received by the generative AI model from the server.

[1191] Data processing: The generative AI model generates new personality and traits for the character based on the prompt text.

[1192] Output: The generated personality and trait information is returned to the server.

[1193] Specific operation: The generative AI model generates information about a character with a "gentle personality" and returns it to the server.

[1194] Step 6:

[1195] The server saves the generated character information and transmits it to the terminal.

[1196] Input: Information about the character's personality and characteristics received by the server from the generated AI model.

[1197] Data processing: The server saves the generated character information in a database and converts it into a data format for sending to the terminal.

[1198] Output: The generated character information is stored in a database and sent to the terminal.

[1199] Specific operation: The server stores information about characters with a "gentle personality" in a database and sends it to the terminal.

[1200] Step 7:

[1201] The user confirms the updated character.

[1202] Input: The user receives updated character information using the terminal.

[1203] Data processing: The terminal converts the received character information into a suitable format for display.

[1204] Output: Updated character information is displayed on the terminal.

[1205] Specific operation: The user checks out a character with a "gentle personality" on the device and enjoys the dialogue and actions.

[1206] (Application example 2)

[1207] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1208] Conventional virtual shopping experiences have been limited to one-way information provision for users, making it difficult to customize to meet individual needs and preferences. Furthermore, there has been a lack of ways for users to develop their own personalized assistants and enrich their shopping experiences.

[1209] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; means for purchasing personality and characteristics for a fee and training an AI that can converse using past conversations and big data; means for enjoying conversations with the AI ​​and conversations between AIs trained by other users; means for providing an alarm function; means for performing live streaming and live commerce; means for providing a customizable AI assistant to support shopping in a virtual store; and means for the AI ​​assistant to respond to user questions through an application installed on a smartphone or head-mounted display. This allows users to train their own virtual shopping assistant and enjoy a shopping experience tailored to their individual needs and preferences.

[1210] A "user-customized character" is a character such as a virtual person or animal that is individually customized by the user by setting the personality and characteristics according to the user's preferences.

[1211] "AI for generating thoughts" is artificial intelligence that generates natural conversations and responses based on user input and past data.

[1212] A "system for generating voice" is a system that converts text data into voice data and provides information to a user by voice.

[1213] "AI with form" is artificial intelligence that has a visually displayed character and can interact with the user.

[1214] "Purchasing a character's personality or characteristics by paying an additional fee" refers to the user acquiring a new character's personality or characteristics by paying an additional fee.

[1215] "AI that uses past conversations and big data to converse" is artificial intelligence that generates more natural and appropriate responses based on past interaction history with users and large amounts of data.

[1216] "Means for enjoying conversations with AI and conversations between AIs trained by other users" refers to a function that allows users to converse with their own characters and observe conversations between characters trained by other users.

[1217] The "means for providing an alarm function" is a function for notifying the user of a specific time or event.

[1218] "Means for live streaming and live commerce" refers to a function for streaming video and audio in real time and selling products and services.

[1219] "Customizable AI assistant to support shopping in virtual stores" is a function that provides support to users when they shop in virtual stores with an individually customized artificial intelligence assistant.

[1220] "Applications installed on smartphones or head-mounted displays" are software that users can use through their smartphones or head-mounted displays.

[1221] "Means for responding to user questions" refers to a function that provides appropriate information and answers to questions and requests from users.

[1222] A system for implementing this invention includes a means for creating a tangible AI by combining a user-customized character with an AI for generating thoughts and a system for generating voices. Users can purchase personalities and characteristics for a fee and develop conversational AIs using past conversations and big data. The system also includes a means for enjoying conversations with the AI ​​and conversations between AIs developed by other users, a means for providing an alarm function, and a means for live streaming and live commerce.

[1223] Additionally, it includes a means to provide a customizable AI assistant to support shopping in the virtual store, allowing users to have the AI ​​assistant respond to their questions through an application installed on their smartphone or head-mounted display.

[1224] Program processing explanation

[1225] The server stores the personalities and characteristics of the characters customized by users and integrates AI to generate thoughts and a system to generate voices, allowing users to develop their own characters and enrich their shopping experience in virtual stores.

[1226] Specifically, the server uses the following hardware and software:

[1227] Hardware: Smartphone, head-mounted display

[1228] Software: Python, OpenAI API

[1229] Data processing and calculations are performed as follows:

[1230] 1. The user sets the character's personality and characteristics, and then purchases additional personality and characteristics by paying a fee.

[1231] 2. The server saves this information in JSON format and generates a prompt based on the user's input.

[1232] 3. Use OpenAI's generative AI model to generate a response based on the prompt.

[1233] 4. A speech generation system converts the generated text response into speech and provides it to the user.

[1234] Specific examples

[1235] For example, if a user sets an assistant to be "gentle and knowledgeable" and asks a question about a product, the assistant will provide product information in a polite and calm tone.

[1236] Example prompt sentence:

[1237] You're a friendly and knowledgeable virtual shopping assistant who answers users' questions. Question: Tell me about this product.

[1238] In this way, users can develop their own virtual shopping assistant and enjoy a shopping experience tailored to their individual needs and preferences.

[1239] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1240] Step 1:

[1241] The user accesses the application using a smartphone or head-mounted display. The user sets the character's personality and characteristics, and purchases additional personalities and characteristics as needed. The input is the user's setting information and billing information, and the output is that this information is sent to the server.

[1242] Step 2:

[1243] The server saves the received user configuration information and billing information in JSON format. The input is the configuration information and billing information sent by the user, and the output is the saved JSON data. Specifically, the server stores the information in a database.

[1244] Step 3:

[1245] The user inputs a question through the application. The input is the user's question, and the output is the question data sent to the server. In concrete terms, the terminal receives the user's input and sends it to the server.

[1246] Step 4:

[1247] The server reads the stored character's personality and characteristics information and generates a prompt sentence based on the user's question. The input is the user's question and the stored character information, and the output is the generated prompt sentence. Specifically, the server retrieves information from the database and constructs the prompt sentence.

[1248] Step 5:

[1249] The server uses OpenAI's generative AI model to generate a response based on the generated prompt. The input is the prompt, and the output is the generated response text. Specifically, the server calls the OpenAI API to obtain the response.

[1250] Step 6:

[1251] The server sends the generated response text to the speech generation system to generate speech data. The input is the response text, and the output is the generated speech data. Specifically, the server calls an API that converts text to speech.

[1252] Step 7:

[1253] The server transmits the generated voice data to the user's terminal. The input is the generated voice data, and the output is the voice data transmitted to the user's terminal. In concrete terms, the server transmits the voice data to the terminal via a network.

[1254] Step 8:

[1255] The user's terminal plays the received voice data and provides a response to the user. The input is the received voice data and the output is the played voice. Specifically, the terminal decodes the voice data and plays it through the speaker.

[1256] Example 3

[1257] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1258] Conventional AI systems have limited user interaction and customization, and have not been able to fully realize flexible behavior based on user instructions or evolution through self-learning. It has also been difficult to provide multifunctional services such as alarm functions, live streaming, and live commerce in a single system. This has limited the user experience and reduced the system's value.

[1259] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1260] In this invention, the server includes a means for converting user instructions into text data using voice recognition software, a means for analyzing the text data and extracting a specified time, and a means for storing the extracted time in a database. This allows for flexible operation based on user instructions. Furthermore, by including a means for sending a signal to trigger an alarm at a specified time and a means for starting live streaming using a streaming server, it becomes possible to provide multifunctional services in a single system.

[1261] "User" refers to any individual or entity that uses the System.

[1262] "Custom" refers to settings and changes that the user makes to suit their own preferences.

[1263] "Character" refers to a virtual being customized by a user.

[1264] "Artificial intelligence for generating thoughts" refers to algorithms and programs that generate appropriate responses and actions based on user interactions and instructions.

[1265] A "system for generating speech" refers to software or hardware for converting text data into speech data.

[1266] "Artificial intelligence with form" refers to artificial intelligence that has a character that is displayed visually.

[1267] "Charge" refers to the fee paid by a user to use a particular function or service.

[1268] "Personality and characteristics" refers to the settings and attributes that influence a character's actions and responses.

[1269] "Past conversations" refer to previous interactions between a user and an artificial intelligence.

[1270] "Large-scale data" refers to a data set that contains a large amount of information.

[1271] "Development" refers to actions taken by a user to improve the capabilities and characteristics of an artificial intelligence.

[1272] The "alarm function" refers to a function that notifies the user at a specified time by notification or voice.

[1273] "Live streaming" refers to the distribution of video and audio in real time over the Internet.

[1274] "Live commerce" refers to a form of commercial transaction in which products are introduced during live broadcasts and viewers can purchase them on the spot.

[1275] "Speech recognition software" refers to a program for converting voice data into text data.

[1276] "Text data" refers to data expressed as character information.

[1277] "Analysis" refers to the act of analyzing data and extracting meaning and information.

[1278] A "database" refers to a system for efficiently storing, managing, and retrieving data.

[1279] A "streaming server" refers to a server for distributing data in real time.

[1280] MODE FOR CARRYING OUT THE INVENTION

[1281] This invention is a system that creates tangible AI by combining an AI for generating thoughts and a system for generating voices for characters customized by the user. Furthermore, users can purchase personality and characteristics for a fee and develop AI that can converse using past conversations and large-scale data. Users can also enjoy conversations with AIs and conversations between AIs developed by other users.

[1282] This system is realized using the following hardware and software.

[1283] Hardware and software used

[1284] Devices: Smartphones, tablets, PCs, etc.

[1285] Server: Cloud server (e.g. AWS, Google Cloud)

[1286] Database: MySQL, PostgreSQL, etc.

[1287] Speech recognition software: Google Speech-to-Text

[1288] Natural language processing software: spaCy

[1289] Streaming server: AWS MediaLive, YouTube Live, etc.

[1290] Specific operation of the system

[1291] 1. The user issues commands to the AI ​​character, such as "Wake me up at 7:00 tomorrow morning."

[1292] 2. The device converts the user's voice into text data using speech recognition software (e.g., Google Speech-to-Text).

[1293] 3. The device sends the converted text data to the server.

[1294] 4. The server analyzes the text data and extracts the specified time. The analysis is performed using natural language processing software (e.g., spaCy).

[1295] 5. The server stores the extracted time in a database (e.g. MySQL).

[1296] 6. When the specified time approaches, the server sends a signal to the device to trigger the alarm.

[1297] 7. The device sounds an alarm and wakes the user up.

[1298] It also offers live streaming and live commerce functions.

[1299] 1. The user commands the AI ​​character to start live streaming. For example, the user can say, "Start live streaming."

[1300] 2. The device converts the user's voice into text data using speech recognition software (e.g., Google Speech-to-Text).

[1301] 3. The device sends the converted text data to the server.

[1302] 4. The server analyzes the text data and prepares for live streaming.

[1303] 5. The server starts streaming using a streaming server (e.g. AWS MediaLive).

[1304] 6. The user watches the live broadcast of the AI ​​character through their device.

[1305] 7. When users enjoy live commerce, AI characters will introduce products and users will be able to purchase them.

[1306] Specific examples

[1307] The user says to the AI ​​character, "Wake me up at 7am tomorrow morning."

[1308] The device converts the speech into text and sends it to the server.

[1309] The server extracts the time information "7:00 a.m. tomorrow" and stores it in the database.

[1310] At 7:00 the next morning, the server sends an alarm signal to the device, which then sounds the alarm.

[1311] The user speaks to the AI ​​character, saying, "Start live streaming."

[1312] The device converts the speech into text and sends it to the server.

[1313] The server confirms the live streaming instructions and starts streaming using AWS MediaLive.

[1314] Users can watch the live broadcast through their devices and purchase products introduced by the AI ​​characters.

[1315] Prompt Sentence Examples

[1316] "Tell the AI ​​character to wake you up at 7am tomorrow morning"

[1317] "Instruct the AI ​​character to start live streaming"

[1318] In this way, the user can utilize a multi-functional artificial intelligence system. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1319] Alarm function processing steps

[1320] Step 1:

[1321] The user instructs the AI ​​character to "wake me up at 7am tomorrow morning."

[1322] Input: User's voice command

[1323] Output: Audio data

[1324] Specific action: The user gives a command by voice.

[1325] Step 2:

[1326] The device converts the user's voice into text data using speech recognition software (e.g., Google Speech-to-Text).

[1327] Input: Audio data

[1328] Output: Text data

[1329] Specific operation: The device converts the voice data into text data.

[1330] Step 3:

[1331] The terminal transmits the converted text data to the server.

[1332] Input: Text data

[1333] Output: HTTP request to the server

[1334] Specific operation: The device sends text data to the server via an HTTP request.

[1335] Step 4:

[1336] The server analyzes the text data and extracts the specified time.

[1337] Input: Text data

[1338] Output: Extracted time information

[1339] What happens: The server uses natural language processing software (e.g., spaCy) to analyze the text data and extract time information.

[1340] Step 5:

[1341] The server stores the extracted time in a database (e.g. MySQL).

[1342] Input: Extracted time information

[1343] Output: Save to database

[1344] Specific operation: The server saves the time information in the database using an INSERT query.

[1345] Step 6:

[1346] When the specified time approaches, the server sends a signal to the terminal to trigger an alarm.

[1347] Input: Time information stored in the database

[1348] Output: HTTP request to the device

[1349] Specific operation: The server sends an alarm signal to the terminal via an HTTP request at the specified time.

[1350] Step 7:

[1351] The device will sound an alarm and wake the user up.

[1352] Input: Alarm signal from the server

[1353] Output: Alarm sound

[1354] Specific behavior: The device plays an alarm sound.

[1355] Live streaming function processing steps

[1356] Step 1:

[1357] The user instructs the AI ​​character to start live streaming.

[1358] Input: User's voice command

[1359] Output: Audio data

[1360] Specific action: The user gives a command by voice.

[1361] Step 2:

[1362] The device converts the user's voice into text data using speech recognition software (e.g., Google Speech-to-Text).

[1363] Input: Audio data

[1364] Output: Text data

[1365] Specific operation: The device converts the voice data into text data.

[1366] Step 3:

[1367] The terminal transmits the converted text data to the server.

[1368] Input: Text data

[1369] Output: HTTP request to the server

[1370] Specific operation: The device sends text data to the server via an HTTP request.

[1371] Step 4:

[1372] The server analyzes the text data and prepares for live streaming.

[1373] Input: Text data

[1374] Output: Notification that live streaming is ready

[1375] What happens: The server uses natural language processing software (e.g., spaCy) to analyze the text data and determine live streaming instructions.

[1376] Step 5:

[1377] The server starts streaming using a streaming server (e.g. AWS MediaLive).

[1378] Input: Notification that live streaming is ready

[1379] Output: Start live streaming

[1380] Specific operation: The server calls the AWS MediaLive API to start live streaming.

[1381] Step 6:

[1382] The user watches the live broadcast of the AI ​​character through the device.

[1383] Input: Live streaming URL

[1384] Output: Live video and audio

[1385] Specific operation: The user watches the live broadcast through the application on their device.

[1386] Step 7:

[1387] When users enjoy live commerce, AI characters introduce products and users can purchase them.

[1388] Input: Product introduction during live streaming

[1389] Output: Product purchase completion notification

[1390] What happens: A user clicks on a link displayed during a live stream to purchase a product.

[1391] (Application example 3)

[1392] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1393] Conventional AI character systems have had difficulty fully understanding users' preferences and tendencies and providing personalized services. Furthermore, when AI characters trained by users engage in live streaming or live commerce, they lacked the functionality to recommend products based on the user's past conversation data or alarms to notify users of sales start times. This limited the user experience, reducing entertainment value and convenience.

[1394] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 3 is realized by the following means.

[1395] In this invention, the server includes: a means for creating a tangible AI by combining a user-customized character with an AI for generating thoughts and a system for generating voices; a means for purchasing personality and characteristics for a fee and cultivating an AI that can converse using past conversations and big data; a means for enjoying conversations with the AI ​​and conversations between AIs developed by other users; a means for providing an alarm function; a means for conducting live streaming and live commerce; a means for recommending products based on the user's past conversation data; and a means for providing an alarm function that notifies the user of the start time of a sale. This makes it possible to understand the user's preferences and tendencies and provide personalized services. Furthermore, it is possible to improve the entertainment value and convenience of the AI ​​character developed by the user when engaging in live streaming and live commerce.

[1396] A "user-customized character" is an artificial intelligence character whose appearance and personality are set by the user based on their own preferences and requests.

[1397] "Artificial intelligence for generating thoughts" refers to artificial intelligence that has algorithms and programs for generating appropriate responses and actions based on conversations and instructions with the user.

[1398] A "system for generating voice" is a technology or device that converts text data into voice data and responds to the user by voice.

[1399] "Purchasing personality and characteristics by paying" is a function that allows the user to customize the personality and characteristics of an AI character by paying an additional fee.

[1400] "Artificial intelligence that converses using past conversations and big data" is artificial intelligence that analyzes past conversation data with the user and large amounts of data, understands the user's preferences and tendencies, and then converses with them.

[1401] "Enjoying conversations with artificial intelligence or conversations between artificial intelligences developed by other users" means that a user enjoys interacting with their own artificial intelligence character or observing conversations between artificial intelligence characters developed by other users.

[1402] "Providing an alarm function" means a function that sounds an alarm by notification or voice at a time specified by the user.

[1403] "Live streaming and live commerce" refers to a function that allows artificial intelligence characters to stream videos in real time and introduce and sell products.

[1404] "Recommending products based on the user's past conversation data" is a function that analyzes the content of past conversations with the user and suggests appropriate products based on the user's interests and concerns.

[1405] "Providing an alarm function that notifies the user of the start time of a sale" refers to an alarm function that notifies the user of the start time of a specific sale or event.

[1406] A system for implementing this invention includes means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices, means for purchasing personality and characteristics for a fee and developing an AI that can converse using past conversations and big data, means for enjoying conversations with the AI ​​or conversations between AIs developed by other users, means for providing an alarm function, means for performing live streaming and live commerce, means for recommending products based on the user's past conversation data, and means for providing an alarm function that notifies the user of the start time of a sale.

[1407] System Program

[1408] The system is implemented using Python and includes functions to record user conversations and save them as JSON files, recommend products based on past conversation data, and provide alarms.

[1409] Hardware and Software

[1410] Hardware: Smartphones, smart glasses, head-mounted displays

[1411] Software: Python, JSON file (for data storage)

[1412] Data processing and calculation

[1413] Record user conversations: Record what the user says with a timestamp and save it in a JSON file.

[1414] Product recommendation: Analyzes past conversation data and recommends appropriate products based on the user's interests.

[1415] Alarm function: The alarm sounds with notifications or sounds at the time specified by the user.

[1416] Specific examples

[1417] If a user says, "I want a new smartphone," the AI ​​will recommend "Product A," "Product B," or "Product C" based on past conversation data. If the user says, "Wake me up at 7 a.m. tomorrow," an alarm will be set.

[1418] Prompt Sentence Examples

[1419] "When a user says, 'I want a new smartphone,' create a Python program that recommends products based on past conversation data. Also, add a function to set an alarm when the user says, 'Wake me up at 7am tomorrow morning.'"

[1420] In this way, it becomes possible to understand the preferences and tendencies of users and provide personalized services. It also makes it possible to improve the entertainment value and convenience of live streaming and live commerce using AI characters that users have developed.

[1421] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1422] Step 1:

[1423] Record user conversations

[1424] The server receives what the user says and records it with a timestamp. The input is what the user said, and the output is the conversation data with a timestamp. This data is saved in a JSON file. Specifically, if a user says, "I want a new smartphone," the server records that statement and the current date and time.

[1425] Step 2:

[1426] Save conversation data

[1427] The server saves the recorded conversation data in a JSON file. The input is the time-stamped conversation data generated in step 1, and the output is an updated JSON file. Specifically, it appends new conversation data to the existing JSON file.

[1428] Step 3:

[1429] Loading past conversation data

[1430] The server reads past conversation data from a saved JSON file. The input is a JSON file, and the output is a list of past conversation data. Specifically, it opens the JSON file and reads all conversation data into memory.

[1431] Step 4:

[1432] Recommend a product

[1433] The server analyzes past conversation data and recommends appropriate products based on the user's interests. The input is past conversation data, and the output is a list of recommended products. Specifically, if a user says, "I want a new smartphone," a list of related smartphone products is generated.

[1434] Step 5:

[1435] Set an alarm

[1436] The server sets up a notification or audio alarm at a time specified by the user. The input is the alarm time specified by the user, and the output is the configured alarm information. Specifically, if the user says, "Wake me up at 7am tomorrow morning," the alarm is set for that time.

[1437] Step 6:

[1438] Live streaming and live commerce

[1439] The server provides functions that allow an AI character to broadcast video in real time and introduce and sell products. The input is a command to start live streaming and product information, and the output is the live streaming video and sales information. Specifically, when the user says "start live streaming," the AI ​​character starts live streaming and introduces products.

[1440] Step 7:

[1441] Notify when the sale starts

[1442] The server provides an alarm function to notify users of the start time of a specific sale or event. The input is the start time of the sale or event, and the output is the notification information. Specifically, it sends a notification to the user when the start time of the sale approaches.

[1443] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1444] "Example 1"

[1445] One embodiment of the present invention is a system that combines an emotion engine that recognizes the user's emotions. In this system, the emotion engine recognizes the emotions expressed by the user during conversation with an AI character and adjusts the AI ​​character's response accordingly. For example, if the user expresses joy, the AI ​​character will also respond with joy. Conversely, if the user expresses sadness, the AI ​​character will respond with comfort.

[1446] "Example 2"

[1447] The emotion engine can also learn the user's emotions and evolve the AI ​​character's response to the user's emotions. Specifically, it records the AI ​​character's reaction when the user expresses a specific emotion and optimizes the AI ​​character's response based on that data. For example, if there is data showing that when a user expresses anger, the AI ​​character responds by apologizing, and the user's anger subsides, the AI ​​character will respond by apologizing in a similar situation.

[1448] "Example 3"

[1449] Furthermore, the emotion engine can predict changes in the user's emotions. This is done by predicting changes in the user's emotions based on past conversation data and the user's behavior patterns, and adjusting the AI ​​character's response based on that prediction. For example, if the AI ​​character predicts that the user is feeling stressed, it will respond in an encouraging way.

[1450] The processing flow of each embodiment will be described below.

[1451] "Example 1"

[1452] Step 1: The user initiates a conversation with an AI character.

[1453] Step 2: The user expresses an emotion, such as joy or sadness.

[1454] Step 3: The emotion engine recognizes the user's emotion.

[1455] Step 4: The AI ​​character adjusts its response based on the information from the emotion engine and responds appropriately to the user.

[1456] "Example 2"

[1457] Step 1: The user initiates a conversation with an AI character.

[1458] Step 2: The user expresses an emotion, such as anger or joy.

[1459] Step 3: The emotion engine recognizes the user's emotion and records the AI ​​character's response to that emotion.

[1460] Step 4: Optimize the AI ​​character's reactions based on the data recorded by the emotion engine.

[1461] "Example 3"

[1462] Step 1: The user initiates a conversation with an AI character.

[1463] Step 2: The emotion engine predicts changes in the user's emotions based on past conversation data and the user's behavioral patterns.

[1464] Step 3: The AI ​​character adjusts its response based on the prediction information from the emotion engine and responds appropriately to the user.

[1465] Example 1

[1466] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1467] Conventional AI systems make it difficult for users to freely customize the appearance of their characters, and lack the ability to recognize the user's emotions in real time and adjust their responses. This limits the user experience and makes it difficult to achieve more natural and personalized interactions. Furthermore, the AI's responses are fixed, and flexible responses based on the user's emotions are required.

[1468] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1469] In this invention, the server includes means for providing an interface for users to customize the appearance of a character, means for recognizing a user's emotions and adjusting the AI's response in accordance with those emotions, means for creating a tangible AI by combining an AI for generating thoughts with a system for generating voices, means for purchasing personalities and characteristics for a fee and developing an AI that can converse by utilizing past conversations and large-scale data, means for enjoying conversations with the AI ​​and conversations between AIs developed by other users, means for providing an alarm function, and means for enabling live streaming and live commerce. This allows users to freely customize the appearance of their characters, and by recognizing emotions and adjusting responses in real time, more natural and personalized interactions are possible.

[1470] "User" means an individual or group that utilizes the system to customize characters and interact with artificial intelligence.

[1471] A "character" is a virtual being with a user-customizable appearance, whose thoughts and voices are generated by artificial intelligence.

[1472] "Artificial intelligence" is a program or system that generates thoughts through conversation and interaction with users and evolves through self-learning.

[1473] "Interface" refers to the screens and controls that users use to customize their character's appearance.

[1474] "Emotion recognition" is a technology that analyzes a user's voice and facial expressions to identify their emotions.

[1475] "Adjusting responses" refers to the AI ​​taking appropriate responses or actions toward the user based on the results of emotion recognition.

[1476] "Charges" refers to fees paid by a user to purchase additional personalities or features.

[1477] "Big data" refers to large datasets containing past conversations and other information used to train artificial intelligence and generate responses.

[1478] The "alarm function" is a function for notifying the user of a specific time or event.

[1479] "Live streaming" is a function that distributes video and audio in real time over the Internet.

[1480] "Live commerce" is a method of selling products and services through live streaming.

[1481] The present invention relates to a system that allows users to customize the appearance of their characters and interact with artificial intelligence through emotion recognition. This system operates in cooperation with a server, a terminal, and a user.

[1482] Character appearance customization

[1483] The server provides an interface that allows users to customize their character's appearance. This interface is accessible through a web browser or a mobile application. Specifically, the server uses the following hardware and software:

[1484] Database: MySQL

[1485] Frontend: React.js

[1486] Backend: Node.js

[1487] Users can create their own original character by selecting options such as hair color, eye color, clothing, etc. For example, if a user sets the hair color to red, the eye color to blue, and the clothing to casual, the server will generate and save the character's appearance data based on this information.

[1488] Example prompt sentence:

[1489] "Set your character's hair color to red, eyes to blue, and clothing to casual."

[1490] Emotion recognition function using emotion engine

[1491] The device is equipped with an emotion engine that recognizes the user's emotions. This emotion engine recognizes the emotions expressed by the user during conversation with the AI ​​character in real time and adjusts the AI ​​character's response accordingly. Specifically, the device uses the following hardware and software:

[1492] Microphone and camera: to capture the user's voice and facial expressions

[1493] Emotion Recognition Software: Microsoft Azure Cognitive Services

[1494] When a user expresses joy, the emotion engine recognizes the emotion and sends it to the server as "joy." The server then configures the AI ​​character to respond with a smile, saying, "Seeing you happy makes me happy too."

[1495] Example prompt sentence:

[1496] "When the user expresses joy, the AI ​​character should respond with a smile, saying, 'Seeing you happy makes me happy too.'"

[1497] Other Features

[1498] The system also provides the following additional features:

[1499] Billing features: A way for users to purchase additional personalities or features

[1500] Alarm function: A means of notifying the user of a specific time or event.

[1501] Live streaming and live commerce functions: A means of selling products and services by streaming video and audio in real time.

[1502] This allows users to freely customize the appearance of their characters, and by recognizing emotions and adjusting responses in real time, it enables more natural and personalized interactions. It also allows for payment and live streaming functions to further enrich the user experience.

[1503] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1504] Step 1:

[1505] A user accesses the character customization screen through a web browser or mobile application.

[1506] Input: User's access request

[1507] Output: Character customization screen display

[1508] Specific operation: The user launches the application and enters a URL to access the character customization screen.

[1509] Step 2:

[1510] The server retrieves the character's part information from the database.

[1511] Input: Database query

[1512] Output: Character part information (hair color, eye color, clothing, etc.)

[1513] Specific operation: The server sends a query to the MySQL database to obtain character part information.

[1514] Step 3:

[1515] Based on the information obtained by the server, customization options are displayed on the device.

[1516] Input: Character part information

[1517] Output: Show customization options

[1518] Specific operation: The server uses React.js to generate customization options based on the acquired part information and send them to the device.

[1519] Step 4:

[1520] The user selects a customization option.

[1521] Input: User's choice

[1522] Output: Selected customization options

[1523] What happens: The user selects an option, such as hair color, eye color, or clothing.

[1524] Step 5:

[1525] The terminal sends the selected option to the server.

[1526] Input: Selected customization options

[1527] Output: Send data to the server

[1528] Specific operation: The device sends the selected options in JSON format to the server.

[1529] Step 6:

[1530] The server generates the character's appearance data based on the selected options and stores it in a database.

[1531] Input: Selected customization options

[1532] Output: Generate and save character appearance data

[1533] Specific operation: The server uses Node.js to generate character appearance data based on the selected options and saves it in a MySQL database.

[1534] Step 7:

[1535] The server displays the appearance of the generated character on the terminal.

[1536] Input: Character appearance data

[1537] Output: Display of character appearance

[1538] Specific operation: The server sends the appearance data of the generated character to the terminal, and the terminal displays it to the user.

[1539] Step 8:

[1540] Enables the microphone and camera for users to start a conversation with an AI character.

[1541] Input: User actions

[1542] Output: Enable microphone and camera

[1543] What happens: The user changes the settings within the application to enable the microphone and camera.

[1544] Step 9:

[1545] The device uses a microphone and camera to capture the user's voice and facial expressions in real time.

[1546] Input: User's voice and facial expressions

[1547] Output: Captured voice and facial expression data

[1548] What it does: The device uses its microphone and camera to capture the user's voice and facial expressions.

[1549] Step 10:

[1550] The device captures voice and facial expression data and sends it to emotion recognition software.

[1551] Input: Captured voice and facial expression data

[1552] Output: Sending data to emotion recognition software

[1553] Specific operation: The device sends captured data to Microsoft Azure Cognitive Services.

[1554] Step 11:

[1555] Emotion recognition software analyzes the user's emotions from their tone of voice and facial expressions, generating emotional labels such as "joy," "sadness," and "anger."

[1556] Input: Captured voice and facial expression data

[1557] Output: Emotion label

[1558] How it works: Emotion recognition software analyzes voice tone and facial expressions to generate emotion labels.

[1559] Step 12:

[1560] The device sends the analysis results to the server.

[1561] Input: Emotion label

[1562] Output: Send data to the server

[1563] Specific operation: The device sends the analysis results in JSON format to the server.

[1564] Step 13:

[1565] Based on the analysis results, the server executes a script to generate a response from the AI ​​character.

[1566] Input: Emotion label

[1567] Output: AI character's reaction

[1568] Specific operation: Based on the analysis results, the server executes a script to make the AI ​​character react appropriately.

[1569] Step 14:

[1570] The server sends the generated response to the terminal.

[1571] Input: AI character's reaction

[1572] Output: Sending data to the terminal

[1573] Specific operation: The server sends the generated response to the terminal.

[1574] Step 15:

[1575] The device displays the AI ​​character's response to the user and plays it back as audio.

[1576] Input: AI character's reaction

[1577] Output: what is displayed to the user and what is played as audio

[1578] Specific operation: The device displays the AI ​​character's response on the screen and plays it back as audio.

[1579] (Application example 1)

[1580] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1581] Conventional virtual shopping experiences have been limited to providing users with one-way information, making it difficult to provide personalized services that reflect the emotions and preferences of individual users. Furthermore, there are limited means of providing interactive experiences using characters customized by users. This makes it difficult to increase user satisfaction and motivation to purchase.

[1582] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means. In this invention, the server includes: a means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; a means for purchasing personality and characteristics for a fee and training an AI to converse using past conversations and big data; a means for enjoying conversations with the AI ​​and conversations between AIs trained by other users; a means for providing an alarm function; a means for performing live streaming and live commerce; a means for recognizing the user's emotions and adjusting the AI ​​character's responses according to those emotions; and a means for functioning as a shopping assistant in a virtual store. This makes it possible to provide a personalized shopping experience tailored to the user's emotions and preferences.

[1583] A "user-customized character" is a character whose appearance has been customized by the user by freely selecting hair color, eye color, clothing, etc.

[1584] "AI for generating thoughts" is an artificial intelligence in which a character thinks autonomously and generates responses based on user input and past data.

[1585] A "system for generating voice" is a system that converts text data into voice and makes it appear as if a character is speaking.

[1586] "AI with Form" is an artificial intelligence that allows users to customize characters with thoughts and voices, giving them a visual presence.

[1587] "Purchase personality and characteristics by paying" refers to a system in which a user can customize a character's personality and characteristics by paying an additional fee.

[1588] "AI that uses past conversations and big data to converse" is artificial intelligence that generates more natural and appropriate responses based on past conversation history with the user and large amounts of data.

[1589] "Means for developing AI" refers to methods or systems that allow users to develop the character's personality and abilities.

[1590] "Means for enjoying conversations with AIs and conversations between AIs developed by other users" refers to a method by which a user can have a conversation with their own character or observe conversations between characters developed by other users.

[1591] The "means for providing an alarm function" is a function in which a character provides a notification or alarm to a user at a specific time.

[1592] "Means for live streaming and live commerce" refers to methods that allow characters to stream in real time or introduce and sell products.

[1593] "Means for recognizing the user's emotions and adjusting the AI ​​character's response in accordance with those emotions" refers to a system that analyzes the user's facial expressions and tone of voice to recognize their emotions, and changes the character's response based on the results.

[1594] "Means for functioning as a shopping assistant in a virtual store" refers to a method by which a character supports a user's shopping in a virtual store and suggests and explains products.

[1595] The embodiments of the present invention will be described in detail below.

[1596] System configuration

[1597] This system includes a means for creating a tangible AI by combining an AI for generating thoughts for a character customized by the user with a system for generating voice, a means for purchasing personality and characteristics by paying a fee and for developing an AI that can converse by utilizing past conversations and big data, a means for enjoying conversations with the AI ​​or conversations between AIs developed by other users, a means for providing an alarm function, a means for performing live streaming and live commerce, a means for recognizing the user's emotions and adjusting the AI ​​character's responses in accordance with those emotions, and a means for functioning as a shopping assistant within a virtual store.

[1598] Hardware and software used

[1599] Hardware: Smartphone (iOS / Android), head-mounted display (Oculus Quest 2, etc.)

[1600] Software: Unity (game engine), OpenCV (emotion recognition library), TensorFlow (emotion recognition model), RESTful API (backend communication)

[1601] Data processing and calculation

[1602] Character Customization

[1603] The user launches the application and selects the character's hair color, eye color, clothing, etc. Unity is used to change the character's appearance in real time.

[1604] emotion recognition

[1605] It captures the user's face using a smartphone or head-mounted display camera, recognizes emotions from the captured facial image using OpenCV and TensorFlow, processes the recognized emotion data in real time, and sends it to the backend through a RESTful API.

[1606] Character Reactions

[1607] The AI ​​character's reaction is determined based on the emotional data received on the backend. The character's facial expressions and movements are changed within Unity, providing feedback to the user.

[1608] Specific examples

[1609] When a user is searching for clothes in a virtual store, an AI character suggests, "How about this dress?" If the user smiles, the character responds, "I'm glad you like it!" Conversely, if the user looks confused, the character suggests, "Shall we take a look at other styles?"

[1610] Prompt Sentence Examples

[1611] If the user smiles:

[1612] "Generate a scenario where an AI character reacts with joy when the user smiles."

[1613] If the user looks confused:

[1614] "Generate a scenario in which an AI character responds in a comforting way when the user makes a troubled expression."

[1615] In this way, it is possible to provide a personalized shopping experience that is tailored to the user's emotions and preferences.

[1616] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1617] Step 1:

[1618] The user launches the application and accesses the character customization screen. The user selects hair color, eye color, clothing, etc. to customize the character. The input is the user's selection data, and the output is the customized character's appearance data. The device uses Unity to change the character's appearance in real time.

[1619] Step 2:

[1620] The device's camera is used to capture the user's face. The input is a facial image acquired from the camera, and the output is facial image data. The device uses OpenCV to analyze the facial image and perform preprocessing for emotion recognition.

[1621] Step 3:

[1622] The device uses TensorFlow to recognize the user's emotions from preprocessed facial image data. The input is the preprocessed facial image data, and the output is the recognized emotion data. The emotion data is processed in real time and sent to the server through a RESTful API.

[1623] Step 4:

[1624] The server determines the AI ​​character's response based on the received emotional data. The input is emotional data, and the output is the character's response data. The server uses a generative AI model to create a prompt sentence to generate an appropriate response.

[1625] Step 5:

[1626] The server generates the AI ​​character's response based on the generated prompt. The input is the prompt, and the output is the character's response data. The generated response data is sent to the device via a RESTful API.

[1627] Step 6:

[1628] The device changes the character's facial expressions and movements in Unity based on the reaction data it receives. The input is the reaction data, and the output is the changed character's facial expressions and movements. The device provides feedback to the user, creating an interactive experience.

[1629] Step 7:

[1630] When a user shops in a virtual store, an AI character acts as a shopping assistant. The input is the user's behavioral and emotional data, and the output is the character's suggestions and explanations. The terminal displays the character's suggestions and explanations in real time to support the user's shopping experience.

[1631] Example 2

[1632] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1633] Conventional AI character systems have had the problem that it is difficult for users to freely customize the character's personality and characteristics, and that they are unable to respond appropriately to the user's emotions. Furthermore, it has been difficult to provide multifunctional services such as dialogue between characters developed by users, live streaming, and live commerce.

[1634] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1635] In this invention, the server includes: means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; means for purchasing personality and characteristics for a fee and cultivating an AI that can converse using past conversations and large-scale data; means for enjoying conversations with the AI ​​and conversations between AIs developed by other users; means for providing an alarm function; means for live streaming and live commerce; and means for learning the user's emotions and evolving the AI ​​character's response to the user's emotions. This allows users to freely customize the character's personality and characteristics, enabling it to respond appropriately to the user's emotions. Furthermore, multifunctional services can be provided, such as dialogue between characters developed by users, live streaming, and live commerce.

[1636] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence and learn, reason, and self-correct.

[1637] A "system for generating voice" is a technology that converts text data into voice data and outputs the voice to the user.

[1638] "Personality and characteristics" refers to the individuality and characteristics that influence the character's actions and speech, and are elements that can be customized by the user.

[1639] "Big data" refers to large datasets containing past conversations and other relevant information that are used for training and analysis of artificial intelligence.

[1640] "Emotional learning" is the process of collecting and analyzing user emotional data and optimizing the AI's response based on that data.

[1641] The "alarm function" is a function that notifies or warns the user based on specific times or conditions.

[1642] "Live streaming" is a technology that distributes audio and video in real time over the Internet.

[1643] "Live commerce" is a method of selling products and services through live streaming.

[1644] "Acting based on user instructions" means that the artificial intelligence performs a specific action in response to input or commands from the user.

[1645] "Evolving through self-learning" refers to the process by which artificial intelligence learns based on its own experience and data, improving its performance and functionality.

[1646] MODE FOR CARRYING OUT THE INVENTION

[1647] This invention is a system that creates a tangible AI by combining a user-customized character with an AI for generating thoughts and a system for generating voices. Specific embodiments of this system are described below.

[1648] System configuration

[1649] The server manages a database for adding personalities and features to characters customized by users. Specifically, it uses a database management system such as MySQL to associate and store information on user IDs and purchased personalities and features.

[1650] The terminal provides an interface for the user to select and purchase the character's personality and characteristics. The personality and characteristics selected by the user are transmitted from the terminal to the server, which stores the information in a database.

[1651] Data processing and calculation

[1652] The server processes data to generate character actions and speech based on the personality and characteristics information purchased by the user. Specifically, it uses a generative AI model to generate text data based on the personality and characteristics selected by the user. This text data is then converted into voice data using a system for generating voice (e.g., a voice synthesis engine).

[1653] The emotion engine collects user emotional data and analyzes it using machine learning libraries such as TensorFlow. This allows it to calculate the data and show an appropriate response based on the user's emotions. For example, it collects data when the user expresses anger and uses that data to evolve the AI ​​character's response.

[1654] Specific examples

[1655] Let's say a user purchases a "gentle personality." The user selects "gentle personality" on the device screen and completes the purchase procedure using a credit card. The server saves the user ID and "gentle personality" information in a MySQL database. The device retrieves the "gentle personality" information from the server and reflects it in the character's actions and speech. For example, the character may start to "speak slowly."

[1656] Prompt Sentence Examples

[1657] An example prompt might look like this:

[1658] If a user purchases a "gentle personality," explain how this will be reflected in the character's actions and words.

[1659] In this way, users can freely customize the character's personality and characteristics, allowing it to respond appropriately to the user's emotions. It also enables multifunctional services such as dialogue between characters developed by users, live streaming, and live commerce.

[1660] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1661] Step 1:

[1662] The user selects the character's personality and characteristics.

[1663] The user selects the personality and characteristics they want to add to their character through the device interface. As input, the information on the personality and characteristics selected by the user is sent to the device. As output, the information on the selected personality and characteristics is saved on the device. As a specific action, the user selects a "gentle personality."

[1664] Step 2:

[1665] Buy the personality or characteristics that the user selects.

[1666] The user uses the terminal to carry out the billing procedure to purchase the selected personality and characteristics. As input, the user's payment information and information on the selected personality and characteristics are sent to the terminal. As output, information indicating that the purchase has been completed is displayed on the terminal. In concrete terms, the user uses a credit card to purchase the "gentle personality."

[1667] Step 3:

[1668] The server stores the purchase information in a database.

[1669] The server saves the information about the personality and characteristics purchased by the user in a database. As input, the user ID and the information about the personality and characteristics purchased are sent to the server. As output, the saved information is recorded in the database. Specifically, the server saves the information about the "gentle personality" in the MySQL database.

[1670] Step 4:

[1671] The terminal obtains the purchase information from the server.

[1672] The device obtains information about the personality and characteristics purchased by the user from the server. As input, the user ID is sent from the device to the server. As output, the information about the purchased personality and characteristics is sent to the device. In concrete terms, the device obtains information about the "easy-going personality" from the server.

[1673] Step 5:

[1674] The device reflects the character's personality and characteristics.

[1675] The device reflects the acquired personality and characteristic information in the character's actions and speech. The purchased personality and characteristic information is sent to the device as input. The character's actions and speech are changed as output. A specific example of this behavior is that the character will "speak slowly."

[1676] Step 6:

[1677] The user interacts with the character.

[1678] The user interacts with the character through the terminal. As input, the user's statements and questions are sent to the terminal. As output, the character's response is displayed on the terminal. In concrete terms, when the user asks the character, "How was your day?", the character replies, "I had a relaxing time today."

[1679] Step 7:

[1680] The emotion engine learns the user's emotions and optimizes the character's reactions.

[1681] The emotion engine collects and analyzes the user's emotion data. As input, the user's emotion data is sent to the emotion engine. As output, an optimized character's reaction is generated. Specifically, if the user expresses sadness, the emotion engine collects that data and optimizes the character's reaction so that the next time in a similar situation, the character will respond with a comforting "It's okay, it'll get better."

[1682] (Application example 2)

[1683] Next, a description will be given of Application Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1684] Conventional AI characters have difficulty responding to users' emotions in real time, or making appropriate comments or taking appropriate actions in response to the content being viewed. Furthermore, there was a lack of systems that allowed users to freely customize the character's personality and characteristics to provide a personalized experience. This led to problems such as a decline in user satisfaction and engagement.

[1685] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1686] In this invention, the server includes means for creating a tangible AI by combining a character customized by the user with an AI for generating thoughts and a system for generating voices, means for purchasing personality and characteristics for a fee and developing an AI that can converse by utilizing past conversations and large-scale data, means for enjoying conversations with the AI ​​and conversations between AIs developed by other users, means for providing an alarm function, means for live streaming and live commerce, means for analyzing user emotions and generating responses in real time, and means for the AI ​​character to comment on or take action in response to content being viewed, thereby enabling users to enjoy real-time interaction with their individually customized AI character.

[1687] "Artificial intelligence" is the technology that enables computer systems to mimic human intelligence and learn, reason, and self-correct.

[1688] A "system for generating voice" is a technology that converts text data into voice data and outputs the voice to the user.

[1689] "Artificial intelligence with form" refers to artificial intelligence that is displayed visually as a character, and is a means for interacting with users.

[1690] "Purchasing personality and characteristics by paying" is a function that allows the user to customize the personality and characteristics of an AI character by paying money.

[1691] "Artificial intelligence that converses by utilizing past conversations and large-scale data" refers to artificial intelligence that can conduct more natural and appropriate conversations based on the past dialogue history with the user and large amounts of data.

[1692] "Enjoying a conversation with an AI" refers to the act of a user having a conversation with an AI character and enjoying that conversation.

[1693] "Enjoying a conversation between AI characters trained by other users" refers to the act of enjoying watching AI characters trained by different users converse with each other.

[1694] "Providing an alarm function" means a function that notifies the user based on specified times or conditions.

[1695] "Live streaming and live commerce" refers to the ability to stream video and audio in real time and sell products and services.

[1696] "Analyzing the user's emotions and generating responses in real time" is a function that analyzes the user's emotions from their facial expressions and voice, and the AI ​​character instantly responds appropriately based on the results.

[1697] "An AI character makes comments or takes action in response to the content being viewed" is a function in which an AI character makes comments or takes action in real time in response to the video or audio content being viewed by the user.

[1698] A system for implementing this invention includes means for creating a tangible artificial intelligence by combining a character customized by a user with an artificial intelligence for generating thoughts and a system for generating voices, means for purchasing personality and characteristics for a fee and developing an artificial intelligence that can converse using past conversations and large-scale data, means for enjoying conversations with the artificial intelligence or conversations between artificial intelligences developed by other users, means for providing an alarm function, means for live streaming and live commerce, means for analyzing the user's emotions and generating responses in real time, and means for the artificial intelligence character to comment on or take action in response to content being viewed.

[1699] System Program

[1700] The program for this system is realized using the following hardware and software.

[1701] Hardware used

[1702] Smartphone or head-mounted display

[1703] Camera (built-in or external)

[1704] Software used

[1705] Python

[1706] OpenCV (for face detection)

[1707] dlib (for face detection)

[1708] transformers (for emotion analysis)

[1709] Processing Description

[1710] User sentiment analysis

[1711] The server captures the user's face in real time through a camera and detects it using OpenCV and dlib. The detected face image data is input to an emotion analysis model in the transformers library to analyze the user's emotions.

[1712] Character reaction generation

[1713] The server then generates a reaction based on the analyzed user's emotional data, according to the character's personality and characteristics. For example, if the user smiles and the character has a "gentle personality," it will respond with a gentle smile.

[1714] Collaboration with content

[1715] The server allows an AI character to make comments and perform actions in real time in response to the content the user is watching, such as shedding tears during a moving scene in a movie.

[1716] Specific examples

[1717] If the user smiles while watching a movie, and the character has a "gentle personality," the character will respond with a gentle smile.

[1718] If the user sheds tears at a sad scene, and the character has a "cheerful personality," the character will make an encouraging comment.

[1719] Prompt Sentence Examples

[1720] When the user smiles, the character responds with a gentle smile, showing its "gentle personality."

[1721] If the user sheds tears at a sad scene, the character will make encouraging comments with a "cheerful personality."

[1722] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1723] Step 1:

[1724] The server captures the user's face in real time through a camera, the input is the video data from the camera, and the output is the captured image frame, which is used for the subsequent face detection process.

[1725] Step 2:

[1726] The server detects the user's face from the captured image frame using OpenCV and dlib. The input is the image frame obtained in step 1, and the output is the region information of the detected face. Specifically, the position and size of the face are identified.

[1727] Step 3:

[1728] The server extracts the detected face region and inputs it into the emotion analysis model of the transformers library. The input is the face image data, and the output is the user's emotion label (e.g., joy, sadness, anger, etc.). The emotion analysis model estimates emotions from facial expressions.

[1729] Step 4:

[1730] The server generates a reaction based on the analyzed user's emotion data, according to the character's personality and characteristics. The input is the user's emotion label and the character's personality and characteristics data, and the output is the character's reaction (e.g., comment, action). Specifically, a reaction corresponding to the emotion label is selected.

[1731] Step 5:

[1732] The server allows an AI character to make comments and take actions in real time in response to the content the user is viewing. The input is information about the content being viewed and the character's reaction data, and the output is the character's comments and actions displayed on the content. Specifically, the character reacts to the content at the appropriate time.

[1733] Step 6:

[1734] The user can watch the reactions of the generated character and enjoy the interaction. The input is the character's reaction data sent from the server, and the output is the user's experience. Specifically, the user can enjoy watching the character's reactions.

[1735] Example 3

[1736] Next, a description will be given of Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1737] Conventional AI systems have not yet fully developed the ability to record conversations with users and learn from them, making it difficult to gain a deep understanding of users' preferences and tendencies. Furthermore, few systems were able to predict changes in users' emotions and provide appropriate responses accordingly. Furthermore, there was a lack of entertainment systems that integrated live streaming and live commerce functions. To solve these issues, a system was needed that could record and store conversations with users, use the AI ​​to learn from them, and predict changes in users' emotions and respond appropriately.

[1738] The specific processing by the specific processing unit 290 of the data processing device 12 in the third embodiment is realized by the following means.

[1739] In this invention, the server includes means for recording conversations between a user and an AI and storing them as large-scale data, means for the AI ​​to learn using the stored conversation data and understand the user's preferences and tendencies, and means for analyzing past conversation data and the user's behavioral patterns, predicting changes in the user's emotions, and adjusting the AI's response based on the predictions. This enables the AI ​​to learn based on conversations with the user, understand changes in the user's preferences and emotions, and respond appropriately.

[1740] "User" refers to any individual or entity that uses the System.

[1741] A "custom character" refers to a virtual being whose appearance, personality, etc. can be freely set and changed by the user.

[1742] "Artificial intelligence" refers to the technology that enables computer systems to think and learn by imitating human intelligence.

[1743] "System for generating voice" refers to technology that converts text data into voice data.

[1744] "Large-scale data" refers to a large amount of data set, and particularly includes conversation data with users.

[1745] "Charge" refers to the fee paid by a user to use a particular service or feature.

[1746] "Personality and characteristics" refers to the elements that determine the behavior and reactions of your customized character.

[1747] "Means for raising" refers to methods and techniques for raising a user's customized character.

[1748] The "alarm function" refers to a function that notifies the user at a specified time by notification or voice.

[1749] "Live streaming" refers to the technology of delivering video and audio in real time over the Internet.

[1750] "Live commerce" refers to the method of introducing and selling products through live streaming.

[1751] "Means for recording conversations" refers to technology that saves the content of conversations between users and artificial intelligence.

[1752] "Means of learning" refers to how AI acquires new knowledge and skills based on accumulated data.

[1753] "Means for predicting changes in emotions" refers to technology that analyzes past data to predict the emotional changes of users.

[1754] "Means for adjusting responses" refers to methods for modifying the AI's responses based on predicted emotions.

[1755] MODE FOR CARRYING OUT THE INVENTION

[1756] This invention is a system for creating tangible AI by combining AI with a character customized by a user and using a system for generating voice. Specific embodiments of this system will be described below.

[1757] System configuration

[1758] 1. User operations

[1759] Users can ask questions and give instructions to their customized characters through their devices, such as "What's the weather like today?" or "Wake me up at 7 a.m."

[1760] 2. Speech-to-text

[1761] The device uses speech recognition technology to convert the user's speech into text, specifically, by using the Google Cloud Speech-to-Text API.

[1762] 3. Recording and storing conversations

[1763] The server receives the converted text data and records the conversation. This recorded data is stored as a large-scale database using AWS's RDS (Relational Database Service).

[1764] 4. AI Learning

[1765] The server uses the accumulated conversation data to train the AI, using Google Cloud's AutoML to train machine learning models to understand user preferences and trends.

[1766] 5. Alarm function

[1767] When a user issues a command such as "Wake me up at 7am tomorrow morning," the device parses the command and uses Android's AlarmManager API to set an alarm for the specified time.

[1768] 6. Live streaming and live commerce

[1769] Users can watch live streams of AI characters through the app, and the server uses the YouTube Live API to stream the content.

[1770] 7. Emotional prediction and response regulation

[1771] The server analyzes past conversation data and user behavior patterns, and uses IBM Watson's Natural Language Understanding to predict changes in the user's emotions. Based on this prediction, the AI ​​character's responses are adjusted.

[1772] Specific examples

[1773] Conversation recording: When a user says "What's the weather today?", the device converts the speech into text and sends the text to the server, which stores the text "What's the weather today?" in a database.

[1774] Set alarm: When a user says, "Wake me up at 7am tomorrow morning," the device parses the instruction and uses the AlarmManager API to set an alarm for the specified time.

[1775] Live streaming: When a user opens the app, the server calls the YouTube Live API to get the live streaming URL and sends it to the device, which then uses the URL to display the live streaming.

[1776] Emotion prediction: The server uses IBM Watson's Natural Language Understanding to analyze conversation data and predict when the user is feeling stressed. Based on this, the AI ​​character generates an encouraging message, such as "Are you OK? Is there anything I can help you with?" and sends it to the device.

[1777] Prompt Sentence Examples

[1778] "Please explain what happens when a user instructs an AI character to "wake me up at 7am tomorrow morning.""

[1779] "Please explain the specific steps that an AI character takes to live stream."

[1780] The above is a specific embodiment for carrying out the present invention. The flow of the identification process in the third embodiment will be described with reference to FIG.

[1781] Step 1:

[1782] User voice input

[1783] The user issues questions or commands by voice into the terminal.

[1784] Input: User's voice data

[1785] Output: Audio data is input to the device

[1786] What happens: The user says, "What's the weather like today?"

[1787] Step 2:

[1788] Speech-to-text

[1789] The device uses speech recognition technology to convert the user's speech into text, specifically, by using the Google Cloud Speech-to-Text API.

[1790] Input: User's voice data

[1791] Output: Text data

[1792] What it does: Your device converts the speech "What's the weather like today?" into text.

[1793] Step 3:

[1794] Record and send conversations

[1795] The terminal transmits the converted text data to the server.

[1796] The server records the received text data.

[1797] Input: Text data

[1798] Output: Text data is sent to the server and recorded.

[1799] Specific operation: The device sends the text "What's the weather today?" to the server, which stores it in a database.

[1800] Step 4:

[1801] Data accumulation

[1802] The server stores the recorded text data in AWS's RDS (Relational Database Service).

[1803] Input: Text data

[1804] Output: Text data stored in a database

[1805] What happens: The server executes an SQL query to insert the text "What's the weather like today?" into the database.

[1806] Step 5:

[1807] Artificial Intelligence Learning

[1808] The server uses the accumulated conversation data to train the AI, using Google Cloud's AutoML to train the machine learning model.

[1809] Input: Accumulated conversation data

[1810] Output: A trained machine learning model

[1811] What it does: The server periodically extracts conversation data from the database and trains the machine learning model.

[1812] Step 6:

[1813] Alarm settings

[1814] The user instructs the AI ​​character to "wake me up at 7:00 tomorrow morning."

[1815] The device parses the instruction and uses Android's AlarmManager API to set an alarm at the specified time.

[1816] Input: User instruction text

[1817] Output: Set alarm

[1818] What it does: When a user says, "Wake me up at 7am tomorrow morning," the device parses the instruction and sets an alarm using the AlarmManager API.

[1819] Step 7:

[1820] Live streaming and live commerce

[1821] Users can watch live broadcasts of AI characters through the app.

[1822] The server uses the YouTube Live API for live streaming.

[1823] Input: Live stream request

[1824] Output: Live stream URL

[1825] What it does: When a user opens the app, the server calls the YouTube Live API to get the live streaming URL and sends it to the device, which then uses the URL to view the live streaming.

[1826] Step 8:

[1827] Emotional prediction and response regulation

[1828] The server analyzes past conversation data and user behavior patterns and uses IBM Watson's Natural Language Understanding to predict changes in the user's emotions.

[1829] The AI ​​character adjusts its response based on that prediction.

[1830] Input: Past conversation data, behavioral patterns

[1831] Output: Coordinated response

[1832] How it works: The server analyzes the conversation data and predicts that the user is feeling stressed. Based on this, the AI ​​character generates an encouraging message, such as "Are you OK? Is there anything I can help you with?" and sends it to the device.

[1833] (Application example 3)

[1834] Next, a description will be given of Application Example 3 of Form Example 3. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1835] Conventional AI character systems have had difficulty fully understanding users' preferences and tendencies and providing personalized experiences. They also lacked the ability to respond to changes in users' emotions, making it difficult to increase user satisfaction. Furthermore, their live streaming and live commerce functions were limited, making it difficult to provide new forms of entertainment.

[1836] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means. In this invention, the server includes: a means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; a means for purchasing personality and characteristics for a fee and cultivating an AI that can converse using past conversations and big data; a means for enjoying conversations with the AI ​​and conversations between AIs developed by other users; a means for providing an alarm function; a means for performing live streaming and live commerce; a means for predicting changes in the user's emotions and providing appropriate responses; and a means for delivering personalized content. This makes it possible to provide a personalized experience tailored to the user's preferences and tendencies and respond to changes in the user's emotions. Furthermore, live streaming and live commerce can provide a new form of entertainment.

[1837] "User" refers to any individual or legal entity that uses the System.

[1838] "Custom" refers to settings and changes that the user makes to suit their own preferences.

[1839] "Character" refers to a virtual being with an artificial intelligence appearance and personality customized by the user.

[1840] "Artificial intelligence for generating thoughts" refers to algorithms and programs that generate appropriate responses and actions based on conversations and instructions with users.

[1841] "System for generating speech" refers to technology or devices for converting text data into speech data.

[1842] "Artificial intelligence" refers to artificial intelligence that has a visual appearance and can interact with users.

[1843] "Charge" refers to the fee paid by a user to use a particular function or service.

[1844] "Personality and characteristics" refers to the settings and attributes that influence the behavior and responses of an AI character.

[1845] "Past conversations and big data" refers to past interaction history with users and large datasets.

[1846] "Development" refers to the growth and evolution of an AI character through interaction and experience with the user.

[1847] The "alarm function" refers to a function that notifies or warns the user at a specified time.

[1848] "Live streaming" refers to the distribution of video and audio in real time over the Internet.

[1849] "Live commerce" refers to the introduction and sale of products and services through live streaming.

[1850] "Means for predicting changes in emotions" refers to algorithms or programs for predicting changes in a user's emotions based on the user's past behavior and conversation data.

[1851] "Means for showing an appropriate reaction" refers to a function that enables the AI ​​character to respond or act appropriately in response to the predicted user's emotions.

[1852] "Personalized content" refers to information and entertainment that is customized to a user's preferences and tendencies.

[1853] A system for implementing this invention includes a means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices. The user can customize the character's appearance and personality using a terminal such as a smartphone or computer.

[1854] The server provides a means for users to purchase personality and characteristics for a fee and develop a conversational AI using past conversations and big data. Users can pay a fee to use specific functions and services and change the personality and characteristics of the AI ​​character. This allows users to develop their own personalized character.

[1855] The server also provides a means for users to enjoy conversations with AIs and conversations between AIs developed by other users. Users can receive entertainment and information by interacting with AI characters. Furthermore, users can also observe conversations between AI characters developed by other users.

[1856] The server includes means for providing an alarm function, whereby a user can set an alarm for an AI character at a specific time, and the AI ​​character will wake the user up at the specified time.

[1857] Furthermore, the server provides a means for live streaming and live commerce. Users can watch their AI characters live stream and enjoy live commerce where AI characters introduce products. This provides a new form of entertainment.

[1858] The server includes a means for predicting changes in the user's emotions and showing an appropriate response. Based on past conversation data and the user's behavior patterns, the AI ​​character predicts changes in the user's emotions and shows an appropriate response based on the prediction. For example, if it is predicted that the user is feeling stressed, the AI ​​character will show a response that encourages the user.

[1859] Finally, the server provides a means for delivering personalized content, tailored to the user's preferences and tendencies based on the user's past conversation data, allowing the user to receive information and entertainment tailored to their needs.

[1860] For example, if a user requests, "Wake me up at 7:00 tomorrow morning," the AI ​​character will sound the alarm at the specified time. Furthermore, if the AI ​​character predicts that the user is feeling stressed, it will encourage them by asking, "Are you okay? Is there anything I can help you with?"

[1861] Examples of prompts for generative AI models include:

[1862] Create an AI character that learns user preferences and trends based on past conversation data and delivers personalized content. Also, provide alarm, live streaming, and live commerce functions, and use an emotion engine to predict changes in user emotions and provide appropriate responses.

[1863] The flow of the specific processing in Application Example 3 will be described with reference to FIG.

[1864] Step 1:

[1865] The user customizes the character using the terminal. The user sets the character's appearance and personality through the terminal interface. The input is the user's selected appearance and personality data, and the output is the customized character data.

[1866] Step 2:

[1867] The server combines artificial intelligence for generating thoughts for a customized character with a system for generating voice. The input is data for the customized character, and the output is data for a character with thoughts and voice. The server generates the character's thoughts using a generative AI model and generates voice using a voice synthesis system.

[1868] Step 3:

[1869] The user pays using a terminal and purchases a character's personality and characteristics. The input is the user's billing information and the purchased personality and characteristics data, and the output is updated character data. The server processes the user's payment through the billing system and updates the character data.

[1870] Step 4:

[1871] The server uses past conversations and big data to develop the character. The input is past conversation data and big data, and the output is learned character data. The server uses machine learning algorithms to improve the character's conversational ability.

[1872] Step 5:

[1873] The user converses with the character using a terminal. The input is the user's utterance data, and the output is the character's response data. The server uses a generative AI model to generate an appropriate response to the user's utterance, and generates the voice using a speech synthesis system.

[1874] Step 6:

[1875] The server provides a means for users to enjoy conversations between characters that other users have raised. The input is character data of other users, and the output is generated conversation data between the characters. The server integrates the data of multiple characters and performs a conversation simulation.

[1876] Step 7:

[1877] The user sets an alarm using a terminal. The input is the alarm time data specified by the user, and the set alarm data is generated as the output. The server triggers the alarm at the specified time, and a character wakes the user up.

[1878] Step 8:

[1879] The server provides the means for live streaming and live commerce. The inputs are instructions to start live streaming and product data, and the output is live streaming data and live commerce data. The server uses a live streaming system to deliver video and audio in real time and introduce products.

[1880] Step 9:

[1881] The server predicts changes in the user's emotions and displays an appropriate response. The inputs are past conversation data and user behavior pattern data, and the output is emotion prediction data and appropriate response data. The server predicts the user's emotions using an emotion prediction algorithm and generates an appropriate response using a generative AI model.

[1882] Step 10:

[1883] The server delivers personalized content. The input is the user's past conversation data and preference data, and the output is personalized content data. The server analyzes the user's data, selects the most appropriate content, and delivers it.

[1884] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1885] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1886] Another example of generative AI is Gemini (internet search engine). <url: https: gemini.google.com ?hl="ja">) are mentioned.

[1887] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1888] [Third embodiment]

[1889] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1890] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1891] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1892] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1893] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1894] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1895] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1896] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1897] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1898] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1899] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1900] Next, the specific processing by the specific processing unit 290 of the data processing device 12 will be described.

[1901] "Example 1"

[1902] One embodiment of the present invention provides a means for users to customize the appearance of their characters, allowing them to freely select their character's hair color, eye color, clothing, etc., to create their own original character.

[1903] "Example 2"

[1904] Furthermore, users can purchase character personalities and traits by paying a fee. For example, users can purchase and add traits such as a "gentle personality," a "lively personality," or a "knowledgeable personality" to their characters. This allows users to develop their own unique AI characters.

[1905] "Example 3"

[1906] The system of the present invention also records conversations between users and AI characters and stores them as big data, allowing the AI ​​characters to learn from past conversations and understand the user's preferences and tendencies.

[1907] "Example 4"

[1908] Furthermore, the system of the present invention provides an alarm function to the AI ​​character: the user can issue an instruction to the AI ​​character, such as "Wake me up at 7:00 tomorrow morning," and the AI ​​character will wake the user up at the specified time.

[1909] "Example 5"

[1910] The system of the present invention also provides the ability for AI characters to perform live streaming and live commerce. Users can watch their AI characters live stream and enjoy live commerce where AI characters introduce products. This provides a new form of entertainment.

[1911] The processing flow of each embodiment will be described below.

[1912] "Example 1"

[1913] Step 1: The user logs into the system.

[1914] Step 2: The user opens the character creation screen and customizes the character's appearance, including choosing hair color, eye color, clothing, etc.

[1915] Step 3: Save the character created by the user. This allows users to create their own original character.

[1916] "Example 2"

[1917] Step 1: The user logs in to the system and selects the character they created. Step 2: The user opens a screen where they can purchase the character's personality and characteristics.

[1918] Step 3: The user selects characteristics such as "gentle personality," "lively personality," or "knowledgeable" and makes a purchase.

[1919] Step 4: The purchased personality and characteristics are added to the character, allowing users to develop their own unique AI character.

[1920] "Example 3"

[1921] Step 1: The user logs into the system and selects the character they created. Step 2: The user starts a conversation with the character.

[1922] Step 3: The system records the conversation between the user and the character and stores it as big data.

[1923] Step 4: The AI ​​character learns from past conversations to understand the user's preferences and tendencies.

[1924] "Example 4"

[1925] Step 1: The user logs in to the system and selects the character they created. Step 2: The user gives the character instructions such as "Wake me up at 7am tomorrow morning."

[1926] Step 3: The system records the specified time and sets an alarm function for the AI ​​character.

[1927] Step 4: At the specified time, the AI ​​character wakes up the user.

[1928] "Example 5"

[1929] Step 1: The user logs in to the system and selects the character they created. Step 2: The user starts live streaming or live commerce with the character.

[1930] Step 3: Other users can watch the live stream and purchase products through live commerce, providing a new form of entertainment.

[1931] Example 1

[1932] Next, a description will be given of Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1933] Conventional character customization systems make it difficult for users to freely customize the appearance of their characters, and the appearance of the generated characters often does not meet the user's expectations. Furthermore, the process for generating a character's appearance is complicated, making it difficult for users to use. Furthermore, there are limitations in that the generated characters cannot be shared with other users or used for live streaming or live commerce.

[1934] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1935] In this invention, the server includes a means for allowing a user to customize the appearance of a character, a means for receiving user selection information and sending a prompt to a generation AI model to generate the character's appearance, and a means for displaying the generated character's appearance to the user. This allows users to easily create their own original characters, share them with other users, and use them for live streaming and live commerce.

[1936] A "user" is an individual or group that utilizes the system to customize the appearance of a character and to operate the generated character.

[1937] A "character" is a digital object such as a virtual person or animal that can be customized by a user.

[1938] "Appearance" refers to a character's visual characteristics such as hair color, eye color, clothing, etc.

[1939] "Customization" refers to the act of a user freely selecting and changing the appearance of a character.

[1940] A "server" is a computer system that receives user requests and performs the processing to generate the character's appearance.

[1941] A "generative AI model" is an artificial intelligence model that generates a character's appearance based on user selection information.

[1942] A "prompt" is an instruction sent to a generative AI model to generate the character's appearance.

[1943] "Selection information" refers to data such as hair color, eye color, clothing, etc. selected by the user when customizing the character's appearance.

[1944] "Display" refers to the act of visually presenting the appearance of the generated character on the user's terminal.

[1945] "Live distribution" refers to the act of distributing video and audio in real time using generated characters.

[1946] "Live commerce" is the act of selling products and services through live streaming.

[1947] The present invention is a system that allows a user to customize the appearance of a character and realize various functions using the created character. Specific embodiments of this system will be described below.

[1948] First, a user accesses the web application using a browser. This web application is built using React.js as the front end and Node.js as the back end. When a user accesses the web application, the server provides a character customization screen. This screen includes an interface for selecting hair color, eye color, clothing, etc.

[1949] The user can freely select the character's appearance using the provided interface. For example, the user can set the hair color to "blue," the eye color to "green," and the clothing to "casual." The user's selection information is sent from the device to the server in real time. The selection information is sent in JSON format.

[1950] The server generates a prompt based on the received selection information, for example, "Generate a character with blue hair, green eyes, and casual clothing." This prompt is then sent to a generative AI model (e.g., OpenAI's DALL-E).

[1951] The generative AI model generates the character's appearance based on the received prompt. The image data of the generated character is returned to the server. The server then sends the image data of the generated character to the user's device, allowing the user to check the appearance of the generated character on their browser.

[1952] For example, if the user selects "blue hair, green eyes, casual clothing," the following prompt is generated:

[1953] "Generate a character with blue hair, green eyes, and casual clothing."

[1954] This prompt is sent to the AI ​​model, which then generates the character's appearance based on the prompt. The generated character is then displayed on the user's screen via the server.

[1955] This system allows users to easily create their own original characters, share them with other users, and use them for live streaming and live commerce.

[1956] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1957] Step 1:

[1958] A user accesses a web application.

[1959] Input: A user accesses the URL of a web application using a browser.

[1960] Output: The web application home page is displayed in the user's browser.

[1961] How it works: When a user visits "https: / / custom-character.com", the browser sends a request to the server. The server receives the request and sends the HTML, CSS, and JavaScript files for the homepage to the user's browser.

[1962] Step 2:

[1963] The server provides a character customization screen.

[1964] Input: Based on the user's request, the server prepares the data for the character customization screen.

[1965] Output: The character customization screen is displayed in the user's browser.

[1966] What it does: The server sends a character customization component built with React.js to the user's browser, providing an interface for the user to select hair color, eye color, clothing, etc.

[1967] Step 3:

[1968] The user selects the character's appearance.

[1969] Input: User selects hair color, eye color, clothing, etc. on the character customization screen.

[1970] Output: The selected information is saved on the user's device.

[1971] Specific operation: The user operates the interface to set the hair color to "blue," the eye color to "green," and the clothing to "casual." The selection information is temporarily saved on the user's device.

[1972] Step 4:

[1973] The terminal transmits the selection information to the server.

[1974] Input: Appearance information for the character selected by the user.

[1975] Output: The selection information is sent to the server.

[1976] Specific behavior: When the user clicks the "Save" button, the selection information is sent to the server in JSON format. For example, the following JSON data is sent:

[1977] json

[1978] {

[1979] "hairColor": "blue",

[1980] "eyeColor": "green",

[1981] "outfit": "casual"

[1982] }

[1983] Step 5:

[1984] The server generates a prompt and sends it to the AI ​​model.

[1985] Input: User selection information (JSON data).

[1986] Output: The generated prompt sentence is sent to the AI ​​model.

[1987] Specific operation: The server generates a prompt based on the received selection information. For example, a prompt such as "Please generate a character with blue hair, green eyes, and casual clothing" is generated. This prompt is then sent to the generative AI model.

[1988] Step 6:

[1989] The AI ​​model generates the character's appearance and returns it to the server.

[1990] Input: The generated prompt statement.

[1991] Output: Image data of the generated character.

[1992] Specific operation: The generative AI model generates the character's appearance based on the received prompt. The image data of the generated character is returned to the server.

[1993] Step 7:

[1994] The server displays the generated character to the user.

[1995] Input: Image data of the generated character.

[1996] Output: The image of the character is displayed in the user's browser.

[1997] Specific operation: The server sends image data of the generated character to the user's device. The user can check the appearance of the generated character on the browser.

[1998] (Application example 1)

[1999] Next, a description will be given of Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2000] Conventional character customization systems allow users to freely customize the appearance of their characters, but they have the problem of not being able to try on clothes in the virtual space or check them before purchasing. Also, since there was no try-on experience in a virtual store using the characters created by the users, it was difficult to stimulate users' desire to purchase.

[2001] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[2002] In this invention, the server includes: means for creating a tangible AI by combining a character customized by a user with an AI for generating thoughts and a system for generating voices; means for purchasing personality and characteristics for a fee and training an AI to converse using past conversations and big data; means for enjoying conversations with the AI ​​and conversations between AIs trained by other users; means for providing an alarm function; means for live streaming and live commerce; means for a user to customize the appearance of a character and try on clothes in a virtual space; and means for trying on clothes in a virtual store and checking them before purchasing. This allows a user to try on clothes in a virtual store using their customized character and check them before purchasing.

[2003] A "user-customized character" is an original character created by the user by freely selecting hair color, eye color, clothing, etc.

[2004] "AI for generating thoughts" is an artificial intelligence that thinks and makes decisions based on knowledge and information for characters customized by users.

[2005] A "system for generating voice" is a technology or device for generating voices uttered by characters.

[2006] "AI with form" is artificial intelligence that gives thoughts and voice to characters customized by users.

[2007] "Purchase personality and characteristics by paying" refers to a system in which a user can give a character new personality and characteristics by paying an additional fee.

[2008] "AI that converses using past conversations and big data" is artificial intelligence that can hold natural conversations based on past conversation history and large amounts of data.

[2009] "Means for developing AI" refers to methods by which users can develop the character's personality and characteristics, enabling them to have more advanced conversations and behave in more advanced ways.

[2010] "Means for enjoying conversations with AI or conversations between AIs trained by other users" refers to a method by which a user can have a conversation with their own character or enjoy conversations between characters trained by other users.

[2011] "Means for providing an alarm function" refers to a function in which a character issues an alarm or notification to the user.

[2012] "Means for live streaming and live commerce" refers to a method of using characters to stream and sell products in real time.

[2013] "Means for trying on clothes in a virtual space" refers to a method in which a user tries on clothes in a virtual space using a character customized by the user.

[2014] The "means of trying on clothes in a virtual store and checking before purchasing" is a method in which a user tries on clothes using a character in a virtual store and checks how they look before actually purchasing them.

[2015] The system for implementing this invention combines an AI for generating thoughts and a system for generating voices to create a physical AI for a character customized by the user. It also provides a means for purchasing personality and characteristics for a fee and cultivating a conversational AI by utilizing past conversations and big data. It also includes a means for enjoying conversations with the AI ​​and conversations between AIs cultivated by other users, a means for providing an alarm function, a means for live streaming and live commerce, a means for the user to customize the appearance of the character and try on clothes in a virtual space, and a means for the user to try on clothes in a virtual store and check them before purchasing.

[2016] System Program

[2017] The server receives information about the appearance of the character customized by the user and controls the character's movements using AI to generate thoughts and a system to generate voices. Specifically, it uses software such as Python, OpenCV, and PIL (Python Imaging Library) to generate images and voices for the character.

[2018] Processing Description

[2019] The server generates a character based on information entered by the user, such as hair color, eye color, and clothing. The generated character thinks and makes decisions based on knowledge and information using AI to generate thoughts, and then produces sounds using a voice generation system. The user can use a smartphone or head-mounted display to control the character in a virtual space and try on clothes.

[2020] Specific examples

[2021] Consider a scenario in which a user operates a virtual fitting room application using a smartphone. The user can customize the appearance of the character and try on clothes in the virtual store by entering the following prompt sentences:

[2022] Example prompt sentence:

[2023] Choose your hair color: Blonde

[2024] Choose your eye color: Blue

[2025] Choose your outfit: Casual

[2026] When this prompt is entered, the server generates a character with blonde hair, blue eyes, and casual clothing, and the user can use the character to try on the clothes in a virtual store and check them before purchasing.

[2027] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[2028] Step 1:

[2029] A user launches the virtual fitting room application using a smartphone or head-mounted display. The user inputs customization information such as hair color, eye color, and clothing. The input information is then sent to the server.

[2030] Step 2:

[2031] The server generates the character's appearance based on the customization information received from the user. Specifically, it generates an image of the character using software such as Python, OpenCV, and PIL (Python Imaging Library). The input is the user's customization information, and the output is an image of the generated character.

[2032] Step 3:

[2033] The server applies AI to the generated character to generate thoughts. The AI ​​performs the character's thoughts and decisions based on the user's past conversation history and big data. The input is an image of the character and the user's past conversation data, and the output is a character with its own thoughts.

[2034] Step 4:

[2035] The server generates the voice of the character using a voice generation system, specifically using text-to-speech technology, where the input is the character's thoughts and the output is the generated voice.

[2036] Step 5:

[2037] The server sends the generated character and voice to the user's device. The user can then control the character in the virtual space and try on the clothes using a smartphone or head-mounted display. The input is the character and voice sent from the server, and the output is the virtual space displayed on the user's device.

[2038] Step 6:

[2039] The user tries on clothes using a character in a virtual store and checks them before purchasing. The user checks the appearance of the clothes they try on and makes a decision about purchasing. The input is the try-on information in the virtual space, and the output is the user's purchasing decision.

[2040] Step 7:

[2041] The server records the user's try-on information and purchasing decision, and uses it as a reference for future customization and purchasing behavior. The input is the user's try-on information and purchasing decision, and the output is the recorded data.

[2042] Example 2

[2043] Next, a description will be given of Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[2044] In conventional AI character systems, it was difficult for users to freely customize the character's personality and characteristics, and adding new personalities and characteristics by paying was cumbersome. Furthermore, the generated character's personality and characteristics often did not meet the user's expectations, resulting in a poor user experience. Furthermore, because character updates and saving were not performed in real time, there was also the issue of users being unable to immediately see the changes.

[2045] The specification process by the specification processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for a user to select a character's personality and characteristics using a terminal, a means for the server to check billing information and update the personality and characteristics, and a means for the server to send a prompt message to the generating AI model. This allows the user to easily customize the character's personality and characteristics, smoothly add new content by paying, and update the generated character's personality and characteristics in real time in a manner that meets the user's expectations.

[2046] A "user" is an individual or group that uses the system to customize the personality and characteristics of a character and pays a fee.

[2047] "Terminal" means a device used by a user to access the system and select a character's personality and characteristics, including a smartphone or PC.

[2048] A "server" is a computer system that manages the overall processing of the system, accepts requests from users, checks billing information, and updates the personalities and characteristics of characters.

[2049] "Artificial intelligence" refers to technology that generates thoughts and voices for characters customized by users, and includes generative AI models.

[2050] A "generative AI model" is an artificial intelligence model that generates a character's personality and characteristics based on a prompt sentence, and examples include GPT-4.

[2051] A "prompt" is a text sentence that instructs the generative AI model about the character's personality and characteristics.

[2052] "Personality and characteristics" are personalities and traits that a user selects to add to a character, and include characteristics such as "easy-going personality" and "knowledgeable traits."

[2053] "Billing information" refers to payment information provided by a user when purchasing a personality or feature, and includes credit card information, electronic payment information, and the like.

[2054] A "database" is a data storage system in which the server stores information about the personalities and characteristics of characters.

[2055] "Live streaming" is a function that allows users to stream video and audio in real time.

[2056] "Live commerce" is a feature that introduces products during live broadcasts and allows viewers to purchase them on the spot.

[2057] This invention is a system that allows a user to add personality and characteristics to a customized character and generate the character's personality and characteristics using a generation AI model. Specific embodiments of this system are described below.

[2058] Hardware and software used

[2059] 1. Terminal

[2060] A device that allows a user to access a system. Examples include smartphones and PCs.

[2061] A screen for selecting the character's personality and characteristics is provided through an application or web browser running on the device.

[2062] 2. Server

[2063] It is a computer system that manages the processing of the entire system.

[2064] The server accepts requests from users, checks billing information, and updates the character's personality and characteristics.

[2065] The server sends a prompt to the generative AI model (e.g., GPT-4) and stores the generated character information in a database.

[2066] 3. Generative AI Models

[2067] It is an artificial intelligence model that generates a character's personality and characteristics based on a prompt sentence.

[2068] Specifically, large-scale language models such as GPT-4 are used.

[2069] Data processing and calculation

[2070] 1. The user selects the character's personality and characteristics

[2071] Users use the terminals to access applications and websites on the system.

[2072] On the character customization screen displayed on the terminal, the user selects the desired personality and characteristics from options such as "easygoing personality," "lively personality," and "knowledgeable characteristics."

[2073] 2. The user makes a payment

[2074] The us...

Claims

1. A response means for making a character customized by a user think and respond autonomously by utilizing a generating AI model and a user's past conversation history; A training means for training the character by inputting a specific prompt sentence into a generating AI model to give the character personality and characteristics purchased by a charge; a means for causing a conversation between the character of a specific first user raised by the raising means and the character of a second user other than the specific first user raised by the raising means; A means for live streaming in which the character of the first user and the character of the second user have a conversation and introduce and sell a specific product; A system including:

2. The system according to claim 1 , further comprising means for having the character try on clothes in a virtual store and displaying the trying-on situation on a user's terminal.

3. The system according to claim 1 , further comprising: means for recognizing an emotion of a user watching a live broadcast and adjusting a reaction of the character in accordance with the emotion.

Images