system

Abstract

Provide a system. An interactive art creation system that allows children to create artwork through their own input, comprising: a login means for a user to access the system and initiate a session; terminal means for collecting user input and transmitting it to a server; A generation means for generating an artwork using an AI generation engine based on the received user input; a transmitting means for returning data of the generated artwork to the terminal; A system including:

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] In modern education, children have limited opportunities to create art to unleash their creativity and express themselves. Furthermore, if parents or educators themselves lack specialized art knowledge, it is difficult to provide appropriate guidance and support to children. Furthermore, existing art experiences lack interactivity and rarely motivate children to participate voluntarily. To address these issues, the present invention aims to provide a system that allows children to easily and enjoyably experience art creation through co-creation with AI. [Means for solving the problem]

[0005] The present invention provides an interactive art creation system that allows children to create artworks through their own input. The system includes a login means for users to access the system and start a session, a terminal means for collecting and transmitting user input to a server, a generation means for generating artworks using an AI generation engine based on the received user input, and a transmission means for transmitting data of the generated artwork back to the terminal. The system also includes a means for collecting and transmitting final user instructions to the server, a means for generating the final artwork and transmitting the data from the server to the terminal, and a means for saving and sharing the generated artwork, allowing children to easily and enjoyably create original artworks while co-creating with AI.

[0006] "User" refers to any user of the art production system, including children, their parents, and educators.

[0007] "Terminal means" refers to a device (e.g., smartphone, tablet, or PC) that allows a user to input information and interact with the system.

[0008] "Server" refers to the central computer system that receives data sent by users and generates artworks using an AI generation engine.

[0009] "Login means" refers to an authentication function that allows a user to access the art production system and start a session.

[0010] "User input" refers to information such as text, voice, and images that a user uses to provide instructions and requests for art production to the system.

[0011] "AI generative engine" refers to a collection of artificial intelligence algorithms that generate artwork based on user input.

[0012] "Generation means" refers to the function of using an AI generation engine to create artwork based on user input.

[0013] "Transmission means" refers to the function of returning data of the generated artwork from the server to the terminal.

[0014] The "final instruction" refers to the final change instruction given by the user to the generated intermediate work.

[0015] "Storage and sharing means" refers to the ability to save the generated artwork on a device or share it on social media or other platforms.

[0016] An "interactive art production system" is a system that allows children to co-create with AI and create artworks based on user input. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0018] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0019] First, the terms used in the following description will be explained.

[0020] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0021] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0022] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0023] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0024] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0025] [First embodiment]

[0026] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0027] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0029] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0030] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0031] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0033] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0034] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0036] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0037] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0038] This invention relates to an interactive art creation system that allows children to create artworks while co-creating with AI through their own input. This system operates among three parties: the user, the terminal, and the server.

[0039] System configuration

[0040] This art production system consists of the following elements:

[0041] 1. Login method:

[0042] It is the means by which a user accesses a system and initiates a session, specifically by authenticating the user to the system using a username and password or other authentication means.

[0043] 2. Terminal means:

[0044] A device through which a user provides input and interacts with a system. Examples include smartphones, tablets, and PCs. It provides an interface for users to input requests and instructions for an artwork.

[0045] 3. Generation means:

[0046] This corresponds to an AI generation engine located on a server. It has the function of generating artworks based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time according to the user's requests.

[0047] 4. Means of transmission:

[0048] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions.

[0049] 5. Storage and sharing methods:

[0050] It is a means to save the generated artwork on your device or share it on social media or other platforms.

[0051] Explaining program processing in natural language

[0052] The process by which children access the system and create artwork is as follows:

[0053] server

[0054] When a user logs in, the server generates a new session ID and sends it back to the device. It receives input from the user and passes it to the AI ​​generation engine to generate an artwork. It then sends the generated artwork to the device and provides an interface for the user to give final instructions. It also sends data of the final generated artwork to the device to support saving and sharing.

[0055] Terminal

[0056] The device collects the information entered by the user and sends it to the server. It displays the artwork received from the server and prompts the user for further instructions. It also provides functions for users to save the artwork they have created and share it on social media.

[0057] User

[0058] A user first accesses the system using a login method and starts a session. Then, they input their art creation request through their device. For example, they might say, "I want to paint a rainbow." The device sends this input to the server, which processes the request using an AI generation engine and generates an artwork. The generated artwork is displayed on the device, and the user can view it while giving their next instruction. Finally, the user can review the completed work and save or share it, completing the art experience.

[0059] Specific examples

[0060] For example, consider the case where a user inputs "I want to draw a rainbow."

[0061] 1. User: Access the Art Experience Studio and log in.

[0062] 2. User: Uses the device to input "I want to draw a rainbow."

[0063] 3. Terminal: Sends this input to the server.

[0064] 4. Server: Receives input and passes it to the AI ​​generation engine.

[0065] 5. AI generation engine: Generates a rainbow image and sends it back to the server.

[0066] 6. Server: Sends the generated rainbow image to the device.

[0067] 7. Terminal: Displays the generated rainbow image to the user.

[0068] 8. User: Save or share your creations.

[0069] In this way, children can easily create original works of art with the assistance of AI.

[0070] The processing flow will be explained below.

[0071] Step 1:

[0072] The user accesses the Art Experience Studio website and enters authentication information using the login means.

[0073] Step 2:

[0074] The terminal sends the authentication information entered by the user to the server (HTTP POST request).

[0075] Step 3:

[0076] The server verifies the received authentication information and generates a new session ID if the user is valid.

[0077] Step 4:

[0078] The server returns the generated session ID to the terminal.

[0079] Step 5:

[0080] After logging in, the user inputs their art creation request (for example, "I want to draw a rainbow") into the terminal.

[0081] Step 6:

[0082] The terminal collects the user's input and sends it to the server along with the session ID (HTTP POST request).

[0083] Step 7:

[0084] The server passes the request to the AI ​​generation engine based on the received user input.

[0085] Step 8:

[0086] The AI ​​generative engine generates artwork (e.g., an image of a rainbow) based on user input.

[0087] Step 9:

[0088] The server receives the generated artwork data and transmits it to the terminal.

[0089] Step 10:

[0090] The terminal displays the artwork received from the server to the user.

[0091] Step 11:

[0092] The user enters final instructions for the displayed artwork (eg, "change the background to blue").

[0093] Step 12:

[0094] The terminal collects the user's final instructions and sends them back to the server (HTTP POST request).

[0095] Step 13:

[0096] The server receives the final instructions and sends a request to the AI ​​generation engine to generate the final artwork.

[0097] Step 14:

[0098] The AI ​​generative engine generates the final artwork and sends the data back to the server.

[0099] Step 15:

[0100] The server transmits the final artwork data to the terminal.

[0101] Step 16:

[0102] The terminal displays the final artwork to the user.

[0103] Step 17:

[0104] Users can save the generated artwork to their device's local storage or share it on social media.

[0105] Step 18:

[0106] The terminal executes the user's save and share requests.

[0107] Example 1

[0108] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0109] Conventional art creation systems make it difficult for users to demonstrate their creativity, and the process of creating artworks is complicated. This makes it difficult for children, in particular, to easily create beautiful artworks while enjoying interactive art creation. This invention aims to solve these problems by providing an interactive art creation system that allows users to intuitively operate the system and create artworks based on their own instructions while co-creating with AI.

[0110] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0111] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for analyzing the received user input and generating an artwork based on a generative model, a transmission means for returning data of the generated artwork to the terminal, an interface means for displaying the transmitted artwork and prompting the user for further instructions, and a storage means and sharing means for saving and sharing data of the final generated artwork. This allows users to intuitively operate the system, easily generate artworks while co-creating with AI, and save or share the final artworks.

[0112] A "login method" is an authentication method for a user to access a system and start a session. Specifically, it has the function of authenticating a user using a username and password or other authentication method.

[0113] "Terminal means" refers to a device that allows a user to input data and interact with the system. Specifically, this includes smartphones, tablets, and personal computers.

[0114] The "generation means" is an engine that uses a generative model stored on a server to generate artworks based on user input. Specifically, it uses AI to generate artworks in real time.

[0115] The "transmission means" is a mechanism that has the function of transmitting data of the generated artwork from the server to the terminal.

[0116] The "interface means" refers to a user interface that allows the user to check the generated artwork and give further instructions. Specifically, this refers to a graphical user interface (GUI) that is displayed on the screen.

[0117] "Storage and sharing means" refers to a system that has the function of storing the final artwork or sharing it on social media or other platforms.

[0118] This invention relates to an interactive art production system that allows users to create artworks in collaboration with AI through their own input. This system operates among three parties: the user, the terminal, and the server.

[0119] System configuration

[0120] This art production system consists of the following elements:

[0121] 1. Login method:

[0122] The means by which a user accesses the system and initiates a session, including the means by which the user authenticates to the system using a username and password or other authentication means, thereby activating the user's session and beginning the art-making process.

[0123] 2. Terminal means:

[0124] This is the device through which the user provides input and interacts with the system. Examples include smartphones, tablets, and PCs. The terminal provides an interface through which the user can input requests and instructions for the artwork. Specific devices that can be used include iOS devices, Android (registered trademark) devices, and Windows PCs.

[0125] 3. Generation means:

[0126] This corresponds to an AI generation engine deployed on a server. It has the function of generating artwork based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artwork in real time according to the user's requests. The specific software used is OpenAI (registered trademark)'s generative AI model (e.g., GPT-3 (registered trademark), DALL-E). This allows for advanced data calculations and image generation.

[0127] 4. Means of transmission:

[0128] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions. The HTTP protocol is typically used as a data transmission method, which efficiently transfers data, including image files, to the terminal.

[0129] 5. Storage and sharing methods:

[0130] It is a means to save the generated artwork on the device and share it on social media and other platforms. Specifically, it includes local storage using the file system and automatic posting to social media via API integration.

[0131] Example of operation

[0132] For example, consider the case where a user inputs "I want to draw a rainbow."

[0133] 1. User: Access the Art Experience Studio and log in. Specifically, enter your username and password on the login screen and click the authentication button.

[0134] 2. User: Uses the device to input "I want to draw a rainbow." For example, enter "I want to draw a rainbow" into an input form.

[0135] 3. Terminal: Send this input to the server. Send the input data to the server using an HTTP request.

[0136] 4. Server: Receives input and passes it to the AI ​​generation engine for processing. Specifically, the AI ​​generation engine generates an image based on the keyword "rainbow."

[0137] 5. AI generation engine: Generates a rainbow image and sends it back to the server. For example, DALL-E is used to generate a "rainbow" image.

[0138] 6. Server: Sends the generated rainbow image to the device. Returns the generated image file to the device as an HTTP response.

[0139] 7. Terminal: Display the generated rainbow image to the user. For example, the generated rainbow image is displayed on the screen.

[0140] 8. User: Save or share the work. For example, press the save button on the device to save the image, or press the share button to share the image on social media.

[0141] Example prompts to input to the generative AI model

[0142] Here are some example prompts to input to a generative AI model:

[0143] "I'd like to draw a rainbow with a blue sky background, please."

[0144] "Draw a picture of animals playing in the forest."

[0145] "I want to generate illustrations of futuristic cities."

[0146] In this way, children can easily create original works of art with the assistance of AI. The system is intuitive to operate and provides a fun and creative experience.

[0147] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0148] Step 1:

[0149] A user accesses the system and enters a username and password on the login screen to request authentication. The terminal sends this input information to the server. The server checks the database based on the received authentication information, generates a new session ID, and sends it back to the terminal. This session ID activates the user's session.

[0150] Input: Username, Password

[0151] Output: Session ID

[0152] Specific operation: The user enters the username "exampleUser" and password "examplePass" and clicks the "Login" button.

[0153] Step 2:

[0154] The user enters their desired artwork into an input field on their device, such as "I want to paint a rainbow." The device then sends this instruction to the server, which parses it and constructs a request to pass to the generative AI model.

[0155] Input: Artwork request (prompt)

[0156] Output: Request to the generative AI model

[0157] Specific behavior: The user enters "I want to draw a rainbow" in the input field and clicks the "Submit" button.

[0158] Step 3:

[0159] The server sends the prompt received from the user to the generative AI model, which analyzes the prompt and performs data calculations to generate an artwork. The generative AI model then returns the resulting artwork data to the server.

[0160] Input: A request to the generative AI model

[0161] Output: The generated artwork data

[0162] Specific operation: The server sends the prompt sentence "I want to draw a rainbow" to the generation AI model (e.g., DALL-E), and the AI ​​generates image data of a rainbow.

[0163] Step 4:

[0164] The server receives the artwork data returned by the generative AI model and sends it to the device. The device receives this data and displays it on the user interface. The user can then view the displayed artwork.

[0165] Input: Generated artwork data

[0166] Output: Artwork data sent to device

[0167] Specific operation: The server sends the generated rainbow image data to the terminal, which then displays it on the user's screen.

[0168] Step 5:

[0169] The user checks the displayed artwork and enters the next instruction or additional instructions for correction. The device sends the new input back to the server, and steps 3 and 4 are repeated.

[0170] Input: Additional or corrective instructions

[0171] Output: Regenerated artwork data

[0172] Specific action: The user types "Make it a little brighter" and clicks the "Submit" button.

[0173] Step 6:

[0174] The user finally confirms the artwork they are satisfied with and takes action to save or share it. The device accepts this action and sends a save request to the server or a share request to a social network via API. The server stores the artwork in a database and generates the appropriate sharing link.

[0175] Input: Save or Share action

[0176] Output: Saved data or shared link

[0177] Specific operation: The user presses the save button to save the work to the device, or presses the share button to share the work on a social networking site.

[0178] In this way, the system allows users to intuitively operate it, easily create artworks in collaboration with AI, and save or share those works.

[0179] (Application example 1)

[0180] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0181] Conventional art creation systems lack interactivity and simplicity when children express their creativity and create artworks, and they also lack an easy way to share the artworks they create with other users. Furthermore, many systems only allow users to use the artworks as they are, and do not provide sufficient functionality for users to edit and finalize their own works. It is necessary to solve these issues and provide a more creative and interactive art creation experience.

[0182] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0183] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for generating an artwork using a generative AI model based on the received user input, a transmission means for returning data of the generated artwork to the terminal, an editing means for displaying the generated artwork on the terminal and allowing the user to edit it, and a saving and sharing means for saving and sharing the final artwork. This allows children to easily and interactively create artworks through their own input and easily share them with other users.

[0184] The "login means" is an authentication means for a user to access the system and start a session, and is a means for authenticating the user by entering a user name, password, etc.

[0185] "Terminal means" refers to a device that collects user input and transmits it to a server, and is a means for providing the corresponding interface, such as a smartphone, tablet, or PC.

[0186] A "generative AI model" is a program or system that contains artificial intelligence algorithms for generating artwork based on received user input.

[0187] "Generative means" refers to a means including a mechanism or device that uses a generative AI model to generate an artwork in response to user input.

[0188] The "transmission means" is a communication means for returning data of the generated artwork from the server to the terminal.

[0189] "Editing means" means a means for displaying the generated artwork on a terminal and providing interactive functionality for the user to edit and finalize the artwork.

[0190] "Storage and sharing means" includes functions and means for saving the final artwork on a terminal or sharing it with other users or platforms via a network.

[0191] This invention is an interactive art creation system that allows children to create artworks through their own input, and then edit, save, and share those artworks. Detailed embodiments of this system are described below.

[0192] System Program

[0193] server:

[0194] The server performs the following main processes:

[0195] 1. Login method: A method for authenticating a user to access a system and start a session. Here, the user is identified by entering a username and password.

[0196] 2. Generation method: Based on the received user input, a generative AI model is used to generate artwork. The generative AI model incorporates advanced artificial intelligence algorithms and creates artwork in real time according to the user's requests.

[0197] 3. Transmission means: A communication means for returning the generated artwork to the terminal. In order to efficiently transfer the data of the generated artwork, the data is transmitted via the Internet.

[0198] Device:

[0199] The terminal has the primary function of collecting user input and displaying, editing, saving and sharing artwork received from the server.

[0200] 1. Input interface: Provides an interface for users to input their requests and specific instructions for art production. This can be a smartphone, tablet, PC, or other device.

[0201] 2. Display and editing means: displays the generated artwork sent from the server and provides a GUI (Graphical User Interface) for the user to edit the artwork.

[0202] 3. Saving and sharing: Provides the ability to save the completed artwork on the device and share it with other users or via social networking sites via the Internet.

[0203] User:

[0204] The user operates the system in the following steps.

[0205] 1. Logging in and starting a session: You start a session by entering your account information and logging into the system.

[0206] 2. Inputting requests for art creation: Input requests such as "I want to draw a seascape" or "I want to draw a rainbow" into the input interface.

[0207] 3. Review and edit the generated artwork: Review the generated artwork, adjust colors, add additional elements, etc.

[0208] 4. Save and Share: Save your final artwork and share it on social media etc.

[0209] Hardware and software used

[0210] The system is implemented using the following hardware and software:

[0211] Hardware: Smartphones (e.g., iPhone (registered trademark), Android devices), tablets (e.g., iPad (registered trademark), Android tablets), computers (e.g., Windows PC, Mac)

[0212] Generative AI model: Uses artificial intelligence models such as OpenAI's DALL-E as the generative algorithm.

[0213] Server: An EC2 instance from Amazon Web Services (AWS (registered trademark)) is used, and an S3 bucket is used for sending and receiving data.

[0214] Database: MongoDB is used to store the metadata of the artworks.

[0215] Front-end: Use Flutter® or React Native to build the user interface.

[0216] Backend: Perform server-side processing using Node.js or Python (Flask).

[0217] Specific examples

[0218] For example, if a user inputs "I want to draw a seascape," the following steps are performed:

[0219] 1. User: Launches the application and logs in.

[0220] 2. User: Uses the interface to input "I want to draw a seascape."

[0221] 3. Terminal: Sends this instruction to the server.

[0222] 4. Server: Receives instructions and passes them to a generative AI model (such as DALL-E) for processing.

[0223] 5. Generative AI model: Generates a seascape artwork that corresponds to the user's request and sends it back to the server.

[0224] 6. Server: Sends the generated artwork back to the device.

[0225] 7. Terminal: Displays the generated artwork to the user and encourages them to edit it.

[0226] 8. User: Edit and finalize your work, save it or share it on social media.

[0227] Prompt Sentence Examples

[0228] "Painting beautiful seascapes"

[0229] In this way, children are provided with a system that allows them to express their creativity and create, edit, and share artworks easily and interactively.

[0230] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0231] Step 1:

[0232] Device: The user launches the app and the login screen appears. The user enters their account information (username and password) and submits a login request.

[0233] Input: Username, Password

[0234] Output: Login request to server

[0235] Step 2:

[0236] Server: Receives the login request and authenticates the user information. If authentication is successful, it generates a new session ID and returns it to the terminal.

[0237] Input: Username, Password

[0238] Output: Session ID

[0239] Step 3:

[0240] Device: Receives the session ID and displays the home screen. The user taps the "Create new art" button, and the input interface appears.

[0241] Input: Session ID

[0242] Output: Home screen

[0243] Step 4:

[0244] User: Enters a request for art creation into the input interface (e.g., "I want to paint a seascape"). The request is structured in text format.

[0245] Input: Art production request (text)

[0246] Output: Text request

[0247] Step 5:

[0248] Terminal: Sends the user's art creation request to the server.

[0249] Input: Text request

[0250] Output: Request data to the server

[0251] Step 6:

[0252] Server: Receives text requests and passes them to a generative AI model, which generates artwork based on the requests.

[0253] Input: Text request

[0254] Output: A prompt to the generative AI model (e.g., "Draw a seascape")

[0255] Step 7:

[0256] Generative AI model: Receives a prompt and generates an artwork. The generated artwork data is sent back to the server.

[0257] Input: prompt statement

[0258] Output: Artwork data

[0259] Step 8:

[0260] Server: Receives the generated artwork data and returns it to the device.

[0261] Input: Artwork data

[0262] Output: Artwork data to device

[0263] Step 9:

[0264] Terminal: Receives artwork data and displays it to the user. The user can view the artwork through the interface and make edits as needed.

[0265] Input: Artwork data

[0266] Output: The displayed artwork

[0267] Step 10:

[0268] User: Edits the displayed artwork, for example by changing the color or drawing in additional elements. Once edits are complete, saves or shares the final work.

[0269] Input:Editing instructions

[0270] Output: Final artwork

[0271] Step 11:

[0272] Device: Save the final artwork and share it with social media or other users if desired. Saving is done in the device's memory, and sharing is done via the Internet.

[0273] Input: Final artwork

[0274] Output: Saved and shared artwork

[0275] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0276] This invention relates to an interactive art creation system that allows children to create artworks in collaboration with AI through their own input, and further combines it with an emotion engine that recognizes the user's emotions. Processing in this system is carried out between four parties: the user, the terminal, the server, and the emotion engine.

[0277] System configuration

[0278] This art production system consists of the following elements:

[0279] 1. Login method:

[0280] It is the means by which a user accesses a system and initiates a session, specifically by authenticating the user to the system using a username and password or other authentication means.

[0281] 2. Terminal means:

[0282] A device through which a user provides input and interacts with a system. Examples include smartphones, tablets, and PCs. It provides an interface for users to input requests and instructions for an artwork.

[0283] 3. Generation means:

[0284] This corresponds to an AI generation engine located on a server. It has the function of generating artworks based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time according to the user's requests.

[0285] 4. Means of transmission:

[0286] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions.

[0287] 5. Storage and sharing methods:

[0288] It is a means to save the generated artwork on your device or share it on social media or other platforms.

[0289] 6. Emotion Engine:

[0290] It is a means to recognize a user's emotions and customize artworks according to those emotions. This engine recognizes emotions from the user's facial expressions, voice, or text, and passes that data to an AI generation engine to generate artworks based on the user's emotions.

[0291] Explaining program processing in natural language

[0292] The process by which children access the system and create artwork that combines the emotion engine is as follows:

[0293] server

[0294] When a user logs in, the server generates a new session ID and sends it back to the device. It receives input from the user and passes it to the AI ​​generation engine and emotion engine to generate an artwork. It then sends the generated artwork to the device and provides an interface for the user to give final instructions. It also sends data of the final generated artwork to the device to support saving and sharing.

[0295] Terminal

[0296] The device collects information entered by the user and sends it to the server. It also collects data to send the user's emotions to the emotion engine. It displays the artwork received from the server and prompts the user for further instructions. It also provides functions that allow users to save the artwork they have created and share it on social media.

[0297] User

[0298] The user first accesses the system using a login method and starts a session. They then input their art creation request through their device, and provide further input for emotion recognition by the emotion engine (for example, facial expression recognition using a camera or voice input). The user's input and emotion data are processed by the AI ​​generation engine, and an appropriate artwork is generated. The generated artwork is displayed on the device, and the user can view it and give further instructions. Finally, the user confirms the completed artwork and saves or shares it, completing the art experience.

[0299] Specific examples

[0300] For example, consider a case where a user inputs "I want to draw a rainbow" and has a happy expression on his / her face at the time.

[0301] 1. User: Access the Art Experience Studio and log in.

[0302] 2. User: Uses the device to input "I want to draw a rainbow."

[0303] 3. Terminal: The user's facial expressions and voice are sent to the emotion engine to recognize happy emotions.

[0304] 4. Terminal: Sends this input and emotion data to the server.

[0305] 5. Server: Receives input and emotion data and passes it to the AI ​​generation engine.

[0306] 6. AI Generative Engine: Generates rainbow images and adds colors and designs that match happy emotions.

[0307] 7. Server: Sends the generated artwork to the device.

[0308] 8. Terminal: Displays the generated rainbow image to the user.

[0309] 9. User: Save or share your creation.

[0310] In this way, children can create original artwork that is more personal and interesting, with the help of AI assistance and emotion recognition.

[0311] The processing flow will be explained below.

[0312] Step 1:

[0313] The user accesses the Art Experience Studio website and enters authentication information using the login means.

[0314] Step 2:

[0315] The terminal sends the authentication information entered by the user to the server (HTTP POST request).

[0316] Step 3:

[0317] The server verifies the received authentication information and generates a new session ID if the user is valid.

[0318] Step 4:

[0319] The server returns the generated session ID to the terminal.

[0320] Step 5:

[0321] After logging in, the user inputs their art creation request (for example, "I want to draw a rainbow") into the terminal.

[0322] Step 6:

[0323] The device sends the user's input to an emotion engine and analyzes the user's facial expressions and voice in real time.

[0324] Step 7:

[0325] The emotion engine recognizes emotions based on the user's facial expressions and voice, and sends that data back to the device.

[0326] Step 8:

[0327] The device sends the user's input and emotion data together to the server (HTTP POST request).

[0328] Step 9:

[0329] The server passes the request to the AI ​​generation engine based on the received user input and emotion data.

[0330] Step 10:

[0331] The AI ​​generative engine generates artwork (for example, an image of a rainbow that matches the emotion of happiness) based on user input and emotional data.

[0332] Step 11:

[0333] The server receives the generated artwork data and transmits it to the terminal.

[0334] Step 12:

[0335] The terminal displays the artwork received from the server to the user.

[0336] Step 13:

[0337] The user enters final instructions for the displayed artwork (eg, "change the background to blue").

[0338] Step 14:

[0339] The terminal collects the user's final instructions and sends them back to the server (HTTP POST request).

[0340] Step 15:

[0341] The server receives the final instructions and sends a request to the AI ​​generation engine to generate the final artwork.

[0342] Step 16:

[0343] The AI ​​generative engine generates the final artwork and sends the data back to the server.

[0344] Step 17:

[0345] The server transmits the final artwork data to the terminal.

[0346] Step 18:

[0347] The terminal displays the final artwork to the user.

[0348] Step 19:

[0349] Users can save the generated artwork to their device's local storage or share it on social media.

[0350] Step 20:

[0351] The terminal executes the user's save and share requests.

[0352] Through this series of steps, children can use AI assistance and emotion recognition to create original artwork that is more personal and interesting.

[0353] Example 2

[0354] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0355] Today's children are seeking new art experiences using digital technology. However, conventional art creation systems lack the ability to generate truly personalized artworks because they do not take the user's emotions into account. Furthermore, they lack the ability to accurately reflect the user's input, as well as to customize artworks using the user's emotions. Therefore, there is a need for a system that allows children to create more engaging, original artworks.

[0356] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0357] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for generating an artwork using an AI generation engine based on the received user input, a transmission means for returning data of the generated artwork to the terminal, a means for collecting user emotion data and sending it to the emotion engine, and a means for the generation means to customize the artwork based on the emotion data recognized by the emotion engine. This makes it possible to generate personal and interesting artwork that reflects the user's emotions.

[0358] A "login means" is a means that provides authentication functionality for a user to access a system and initiate a session.

[0359] "Terminal means" refers to a device through which a user makes input and interacts with the system.

[0360] "Generation means" refers to a means that provides the functionality for an AI generation engine to generate artwork based on user input.

[0361] The "transmission means" is a means for returning data of the generated artwork from the server to the terminal.

[0362] The "emotion engine" is an engine that collects user emotion data and recognizes those emotions.

[0363] "Emotion data" refers to data relating to emotions obtained from the user's facial expressions, voice, etc.

[0364] The "means for customizing" is a means for providing the generating means with the ability to individually adjust the artwork based on the emotional data recognized by the emotional engine.

[0365] This invention relates to an interactive art creation system that allows children to create artworks in collaboration with AI through their own input, and further combines it with an emotion engine that recognizes the user's emotions. This system processes between four parties: the user, the terminal, the server, and the emotion engine.

[0366] System configuration

[0367] This art production system consists of the following elements:

[0368] 1. Login method:

[0369] A login method is a method that provides authentication for a user to access a system and initiate a session by entering a username and password or other authentication information to authenticate the user to the system.

[0370] 2. Terminal means:

[0371] The terminal means is a device through which the user inputs and interacts with the system. Examples include smartphones, tablets, and personal computers. These terminals provide an interface through which the user can input their art creation requests and view the resulting artwork.

[0372] 3. Generation means:

[0373] The generation means is a means for providing a function to generate artworks based on user input using an AI generation engine located on a server. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time based on user requests and prompts.

[0374] 4. Means of transmission:

[0375] The transmission means is a means for returning data of the generated artwork from the server to the terminal, allowing the user to check the generated artwork and give further instructions.

[0376] 5. Emotion Engine:

[0377] The emotion engine is an engine that collects the user's emotional data (facial expressions, voice, etc.) and recognizes those emotions. By analyzing the user's emotional data and passing it to the AI ​​generation engine, it generates artwork based on the user's emotions.

[0378] 6. Customization methods:

[0379] The customization means is a means for providing a function in which the generation means adjusts the artwork individually based on the emotional data recognized by the emotion engine. For example, if the user is happy, the colors may be brightened.

[0380] Specific example of system operation

[0381] For example, consider a case where a user inputs "I want to draw a rainbow" and has a happy expression on his / her face at the time.

[0382] 1. User: Accesses the system and logs in.

[0383] 2. User: Uses the device to input "I want to draw a rainbow."

[0384] 3. Terminal: The user's facial expressions and voice are sent to the emotion engine to recognize happy emotions.

[0385] 4. Terminal: Sends this input and emotion data to the server.

[0386] 5. Server: Receives input and emotion data and passes it to the AI ​​generation engine.

[0387] 6. AI Generative Engine: Generates rainbow images and adds colors and designs that match happy emotions.

[0388] 7. Server: Sends the generated artwork to the device.

[0389] 8. Terminal: Displays the generated rainbow image to the user.

[0390] 9. User: Save or share your creation.

[0391] This allows children to create original artwork that is more personal, interesting, and engaging with the help of AI and emotional recognition.

[0392] Examples of prompt statements

[0393] Below is an example of a prompt sentence to input to the generative AI model.

[0394] 1. "When a child says with a smile, 'I want to draw a rainbow,' create a colorful and vibrant rainbow using colors that bring joy."

[0395] 2. "When a child says with a gloomy expression, 'I want to draw a rainy landscape,' please create a rainy landscape using calm colors."

[0396] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0397] Processing flow

[0398] Step 1: User Login

[0399] Terminal: The user accesses the system and is presented with a login screen, providing a UI for entering a username and password.

[0400] Input: Username and Password

[0401] Output: User credentials

[0402] Action: Enter your username and password and press the login button.

[0403] Server: Receives the entered authentication information and checks it against the database. If authentication is successful, generates a new session ID and returns it to the terminal.

[0404] Input: User credentials

[0405] Output: Session ID

[0406] Operation: If authentication is successful, a session ID is generated and returned to the terminal.

[0407] Step 2: Enter your art requirements

[0408] Terminal: After successful login, present the user with a UI for entering their art request. Provide a text box asking "What kind of art would you like to create?" and a submit button.

[0409] Input: Art request (e.g. "I want to draw a rainbow")

[0410] Output: User's art request data

[0411] Action: The user types "I want to draw a rainbow" and presses the send button.

[0412] Step 3: Collecting emotion data

[0413] Terminal: Activates an emotion engine that uses a camera and microphone to collect the user's emotional data (facial expressions and voice).

[0414] Input: User's facial expression, voice

[0415] Output: Recognized emotion data (e.g., joy)

[0416] How it works: The device captures the user's camera footage and audio, and the emotion engine analyzes this to generate emotion data.

[0417] Step 4: Sending data to the server

[0418] Terminal: Sends the user's art requests and emotional data to the server.

[0419] Input: Art request data, emotion data

[0420] Output: Transmitted data

[0421] Operation: The device combines the art request and emotion data and sends the data to the server.

[0422] Server: Analyzes the received data and prepares it to be passed to the AI ​​generation engine.

[0423] Input: Send data

[0424] Output: Parsed data

[0425] Operation: The server receives the transmitted data and performs any necessary data conversions.

[0426] Step 5: Generate artwork using the AI ​​generation engine

[0427] Server: Passes the received art request and emotion data to the AI ​​generation engine.

[0428] Input: Analyzed data (art requests, emotional data)

[0429] Output: prompt statement

[0430] How it works: The server creates a prompt based on the art request and emotional data, and inputs it into the AI ​​generation engine.

[0431] AI generation engine: Generates artwork based on prompts.

[0432] Input: prompt statement

[0433] Output: Artwork data

[0434] How it works: The AI ​​generation engine inputs prompts into the generative model to generate artwork.

[0435] Step 6: Sending the generated artwork from the server to the device

[0436] Server: Receives the generated artwork and sends it to the device.

[0437] Input: Artwork data

[0438] Output: Send artwork data

[0439] Operation: The server receives artwork data and sends it to the device.

[0440] Terminal: Displays the received artwork to the user.

[0441] Input: Submitted artwork data

[0442] Output: The displayed artwork

[0443] What it does: The device displays the artwork and lets the user review it.

[0444] Step 7: User review and feedback on artwork

[0445] User: Review the generated artwork and provide corrections or additional instructions as needed.

[0446] Input: Feedback

[0447] Output: Correction request data

[0448] How it works: The user reviews the artwork and inputs corrections and additions into the device.

[0449] Terminal: Sends correction request data to the server.

[0450] Input: Correction request data

[0451] Output: Send correction data

[0452] Operation: The device sends data to the server.

[0453] Server: Receives the feedback, passes it back to the AI ​​generation engine, and repeats the process to generate a new piece of art.

[0454] Input: Send correction data

[0455] Output: New artwork data

[0456] How it works: The server passes correction instructions to the AI ​​generation engine and regenerates it.

[0457] Step 8: Save and share your artwork

[0458] Device: Once the user is satisfied with their artwork, it will be saved to local storage, and they will also have the option to share it on social media or other platforms.

[0459] Input: Save and Share Instructions

[0460] Output: Save and share completed

[0461] How it works: The device saves artwork and provides functionality for sharing on social media. The user performs the save and share operations.

[0462] This allows users to create more personal, interesting and original artworks with the help of AI and emotion recognition, completing a satisfying art experience.

[0463] (Application example 2)

[0464] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0465] Conventional interactive art creation systems have had difficulty enabling children to effectively create artwork that reflects their own emotions. Furthermore, they lacked a mechanism for easily saving, sharing, and printing the generated artwork in a physical store. Furthermore, they were difficult to integrate with specific hardware and devices, limiting user interaction.

[0466] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: login means for a user to access the system and start a session; terminal means for collecting user input and sending it to the server; generation means for generating an artwork using an AI generation engine based on the received user input; transmission means for returning data of the generated artwork to the terminal; emotion recognition means for recognizing the user's emotion and sending the data to the server; output means for providing functions such as outputting, saving, sharing, and printing the generated artwork; and linking means for linking with in-store hardware such as in-store displays and printers. This enables children to easily create and output personalized artwork that reflects their emotions, and then instantly save, share, and print it in the physical store.

[0467] A "login method" is the method by which a user accesses a system and initiates a session.

[0468] A "terminal means" is a device for collecting user input and transmitting it to a server.

[0469] "Generation means" refers to the method by which an AI generation engine generates an artwork based on received user input.

[0470] The "transmission means" is a method for returning the data of the generated artwork to the terminal.

[0471] "Emotion recognition means" is a method for recognizing a user's emotions and transmitting the data to a server.

[0472] "Output means" refers to a method for providing functions such as outputting, saving, sharing, and printing the generated artwork.

[0473] "Linkage means" refers to a method for linking with hardware in a physical store, such as in-store displays and printers.

[0474] This invention is a system for children to interactively create artworks, with a particular focus on generating artworks that reflect the user's emotions. This system is realized through cooperation between users, terminals, a server, an emotion engine, and hardware in a physical store.

[0475] Basic system configuration

[0476] The system consists of the following elements:

[0477] 1. Login method: In this system, users must log in to access and start a session. Specifically, they enter their name on a device such as a tablet, and then use Firebase Authentication to authenticate and generate a session ID.

[0478] 2. Terminal means: A smart device (e.g., iPad) that collects user input and emotion data and transmits them to the server.

[0479] 3. Generation method: Using an AI generation engine (e.g., DALL-E) on the server, artworks are generated based on user input and emotional data.

[0480] 4. Transmission means: A method for sending the generated artwork back to the terminal from the server.

[0481] 5. Emotion recognition means: The device's camera and microphone are used to recognize the user's emotions, and the data is analyzed by an emotion engine (e.g., TENSORFLOW (registered trademark)) and sent to the server.

[0482] 6. Output means: Provides functions such as displaying, saving, sharing, and printing artworks generated on the device.

[0483] 7. Integration method: A method for integration with in-store hardware such as displays and printers.

[0484] What the program does

[0485] 1. Login process:

[0486] The user logs in by entering their name on the tablet. Firebase Authentication is used to authenticate and generate a session ID.

[0487] 2. Art Creation Interface:

[0488] Users select tools and brushes for painting through the tablet interface, which is equipped with a camera and microphone to recognize users' emotions in real time.

[0489] 3. Emotion Recognition and Data Transmission:

[0490] Using an emotion engine (TensorFlow), the device analyzes the user's facial expressions and voice, and sends the emotion (e.g., joy) they are feeling to the server. This data is sent directly from the device to the server.

[0491] 4. Artwork generation using an AI generation engine:

[0492] The server receives user input and emotion data and generates artwork using a generative AI model such as DALL-E. The generated artwork is personalized according to the user's emotions.

[0493] 5. Submission and Display of Generated Works:

[0494] The generated artwork is sent from the server to the device and displayed instantly, allowing the user to review the artwork and provide further instructions.

[0495] 6. Output and Linkage:

[0496] The completed artwork is stored in Firebase Storage, and can also be displayed and printed on in-store displays and printers via the device interface.

[0497] Specific examples

[0498] For example, if a user types "I want to draw a rainbow" and has a happy expression while doing so, the following prompt sentence can be sent to the generative AI model:

[0499] "Generate an image of a rainbow. The user's emotion is joy."

[0500] The generative AI model then generates a rainbow image that reflects the user's emotions and sends it to the device, allowing children to create, display, share, and print artwork personalized by their emotions and inputs.

[0501] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0502] Step 1:

[0503] The user enters their name into the tablet and logs in. The device authenticates the user using Firebase Authentication and requests the server to generate a session ID. The generated session ID is sent back to the device. The input is the user's name and the output is the session ID. Specifically, the user enters their name into the tablet's login screen and taps the "Login" button.

[0504] Step 2:

[0505] The user begins creating art through the tablet interface. The device collects the user's input in real time and sends it to the server. The input is the user's drawing instructions, and the output is instruction data for the server. In concrete terms, the user selects a brush and color and draws on the tablet.

[0506] Step 3:

[0507] The device's camera and microphone are used to recognize the user's emotions in real time. The emotion engine (TensorFlow) analyzes the user's facial expressions and voice, and sends the results from the device to a server. The input is facial expression and voice data, and the output is analyzed emotion data. Specifically, the device periodically captures and processes camera images and audio.

[0508] Step 4:

[0509] The server receives the user's input and emotional data and generates an artwork using the AI ​​generation engine (DALL-E). The input is the user's instructions and emotional data, and the output is the data of the generated artwork. Specifically, the server passes the necessary data to the AI ​​generation engine and receives the generated artwork.

[0510] Step 5:

[0511] The server returns the generated artwork to the terminal. The input is the data of the generated artwork, and the output is the data to be sent to the terminal. In concrete terms, the server transfers the artwork data to the terminal and confirms receipt.

[0512] Step 6:

[0513] The device displays the generated artwork. The input is the artwork data received from the server, and the output is the display on the tablet. Specifically, the device draws the received artwork on the screen and shows it to the user.

[0514] Step 7:

[0515] The user inputs the final instructions for the work into the terminal, and the terminal sends the data to the server. The input is the user's final instructions, and the output is the final instruction data to the server. Specifically, the user checks the work, makes any necessary corrections, and taps the "Done" button.

[0516] Step 8:

[0517] The server generates the final artwork based on the final instructions and sends the data to the terminal. The input is the user's final instructions, and the output is the data of the final generated artwork. Specifically, the server calls the AI ​​generation engine again to generate the final artwork.

[0518] Step 9:

[0519] The device stores the final artwork. The input is the data of the final artwork, and the output is the saved file. Specifically, the device stores the artwork data in local storage or cloud storage.

[0520] Step 10:

[0521] Finally, the device provides the user with the option to share or print the work. The input is the user's instruction to share or print, and the output is the shared data or printed paper. Specifically, the user selects a sharing destination or printer and taps the "Share" or "Print" button.

[0522] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0523] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (registered trademark) (Internet search engine).<URL: https: / / openai.com / blog / chatgpt> ), Gemini (registered trademark) (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0524] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0525] [Second embodiment]

[0526] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0527] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0528] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0529] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0530] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0531] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0532] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0533] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0534] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0535] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0536] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0537] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0538] This invention relates to an interactive art creation system that allows children to create artworks while co-creating with AI through their own input. This system operates among three parties: the user, the terminal, and the server.

[0539] System configuration

[0540] This art production system consists of the following elements:

[0541] 1. Login method:

[0542] It is the means by which a user accesses a system and initiates a session, specifically by authenticating the user to the system using a username and password or other authentication means.

[0543] 2. Terminal means:

[0544] A device through which a user provides input and interacts with a system. Examples include smartphones, tablets, and PCs. It provides an interface for users to input requests and instructions for an artwork.

[0545] 3. Generation means:

[0546] This corresponds to an AI generation engine located on a server. It has the function of generating artworks based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time according to the user's requests.

[0547] 4. Means of transmission:

[0548] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions.

[0549] 5. Storage and sharing methods:

[0550] It is a means to save the generated artwork on your device or share it on social media or other platforms.

[0551] Explaining program processing in natural language

[0552] The process by which children access the system and create artwork is as follows:

[0553] server

[0554] When a user logs in, the server generates a new session ID and sends it back to the device. It receives input from the user and passes it to the AI ​​generation engine to generate an artwork. It then sends the generated artwork to the device and provides an interface for the user to give final instructions. It also sends data of the final generated artwork to the device to support saving and sharing.

[0555] Terminal

[0556] The device collects the information entered by the user and sends it to the server. It displays the artwork received from the server and prompts the user for further instructions. It also provides functions for users to save the artwork they have created and share it on social media.

[0557] User

[0558] A user first accesses the system using a login method and starts a session. Then, they input their art creation request through their device. For example, they might say, "I want to paint a rainbow." The device sends this input to the server, which processes the request using an AI generation engine and generates an artwork. The generated artwork is displayed on the device, and the user can view it while giving their next instruction. Finally, the user can review the completed work and save or share it, completing the art experience.

[0559] Specific examples

[0560] For example, consider the case where a user inputs "I want to draw a rainbow."

[0561] 1. User: Access the Art Experience Studio and log in.

[0562] 2. User: Uses the device to input "I want to draw a rainbow."

[0563] 3. Terminal: Sends this input to the server.

[0564] 4. Server: Receives input and passes it to the AI ​​generation engine.

[0565] 5. AI generation engine: Generates a rainbow image and sends it back to the server.

[0566] 6. Server: Sends the generated rainbow image to the device.

[0567] 7. Terminal: Displays the generated rainbow image to the user.

[0568] 8. User: Save or share your creations.

[0569] In this way, children can easily create original works of art with the assistance of AI.

[0570] The processing flow will be explained below.

[0571] Step 1:

[0572] The user accesses the Art Experience Studio website and enters authentication information using the login means.

[0573] Step 2:

[0574] The terminal sends the authentication information entered by the user to the server (HTTP POST request).

[0575] Step 3:

[0576] The server verifies the received authentication information and generates a new session ID if the user is valid.

[0577] Step 4:

[0578] The server returns the generated session ID to the terminal.

[0579] Step 5:

[0580] After logging in, the user inputs their art creation request (for example, "I want to draw a rainbow") into the terminal.

[0581] Step 6:

[0582] The terminal collects the user's input and sends it to the server along with the session ID (HTTP POST request).

[0583] Step 7:

[0584] The server passes the request to the AI ​​generation engine based on the received user input.

[0585] Step 8:

[0586] The AI ​​generative engine generates artwork (e.g., an image of a rainbow) based on user input.

[0587] Step 9:

[0588] The server receives the generated artwork data and transmits it to the terminal.

[0589] Step 10:

[0590] The terminal displays the artwork received from the server to the user.

[0591] Step 11:

[0592] The user enters final instructions for the displayed artwork (eg, "change the background to blue").

[0593] Step 12:

[0594] The terminal collects the user's final instructions and sends them back to the server (HTTP POST request).

[0595] Step 13:

[0596] The server receives the final instructions and sends a request to the AI ​​generation engine to generate the final artwork.

[0597] Step 14:

[0598] The AI ​​generative engine generates the final artwork and sends the data back to the server.

[0599] Step 15:

[0600] The server transmits the final artwork data to the terminal.

[0601] Step 16:

[0602] The terminal displays the final artwork to the user.

[0603] Step 17:

[0604] Users can save the generated artwork to their device's local storage or share it on social media.

[0605] Step 18:

[0606] The terminal executes the user's save and share requests.

[0607] Example 1

[0608] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0609] Conventional art creation systems make it difficult for users to demonstrate their creativity, and the process of creating artworks is complicated. This makes it difficult for children, in particular, to easily create beautiful artworks while enjoying interactive art creation. This invention aims to solve these problems by providing an interactive art creation system that allows users to intuitively operate the system and create artworks based on their own instructions while co-creating with AI.

[0610] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0611] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for analyzing the received user input and generating an artwork based on a generative model, a transmission means for returning data of the generated artwork to the terminal, an interface means for displaying the transmitted artwork and prompting the user for further instructions, and a storage means and sharing means for saving and sharing data of the final generated artwork. This allows users to intuitively operate the system, easily generate artworks while co-creating with AI, and save or share the final artworks.

[0612] A "login method" is an authentication method for a user to access a system and start a session. Specifically, it has the function of authenticating a user using a username and password or other authentication method.

[0613] "Terminal means" refers to a device that allows a user to input data and interact with the system. Specifically, this includes smartphones, tablets, and personal computers.

[0614] The "generation means" is an engine that uses a generative model stored on a server to generate artworks based on user input. Specifically, it uses AI to generate artworks in real time.

[0615] The "transmission means" is a mechanism that has the function of transmitting data of the generated artwork from the server to the terminal.

[0616] The "interface means" refers to a user interface that allows the user to check the generated artwork and give further instructions. Specifically, this refers to a graphical user interface (GUI) that is displayed on the screen.

[0617] "Storage and sharing means" refers to a system that has the function of storing the final artwork or sharing it on social media or other platforms.

[0618] This invention relates to an interactive art production system that allows users to create artworks in collaboration with AI through their own input. This system operates among three parties: the user, the terminal, and the server.

[0619] System configuration

[0620] This art production system consists of the following elements:

[0621] 1. Login method:

[0622] The means by which a user accesses the system and initiates a session, including the means by which the user authenticates to the system using a username and password or other authentication means, thereby activating the user's session and beginning the art-making process.

[0623] 2. Terminal means:

[0624] This is the device through which the user provides input and interacts with the system. Examples include smartphones, tablets, and PCs. The terminal provides an interface through which the user can input requests and instructions for the artwork. Specific devices that can be used include iOS devices, Android devices, and Windows PCs.

[0625] 3. Generation means:

[0626] This corresponds to an AI generation engine deployed on a server. It has the function of generating artwork based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artwork in real time according to the user's requests. The specific software used is OpenAI's generative AI model (e.g., GPT-3, DALL-E). This performs advanced data calculations and image generation.

[0627] 4. Means of transmission:

[0628] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions. The HTTP protocol is typically used as a data transmission method, which efficiently transfers data, including image files, to the terminal.

[0629] 5. Storage and sharing methods:

[0630] It is a means to save the generated artwork on the device and share it on social media and other platforms. Specifically, it includes local storage using the file system and automatic posting to social media via API integration.

[0631] Example of operation

[0632] For example, consider the case where a user inputs "I want to draw a rainbow."

[0633] 1. User: Access the Art Experience Studio and log in. Specifically, enter your username and password on the login screen and click the authentication button.

[0634] 2. User: Uses the device to input "I want to draw a rainbow." For example, enter "I want to draw a rainbow" into an input form.

[0635] 3. Terminal: Send this input to the server. Send the input data to the server using an HTTP request.

[0636] 4. Server: Receives input and passes it to the AI ​​generation engine for processing. Specifically, the AI ​​generation engine generates an image based on the keyword "rainbow."

[0637] 5. AI generation engine: Generates a rainbow image and sends it back to the server. For example, DALL-E is used to generate a "rainbow" image.

[0638] 6. Server: Sends the generated rainbow image to the device. Returns the generated image file to the device as an HTTP response.

[0639] 7. Terminal: Display the generated rainbow image to the user. For example, the generated rainbow image is displayed on the screen.

[0640] 8. User: Save or share the work. For example, press the save button on the device to save the image, or press the share button to share the image on social media.

[0641] Example prompts to input to the generative AI model

[0642] Here are some example prompts to input to a generative AI model:

[0643] "I'd like to draw a rainbow with a blue sky background, please."

[0644] "Draw a picture of animals playing in the forest."

[0645] "I want to generate illustrations of futuristic cities."

[0646] In this way, children can easily create original works of art with the assistance of AI. The system is intuitive to operate and provides a fun and creative experience.

[0647] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0648] Step 1:

[0649] A user accesses the system and enters a username and password on the login screen to request authentication. The terminal sends this input information to the server. The server checks the database based on the received authentication information, generates a new session ID, and sends it back to the terminal. This session ID activates the user's session.

[0650] Input: Username, Password

[0651] Output: Session ID

[0652] Specific operation: The user enters the username "exampleUser" and password "examplePass" and clicks the "Login" button.

[0653] Step 2:

[0654] The user enters their desired artwork into an input field on their device, such as "I want to paint a rainbow." The device then sends this instruction to the server, which parses it and constructs a request to pass to the generative AI model.

[0655] Input: Artwork request (prompt)

[0656] Output: Request to the generative AI model

[0657] Specific behavior: The user enters "I want to draw a rainbow" in the input field and clicks the "Submit" button.

[0658] Step 3:

[0659] The server sends the prompt received from the user to the generative AI model, which analyzes the prompt and performs data calculations to generate an artwork. The generative AI model then returns the resulting artwork data to the server.

[0660] Input: A request to the generative AI model

[0661] Output: The generated artwork data

[0662] Specific operation: The server sends the prompt sentence "I want to draw a rainbow" to the generation AI model (e.g., DALL-E), and the AI ​​generates image data of a rainbow.

[0663] Step 4:

[0664] The server receives the artwork data returned by the generative AI model and sends it to the device. The device receives this data and displays it on the user interface. The user can then view the displayed artwork.

[0665] Input: Generated artwork data

[0666] Output: Artwork data sent to device

[0667] Specific operation: The server sends the generated rainbow image data to the terminal, which then displays it on the user's screen.

[0668] Step 5:

[0669] The user checks the displayed artwork and enters the next instruction or additional instructions for correction. The device sends the new input back to the server, and steps 3 and 4 are repeated.

[0670] Input: Additional or corrective instructions

[0671] Output: Regenerated artwork data

[0672] Specific action: The user types "Make it a little brighter" and clicks the "Submit" button.

[0673] Step 6:

[0674] The user finally confirms the artwork they are satisfied with and takes action to save or share it. The device accepts this action and sends a save request to the server or a share request to a social network via API. The server stores the artwork in a database and generates the appropriate sharing link.

[0675] Input: Save or Share action

[0676] Output: Saved data or shared link

[0677] Specific operation: The user presses the save button to save the work to the device, or presses the share button to share the work on a social networking site.

[0678] In this way, the system allows users to intuitively operate it, easily create artworks in collaboration with AI, and save or share those works.

[0679] (Application example 1)

[0680] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0681] Conventional art creation systems lack interactivity and simplicity when children express their creativity and create artworks, and they also lack an easy way to share the artworks they create with other users. Furthermore, many systems only allow users to use the artworks as they are, and do not provide sufficient functionality for users to edit and finalize their own works. It is necessary to solve these issues and provide a more creative and interactive art creation experience.

[0682] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0683] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for generating an artwork using a generative AI model based on the received user input, a transmission means for returning data of the generated artwork to the terminal, an editing means for displaying the generated artwork on the terminal and allowing the user to edit it, and a saving and sharing means for saving and sharing the final artwork. This allows children to easily and interactively create artworks through their own input and easily share them with other users.

[0684] The "login means" is an authentication means for a user to access the system and start a session, and is a means for authenticating the user by entering a user name, password, etc.

[0685] "Terminal means" refers to a device that collects user input and transmits it to a server, and is a means for providing the corresponding interface, such as a smartphone, tablet, or PC.

[0686] A "generative AI model" is a program or system that contains artificial intelligence algorithms for generating artwork based on received user input.

[0687] "Generative means" refers to a means including a mechanism or device that uses a generative AI model to generate an artwork in response to user input.

[0688] The "transmission means" is a communication means for returning data of the generated artwork from the server to the terminal.

[0689] "Editing means" means a means for displaying the generated artwork on a terminal and providing interactive functionality for the user to edit and finalize the artwork.

[0690] "Storage and sharing means" includes functions and means for saving the final artwork on a terminal or sharing it with other users or platforms via a network.

[0691] This invention is an interactive art creation system that allows children to create artworks through their own input, and then edit, save, and share those artworks. Detailed embodiments of this system are described below.

[0692] System Program

[0693] server:

[0694] The server performs the following main processes:

[0695] 1. Login method: A method for authenticating a user to access a system and start a session. Here, the user is identified by entering a username and password.

[0696] 2. Generation method: Based on the received user input, a generative AI model is used to generate artwork. The generative AI model incorporates advanced artificial intelligence algorithms and creates artwork in real time according to the user's requests.

[0697] 3. Transmission means: A communication means for returning the generated artwork to the terminal. In order to efficiently transfer the data of the generated artwork, the data is transmitted via the Internet.

[0698] Device:

[0699] The terminal has the primary function of collecting user input and displaying, editing, saving and sharing artwork received from the server.

[0700] 1. Input interface: Provides an interface for users to input their requests and specific instructions for art production. This can be a smartphone, tablet, PC, or other device.

[0701] 2. Display and editing means: displays the generated artwork sent from the server and provides a GUI (Graphical User Interface) for the user to edit the artwork.

[0702] 3. Saving and sharing: Provides the ability to save the completed artwork on the device and share it with other users or via social networking sites via the Internet.

[0703] User:

[0704] The user operates the system in the following steps.

[0705] 1. Logging in and starting a session: You start a session by entering your account information and logging into the system.

[0706] 2. Inputting requests for art creation: Input requests such as "I want to draw a seascape" or "I want to draw a rainbow" into the input interface.

[0707] 3. Review and edit the generated artwork: Review the generated artwork, adjust colors, add additional elements, etc.

[0708] 4. Save and Share: Save your final artwork and share it on social media etc.

[0709] Hardware and software used

[0710] The system is implemented using the following hardware and software:

[0711] Hardware: Smartphones (e.g., iPhone, Android devices), tablets (e.g., iPad, Android tablets), computers (e.g., Windows PC, Mac)

[0712] Generative AI model: Uses artificial intelligence models such as OpenAI's DALL-E as the generative algorithm.

[0713] Server: An EC2 instance from Amazon Web Services (AWS) is used, and an S3 bucket is used for sending and receiving data.

[0714] Database: MongoDB is used to store the metadata of the artworks.

[0715] Front-end: Use Flutter or React Native to build the user interface.

[0716] Backend: Perform server-side processing using Node.js or Python (Flask).

[0717] Specific examples

[0718] For example, if a user inputs "I want to draw a seascape," the following steps are performed:

[0719] 1. User: Launches the application and logs in.

[0720] 2. User: Uses the interface to input "I want to draw a seascape."

[0721] 3. Terminal: Sends this instruction to the server.

[0722] 4. Server: Receives instructions and passes them to a generative AI model (such as DALL-E) for processing.

[0723] 5. Generative AI model: Generates a seascape artwork that corresponds to the user's request and sends it back to the server.

[0724] 6. Server: Sends the generated artwork back to the device.

[0725] 7. Terminal: Displays the generated artwork to the user and encourages them to edit it.

[0726] 8. User: Edit and finalize your work, save it or share it on social media.

[0727] Prompt Sentence Examples

[0728] "Painting beautiful seascapes"

[0729] In this way, children are provided with a system that allows them to express their creativity and create, edit, and share artworks easily and interactively.

[0730] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0731] Step 1:

[0732] Device: The user launches the app and the login screen appears. The user enters their account information (username and password) and submits a login request.

[0733] Input: Username, Password

[0734] Output: Login request to server

[0735] Step 2:

[0736] Server: Receives the login request and authenticates the user information. If authentication is successful, it generates a new session ID and returns it to the terminal.

[0737] Input: Username, Password

[0738] Output: Session ID

[0739] Step 3:

[0740] Device: Receives the session ID and displays the home screen. The user taps the "Create new art" button, and the input interface appears.

[0741] Input: Session ID

[0742] Output: Home screen

[0743] Step 4:

[0744] User: Enters a request for art creation into the input interface (e.g., "I want to paint a seascape"). The request is structured in text format.

[0745] Input: Art production request (text)

[0746] Output: Text request

[0747] Step 5:

[0748] Terminal: Sends the user's art creation request to the server.

[0749] Input: Text request

[0750] Output: Request data to the server

[0751] Step 6:

[0752] Server: Receives text requests and passes them to a generative AI model, which generates artwork based on the requests.

[0753] Input: Text request

[0754] Output: A prompt to the generative AI model (e.g., "Draw a seascape")

[0755] Step 7:

[0756] Generative AI model: Receives a prompt and generates an artwork. The generated artwork data is sent back to the server.

[0757] Input: prompt statement

[0758] Output: Artwork data

[0759] Step 8:

[0760] Server: Receives the generated artwork data and returns it to the device.

[0761] Input: Artwork data

[0762] Output: Artwork data to device

[0763] Step 9:

[0764] Terminal: Receives artwork data and displays it to the user. The user can view the artwork through the interface and make edits as needed.

[0765] Input: Artwork data

[0766] Output: The displayed artwork

[0767] Step 10:

[0768] User: Edits the displayed artwork, for example by changing the color or drawing in additional elements. Once edits are complete, saves or shares the final work.

[0769] Input:Editing instructions

[0770] Output: Final artwork

[0771] Step 11:

[0772] Device: Save the final artwork and share it with social media or other users if desired. Saving is done in the device's memory, and sharing is done via the Internet.

[0773] Input: Final artwork

[0774] Output: Saved and shared artwork

[0775] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0776] This invention relates to an interactive art creation system that allows children to create artworks in collaboration with AI through their own input, and further combines it with an emotion engine that recognizes the user's emotions. Processing in this system is carried out between four parties: the user, the terminal, the server, and the emotion engine.

[0777] System configuration

[0778] This art production system consists of the following elements:

[0779] 1. Login method:

[0780] It is the means by which a user accesses a system and initiates a session, specifically by authenticating the user to the system using a username and password or other authentication means.

[0781] 2. Terminal means:

[0782] A device through which a user provides input and interacts with a system. Examples include smartphones, tablets, and PCs. It provides an interface for users to input requests and instructions for an artwork.

[0783] 3. Generation means:

[0784] This corresponds to an AI generation engine located on a server. It has the function of generating artworks based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time according to the user's requests.

[0785] 4. Means of transmission:

[0786] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions.

[0787] 5. Storage and sharing methods:

[0788] It is a means to save the generated artwork on your device or share it on social media or other platforms.

[0789] 6. Emotion Engine:

[0790] It is a means to recognize a user's emotions and customize artworks according to those emotions. This engine recognizes emotions from the user's facial expressions, voice, or text, and passes that data to an AI generation engine to generate artworks based on the user's emotions.

[0791] Explaining program processing in natural language

[0792] The process by which children access the system and create artwork that combines the emotion engine is as follows:

[0793] server

[0794] When a user logs in, the server generates a new session ID and sends it back to the device. It receives input from the user and passes it to the AI ​​generation engine and emotion engine to generate an artwork. It then sends the generated artwork to the device and provides an interface for the user to give final instructions. It also sends data of the final generated artwork to the device to support saving and sharing.

[0795] Terminal

[0796] The device collects information entered by the user and sends it to the server. It also collects data to send the user's emotions to the emotion engine. It displays the artwork received from the server and prompts the user for further instructions. It also provides functions that allow users to save the artwork they have created and share it on social media.

[0797] User

[0798] The user first accesses the system using a login method and starts a session. They then input their art creation request through their device, and provide further input for emotion recognition by the emotion engine (for example, facial expression recognition using a camera or voice input). The user's input and emotion data are processed by the AI ​​generation engine, and an appropriate artwork is generated. The generated artwork is displayed on the device, and the user can view it and give further instructions. Finally, the user confirms the completed artwork and saves or shares it, completing the art experience.

[0799] Specific examples

[0800] For example, consider a case where a user inputs "I want to draw a rainbow" and has a happy expression on his / her face at the time.

[0801] 1. User: Access the Art Experience Studio and log in.

[0802] 2. User: Uses the device to input "I want to draw a rainbow."

[0803] 3. Terminal: The user's facial expressions and voice are sent to the emotion engine to recognize happy emotions.

[0804] 4. Terminal: Sends this input and emotion data to the server.

[0805] 5. Server: Receives input and emotion data and passes it to the AI ​​generation engine.

[0806] 6. AI Generative Engine: Generates rainbow images and adds colors and designs that match happy emotions.

[0807] 7. Server: Sends the generated artwork to the device.

[0808] 8. Terminal: Displays the generated rainbow image to the user.

[0809] 9. User: Save or share your creation.

[0810] In this way, children can create original artwork that is more personal and interesting, with the help of AI assistance and emotion recognition.

[0811] The processing flow will be explained below.

[0812] Step 1:

[0813] The user accesses the Art Experience Studio website and enters authentication information using the login means.

[0814] Step 2:

[0815] The terminal sends the authentication information entered by the user to the server (HTTP POST request).

[0816] Step 3:

[0817] The server verifies the received authentication information and generates a new session ID if the user is valid.

[0818] Step 4:

[0819] The server returns the generated session ID to the terminal.

[0820] Step 5:

[0821] After logging in, the user inputs their art creation request (for example, "I want to draw a rainbow") into the terminal.

[0822] Step 6:

[0823] The device sends the user's input to an emotion engine and analyzes the user's facial expressions and voice in real time.

[0824] Step 7:

[0825] The emotion engine recognizes emotions based on the user's facial expressions and voice, and sends that data back to the device.

[0826] Step 8:

[0827] The device sends the user's input and emotion data together to the server (HTTP POST request).

[0828] Step 9:

[0829] The server passes the request to the AI ​​generation engine based on the received user input and emotion data.

[0830] Step 10:

[0831] The AI ​​generative engine generates artwork (for example, an image of a rainbow that matches the emotion of happiness) based on user input and emotional data.

[0832] Step 11:

[0833] The server receives the generated artwork data and transmits it to the terminal.

[0834] Step 12:

[0835] The terminal displays the artwork received from the server to the user.

[0836] Step 13:

[0837] The user enters final instructions for the displayed artwork (eg, "change the background to blue").

[0838] Step 14:

[0839] The terminal collects the user's final instructions and sends them back to the server (HTTP POST request).

[0840] Step 15:

[0841] The server receives the final instructions and sends a request to the AI ​​generation engine to generate the final artwork.

[0842] Step 16:

[0843] The AI ​​generative engine generates the final artwork and sends the data back to the server.

[0844] Step 17:

[0845] The server transmits the final artwork data to the terminal.

[0846] Step 18:

[0847] The terminal displays the final artwork to the user.

[0848] Step 19:

[0849] Users can save the generated artwork to their device's local storage or share it on social media.

[0850] Step 20:

[0851] The terminal executes the user's save and share requests.

[0852] Through this series of steps, children can use AI assistance and emotion recognition to create original artwork that is more personal and interesting.

[0853] Example 2

[0854] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0855] Today's children are seeking new art experiences using digital technology. However, conventional art creation systems lack the ability to generate truly personalized artworks because they do not take the user's emotions into account. Furthermore, they lack the ability to accurately reflect the user's input, as well as to customize artworks using the user's emotions. Therefore, there is a need for a system that allows children to create more engaging, original artworks.

[0856] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0857] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for generating an artwork using an AI generation engine based on the received user input, a transmission means for returning data of the generated artwork to the terminal, a means for collecting user emotion data and sending it to the emotion engine, and a means for the generation means to customize the artwork based on the emotion data recognized by the emotion engine. This makes it possible to generate personal and interesting artwork that reflects the user's emotions.

[0858] A "login means" is a means that provides authentication functionality for a user to access a system and initiate a session.

[0859] "Terminal means" refers to a device through which a user makes input and interacts with the system.

[0860] "Generation means" refers to a means that provides the functionality for an AI generation engine to generate artwork based on user input.

[0861] The "transmission means" is a means for returning data of the generated artwork from the server to the terminal.

[0862] The "emotion engine" is an engine that collects user emotion data and recognizes those emotions.

[0863] "Emotion data" refers to data relating to emotions obtained from the user's facial expressions, voice, etc.

[0864] The "means for customizing" is a means for providing the generating means with the ability to individually adjust the artwork based on the emotional data recognized by the emotional engine.

[0865] This invention relates to an interactive art creation system that allows children to create artworks in collaboration with AI through their own input, and further combines it with an emotion engine that recognizes the user's emotions. This system processes between four parties: the user, the terminal, the server, and the emotion engine.

[0866] System configuration

[0867] This art production system consists of the following elements:

[0868] 1. Login method:

[0869] A login method is a method that provides authentication for a user to access a system and initiate a session by entering a username and password or other authentication information to authenticate the user to the system.

[0870] 2. Terminal means:

[0871] The terminal means is a device through which the user inputs and interacts with the system. Examples include smartphones, tablets, and personal computers. These terminals provide an interface through which the user can input their art creation requests and view the resulting artwork.

[0872] 3. Generation means:

[0873] The generation means is a means for providing a function to generate artworks based on user input using an AI generation engine located on a server. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time based on user requests and prompts.

[0874] 4. Means of transmission:

[0875] The transmission means is a means for returning data of the generated artwork from the server to the terminal, allowing the user to check the generated artwork and give further instructions.

[0876] 5. Emotion Engine:

[0877] The emotion engine is an engine that collects the user's emotional data (facial expressions, voice, etc.) and recognizes those emotions. By analyzing the user's emotional data and passing it to the AI ​​generation engine, it generates artwork based on the user's emotions.

[0878] 6. Customization methods:

[0879] The customization means is a means for providing a function in which the generation means adjusts the artwork individually based on the emotional data recognized by the emotion engine. For example, if the user is happy, the colors may be brightened.

[0880] Specific example of system operation

[0881] For example, consider a case where a user inputs "I want to draw a rainbow" and has a happy expression on his / her face at the time.

[0882] 1. User: Accesses the system and logs in.

[0883] 2. User: Uses the device to input "I want to draw a rainbow."

[0884] 3. Terminal: The user's facial expressions and voice are sent to the emotion engine to recognize happy emotions.

[0885] 4. Terminal: Sends this input and emotion data to the server.

[0886] 5. Server: Receives input and emotion data and passes it to the AI ​​generation engine.

[0887] 6. AI Generative Engine: Generates rainbow images and adds colors and designs that match happy emotions.

[0888] 7. Server: Sends the generated artwork to the device.

[0889] 8. Terminal: Displays the generated rainbow image to the user.

[0890] 9. User: Save or share your creation.

[0891] This allows children to create original artwork that is more personal, interesting, and engaging with the help of AI and emotional recognition.

[0892] Examples of prompt statements

[0893] Below is an example of a prompt sentence to input to the generative AI model.

[0894] 1. "When a child says with a smile, 'I want to draw a rainbow,' create a colorful and vibrant rainbow using colors that bring joy."

[0895] 2. "When a child says with a gloomy expression, 'I want to draw a rainy landscape,' please create a rainy landscape using calm colors."

[0896] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0897] Processing flow

[0898] Step 1: User Login

[0899] Terminal: The user accesses the system and is presented with a login screen, providing a UI for entering a username and password.

[0900] Input: Username and Password

[0901] Output: User credentials

[0902] Action: Enter your username and password and press the login button.

[0903] Server: Receives the entered authentication information and checks it against the database. If authentication is successful, generates a new session ID and returns it to the terminal.

[0904] Input: User credentials

[0905] Output: Session ID

[0906] Operation: If authentication is successful, a session ID is generated and returned to the terminal.

[0907] Step 2: Enter your art requirements

[0908] Terminal: After successful login, present the user with a UI for entering their art request. Provide a text box asking "What kind of art would you like to create?" and a submit button.

[0909] Input: Art request (e.g. "I want to draw a rainbow")

[0910] Output: User's art request data

[0911] Action: The user types "I want to draw a rainbow" and presses the send button.

[0912] Step 3: Collecting emotion data

[0913] Terminal: Activates an emotion engine that uses a camera and microphone to collect the user's emotional data (facial expressions and voice).

[0914] Input: User's facial expression, voice

[0915] Output: Recognized emotion data (e.g., joy)

[0916] How it works: The device captures the user's camera footage and audio, and the emotion engine analyzes this to generate emotion data.

[0917] Step 4: Sending data to the server

[0918] Terminal: Sends the user's art requests and emotional data to the server.

[0919] Input: Art request data, emotion data

[0920] Output: Transmitted data

[0921] Operation: The device combines the art request and emotion data and sends the data to the server.

[0922] Server: Analyzes the received data and prepares it to be passed to the AI ​​generation engine.

[0923] Input: Send data

[0924] Output: Parsed data

[0925] Operation: The server receives the transmitted data and performs any necessary data conversions.

[0926] Step 5: Generate artwork using the AI ​​generation engine

[0927] Server: Passes the received art request and emotion data to the AI ​​generation engine.

[0928] Input: Analyzed data (art requests, emotional data)

[0929] Output: prompt statement

[0930] How it works: The server creates a prompt based on the art request and emotional data, and inputs it into the AI ​​generation engine.

[0931] AI generation engine: Generates artwork based on prompts.

[0932] Input: prompt statement

[0933] Output: Artwork data

[0934] How it works: The AI ​​generation engine inputs prompts into the generative model to generate artwork.

[0935] Step 6: Sending the generated artwork from the server to the device

[0936] Server: Receives the generated artwork and sends it to the device.

[0937] Input: Artwork data

[0938] Output: Send artwork data

[0939] Operation: The server receives artwork data and sends it to the device.

[0940] Terminal: Displays the received artwork to the user.

[0941] Input: Submitted artwork data

[0942] Output: The displayed artwork

[0943] What it does: The device displays the artwork and lets the user review it.

[0944] Step 7: User review and feedback on artwork

[0945] User: Review the generated artwork and provide corrections or additional instructions as needed.

[0946] Input: Feedback

[0947] Output: Correction request data

[0948] How it works: The user reviews the artwork and inputs corrections and additions into the device.

[0949] Terminal: Sends correction request data to the server.

[0950] Input: Correction request data

[0951] Output: Send correction data

[0952] Operation: The device sends data to the server.

[0953] Server: Receives the feedback, passes it back to the AI ​​generation engine, and repeats the process to generate a new piece of art.

[0954] Input: Send correction data

[0955] Output: New artwork data

[0956] How it works: The server passes correction instructions to the AI ​​generation engine and regenerates it.

[0957] Step 8: Save and share your artwork

[0958] Device: Once the user is satisfied with their artwork, it will be saved to local storage, and they will also have the option to share it on social media or other platforms.

[0959] Input: Save and Share Instructions

[0960] Output: Save and share completed

[0961] How it works: The device saves artwork and provides functionality for sharing on social media. The user performs the save and share operations.

[0962] This allows users to create more personal, interesting and original artworks with the help of AI and emotion recognition, completing a satisfying art experience.

[0963] (Application example 2)

[0964] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0965] Conventional interactive art creation systems have had difficulty enabling children to effectively create artwork that reflects their own emotions. Furthermore, they lacked a mechanism for easily saving, sharing, and printing the generated artwork in a physical store. Furthermore, they were difficult to integrate with specific hardware and devices, limiting user interaction.

[0966] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: login means for a user to access the system and start a session; terminal means for collecting user input and sending it to the server; generation means for generating an artwork using an AI generation engine based on the received user input; transmission means for returning data of the generated artwork to the terminal; emotion recognition means for recognizing the user's emotion and sending the data to the server; output means for providing functions such as outputting, saving, sharing, and printing the generated artwork; and linking means for linking with in-store hardware such as in-store displays and printers. This enables children to easily create and output personalized artwork that reflects their emotions, and then instantly save, share, and print it in the physical store.

[0967] A "login method" is the method by which a user accesses a system and initiates a session.

[0968] A "terminal means" is a device for collecting user input and transmitting it to a server.

[0969] "Generation means" refers to the method by which an AI generation engine generates an artwork based on received user input.

[0970] The "transmission means" is a method for returning the data of the generated artwork to the terminal.

[0971] "Emotion recognition means" is a method for recognizing a user's emotions and transmitting the data to a server.

[0972] "Output means" refers to a method for providing functions such as outputting, saving, sharing, and printing the generated artwork.

[0973] "Linkage means" refers to a method for linking with hardware in a physical store, such as in-store displays and printers.

[0974] This invention is a system for children to interactively create artworks, with a particular focus on generating artworks that reflect the user's emotions. This system is realized through cooperation between users, terminals, a server, an emotion engine, and hardware in a physical store.

[0975] Basic system configuration

[0976] The system consists of the following elements:

[0977] 1. Login method: In this system, users must log in to access and start a session. Specifically, they enter their name on a device such as a tablet, and then use Firebase Authentication to authenticate and generate a session ID.

[0978] 2. Terminal means: A smart device (e.g., iPad) that collects user input and emotion data and transmits them to the server.

[0979] 3. Generation method: Using an AI generation engine (e.g., DALL-E) on the server, artworks are generated based on user input and emotional data.

[0980] 4. Transmission means: A method for sending the generated artwork back to the terminal from the server.

[0981] 5. Emotion recognition means: The device's camera and microphone are used to recognize the user's emotions, and the data is analyzed by an emotion engine (e.g., TensorFlow) and sent to the server.

[0982] 6. Output means: Provides functions such as displaying, saving, sharing, and printing artworks generated on the device.

[0983] 7. Integration method: A method for integration with in-store hardware such as displays and printers.

[0984] What the program does

[0985] 1. Login process:

[0986] The user logs in by entering their name on the tablet. Firebase Authentication is used to authenticate and generate a session ID.

[0987] 2. Art Creation Interface:

[0988] Users select tools and brushes for painting through the tablet interface, which is equipped with a camera and microphone to recognize users' emotions in real time.

[0989] 3. Emotion Recognition and Data Transmission:

[0990] Using an emotion engine (TensorFlow), the device analyzes the user's facial expressions and voice, and sends the emotion (e.g., joy) they are feeling to the server. This data is sent directly from the device to the server.

[0991] 4. Artwork generation using an AI generation engine:

[0992] The server receives user input and emotion data and generates artwork using a generative AI model such as DALL-E. The generated artwork is personalized according to the user's emotions.

[0993] 5. Submission and Display of Generated Works:

[0994] The generated artwork is sent from the server to the device and displayed instantly, allowing the user to review the artwork and provide further instructions.

[0995] 6. Output and Linkage:

[0996] The completed artwork is stored in Firebase Storage, and can also be displayed and printed on in-store displays and printers via the device interface.

[0997] Specific examples

[0998] For example, if a user types "I want to draw a rainbow" and has a happy expression while doing so, the following prompt sentence can be sent to the generative AI model:

[0999] "Generate an image of a rainbow. The user's emotion is joy."

[1000] The generative AI model then generates a rainbow image that reflects the user's emotions and sends it to the device, allowing children to create, display, share, and print artwork personalized by their emotions and inputs.

[1001] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1002] Step 1:

[1003] The user enters their name into the tablet and logs in. The device authenticates the user using Firebase Authentication and requests the server to generate a session ID. The generated session ID is sent back to the device. The input is the user's name and the output is the session ID. Specifically, the user enters their name into the tablet's login screen and taps the "Login" button.

[1004] Step 2:

[1005] The user begins creating art through the tablet interface. The device collects the user's input in real time and sends it to the server. The input is the user's drawing instructions, and the output is instruction data for the server. In concrete terms, the user selects a brush and color and draws on the tablet.

[1006] Step 3:

[1007] The device's camera and microphone are used to recognize the user's emotions in real time. The emotion engine (TensorFlow) analyzes the user's facial expressions and voice, and sends the results from the device to a server. The input is facial expression and voice data, and the output is analyzed emotion data. Specifically, the device periodically captures and processes camera images and audio.

[1008] Step 4:

[1009] The server receives the user's input and emotional data and generates an artwork using the AI ​​generation engine (DALL-E). The input is the user's instructions and emotional data, and the output is the data of the generated artwork. Specifically, the server passes the necessary data to the AI ​​generation engine and receives the generated artwork.

[1010] Step 5:

[1011] The server returns the generated artwork to the terminal. The input is the data of the generated artwork, and the output is the data to be sent to the terminal. In concrete terms, the server transfers the artwork data to the terminal and confirms receipt.

[1012] Step 6:

[1013] The device displays the generated artwork. The input is the artwork data received from the server, and the output is the display on the tablet. Specifically, the device draws the received artwork on the screen and shows it to the user.

[1014] Step 7:

[1015] The user inputs the final instructions for the work into the terminal, and the terminal sends the data to the server. The input is the user's final instructions, and the output is the final instruction data to the server. Specifically, the user checks the work, makes any necessary corrections, and taps the "Done" button.

[1016] Step 8:

[1017] The server generates the final artwork based on the final instructions and sends the data to the terminal. The input is the user's final instructions, and the output is the data of the final generated artwork. Specifically, the server calls the AI ​​generation engine again to generate the final artwork.

[1018] Step 9:

[1019] The device stores the final artwork. The input is the data of the final artwork, and the output is the saved file. Specifically, the device stores the artwork data in local storage or cloud storage.

[1020] Step 10:

[1021] Finally, the device provides the user with the option to share or print the work. The input is the user's instruction to share or print, and the output is the shared data or printed paper. Specifically, the user selects a sharing destination or printer and taps the "Share" or "Print" button.

[1022] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1023] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1024] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1025] [Third embodiment]

[1026] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1027] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[1028] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1029] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1030] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1031] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1032] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1033] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1034] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1035] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1036] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1037] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1038] This invention relates to an interactive art creation system that allows children to create artworks while co-creating with AI through their own input. This system operates among three parties: the user, the terminal, and the server.

[1039] System configuration

[1040] This art production system consists of the following elements:

[1041] 1. Login method:

[1042] It is the means by which a user accesses a system and initiates a session, specifically by authenticating the user to the system using a username and password or other authentication means.

[1043] 2. Terminal means:

[1044] A device through which a user provides input and interacts with a system. Examples include smartphones, tablets, and PCs. It provides an interface for users to input requests and instructions for an artwork.

[1045] 3. Generation means:

[1046] This corresponds to an AI generation engine located on a server. It has the function of generating artworks based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time according to the user's requests.

[1047] 4. Means of transmission:

[1048] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions.

[1049] 5. Storage and sharing methods:

[1050] It is a means to save the generated artwork on your device or share it on social media or other platforms.

[1051] Explaining program processing in natural language

[1052] The process by which children access the system and create artwork is as follows:

[1053] server

[1054] When a user logs in, the server generates a new session ID and sends it back to the device. It receives input from the user and passes it to the AI ​​generation engine to generate an artwork. It then sends the generated artwork to the device and provides an interface for the user to give final instructions. It also sends data of the final generated artwork to the device to support saving and sharing.

[1055] Terminal

[1056] The device collects the information entered by the user and sends it to the server. It displays the artwork received from the server and prompts the user for further instructions. It also provides functions for users to save the artwork they have created and share it on social media.

[1057] User

[1058] A user first accesses the system using a login method and starts a session. Then, they input their art creation request through their device. For example, they might say, "I want to paint a rainbow." The device sends this input to the server, which processes the request using an AI generation engine and generates an artwork. The generated artwork is displayed on the device, and the user can view it while giving their next instruction. Finally, the user can review the completed work and save or share it, completing the art experience.

[1059] Specific examples

[1060] For example, consider the case where a user inputs "I want to draw a rainbow."

[1061] 1. User: Access the Art Experience Studio and log in.

[1062] 2. User: Uses the device to input "I want to draw a rainbow."

[1063] 3. Terminal: Sends this input to the server.

[1064] 4. Server: Receives input and passes it to the AI ​​generation engine.

[1065] 5. AI generation engine: Generates a rainbow image and sends it back to the server.

[1066] 6. Server: Sends the generated rainbow image to the device.

[1067] 7. Terminal: Displays the generated rainbow image to the user.

[1068] 8. User: Save or share your creations.

[1069] In this way, children can easily create original works of art with the assistance of AI.

[1070] The processing flow will be explained below.

[1071] Step 1:

[1072] The user accesses the Art Experience Studio website and enters authentication information using the login means.

[1073] Step 2:

[1074] The terminal sends the authentication information entered by the user to the server (HTTP POST request).

[1075] Step 3:

[1076] The server verifies the received authentication information and generates a new session ID if the user is valid.

[1077] Step 4:

[1078] The server returns the generated session ID to the terminal.

[1079] Step 5:

[1080] After logging in, the user inputs their art creation request (for example, "I want to draw a rainbow") into the terminal.

[1081] Step 6:

[1082] The terminal collects the user's input and sends it to the server along with the session ID (HTTP POST request).

[1083] Step 7:

[1084] The server passes the request to the AI ​​generation engine based on the received user input.

[1085] Step 8:

[1086] The AI ​​generative engine generates artwork (e.g., an image of a rainbow) based on user input.

[1087] Step 9:

[1088] The server receives the generated artwork data and transmits it to the terminal.

[1089] Step 10:

[1090] The terminal displays the artwork received from the server to the user.

[1091] Step 11:

[1092] The user enters final instructions for the displayed artwork (eg, "change the background to blue").

[1093] Step 12:

[1094] The terminal collects the user's final instructions and sends them back to the server (HTTP POST request).

[1095] Step 13:

[1096] The server receives the final instructions and sends a request to the AI ​​generation engine to generate the final artwork.

[1097] Step 14:

[1098] The AI ​​generative engine generates the final artwork and sends the data back to the server.

[1099] Step 15:

[1100] The server transmits the final artwork data to the terminal.

[1101] Step 16:

[1102] The terminal displays the final artwork to the user.

[1103] Step 17:

[1104] Users can save the generated artwork to their device's local storage or share it on social media.

[1105] Step 18:

[1106] The terminal executes the user's save and share requests.

[1107] Example 1

[1108] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1109] Conventional art creation systems make it difficult for users to demonstrate their creativity, and the process of creating artworks is complicated. This makes it difficult for children, in particular, to easily create beautiful artworks while enjoying interactive art creation. This invention aims to solve these problems by providing an interactive art creation system that allows users to intuitively operate the system and create artworks based on their own instructions while co-creating with AI.

[1110] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1111] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for analyzing the received user input and generating an artwork based on a generative model, a transmission means for returning data of the generated artwork to the terminal, an interface means for displaying the transmitted artwork and prompting the user for further instructions, and a storage means and sharing means for saving and sharing data of the final generated artwork. This allows users to intuitively operate the system, easily generate artworks while co-creating with AI, and save or share the final artworks.

[1112] A "login method" is an authentication method for a user to access a system and start a session. Specifically, it has the function of authenticating a user using a username and password or other authentication method.

[1113] "Terminal means" refers to a device that allows a user to input data and interact with the system. Specifically, this includes smartphones, tablets, and personal computers.

[1114] The "generation means" is an engine that uses a generative model stored on a server to generate artworks based on user input. Specifically, it uses AI to generate artworks in real time.

[1115] The "transmission means" is a mechanism that has the function of transmitting data of the generated artwork from the server to the terminal.

[1116] The "interface means" refers to a user interface that allows the user to check the generated artwork and give further instructions. Specifically, this refers to a graphical user interface (GUI) that is displayed on the screen.

[1117] "Storage and sharing means" refers to a system that has the function of storing the final artwork or sharing it on social media or other platforms.

[1118] This invention relates to an interactive art production system that allows users to create artworks in collaboration with AI through their own input. This system operates among three parties: the user, the terminal, and the server.

[1119] System configuration

[1120] This art production system consists of the following elements:

[1121] 1. Login method:

[1122] The means by which a user accesses the system and initiates a session, including the means by which the user authenticates to the system using a username and password or other authentication means, thereby activating the user's session and beginning the art-making process.

[1123] 2. Terminal means:

[1124] This is the device through which the user provides input and interacts with the system. Examples include smartphones, tablets, and PCs. The terminal provides an interface through which the user can input requests and instructions for the artwork. Specific devices that can be used include iOS devices, Android devices, and Windows PCs.

[1125] 3. Generation means:

[1126] This corresponds to an AI generation engine deployed on a server. It has the function of generating artwork based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artwork in real time according to the user's requests. The specific software used is OpenAI's generative AI model (e.g., GPT-3, DALL-E). This performs advanced data calculations and image generation.

[1127] 4. Means of transmission:

[1128] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions. The HTTP protocol is typically used as a data transmission method, which efficiently transfers data, including image files, to the terminal.

[1129] 5. Storage and sharing methods:

[1130] It is a means to save the generated artwork on the device and share it on social media and other platforms. Specifically, it includes local storage using the file system and automatic posting to social media via API integration.

[1131] Example of operation

[1132] For example, consider the case where a user inputs "I want to draw a rainbow."

[1133] 1. User: Access the Art Experience Studio and log in. Specifically, enter your username and password on the login screen and click the authentication button.

[1134] 2. User: Uses the device to input "I want to draw a rainbow." For example, enter "I want to draw a rainbow" into an input form.

[1135] 3. Terminal: Send this input to the server. Send the input data to the server using an HTTP request.

[1136] 4. Server: Receives input and passes it to the AI ​​generation engine for processing. Specifically, the AI ​​generation engine generates an image based on the keyword "rainbow."

[1137] 5. AI generation engine: Generates a rainbow image and sends it back to the server. For example, DALL-E is used to generate a "rainbow" image.

[1138] 6. Server: Sends the generated rainbow image to the device. Returns the generated image file to the device as an HTTP response.

[1139] 7. Terminal: Display the generated rainbow image to the user. For example, the generated rainbow image is displayed on the screen.

[1140] 8. User: Save or share the work. For example, press the save button on the device to save the image, or press the share button to share the image on social media.

[1141] Example prompts to input to the generative AI model

[1142] Here are some example prompts to input to a generative AI model:

[1143] "I'd like to draw a rainbow with a blue sky background, please."

[1144] "Draw a picture of animals playing in the forest."

[1145] "I want to generate illustrations of futuristic cities."

[1146] In this way, children can easily create original works of art with the assistance of AI. The system is intuitive to operate and provides a fun and creative experience.

[1147] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1148] Step 1:

[1149] A user accesses the system and enters a username and password on the login screen to request authentication. The terminal sends this input information to the server. The server checks the database based on the received authentication information, generates a new session ID, and sends it back to the terminal. This session ID activates the user's session.

[1150] Input: Username, Password

[1151] Output: Session ID

[1152] Specific operation: The user enters the username "exampleUser" and password "examplePass" and clicks the "Login" button.

[1153] Step 2:

[1154] The user enters their desired artwork into an input field on their device, such as "I want to paint a rainbow." The device then sends this instruction to the server, which parses it and constructs a request to pass to the generative AI model.

[1155] Input: Artwork request (prompt)

[1156] Output: Request to the generative AI model

[1157] Specific behavior: The user enters "I want to draw a rainbow" in the input field and clicks the "Submit" button.

[1158] Step 3:

[1159] The server sends the prompt received from the user to the generative AI model, which analyzes the prompt and performs data calculations to generate an artwork. The generative AI model then returns the resulting artwork data to the server.

[1160] Input: A request to the generative AI model

[1161] Output: The generated artwork data

[1162] Specific operation: The server sends the prompt sentence "I want to draw a rainbow" to the generation AI model (e.g., DALL-E), and the AI ​​generates image data of a rainbow.

[1163] Step 4:

[1164] The server receives the artwork data returned by the generative AI model and sends it to the device. The device receives this data and displays it on the user interface. The user can then view the displayed artwork.

[1165] Input: Generated artwork data

[1166] Output: Artwork data sent to device

[1167] Specific operation: The server sends the generated rainbow image data to the terminal, which then displays it on the user's screen.

[1168] Step 5:

[1169] The user checks the displayed artwork and enters the next instruction or additional instructions for correction. The device sends the new input back to the server, and steps 3 and 4 are repeated.

[1170] Input: Additional or corrective instructions

[1171] Output: Regenerated artwork data

[1172] Specific action: The user types "Make it a little brighter" and clicks the "Submit" button.

[1173] Step 6:

[1174] The user finally confirms the artwork they are satisfied with and takes action to save or share it. The device accepts this action and sends a save request to the server or a share request to a social network via API. The server stores the artwork in a database and generates the appropriate sharing link.

[1175] Input: Save or Share action

[1176] Output: Saved data or shared link

[1177] Specific operation: The user presses the save button to save the work to the device, or presses the share button to share the work on a social networking site.

[1178] In this way, the system allows users to intuitively operate it, easily create artworks in collaboration with AI, and save or share those works.

[1179] (Application example 1)

[1180] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1181] Conventional art creation systems lack interactivity and simplicity when children express their creativity and create artworks, and they also lack an easy way to share the artworks they create with other users. Furthermore, many systems only allow users to use the artworks as they are, and do not provide sufficient functionality for users to edit and finalize their own works. It is necessary to solve these issues and provide a more creative and interactive art creation experience.

[1182] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1183] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for generating an artwork using a generative AI model based on the received user input, a transmission means for returning data of the generated artwork to the terminal, an editing means for displaying the generated artwork on the terminal and allowing the user to edit it, and a saving and sharing means for saving and sharing the final artwork. This allows children to easily and interactively create artworks through their own input and easily share them with other users.

[1184] The "login means" is an authentication means for a user to access the system and start a session, and is a means for authenticating the user by entering a user name, password, etc.

[1185] "Terminal means" refers to a device that collects user input and transmits it to a server, and is a means for providing the corresponding interface, such as a smartphone, tablet, or PC.

[1186] A "generative AI model" is a program or system that contains artificial intelligence algorithms for generating artwork based on received user input.

[1187] "Generative means" refers to a means including a mechanism or device that uses a generative AI model to generate an artwork in response to user input.

[1188] The "transmission means" is a communication means for returning data of the generated artwork from the server to the terminal.

[1189] "Editing means" means a means for displaying the generated artwork on a terminal and providing interactive functionality for the user to edit and finalize the artwork.

[1190] "Storage and sharing means" includes functions and means for saving the final artwork on a terminal or sharing it with other users or platforms via a network.

[1191] This invention is an interactive art creation system that allows children to create artworks through their own input, and then edit, save, and share those artworks. Detailed embodiments of this system are described below.

[1192] System Program

[1193] server:

[1194] The server performs the following main processes:

[1195] 1. Login method: A method for authenticating a user to access a system and start a session. Here, the user is identified by entering a username and password.

[1196] 2. Generation method: Based on the received user input, a generative AI model is used to generate artwork. The generative AI model incorporates advanced artificial intelligence algorithms and creates artwork in real time according to the user's requests.

[1197] 3. Transmission means: A communication means for returning the generated artwork to the terminal. In order to efficiently transfer the data of the generated artwork, the data is transmitted via the Internet.

[1198] Device:

[1199] The terminal has the primary function of collecting user input and displaying, editing, saving and sharing artwork received from the server.

[1200] 1. Input interface: Provides an interface for users to input their requests and specific instructions for art production. This can be a smartphone, tablet, PC, or other device.

[1201] 2. Display and editing means: displays the generated artwork sent from the server and provides a GUI (Graphical User Interface) for the user to edit the artwork.

[1202] 3. Saving and sharing: Provides the ability to save the completed artwork on the device and share it with other users or via social networking sites via the Internet.

[1203] User:

[1204] The user operates the system in the following steps.

[1205] 1. Logging in and starting a session: You start a session by entering your account information and logging into the system.

[1206] 2. Inputting requests for art creation: Input requests such as "I want to draw a seascape" or "I want to draw a rainbow" into the input interface.

[1207] 3. Review and edit the generated artwork: Review the generated artwork, adjust colors, add additional elements, etc.

[1208] 4. Save and Share: Save your final artwork and share it on social media etc.

[1209] Hardware and software used

[1210] The system is implemented using the following hardware and software:

[1211] Hardware: Smartphones (e.g., iPhone, Android devices), tablets (e.g., iPad, Android tablets), computers (e.g., Windows PC, Mac)

[1212] Generative AI model: Uses artificial intelligence models such as OpenAI's DALL-E as the generative algorithm.

[1213] Server: An EC2 instance from Amazon Web Services (AWS) is used, and an S3 bucket is used for sending and receiving data.

[1214] Database: MongoDB is used to store the metadata of the artworks.

[1215] Front-end: Use Flutter or React Native to build the user interface.

[1216] Backend: Perform server-side processing using Node.js or Python (Flask).

[1217] Specific examples

[1218] For example, if a user inputs "I want to draw a seascape," the following steps are performed:

[1219] 1. User: Launches the application and logs in.

[1220] 2. User: Uses the interface to input "I want to draw a seascape."

[1221] 3. Terminal: Sends this instruction to the server.

[1222] 4. Server: Receives instructions and passes them to a generative AI model (such as DALL-E) for processing.

[1223] 5. Generative AI model: Generates a seascape artwork that corresponds to the user's request and sends it back to the server.

[1224] 6. Server: Sends the generated artwork back to the device.

[1225] 7. Terminal: Displays the generated artwork to the user and encourages them to edit it.

[1226] 8. User: Edit and finalize your work, save it or share it on social media.

[1227] Prompt Sentence Examples

[1228] "Painting beautiful seascapes"

[1229] In this way, children are provided with a system that allows them to express their creativity and create, edit, and share artworks easily and interactively.

[1230] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1231] Step 1:

[1232] Device: The user launches the app and the login screen appears. The user enters their account information (username and password) and submits a login request.

[1233] Input: Username, Password

[1234] Output: Login request to server

[1235] Step 2:

[1236] Server: Receives the login request and authenticates the user information. If authentication is successful, it generates a new session ID and returns it to the terminal.

[1237] Input: Username, Password

[1238] Output: Session ID

[1239] Step 3:

[1240] Device: Receives the session ID and displays the home screen. The user taps the "Create new art" button, and the input interface appears.

[1241] Input: Session ID

[1242] Output: Home screen

[1243] Step 4:

[1244] User: Enters a request for art creation into the input interface (e.g., "I want to paint a seascape"). The request is structured in text format.

[1245] Input: Art production request (text)

[1246] Output: Text request

[1247] Step 5:

[1248] Terminal: Sends the user's art creation request to the server.

[1249] Input: Text request

[1250] Output: Request data to the server

[1251] Step 6:

[1252] Server: Receives text requests and passes them to a generative AI model, which generates artwork based on the requests.

[1253] Input: Text request

[1254] Output: A prompt to the generative AI model (e.g., "Draw a seascape")

[1255] Step 7:

[1256] Generative AI model: Receives a prompt and generates an artwork. The generated artwork data is sent back to the server.

[1257] Input: prompt statement

[1258] Output: Artwork data

[1259] Step 8:

[1260] Server: Receives the generated artwork data and returns it to the device.

[1261] Input: Artwork data

[1262] Output: Artwork data to device

[1263] Step 9:

[1264] Terminal: Receives artwork data and displays it to the user. The user can view the artwork through the interface and make edits as needed.

[1265] Input: Artwork data

[1266] Output: The displayed artwork

[1267] Step 10:

[1268] User: Edits the displayed artwork, for example by changing the color or drawing in additional elements. Once edits are complete, saves or shares the final work.

[1269] Input:Editing instructions

[1270] Output: Final artwork

[1271] Step 11:

[1272] Device: Save the final artwork and share it with social media or other users if desired. Saving is done in the device's memory, and sharing is done via the Internet.

[1273] Input: Final artwork

[1274] Output: Saved and shared artwork

[1275] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1276] This invention relates to an interactive art creation system that allows children to create artworks in collaboration with AI through their own input, and further combines it with an emotion engine that recognizes the user's emotions. Processing in this system is carried out between four parties: the user, the terminal, the server, and the emotion engine.

[1277] System configuration

[1278] This art production system consists of the following elements:

[1279] 1. Login method:

[1280] It is the means by which a user accesses a system and initiates a session, specifically by authenticating the user to the system using a username and password or other authentication means.

[1281] 2. Terminal means:

[1282] A device through which a user provides input and interacts with a system. Examples include smartphones, tablets, and PCs. It provides an interface for users to input requests and instructions for an artwork.

[1283] 3. Generation means:

[1284] This corresponds to an AI generation engine located on a server. It has the function of generating artworks based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time according to the user's requests.

[1285] 4. Means of transmission:

[1286] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions.

[1287] 5. Storage and sharing methods:

[1288] It is a means to save the generated artwork on your device or share it on social media or other platforms.

[1289] 6. Emotion Engine:

[1290] It is a means to recognize a user's emotions and customize artworks according to those emotions. This engine recognizes emotions from the user's facial expressions, voice, or text, and passes that data to an AI generation engine to generate artworks based on the user's emotions.

[1291] Explaining program processing in natural language

[1292] The process by which children access the system and create artwork that combines the emotion engine is as follows:

[1293] server

[1294] When a user logs in, the server generates a new session ID and sends it back to the device. It receives input from the user and passes it to the AI ​​generation engine and emotion engine to generate an artwork. It then sends the generated artwork to the device and provides an interface for the user to give final instructions. It also sends data of the final generated artwork to the device to support saving and sharing.

[1295] Terminal

[1296] The device collects information entered by the user and sends it to the server. It also collects data to send the user's emotions to the emotion engine. It displays the artwork received from the server and prompts the user for further instructions. It also provides functions that allow users to save the artwork they have created and share it on social media.

[1297] User

[1298] The user first accesses the system using a login method and starts a session. They then input their art creation request through their device, and provide further input for emotion recognition by the emotion engine (for example, facial expression recognition using a camera or voice input). The user's input and emotion data are processed by the AI ​​generation engine, and an appropriate artwork is generated. The generated artwork is displayed on the device, and the user can view it and give further instructions. Finally, the user confirms the completed artwork and saves or shares it, completing the art experience.

[1299] Specific examples

[1300] For example, consider a case where a user inputs "I want to draw a rainbow" and has a happy expression on his / her face at the time.

[1301] 1. User: Access the Art Experience Studio and log in.

[1302] 2. User: Uses the device to input "I want to draw a rainbow."

[1303] 3. Terminal: The user's facial expressions and voice are sent to the emotion engine to recognize happy emotions.

[1304] 4. Terminal: Sends this input and emotion data to the server.

[1305] 5. Server: Receives input and emotion data and passes it to the AI ​​generation engine.

[1306] 6. AI Generative Engine: Generates rainbow images and adds colors and designs that match happy emotions.

[1307] 7. Server: Sends the generated artwork to the device.

[1308] 8. Terminal: Displays the generated rainbow image to the user.

[1309] 9. User: Save or share your creation.

[1310] In this way, children can create original artwork that is more personal and interesting, with the help of AI assistance and emotion recognition.

[1311] The processing flow will be explained below.

[1312] Step 1:

[1313] The user accesses the Art Experience Studio website and enters authentication information using the login means.

[1314] Step 2:

[1315] The terminal sends the authentication information entered by the user to the server (HTTP POST request).

[1316] Step 3:

[1317] The server verifies the received authentication information and generates a new session ID if the user is valid.

[1318] Step 4:

[1319] The server returns the generated session ID to the terminal.

[1320] Step 5:

[1321] After logging in, the user inputs their art creation request (for example, "I want to draw a rainbow") into the terminal.

[1322] Step 6:

[1323] The device sends the user's input to an emotion engine and analyzes the user's facial expressions and voice in real time.

[1324] Step 7:

[1325] The emotion engine recognizes emotions based on the user's facial expressions and voice, and sends that data back to the device.

[1326] Step 8:

[1327] The device sends the user's input and emotion data together to the server (HTTP POST request).

[1328] Step 9:

[1329] The server passes the request to the AI ​​generation engine based on the received user input and emotion data.

[1330] Step 10:

[1331] The AI ​​generative engine generates artwork (for example, an image of a rainbow that matches the emotion of happiness) based on user input and emotional data.

[1332] Step 11:

[1333] The server receives the generated artwork data and transmits it to the terminal.

[1334] Step 12:

[1335] The terminal displays the artwork received from the server to the user.

[1336] Step 13:

[1337] The user enters final instructions for the displayed artwork (eg, "change the background to blue").

[1338] Step 14:

[1339] The terminal collects the user's final instructions and sends them back to the server (HTTP POST request).

[1340] Step 15:

[1341] The server receives the final instructions and sends a request to the AI ​​generation engine to generate the final artwork.

[1342] Step 16:

[1343] The AI ​​generative engine generates the final artwork and sends the data back to the server.

[1344] Step 17:

[1345] The server transmits the final artwork data to the terminal.

[1346] Step 18:

[1347] The terminal displays the final artwork to the user.

[1348] Step 19:

[1349] Users can save the generated artwork to their device's local storage or share it on social media.

[1350] Step 20:

[1351] The terminal executes the user's save and share requests.

[1352] Through this series of steps, children can use AI assistance and emotion recognition to create original artwork that is more personal and interesting.

[1353] Example 2

[1354] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1355] Today's children are seeking new art experiences using digital technology. However, conventional art creation systems lack the ability to generate truly personalized artworks because they do not take the user's emotions into account. Furthermore, they lack the ability to accurately reflect the user's input, as well as to customize artworks using the user's emotions. Therefore, there is a need for a system that allows children to create more engaging, original artworks.

[1356] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1357] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for generating an artwork using an AI generation engine based on the received user input, a transmission means for returning data of the generated artwork to the terminal, a means for collecting user emotion data and sending it to the emotion engine, and a means for the generation means to customize the artwork based on the emotion data recognized by the emotion engine. This makes it possible to generate personal and interesting artwork that reflects the user's emotions.

[1358] A "login means" is a means that provides authentication functionality for a user to access a system and initiate a session.

[1359] "Terminal means" refers to a device through which a user makes input and interacts with the system.

[1360] "Generation means" refers to a means that provides the functionality for an AI generation engine to generate artwork based on user input.

[1361] The "transmission means" is a means for returning data of the generated artwork from the server to the terminal.

[1362] The "emotion engine" is an engine that collects user emotion data and recognizes those emotions.

[1363] "Emotion data" refers to data relating to emotions obtained from the user's facial expressions, voice, etc.

[1364] The "means for customizing" is a means for providing the generating means with the ability to individually adjust the artwork based on the emotional data recognized by the emotional engine.

[1365] This invention relates to an interactive art creation system that allows children to create artworks in collaboration with AI through their own input, and further combines it with an emotion engine that recognizes the user's emotions. This system processes between four parties: the user, the terminal, the server, and the emotion engine.

[1366] System configuration

[1367] This art production system consists of the following elements:

[1368] 1. Login method:

[1369] A login method is a method that provides authentication for a user to access a system and initiate a session by entering a username and password or other authentication information to authenticate the user to the system.

[1370] 2. Terminal means:

[1371] The terminal means is a device through which the user inputs and interacts with the system. Examples include smartphones, tablets, and personal computers. These terminals provide an interface through which the user can input their art creation requests and view the resulting artwork.

[1372] 3. Generation means:

[1373] The generation means is a means for providing a function to generate artworks based on user input using an AI generation engine located on a server. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time based on user requests and prompts.

[1374] 4. Means of transmission:

[1375] The transmission means is a means for returning data of the generated artwork from the server to the terminal, allowing the user to check the generated artwork and give further instructions.

[1376] 5. Emotion Engine:

[1377] The emotion engine is an engine that collects the user's emotional data (facial expressions, voice, etc.) and recognizes those emotions. By analyzing the user's emotional data and passing it to the AI ​​generation engine, it generates artwork based on the user's emotions.

[1378] 6. Customization methods:

[1379] The customization means is a means for providing a function in which the generation means adjusts the artwork individually based on the emotional data recognized by the emotion engine. For example, if the user is happy, the colors may be brightened.

[1380] Specific example of system operation

[1381] For example, consider a case where a user inputs "I want to draw a rainbow" and has a happy expression on his / her face at the time.

[1382] 1. User: Accesses the system and logs in.

[1383] 2. User: Uses the device to input "I want to draw a rainbow."

[1384] 3. Terminal: The user's facial expressions and voice are sent to the emotion engine to recognize happy emotions.

[1385] 4. Terminal: Sends this input and emotion data to the server.

[1386] 5. Server: Receives input and emotion data and passes it to the AI ​​generation engine.

[1387] 6. AI Generative Engine: Generates rainbow images and adds colors and designs that match happy emotions.

[1388] 7. Server: Sends the generated artwork to the device.

[1389] 8. Terminal: Displays the generated rainbow image to the user.

[1390] 9. User: Save or share your creation.

[1391] This allows children to create original artwork that is more personal, interesting, and engaging with the help of AI and emotional recognition.

[1392] Examples of prompt statements

[1393] Below is an example of a prompt sentence to input to the generative AI model.

[1394] 1. "When a child says with a smile, 'I want to draw a rainbow,' create a colorful and vibrant rainbow using colors that bring joy."

[1395] 2. "When a child says with a gloomy expression, 'I want to draw a rainy landscape,' please create a rainy landscape using calm colors."

[1396] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1397] Processing flow

[1398] Step 1: User Login

[1399] Terminal: The user accesses the system and is presented with a login screen, providing a UI for entering a username and password.

[1400] Input: Username and Password

[1401] Output: User credentials

[1402] Action: Enter your username and password and press the login button.

[1403] Server: Receives the entered authentication information and checks it against the database. If authentication is successful, generates a new session ID and returns it to the terminal.

[1404] Input: User credentials

[1405] Output: Session ID

[1406] Operation: If authentication is successful, a session ID is generated and returned to the terminal.

[1407] Step 2: Enter your art requirements

[1408] Terminal: After successful login, present the user with a UI for entering their art request. Provide a text box asking "What kind of art would you like to create?" and a submit button.

[1409] Input: Art request (e.g. "I want to draw a rainbow")

[1410] Output: User's art request data

[1411] Action: The user types "I want to draw a rainbow" and presses the send button.

[1412] Step 3: Collecting emotion data

[1413] Terminal: Activates an emotion engine that uses a camera and microphone to collect the user's emotional data (facial expressions and voice).

[1414] Input: User's facial expression, voice

[1415] Output: Recognized emotion data (e.g., joy)

[1416] How it works: The device captures the user's camera footage and audio, and the emotion engine analyzes this to generate emotion data.

[1417] Step 4: Sending data to the server

[1418] Terminal: Sends the user's art requests and emotional data to the server.

[1419] Input: Art request data, emotion data

[1420] Output: Transmitted data

[1421] Operation: The device combines the art request and emotion data and sends the data to the server.

[1422] Server: Analyzes the received data and prepares it to be passed to the AI ​​generation engine.

[1423] Input: Send data

[1424] Output: Parsed data

[1425] Operation: The server receives the transmitted data and performs any necessary data conversions.

[1426] Step 5: Generate artwork using the AI ​​generation engine

[1427] Server: Passes the received art request and emotion data to the AI ​​generation engine.

[1428] Input: Analyzed data (art requests, emotional data)

[1429] Output: prompt statement

[1430] How it works: The server creates a prompt based on the art request and emotional data, and inputs it into the AI ​​generation engine.

[1431] AI generation engine: Generates artwork based on prompts.

[1432] Input: prompt statement

[1433] Output: Artwork data

[1434] How it works: The AI ​​generation engine inputs prompts into the generative model to generate artwork.

[1435] Step 6: Sending the generated artwork from the server to the device

[1436] Server: Receives the generated artwork and sends it to the device.

[1437] Input: Artwork data

[1438] Output: Send artwork data

[1439] Operation: The server receives artwork data and sends it to the device.

[1440] Terminal: Displays the received artwork to the user.

[1441] Input: Submitted artwork data

[1442] Output: The displayed artwork

[1443] What it does: The device displays the artwork and lets the user review it.

[1444] Step 7: User review and feedback on artwork

[1445] User: Review the generated artwork and provide corrections or additional instructions as needed.

[1446] Input: Feedback

[1447] Output: Correction request data

[1448] How it works: The user reviews the artwork and inputs corrections and additions into the device.

[1449] Terminal: Sends correction request data to the server.

[1450] Input: Correction request data

[1451] Output: Send correction data

[1452] Operation: The device sends data to the server.

[1453] Server: Receives the feedback, passes it back to the AI ​​generation engine, and repeats the process to generate a new piece of art.

[1454] Input: Send correction data

[1455] Output: New artwork data

[1456] How it works: The server passes correction instructions to the AI ​​generation engine and regenerates it.

[1457] Step 8: Save and share your artwork

[1458] Device: Once the user is satisfied with their artwork, it will be saved to local storage, and they will also have the option to share it on social media or other platforms.

[1459] Input: Save and Share Instructions

[1460] Output: Save and share completed

[1461] How it works: The device saves artwork and provides functionality for sharing on social media. The user performs the save and share operations.

[1462] This allows users to create more personal, interesting and original artworks with the help of AI and emotion recognition, completing a satisfying art experience.

[1463] (Application example 2)

[1464] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1465] Conventional interactive art creation systems have had difficulty enabling children to effectively create artwork that reflects their own emotions. Furthermore, they lacked a mechanism for easily saving, sharing, and printing the generated artwork in a physical store. Furthermore, they were difficult to integrate with specific hardware and devices, limiting user interaction.

[1466] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: login means for a user to access the system and start a session; terminal means for collecting user input and sending it to the server; generation means for generating an artwork using an AI generation engine based on the received user input; transmission means for returning data of the generated artwork to the terminal; emotion recognition means for recognizing the user's emotion and sending the data to the server; output means for providing functions such as outputting, saving, sharing, and printing the generated artwork; and linking means for linking with in-store hardware such as in-store displays and printers. This enables children to easily create and output personalized artwork that reflects their emotions, and then instantly save, share, and print it in the physical store.

[1467] A "login method" is the method by which a user accesses a system and initiates a session.

[1468] A "terminal means" is a device for collecting user input and transmitting it to a server.

[1469] "Generation means" refers to the method by which an AI generation engine generates an artwork based on received user input.

[1470] The "transmission means" is a method for returning the data of the generated artwork to the terminal.

[1471] "Emotion recognition means" is a method for recognizing a user's emotions and transmitting the data to a server.

[1472] "Output means" refers to a method for providing functions such as outputting, saving, sharing, and printing the generated artwork.

[1473] "Linkage means" refers to a method for linking with hardware in a physical store, such as in-store displays and printers.

[1474] This invention is a system for children to interactively create artworks, with a particular focus on generating artworks that reflect the user's emotions. This system is realized through cooperation between users, terminals, a server, an emotion engine, and hardware in a physical store.

[1475] Basic system configuration

[1476] The system consists of the following elements:

[1477] 1. Login method: In this system, users must log in to access and start a session. Specifically, they enter their name on a device such as a tablet, and then use Firebase Authentication to authenticate and generate a session ID.

[1478] 2. Terminal means: A smart device (e.g., iPad) that collects user input and emotion data and transmits them to the server.

[1479] 3. Generation method: Using an AI generation engine (e.g., DALL-E) on the server, artworks are generated based on user input and emotional data.

[1480] 4. Transmission means: A method for sending the generated artwork back to the terminal from the server.

[1481] 5. Emotion recognition means: The device's camera and microphone are used to recognize the user's emotions, and the data is analyzed by an emotion engine (e.g., TensorFlow) and sent to the server.

[1482] 6. Output means: Provides functions such as displaying, saving, sharing, and printing artworks generated on the device.

[1483] 7. Integration method: A method for integration with in-store hardware such as displays and printers.

[1484] What the program does

[1485] 1. Login process:

[1486] The user logs in by entering their name on the tablet. Firebase Authentication is used to authenticate and generate a session ID.

[1487] 2. Art Creation Interface:

[1488] Users select tools and brushes for painting through the tablet interface, which is equipped with a camera and microphone to recognize users' emotions in real time.

[1489] 3. Emotion Recognition and Data Transmission:

[1490] Using an emotion engine (TensorFlow), the device analyzes the user's facial expressions and voice, and sends the emotion (e.g., joy) they are feeling to the server. This data is sent directly from the device to the server.

[1491] 4. Artwork generation using an AI generation engine:

[1492] The server receives user input and emotion data and generates artwork using a generative AI model such as DALL-E. The generated artwork is personalized according to the user's emotions.

[1493] 5. Submission and Display of Generated Works:

[1494] The generated artwork is sent from the server to the device and displayed instantly, allowing the user to review the artwork and provide further instructions.

[1495] 6. Output and Linkage:

[1496] The completed artwork is stored in Firebase Storage, and can also be displayed and printed on in-store displays and printers via the device interface.

[1497] Specific examples

[1498] For example, if a user types "I want to draw a rainbow" and has a happy expression while doing so, the following prompt sentence can be sent to the generative AI model:

[1499] "Generate an image of a rainbow. The user's emotion is joy."

[1500] The generative AI model then generates a rainbow image that reflects the user's emotions and sends it to the device, allowing children to create, display, share, and print artwork personalized by their emotions and inputs.

[1501] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1502] Step 1:

[1503] The user enters their name into the tablet and logs in. The device authenticates the user using Firebase Authentication and requests the server to generate a session ID. The generated session ID is sent back to the device. The input is the user's name and the output is the session ID. Specifically, the user enters their name into the tablet's login screen and taps the "Login" button.

[1504] Step 2:

[1505] The user begins creating art through the tablet interface. The device collects the user's input in real time and sends it to the server. The input is the user's drawing instructions, and the output is instruction data for the server. In concrete terms, the user selects a brush and color and draws on the tablet.

[1506] Step 3:

[1507] The device's camera and microphone are used to recognize the user's emotions in real time. The emotion engine (TensorFlow) analyzes the user's facial expressions and voice, and sends the results from the device to a server. The input is facial expression and voice data, and the output is analyzed emotion data. Specifically, the device periodically captures and processes camera images and audio.

[1508] Step 4:

[1509] The server receives the user's input and emotional data and generates an artwork using the AI ​​generation engine (DALL-E). The input is the user's instructions and emotional data, and the output is the data of the generated artwork. Specifically, the server passes the necessary data to the AI ​​generation engine and receives the generated artwork.

[1510] Step 5:

[1511] The server returns the generated artwork to the terminal. The input is the data of the generated artwork, and the output is the data to be sent to the terminal. In concrete terms, the server transfers the artwork data to the terminal and confirms receipt.

[1512] Step 6:

[1513] The device displays the generated artwork. The input is the artwork data received from the server, and the output is the display on the tablet. Specifically, the device draws the received artwork on the screen and shows it to the user.

[1514] Step 7:

[1515] The user inputs the final instructions for the work into the terminal, and the terminal sends the data to the server. The input is the user's final instructions, and the output is the final instruction data to the server. Specifically, the user checks the work, makes any necessary corrections, and taps the "Done" button.

[1516] Step 8:

[1517] The server generates the final artwork based on the final instructions and sends the data to the terminal. The input is the user's final instructions, and the output is the data of the final generated artwork. Specifically, the server calls the AI ​​generation engine again to generate the final artwork.

[1518] Step 9:

[1519] The device stores the final artwork. The input is the data of the final artwork, and the output is the saved file. Specifically, the device stores the artwork data in local storage or cloud storage.

[1520] Step 10:

[1521] Finally, the device provides the user with the option to share or print the work. The input is the user's instruction to share or print, and the output is the shared data or printed paper. Specifically, the user selects a sharing destination or printer and taps the "Share" or "Print" button.

[1522] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1523] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1524] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1525] [Fourth embodiment]

[1526] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1527] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1528] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1529] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1530] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1531] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1532] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1533] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1534] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1535] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1536] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1537] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1538] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1539] This invention relates to an interactive art creation system that allows children to create artworks while co-creating with AI through their own input. This system operates among three parties: the user, the terminal, and the server.

[1540] System configuration

[1541] This art production system consists of the following elements:

[1542] 1. Login method:

[1543] It is the means by which a user accesses a system and initiates a session, specifically by authenticating the user to the system using a username and password or other authentication means.

[1544] 2. Terminal means:

[1545] A device through which a user provides input and interacts with a system. Examples include smartphones, tablets, and PCs. It provides an interface for users to input requests and instructions for an artwork.

[1546] 3. Generation means:

[1547] This corresponds to an AI generation engine located on a server. It has the function of generating artworks based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time according to the user's requests.

[1548] 4. Means of transmission:

[1549] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions.

[1550] 5. Storage and sharing methods:

[1551] It is a means to save the generated artwork on your device or share it on social media or other platforms.

[1552] Explaining program processing in natural language

[1553] The process by which children access the system and create artwork is as follows:

[1554] server

[1555] When a user logs in, the server generates a new session ID and sends it back to the device. It receives input from the user and passes it to the AI ​​generation engine to generate an artwork. It then sends the generated artwork to the device and provides an interface for the user to give final instructions. It also sends data of the final generated artwork to the device to support saving and sharing.

[1556] Terminal

[1557] The device collects the information entered by the user and sends it to the server. It displays the artwork received from the server and prompts the user for further instructions. It also provides functions for users to save the artwork they have created and share it on social media.

[1558] User

[1559] A user first accesses the system using a login method and starts a session. Then, they input their art creation request through their device. For example, they might say, "I want to paint a rainbow." The device sends this input to the server, which processes the request using an AI generation engine and generates an artwork. The generated artwork is displayed on the device, and the user can view it while giving their next instruction. Finally, the user can review the completed work and save or share it, completing the art experience.

[1560] Specific examples

[1561] For example, consider the case where a user inputs "I want to draw a rainbow."

[1562] 1. User: Access the Art Experience Studio and log in.

[1563] 2. User: Uses the device to input "I want to draw a rainbow."

[1564] 3. Terminal: Sends this input to the server.

[1565] 4. Server: Receives input and passes it to the AI ​​generation engine.

[1566] 5. AI generation engine: Generates a rainbow image and sends it back to the server.

[1567] 6. Server: Sends the generated rainbow image to the device.

[1568] 7. Terminal: Displays the generated rainbow image to the user.

[1569] 8. User: Save or share your creations.

[1570] In this way, children can easily create original works of art with the assistance of AI.

[1571] The processing flow will be explained below.

[1572] Step 1:

[1573] The user accesses the Art Experience Studio website and enters authentication information using the login means.

[1574] Step 2:

[1575] The terminal sends the authentication information entered by the user to the server (HTTP POST request).

[1576] Step 3:

[1577] The server verifies the received authentication information and generates a new session ID if the user is valid.

[1578] Step 4:

[1579] The server returns the generated session ID to the terminal.

[1580] Step 5:

[1581] After logging in, the user inputs their art creation request (for example, "I want to draw a rainbow") into the terminal.

[1582] Step 6:

[1583] The terminal collects the user's input and sends it to the server along with the session ID (HTTP POST request).

[1584] Step 7:

[1585] The server passes the request to the AI ​​generation engine based on the received user input.

[1586] Step 8:

[1587] The AI ​​generative engine generates artwork (e.g., an image of a rainbow) based on user input.

[1588] Step 9:

[1589] The server receives the generated artwork data and transmits it to the terminal.

[1590] Step 10:

[1591] The terminal displays the artwork received from the server to the user.

[1592] Step 11:

[1593] The user enters final instructions for the displayed artwork (eg, "change the background to blue").

[1594] Step 12:

[1595] The terminal collects the user's final instructions and sends them back to the server (HTTP POST request).

[1596] Step 13:

[1597] The server receives the final instructions and sends a request to the AI ​​generation engine to generate the final artwork.

[1598] Step 14:

[1599] The AI ​​generative engine generates the final artwork and sends the data back to the server.

[1600] Step 15:

[1601] The server transmits the final artwork data to the terminal.

[1602] Step 16:

[1603] The terminal displays the final artwork to the user.

[1604] Step 17:

[1605] Users can save the generated artwork to their device's local storage or share it on social media.

[1606] Step 18:

[1607] The terminal executes the user's save and share requests.

[1608] Example 1

[1609] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1610] Conventional art creation systems make it difficult for users to demonstrate their creativity, and the process of creating artworks is complicated. This makes it difficult for children, in particular, to easily create beautiful artworks while enjoying interactive art creation. This invention aims to solve these problems by providing an interactive art creation system that allows users to intuitively operate the system and create artworks based on their own instructions while co-creating with AI.

[1611] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1612] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for analyzing the received user input and generating an artwork based on a generative model, a transmission means for returning data of the generated artwork to the terminal, an interface means for displaying the transmitted artwork and prompting the user for further instructions, and a storage means and sharing means for saving and sharing data of the final generated artwork. This allows users to intuitively operate the system, easily generate artworks while co-creating with AI, and save or share the final artworks.

[1613] A "login method" is an authentication method for a user to access a system and start a session. Specifically, it has the function of authenticating a user using a username and password or other authentication method.

[1614] "Terminal means" refers to a device that allows a user to input data and interact with the system. Specifically, this includes smartphones, tablets, and personal computers.

[1615] The "generation means" is an engine that uses a generative model stored on a server to generate artworks based on user input. Specifically, it uses AI to generate artworks in real time.

[1616] The "transmission means" is a mechanism that has the function of transmitting data of the generated artwork from the server to the terminal.

[1617] The "interface means" refers to a user interface that allows the user to check the generated artwork and give further instructions. Specifically, this refers to a graphical user interface (GUI) that is displayed on the screen.

[1618] "Storage and sharing means" refers to a system that has the function of storing the final artwork or sharing it on social media or other platforms.

[1619] This invention relates to an interactive art production system that allows users to create artworks in collaboration with AI through their own input. This system operates among three parties: the user, the terminal, and the server.

[1620] System configuration

[1621] This art production system consists of the following elements:

[1622] 1. Login method:

[1623] The means by which a user accesses the system and initiates a session, including the means by which the user authenticates to the system using a username and password or other authentication means, thereby activating the user's session and beginning the art-making process.

[1624] 2. Terminal means:

[1625] This is the device through which the user provides input and interacts with the system. Examples include smartphones, tablets, and PCs. The terminal provides an interface through which the user can input requests and instructions for the artwork. Specific devices that can be used include iOS devices, Android devices, and Windows PCs.

[1626] 3. Generation means:

[1627] This corresponds to an AI generation engine deployed on a server. It has the function of generating artwork based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artwork in real time according to the user's requests. The specific software used is OpenAI's generative AI model (e.g., GPT-3, DALL-E). This performs advanced data calculations and image generation.

[1628] 4. Means of transmission:

[1629] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions. The HTTP protocol is typically used as a data transmission method, which efficiently transfers data, including image files, to the terminal.

[1630] 5. Storage and sharing methods:

[1631] It is a means to save the generated artwork on the device and share it on social media and other platforms. Specifically, it includes local storage using the file system and automatic posting to social media via API integration.

[1632] Example of operation

[1633] For example, consider the case where a user inputs "I want to draw a rainbow."

[1634] 1. User: Access the Art Experience Studio and log in. Specifically, enter your username and password on the login screen and click the authentication button.

[1635] 2. User: Uses the device to input "I want to draw a rainbow." For example, enter "I want to draw a rainbow" into an input form.

[1636] 3. Terminal: Send this input to the server. Send the input data to the server using an HTTP request.

[1637] 4. Server: Receives input and passes it to the AI ​​generation engine for processing. Specifically, the AI ​​generation engine generates an image based on the keyword "rainbow."

[1638] 5. AI generation engine: Generates a rainbow image and sends it back to the server. For example, DALL-E is used to generate a "rainbow" image.

[1639] 6. Server: Sends the generated rainbow image to the device. Returns the generated image file to the device as an HTTP response.

[1640] 7. Terminal: Display the generated rainbow image to the user. For example, the generated rainbow image is displayed on the screen.

[1641] 8. User: Save or share the work. For example, press the save button on the device to save the image, or press the share button to share the image on social media.

[1642] Example prompts to input to the generative AI model

[1643] Here are some example prompts to input to a generative AI model:

[1644] "I'd like to draw a rainbow with a blue sky background, please."

[1645] "Draw a picture of animals playing in the forest."

[1646] "I want to generate illustrations of futuristic cities."

[1647] In this way, children can easily create original works of art with the assistance of AI. The system is intuitive to operate and provides a fun and creative experience.

[1648] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1649] Step 1:

[1650] A user accesses the system and enters a username and password on the login screen to request authentication. The terminal sends this input information to the server. The server checks the database based on the received authentication information, generates a new session ID, and sends it back to the terminal. This session ID activates the user's session.

[1651] Input: Username, Password

[1652] Output: Session ID

[1653] Specific operation: The user enters the username "exampleUser" and password "examplePass" and clicks the "Login" button.

[1654] Step 2:

[1655] The user enters their desired artwork into an input field on their device, such as "I want to paint a rainbow." The device then sends this instruction to the server, which parses it and constructs a request to pass to the generative AI model.

[1656] Input: Artwork request (prompt)

[1657] Output: Request to the generative AI model

[1658] Specific behavior: The user enters "I want to draw a rainbow" in the input field and clicks the "Submit" button.

[1659] Step 3:

[1660] The server sends the prompt received from the user to the generative AI model, which analyzes the prompt and performs data calculations to generate an artwork. The generative AI model then returns the resulting artwork data to the server.

[1661] Input: A request to the generative AI model

[1662] Output: The generated artwork data

[1663] Specific operation: The server sends the prompt sentence "I want to draw a rainbow" to the generation AI model (e.g., DALL-E), and the AI ​​generates image data of a rainbow.

[1664] Step 4:

[1665] The server receives the artwork data returned by the generative AI model and sends it to the device. The device receives this data and displays it on the user interface. The user can then view the displayed artwork.

[1666] Input: Generated artwork data

[1667] Output: Artwork data sent to device

[1668] Specific operation: The server sends the generated rainbow image data to the terminal, which then displays it on the user's screen.

[1669] Step 5:

[1670] The user checks the displayed artwork and enters the next instruction or additional instructions for correction. The device sends the new input back to the server, and steps 3 and 4 are repeated.

[1671] Input: Additional or corrective instructions

[1672] Output: Regenerated artwork data

[1673] Specific action: The user types "Make it a little brighter" and clicks the "Submit" button.

[1674] Step 6:

[1675] The user finally confirms the artwork they are satisfied with and takes action to save or share it. The device accepts this action and sends a save request to the server or a share request to a social network via API. The server stores the artwork in a database and generates the appropriate sharing link.

[1676] Input: Save or Share action

[1677] Output: Saved data or shared link

[1678] Specific operation: The user presses the save button to save the work to the device, or presses the share button to share the work on a social networking site.

[1679] In this way, the system allows users to intuitively operate it, easily create artworks in collaboration with AI, and save or share those works.

[1680] (Application example 1)

[1681] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1682] Conventional art creation systems lack interactivity and simplicity when children express their creativity and create artworks, and they also lack an easy way to share the artworks they create with other users. Furthermore, many systems only allow users to use the artworks as they are, and do not provide sufficient functionality for users to edit and finalize their own works. It is necessary to solve these issues and provide a more creative and interactive art creation experience.

[1683] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1684] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for generating an artwork using a generative AI model based on the received user input, a transmission means for returning data of the generated artwork to the terminal, an editing means for displaying the generated artwork on the terminal and allowing the user to edit it, and a saving and sharing means for saving and sharing the final artwork. This allows children to easily and interactively create artworks through their own input and easily share them with other users.

[1685] The "login means" is an authentication means for a user to access the system and start a session, and is a means for authenticating the user by entering a user name, password, etc.

[1686] "Terminal means" refers to a device that collects user input and transmits it to a server, and is a means for providing the corresponding interface, such as a smartphone, tablet, or PC.

[1687] A "generative AI model" is a program or system that contains artificial intelligence algorithms for generating artwork based on received user input.

[1688] "Generative means" refers to a means including a mechanism or device that uses a generative AI model to generate an artwork in response to user input.

[1689] The "transmission means" is a communication means for returning data of the generated artwork from the server to the terminal.

[1690] "Editing means" means a means for displaying the generated artwork on a terminal and providing interactive functionality for the user to edit and finalize the artwork.

[1691] "Storage and sharing means" includes functions and means for saving the final artwork on a terminal or sharing it with other users or platforms via a network.

[1692] This invention is an interactive art creation system that allows children to create artworks through their own input, and then edit, save, and share those artworks. Detailed embodiments of this system are described below.

[1693] System Program

[1694] server:

[1695] The server performs the following main processes:

[1696] 1. Login method: A method for authenticating a user to access a system and start a session. Here, the user is identified by entering a username and password.

[1697] 2. Generation method: Based on the received user input, a generative AI model is used to generate artwork. The generative AI model incorporates advanced artificial intelligence algorithms and creates artwork in real time according to the user's requests.

[1698] 3. Transmission means: A communication means for returning the generated artwork to the terminal. In order to efficiently transfer the data of the generated artwork, the data is transmitted via the Internet.

[1699] Device:

[1700] The terminal has the primary function of collecting user input and displaying, editing, saving and sharing artwork received from the server.

[1701] 1. Input interface: Provides an interface for users to input their requests and specific instructions for art production. This can be a smartphone, tablet, PC, or other device.

[1702] 2. Display and editing means: displays the generated artwork sent from the server and provides a GUI (Graphical User Interface) for the user to edit the artwork.

[1703] 3. Saving and sharing: Provides the ability to save the completed artwork on the device and share it with other users or via social networking sites via the Internet.

[1704] User:

[1705] The user operates the system in the following steps.

[1706] 1. Logging in and starting a session: You start a session by entering your account information and logging into the system.

[1707] 2. Inputting requests for art creation: Input requests such as "I want to draw a seascape" or "I want to draw a rainbow" into the input interface.

[1708] 3. Review and edit the generated artwork: Review the generated artwork, adjust colors, add additional elements, etc.

[1709] 4. Save and Share: Save your final artwork and share it on social media etc.

[1710] Hardware and software used

[1711] The system is implemented using the following hardware and software:

[1712] Hardware: Smartphones (e.g., iPhone, Android devices), tablets (e.g., iPad, Android tablets), computers (e.g., Windows PC, Mac)

[1713] Generative AI model: Uses artificial intelligence models such as OpenAI's DALL-E as the generative algorithm.

[1714] Server: An EC2 instance from Amazon Web Services (AWS) is used, and an S3 bucket is used for sending and receiving data.

[1715] Database: MongoDB is used to store the metadata of the artworks.

[1716] Front-end: Use Flutter or React Native to build the user interface.

[1717] Backend: Perform server-side processing using Node.js or Python (Flask).

[1718] Specific examples

[1719] For example, if a user inputs "I want to draw a seascape," the following steps are performed:

[1720] 1. User: Launches the application and logs in.

[1721] 2. User: Uses the interface to input "I want to draw a seascape."

[1722] 3. Terminal: Sends this instruction to the server.

[1723] 4. Server: Receives instructions and passes them to a generative AI model (such as DALL-E) for processing.

[1724] 5. Generative AI model: Generates a seascape artwork that corresponds to the user's request and sends it back to the server.

[1725] 6. Server: Sends the generated artwork back to the device.

[1726] 7. Terminal: Displays the generated artwork to the user and encourages them to edit it.

[1727] 8. User: Edit and finalize your work, save it or share it on social media.

[1728] Prompt Sentence Examples

[1729] "Painting beautiful seascapes"

[1730] In this way, children are provided with a system that allows them to express their creativity and create, edit, and share artworks easily and interactively.

[1731] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1732] Step 1:

[1733] Device: The user launches the app and the login screen appears. The user enters their account information (username and password) and submits a login request.

[1734] Input: Username, Password

[1735] Output: Login request to server

[1736] Step 2:

[1737] Server: Receives the login request and authenticates the user information. If authentication is successful, it generates a new session ID and returns it to the terminal.

[1738] Input: Username, Password

[1739] Output: Session ID

[1740] Step 3:

[1741] Device: Receives the session ID and displays the home screen. The user taps the "Create new art" button, and the input interface appears.

[1742] Input: Session ID

[1743] Output: Home screen

[1744] Step 4:

[1745] User: Enters a request for art creation into the input interface (e.g., "I want to paint a seascape"). The request is structured in text format.

[1746] Input: Art production request (text)

[1747] Output: Text request

[1748] Step 5:

[1749] Terminal: Sends the user's art creation request to the server.

[1750] Input: Text request

[1751] Output: Request data to the server

[1752] Step 6:

[1753] Server: Receives text requests and passes them to a generative AI model, which generates artwork based on the requests.

[1754] Input: Text request

[1755] Output: A prompt to the generative AI model (e.g., "Draw a seascape")

[1756] Step 7:

[1757] Generative AI model: Receives a prompt and generates an artwork. The generated artwork data is sent back to the server.

[1758] Input: prompt statement

[1759] Output: Artwork data

[1760] Step 8:

[1761] Server: Receives the generated artwork data and returns it to the device.

[1762] Input: Artwork data

[1763] Output: Artwork data to device

[1764] Step 9:

[1765] Terminal: Receives artwork data and displays it to the user. The user can view the artwork through the interface and make edits as needed.

[1766] Input: Artwork data

[1767] Output: The displayed artwork

[1768] Step 10:

[1769] User: Edits the displayed artwork, for example by changing the color or drawing in additional elements. Once edits are complete, saves or shares the final work.

[1770] Input:Editing instructions

[1771] Output: Final artwork

[1772] Step 11:

[1773] Device: Save the final artwork and share it with social media or other users if desired. Saving is done in the device's memory, and sharing is done via the Internet.

[1774] Input: Final artwork

[1775] Output: Saved and shared artwork

[1776] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1777] This invention relates to an interactive art creation system that allows children to create artworks in collaboration with AI through their own input, and further combines it with an emotion engine that recognizes the user's emotions. Processing in this system is carried out between four parties: the user, the terminal, the server, and the emotion engine.

[1778] System configuration

[1779] This art production system consists of the following elements:

[1780] 1. Login method:

[1781] It is the means by which a user accesses a system and initiates a session, specifically by authenticating the user to the system using a username and password or other authentication means.

[1782] 2. Terminal means:

[1783] A device through which a user provides input and interacts with a system. Examples include smartphones, tablets, and PCs. It provides an interface for users to input requests and instructions for an artwork.

[1784] 3. Generation means:

[1785] This corresponds to an AI generation engine located on a server. It has the function of generating artworks based on user input. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time according to the user's requests.

[1786] 4. Means of transmission:

[1787] This is a means for returning the generated artwork from the server to the terminal, allowing the user to review the generated artwork and provide final instructions.

[1788] 5. Storage and sharing methods:

[1789] It is a means to save the generated artwork on your device or share it on social media or other platforms.

[1790] 6. Emotion Engine:

[1791] It is a means to recognize a user's emotions and customize artworks according to those emotions. This engine recognizes emotions from the user's facial expressions, voice, or text, and passes that data to an AI generation engine to generate artworks based on the user's emotions.

[1792] Explaining program processing in natural language

[1793] The process by which children access the system and create artwork that combines the emotion engine is as follows:

[1794] server

[1795] When a user logs in, the server generates a new session ID and sends it back to the device. It receives input from the user and passes it to the AI ​​generation engine and emotion engine to generate an artwork. It then sends the generated artwork to the device and provides an interface for the user to give final instructions. It also sends data of the final generated artwork to the device to support saving and sharing.

[1796] Terminal

[1797] The device collects information entered by the user and sends it to the server. It also collects data to send the user's emotions to the emotion engine. It displays the artwork received from the server and prompts the user for further instructions. It also provides functions that allow users to save the artwork they have created and share it on social media.

[1798] User

[1799] The user first accesses the system using a login method and starts a session. They then input their art creation request through their device, and provide further input for emotion recognition by the emotion engine (for example, facial expression recognition using a camera or voice input). The user's input and emotion data are processed by the AI ​​generation engine, and an appropriate artwork is generated. The generated artwork is displayed on the device, and the user can view it and give further instructions. Finally, the user confirms the completed artwork and saves or shares it, completing the art experience.

[1800] Specific examples

[1801] For example, consider a case where a user inputs "I want to draw a rainbow" and has a happy expression on his / her face at the time.

[1802] 1. User: Access the Art Experience Studio and log in.

[1803] 2. User: Uses the device to input "I want to draw a rainbow."

[1804] 3. Terminal: The user's facial expressions and voice are sent to the emotion engine to recognize happy emotions.

[1805] 4. Terminal: Sends this input and emotion data to the server.

[1806] 5. Server: Receives input and emotion data and passes it to the AI ​​generation engine.

[1807] 6. AI Generative Engine: Generates rainbow images and adds colors and designs that match happy emotions.

[1808] 7. Server: Sends the generated artwork to the device.

[1809] 8. Terminal: Displays the generated rainbow image to the user.

[1810] 9. User: Save or share your creation.

[1811] In this way, children can create original artwork that is more personal and interesting, with the help of AI assistance and emotion recognition.

[1812] The processing flow will be explained below.

[1813] Step 1:

[1814] The user accesses the Art Experience Studio website and enters authentication information using the login means.

[1815] Step 2:

[1816] The terminal sends the authentication information entered by the user to the server (HTTP POST request).

[1817] Step 3:

[1818] The server verifies the received authentication information and generates a new session ID if the user is valid.

[1819] Step 4:

[1820] The server returns the generated session ID to the terminal.

[1821] Step 5:

[1822] After logging in, the user inputs their art creation request (for example, "I want to draw a rainbow") into the terminal.

[1823] Step 6:

[1824] The device sends the user's input to an emotion engine and analyzes the user's facial expressions and voice in real time.

[1825] Step 7:

[1826] The emotion engine recognizes emotions based on the user's facial expressions and voice, and sends that data back to the device.

[1827] Step 8:

[1828] The device sends the user's input and emotion data together to the server (HTTP POST request).

[1829] Step 9:

[1830] The server passes the request to the AI ​​generation engine based on the received user input and emotion data.

[1831] Step 10:

[1832] The AI ​​generative engine generates artwork (for example, an image of a rainbow that matches the emotion of happiness) based on user input and emotional data.

[1833] Step 11:

[1834] The server receives the generated artwork data and transmits it to the terminal.

[1835] Step 12:

[1836] The terminal displays the artwork received from the server to the user.

[1837] Step 13:

[1838] The user enters final instructions for the displayed artwork (eg, "change the background to blue").

[1839] Step 14:

[1840] The terminal collects the user's final instructions and sends them back to the server (HTTP POST request).

[1841] Step 15:

[1842] The server receives the final instructions and sends a request to the AI ​​generation engine to generate the final artwork.

[1843] Step 16:

[1844] The AI ​​generative engine generates the final artwork and sends the data back to the server.

[1845] Step 17:

[1846] The server transmits the final artwork data to the terminal.

[1847] Step 18:

[1848] The terminal displays the final artwork to the user.

[1849] Step 19:

[1850] Users can save the generated artwork to their device's local storage or share it on social media.

[1851] Step 20:

[1852] The terminal executes the user's save and share requests.

[1853] Through this series of steps, children can use AI assistance and emotion recognition to create original artwork that is more personal and interesting.

[1854] Example 2

[1855] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1856] Today's children are seeking new art experiences using digital technology. However, conventional art creation systems lack the ability to generate truly personalized artworks because they do not take the user's emotions into account. Furthermore, they lack the ability to accurately reflect the user's input, as well as to customize artworks using the user's emotions. Therefore, there is a need for a system that allows children to create more engaging, original artworks.

[1857] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1858] In this invention, the server includes a login means for a user to access the system and start a session, a terminal means for collecting user input and sending it to the server, a generation means for generating an artwork using an AI generation engine based on the received user input, a transmission means for returning data of the generated artwork to the terminal, a means for collecting user emotion data and sending it to the emotion engine, and a means for the generation means to customize the artwork based on the emotion data recognized by the emotion engine. This makes it possible to generate personal and interesting artwork that reflects the user's emotions.

[1859] A "login means" is a means that provides authentication functionality for a user to access a system and initiate a session.

[1860] "Terminal means" refers to a device through which a user makes input and interacts with the system.

[1861] "Generation means" refers to a means that provides the functionality for an AI generation engine to generate artwork based on user input.

[1862] The "transmission means" is a means for returning data of the generated artwork from the server to the terminal.

[1863] The "emotion engine" is an engine that collects user emotion data and recognizes those emotions.

[1864] "Emotion data" refers to data relating to emotions obtained from the user's facial expressions, voice, etc.

[1865] The "means for customizing" is a means for providing the generating means with the ability to individually adjust the artwork based on the emotional data recognized by the emotional engine.

[1866] This invention relates to an interactive art creation system that allows children to create artworks in collaboration with AI through their own input, and further combines it with an emotion engine that recognizes the user's emotions. This system processes between four parties: the user, the terminal, the server, and the emotion engine.

[1867] System configuration

[1868] This art production system consists of the following elements:

[1869] 1. Login method:

[1870] A login method is a method that provides authentication for a user to access a system and initiate a session by entering a username and password or other authentication information to authenticate the user to the system.

[1871] 2. Terminal means:

[1872] The terminal means is a device through which the user inputs and interacts with the system. Examples include smartphones, tablets, and personal computers. These terminals provide an interface through which the user can input their art creation requests and view the resulting artwork.

[1873] 3. Generation means:

[1874] The generation means is a means for providing a function to generate artworks based on user input using an AI generation engine located on a server. The AI ​​generation engine uses advanced artificial intelligence algorithms to generate artworks in real time based on user requests and prompts.

[1875] 4. Means of transmission:

[1876] The transmission means is a means for returning data of the generated artwork from the server to the terminal, allowing the user to check the generated artwork and give further instructions.

[1877] 5. Emotion Engine:

[1878] The emotion engine is an engine that collects the user's emotional data (facial expressions, voice, etc.) and recognizes those emotions. By analyzing the user's emotional data and passing it to the AI ​​generation engine, it generates artwork based on the user's emotions.

[1879] 6. Customization methods:

[1880] The customization means is a means for providing a function in which the generation means adjusts the artwork individually based on the emotional data recognized by the emotion engine. For example, if the user is happy, the colors may be brightened.

[1881] Specific example of system operation

[1882] For example, consider a case where a user inputs "I want to draw a rainbow" and has a happy expression on his / her face at the time.

[1883] 1. User: Accesses the system and logs in.

[1884] 2. User: Uses the device to input "I want to draw a rainbow."

[1885] 3. Terminal: The user's facial expressions and voice are sent to the emotion engine to recognize happy emotions.

[1886] 4. Terminal: Sends this input and emotion data to the server.

[1887] 5. Server: Receives input and emotion data and passes it to the AI ​​generation engine.

[1888] 6. AI Generative Engine: Generates rainbow images and adds colors and designs that match happy emotions.

[1889] 7. Server: Sends the generated artwork to the device.

[1890] 8. Terminal: Displays the generated rainbow image to the user.

[1891] 9. User: Save or share your creation.

[1892] This allows children to create original artwork that is more personal, interesting, and engaging with the help of AI and emotional recognition.

[1893] Examples of prompt statements

[1894] Below is an example of a prompt sentence to input to the generative AI model.

[1895] 1. "When a child says with a smile, 'I want to draw a rainbow,' create a colorful and vibrant rainbow using colors that bring joy."

[1896] 2. "When a child says with a gloomy expression, 'I want to draw a rainy landscape,' please create a rainy landscape using calm colors."

[1897] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1898] Processing flow

[1899] Step 1: User Login

[1900] Terminal: The user accesses the system and is presented with a login screen, providing a UI for entering a username and password.

[1901] Input: Username and Password

[1902] Output: User credentials

[1903] Action: Enter your username and password and press the login button.

[1904] Server: Receives the entered authentication information and checks it against the database. If authentication is successful, generates a new session ID and returns it to the terminal.

[1905] Input: User credentials

[1906] Output: Session ID

[1907] Operation: If authentication is successful, a session ID is generated and returned to the terminal.

[1908] Step 2: Enter your art requirements

[1909] Terminal: After successful login, present the user with a UI for entering their art request. Provide a text box asking "What kind of art would you like to create?" and a submit button.

[1910] Input: Art request (e.g. "I want to draw a rainbow")

[1911] Output: User's art request data

[1912] Action: The user types "I want to draw a rainbow" and presses the send button.

[1913] Step 3: Collecting emotion data

[1914] Terminal: Activates an emotion engine that uses a camera and microphone to collect the user's emotional data (facial expressions and voice).

[1915] Input: User's facial expression, voice

[1916] Output: Recognized emotion data (e.g., joy)

[1917] How it works: The device captures the user's camera footage and audio, and the emotion engine analyzes this to generate emotion data.

[1918] Step 4: Sending data to the server

[1919] Terminal: Sends the user's art requests and emotional data to the server.

[1920] Input: Art request data, emotion data

[1921] Output: Transmitted data

[1922] Operation: The device combines the art request and emotion data and sends the data to the server.

[1923] Server: Analyzes the received data and prepares it to be passed to the AI ​​generation engine.

[1924] Input: Send data

[1925] Output: Parsed data

[1926] Operation: The server receives the transmitted data and performs any necessary data conversions.

[1927] Step 5: Generate artwork using the AI ​​generation engine

[1928] Server: Passes the received art request and emotion data to the AI ​​generation engine.

[1929] Input: Analyzed data (art requests, emotional data)

[1930] Output: prompt statement

[1931] How it works: The server creates a prompt based on the art request and emotional data, and inputs it into the AI ​​generation engine.

[1932] AI generation engine: Generates artwork based on prompts.

[1933] Input: prompt statement

[1934] Output: Artwork data

[1935] How it works: The AI ​​generation engine inputs prompts into the generative model to generate artwork.

[1936] Step 6: Sending the generated artwork from the server to the device

[1937] Server: Receives the generated artwork and sends it to the device.

[1938] Input: Artwork data

[1939] Output: Send artwork data

[1940] Operation: The server receives artwork data and sends it to the device.

[1941] Terminal: Displays the received artwork to the user.

[1942] Input: Submitted artwork data

[1943] Output: The displayed artwork

[1944] What it does: The device displays the artwork and lets the user review it.

[1945] Step 7: User review and feedback on artwork

[1946] User: Review the generated artwork and provide corrections or additional instructions as needed.

[1947] Input: Feedback

[1948] Output: Correction request data

[1949] How it works: The user reviews the artwork and inputs corrections and additions into the device.

[1950] Terminal: Sends correction request data to the server.

[1951] Input: Correction request data

[1952] Output: Send correction data

[1953] Operation: The device sends data to the server.

[1954] Server: Receives the feedback, passes it back to the AI ​​generation engine, and repeats the process to generate a new piece of art.

[1955] Input: Send correction data

[1956] Output: New artwork data

[1957] How it works: The server passes correction instructions to the AI ​​generation engine and regenerates it.

[1958] Step 8: Save and share your artwork

[1959] Device: Once the user is satisfied with their artwork, it will be saved to local storage, and they will also have the option to share it on social media or other platforms.

[1960] Input: Save and Share Instructions

[1961] Output: Save and share completed

[1962] How it works: The device saves artwork and provides functionality for sharing on social media. The user performs the save and share operations.

[1963] This allows users to create more personal, interesting and original artworks with the help of AI and emotion recognition, completing a satisfying art experience.

[1964] (Application example 2)

[1965] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1966] Conventional interactive art creation systems have had difficulty enabling children to effectively create artwork that reflects their own emotions. Furthermore, they lacked a mechanism for easily saving, sharing, and printing the generated artwork in a physical store. Furthermore, they were difficult to integrate with specific hardware and devices, limiting user interaction.

[1967] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes: login means for a user to access the system and start a session; terminal means for collecting user input and sending it to the server; generation means for generating an artwork using an AI generation engine based on the received user input; transmission means for returning data of the generated artwork to the terminal; emotion recognition means for recognizing the user's emotion and sending the data to the server; output means for providing functions such as outputting, saving, sharing, and printing the generated artwork; and linking means for linking with in-store hardware such as in-store displays and printers. This enables children to easily create and output personalized artwork that reflects their emotions, and then instantly save, share, and print it in the physical store.

[1968] A "login method" is the method by which a user accesses a system and initiates a session.

[1969] A "terminal means" is a device for collecting user input and transmitting it to a server.

[1970] "Generation means" refers to the method by which an AI generation engine generates an artwork based on received user input.

[1971] The "transmission means" is a method for returning the data of the generated artwork to the terminal.

[1972] "Emotion recognition means" is a method for recognizing a user's emotions and transmitting the data to a server.

[1973] "Output means" refers to a method for providing functions such as outputting, saving, sharing, and printing the generated artwork.

[1974] "Linkage means" refers to a method for linking with hardware in a physical store, such as in-store displays and printers.

[1975] This invention is a system for children to interactively create artworks, with a particular focus on generating artworks that reflect the user's emotions. This system is realized through cooperation between users, terminals, a server, an emotion engine, and hardware in a physical store.

[1976] Basic system configuration

[1977] The system consists of the following elements:

[1978] 1. Login method: In this system, users must log in to access and start a session. Specifically, they enter their name on a device such as a tablet, and then use Firebase Authentication to authenticate and generate a session ID.

[1979] 2. Terminal means: A smart device (e.g., iPad) that collects user input and emotion data and transmits them to the server.

[1980] 3. Generation method: Using an AI generation engine (e.g., DALL-E) on the server, artworks are generated based on user input and emotional data.

[1981] 4. Transmission means: A method for sending the generated artwork back to the terminal from the server.

[1982] 5. Emotion recognition means: The device's camera and microphone are used to recognize the user's emotions, and the data is analyzed by an emotion engine (e.g., TensorFlow) and sent to the server.

[1983] 6. Output means: Provides functions such as displaying, saving, sharing, and printing artworks generated on the device.

[1984] 7. Integration method: A method for integration with in-store hardware such as displays and printers.

[1985] What the program does

[1986] 1. Login process:

[1987] The user logs in by entering their name on the tablet. Firebase Authentication is used to authenticate and generate a session ID.

[1988] 2. Art Creation Interface:

[1989] Users select tools and brushes for painting through the tablet interface, which is equipped with a camera and microphone to recognize users' emotions in real time.

[1990] 3. Emotion Recognition and Data Transmission:

[1991] Using an emotion engine (TensorFlow), the device analyzes the user's facial expressions and voice, and sends the emotion (e.g., joy) they are feeling to the server. This data is sent directly from the device to the server.

[1992] 4. Artwork generation using an AI generation engine:

[1993] The server receives user input and emotion data and generates artwork using a generative AI model such as DALL-E. The generated artwork is personalized according to the user's emotions.

[1994] 5. Submission and Display of Generated Works:

[1995] The generated artwork is sent from the server to the device and displayed instantly, allowing the user to review the artwork and provide further instructions.

[1996] 6. Output and Linkage:

[1997] The completed artwork is stored in Firebase Storage, and can also be displayed and printed on in-store displays and printers via the device interface.

[1998] Specific examples

[1999] For example, if a user types "I want to draw a rainbow" and has a happy expression while doing so, the following prompt sentence can be sent to the generative AI model:

[2000] "Generate an image of a rainbow. The user's emotion is joy."

[2001] The generative AI model then generates a rainbow image that reflects the user's emotions and sends it to the device, allowing children to create, display, share, and print artwork personalized by their emotions and inputs.

[2002] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2003] Step 1:

[2004] The user enters their name into the tablet and logs in. The device authenticates the user using Firebase Authentication and requests the server to generate a session ID. The generated session ID is sent back to the device. The input is the user's name and the output is the session ID. Specifically, the user enters their name into the tablet's login screen and taps the "Login" button.

[2005] Step 2:

[2006] The user begins creating art through the tablet interface. The device collects the user's input in real time and sends it to the server. The input is the user's drawing instructions, and the output is instruction data for the server. In concrete terms, the user selects a brush and color and draws on the tablet.

[2007] Step 3:

[2008] The device's camera and microphone are used to recognize the user's emotions in real time. The emotion engine (TensorFlow) analyzes the user's facial expressions and voice, and sends the results from the device to a server. The input is facial expression and voice data, and the output is analyzed emotion data. Specifically, the device periodically captures and processes camera images and audio.

[2009] Step 4:

[2010] The server receives the user's input and emotional data and generates an artwork using the AI ​​generation engine (DALL-E). The input is the user's instructions and emotional data, and the output is the data of the generated artwork. Specifically, the server passes the necessary data to the AI ​​generation engine and receives the generated artwork.

[2011] Step 5:

[2012] The server returns the generated artwork to the terminal. The input is the data of the generated artwork, and the output is the data to be sent to the terminal. In concrete terms, the server transfers the artwork data to the terminal and confirms receipt.

[2013] Step 6:

[2014] The device displays the generated artwork. The input is the artwork data received from the server, and the output is the display on the tablet. Specifically, the device draws the received artwork on the screen and shows it to the user.

[2015] Step 7:

[2016] The user inputs the final instructions for the work into the terminal, and the terminal sends the data to the server. The input is the user's final instructions, and the output is the final instruction data to the server. Specifically, the user checks the work, makes any necessary corrections, and taps the "Done" button.

[2017] Step 8:

[2018] The server generates the final artwork based on the final instructions and sends the data to the terminal. The input is the user's final instructions, and the output is the data of the final generated artwork. Specifically, the server calls the AI ​​generation engine again to generate the final artwork.

[2019] Step 9:

[2020] The device stores the final artwork. The input is the data of the final artwork, and the output is the saved file. Specifically, the device stores the artwork data in local storage or cloud storage.

[2021] Step 10:

[2022] Finally, the device provides the user with the option to share or print the work. The input is the user's instruction to share or print, and the output is the shared data or printed paper. Specifically, the user selects a sharing destination or printer and taps the "Share" or "Print" button.

[2023] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2024] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2025] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2026] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2027] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2028] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2029] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2030] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2031] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2032] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2033] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2034] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2035] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2036] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2037] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2038] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2039] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2040] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2041] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2042] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2043] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2044] The following is further disclosed regarding the above embodiment.

[2045] (Claim 1)

[2046] An interactive art creation system that allows children to create artwork through their own input, comprising:

[2047] a login means for a user to access the system and initiate a session;

[2048] terminal means for collecting user input and transmitting it to a server;

[2049] A generation means for generating an artwork using an AI generation engine based on the received user input;

[2050] a transmitting means for returning data of the generated artwork to the terminal;

[2051] A system including:

[2052] (Claim 2)

[2053] means for collecting and transmitting final user instructions to a server;

[2054] A means for generating the final artwork and transmitting the data from the server to the terminal;

[2055] 10. The system of claim 1, further comprising:

[2056] (Claim 3)

[2057] 10. The system of claim 1, further comprising means for saving and sharing the generated artwork.

[2058] "Example 1"

[2059] (Claim 1)

[2060] a login means for a user to access the system and initiate a session;

[2061] terminal means for collecting user input and transmitting it to a server;

[2062] generation means for analyzing received user input and generating an artwork based on the generative model;

[2063] a transmitting means for returning data of the generated artwork to the terminal;

[2064] an interface means for displaying the submitted artwork and prompting the user for further instructions;

[2065] a storage and sharing means for storing and sharing data of the final generated artwork;

[2066] A system including:

[2067] (Claim 2)

[2068] means for collecting the user's final instructions and transmitting them to a server; means for generating a final artwork and transmitting the data from the server to the terminal;

[2069] 10. The system of claim 1, further comprising:

[2070] (Claim 3)

[2071] 10. The system of claim 1, further comprising means for saving and sharing the generated artwork.

[2072] "Application Example 1"

[2073] (Claim 1)

[2074] An interactive art creation system that allows children to create artwork through their own input, comprising:

[2075] a login means for a user to access the system and initiate a session;

[2076] terminal means for collecting user input and transmitting it to a server;

[2077] a generation means for generating an artwork using a generative AI model based on the received user input;

[2078] a transmitting means for returning data of the generated artwork to the terminal;

[2079] an editing means for displaying the generated artwork on a terminal and for a user to edit the artwork;

[2080] a means of preserving and sharing the final artwork;

[2081] A system including:

[2082] (Claim 2)

[2083] means for collecting and transmitting final user instructions to a server;

[2084] A means for generating the final artwork and transmitting the data from the server to the terminal;

[2085] 10. The system of claim 1, further comprising:

[2086] (Claim 3)

[2087] 10. The system of claim 1, further comprising a sharing means for sharing the generated artwork with other users.

[2088] "Example 2: Combining Emotion Engines"

[2089] (Claim 1)

[2090] a login means for a user to access the system and initiate a session;

[2091] terminal means for collecting user input and transmitting it to a server;

[2092] A generation means for generating an artwork using an AI generation engine based on the received user input;

[2093] a transmitting means for returning data of the generated artwork to the terminal;

[2094] means for collecting and transmitting user emotion data to an emotion engine;

[2095] A means for generating a customized artwork based on the emotion data recognized by the emotion engine;

[2096] A system including:

[2097] (Claim 2)

[2098] means for collecting and transmitting final user instructions to a server;

[2099] A means for generating the final artwork and transmitting the data from the server to the terminal;

[2100] 10. The system of claim 1, further comprising:

[2101] (Claim 3)

[2102] 10. The system of claim 1, further comprising means for saving and sharing the generated artwork.

[2103] "Application example 2 when combining emotion engines"

[2104] (Claim 1)

[2105] An interactive art creation system that allows children to create artwork through their own input, comprising:

[2106] a login means for a user to access the system and initiate a session;

[2107] terminal means for collecting user input and transmitting it to a server;

[2108] A generation means for generating an artwork using an AI generation engine based on the received user input;

[2109] a transmitting means for returning data of the generated artwork to the terminal;

[2110] emotion recognition means for recognizing the emotion of a user and transmitting the data to a server;

[2111] An output means that provides functions such as outputting, saving, sharing, and printing the generated artwork;

[2112] A means of linking with in-store hardware such as in-store displays and printers,

[2113] A system including:

[2114] (Claim 2)

[2115] means for collecting and transmitting final user instructions to a server;

[2116] A means for generating the final artwork and transmitting the data from the server to the terminal;

[2117] further including means for printing and displaying the generated artwork in store;

[2118] 10. The system of claim 1.

[2119] (Claim 3)

[2120] further including means for storing and sharing the generated artwork;

[2121] 10. The system of claim 1. [Explanation of symbols]

[2122] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. An interactive art creation system that allows children to create artwork through their own input, comprising: a login means for a user to access the system and initiate a session; terminal means for collecting user input and transmitting it to a server; A generation means for generating an artwork using an AI generation engine based on the received user input; a transmitting means for returning data of the generated artwork to the terminal; A system including:

2. means for collecting and transmitting final user instructions to a server; A means for generating the final artwork and transmitting the data from the server to the terminal; The system of claim 1 further comprising:

3. The system of claim 1 , further comprising means for saving and sharing the generated artwork.

Images