System

Abstract

A system is provided.SOLUTION: A system comprising: means for receiving a creative idea input by a user; terminal means for transmitting the user's idea to a server; means for analyzing the received idea data; generative model means for automatically generating digital art based on the analyzed data; means for transmitting the generated digital art to the terminal; and means for displaying the transmitted digital art to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Contemporary art education faces the problem of a lack of means for children to freely express their creative ideas visually. Because traditional painting and sculpting require advanced skills and numerous resources, many children lack the opportunity to fully express their creativity. There is a need to solve this problem and provide an environment where children can easily enjoy art and develop their creativity. [Means for solving the problem]

[0005] To solve this problem, the present invention provides the following means: a system including means for receiving creative ideas input by a user, terminal means for transmitting the user's ideas to a server, means for analyzing the received idea data, generative model means for automatically generating digital art based on the analyzed data, means for transmitting the generated digital art to the terminal, and means for displaying the transmitted digital art to the user. Furthermore, by providing means for receiving sketch images and text data from the user and preprocessing them, and means for displaying the generated digital art so that other users can view and provide feedback, the system allows children to easily visually express their creative ideas and promotes self-esteem and growth through interaction with other users.

[0006] A "user" is someone who utilizes the system to input creative ideas.

[0007] A "creative idea" is an artistic concept or theme that a user wishes to express visually.

[0008] "Means" refers to methods or equipment for achieving a specific purpose.

[0009] A "terminal" is an electronic device that a user uses to input creative ideas and display the resulting digital art.

[0010] A "server" is a central computer system that receives, analyzes, and processes data sent from terminals.

[0011] "Idea data" is digital data containing information on creative ideas entered by a user.

[0012] "Means for analyzing" refers to the process by which the server understands the idea data it receives and extracts the necessary information.

[0013] A "generative model" is an algorithm or program that automatically generates digital art based on analyzed data.

[0014] "Generated digital art" is a work of visual art created by means of a generative model.

[0015] "Preprocessing" refers to the procedure of converting sketch images and text data received from a user into a format suitable for processing by the generative model.

[0016] The "exhibition means" is a function that allows other users to view and provide feedback on the created digital art.

[0017] These definitions clarify the meaning of important terms included in the claims and clarify the technical scope of the invention. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8]FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] This invention relates to a digital art creation system that allows children to visually express their creative ideas. This system provides the functionality to automatically create, display, and exhibit digital art based on creative ideas input by users.

[0040] System Overview

[0041] The system mainly consists of the following elements:

[0042] 1. A way for users to input their ideas: This could include, for example, an image upload feature that allows users to upload sketches, or a text field that allows users to type their ideas.

[0043] 2. Terminal: The device on which the user inputs ideas, such as a PC, tablet, or smartphone.

[0044] 3. Server: A computer system that receives and analyzes users' idea data (sketch images and text data) and generates digital art using a generative model.

[0045] 4. Generative models: Algorithms that take analyzed data as input and generate digital art, such as generative adversarial networks (GANs) or transformer models.

[0046] 5. Display and exhibition means: The ability to display the generated digital art on a device so that the user can view it, and also to exhibit it for sharing with other users.

[0047] Program processing

[0048] User data entry

[0049] Users input their creative ideas into the device, either by uploading sketches as images or by entering text into a text input field.

[0050] Data transmission

[0051] The terminal transmits the data entered by the user to the server using a secure communication protocol (e.g., HTTPS).

[0052] Data analysis

[0053] The server receives and analyzes the data, performing preprocessing in the case of sketch images and natural language processing in the case of text data, converting the data into a format suitable for the generative model.

[0054] Digital Art Generation

[0055] The server then inputs the pre-processed data into a generative model, which uses a pre-trained deep learning algorithm, to generate the digital art.

[0056] Digital Art Submission

[0057] The server then transmits the generated digital art to the device, where it is presented in a high-resolution image format.

[0058] Display and Exhibition

[0059] The device displays the received digital art to the user, who can then view it. The user can also exhibit the generated art within the platform and receive feedback from other users.

[0060] Specific examples

[0061] For example, if a user inputs the idea of ​​a "flying cat," the following specific processing is performed.

[0062] 1. Data Entry

[0063] The user types "flying cat" into the text field.

[0064] 2. Data Transmission

[0065] The terminal transmits this text data to the server.

[0066] 3. Data Analysis

[0067] The server tokenizes and grammatically analyzes the received text data and converts it into a format suitable for the generative model.

[0068] 4. Digital Art Generation

[0069] Based on the information about the "flying cat," the server uses a generative model to generate visual art of a flying cat.

[0070] 5. Submitting Digital Art

[0071] The generated artwork is sent to the device as a high-resolution image.

[0072] 6. Display and Exhibition

[0073] The device displays the received art to the user, who can then view it and share it with other users within the platform to receive feedback.

[0074] In this way, a system is provided that allows users to easily visually express and share their creative ideas with others, thereby fostering children's artistic talent and self-esteem.

[0075] The processing flow will be explained below.

[0076] Step 1:

[0077] Users input their creative ideas into the device, either by uploading sketches as image files or by entering text ideas into a text field.

[0078] Step 2:

[0079] The device sends the idea data (sketch image and text data) entered by the user to the server using a secure communication protocol such as HTTPS.

[0080] Step 3:

[0081] The server first analyzes the received idea data. If it is a sketch image, it uses an image processing library for preprocessing, and if it is text data, it uses a natural language processing library for analysis.

[0082] Step 4:

[0083] The server inputs the pre-processed data into a generative model, which uses pre-trained deep learning algorithms (e.g., generative adversarial networks or transformer models) to generate digital art.

[0084] Step 5:

[0085] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[0086] Step 6:

[0087] The device displays the received high-resolution image files for the user to view, and the user can share the generated art with other users within the platform.

[0088] Step 7:

[0089] Users can receive feedback from other users within the platform, which can help improve self-esteem and creativity.

[0090] In this way, the "Future Artist" AI Art Studio provides a series of processes that allow users to easily visually express their creative ideas and share them with others.

[0091] Example 1

[0092] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0093] In the modern educational environment and the field of digital art, there is a lack of effective means for children to easily visually express their creative ideas and share them with others. In particular, there is a need for a system that provides a user-friendly interface and allows them to safely and quickly generate digital art. There is also a lack of an easy-to-use platform for sharing the generated artwork with others and receiving feedback.

[0094] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0095] In this invention, the server includes: means for receiving creative ideas input by a user; terminal means for transmitting the user's ideas to the server; means for transmitting the received idea data to the server using a secure communication protocol; means for analyzing and preprocessing the received idea data; generative model means for automatically generating digital art based on the preprocessed data; means for transmitting the generated digital art to the terminal in high resolution; and means for displaying the transmitted digital art to the user and sharing it with other users. This allows users to easily visualize their creative ideas as digital art and share it securely. Furthermore, it makes it easy to share the generated artwork with other users and receive feedback. This system contributes to fostering children's artistic talent and self-esteem.

[0096] A "creative idea" is an original idea or artistic concept that a user has in mind.

[0097] A "terminal" is a computing device that a user uses to input and send ideas to a server.

[0098] A "server" is a central processing unit that receives and analyzes data sent by users and generates digital art.

[0099] The "data transmission means" is a function for safely transmitting the user's idea data from the terminal to the server.

[0100] The "analysis means" is a method for preprocessing the received idea data and converting it into a format that can be understood by the generative model.

[0101] A "generative model" is an algorithm for automatically generating digital art based on preprocessed data.

[0102] "Digital art" is a visual work of art that is automatically generated by a generative model.

[0103] "High resolution" refers to an image quality that allows images to be displayed clearly down to the fine details.

[0104] "Display means" is a function for displaying the transmitted digital art on the user's terminal.

[0105] "Sharing means" is a function for sharing the created digital art with other users and receiving feedback.

[0106] "Preprocessing" is the process of analyzing the received data and converting it into a format that can be properly processed by the generative model.

[0107] "Natural language processing" is a technology for analyzing text data and understanding and extracting meaning.

[0108] An "encrypted protocol" is a technique for encrypting transmitted data in order to communicate the data securely.

[0109] MODE FOR CARRYING OUT THE INVENTION

[0110] This invention is a system that automatically generates digital art based on creative ideas input by users, and allows users to display and share it with other users. This system allows users to input creative ideas through digital devices, and the server analyzes and generates the data, providing artistic digital works.

[0111] Hardware and software used

[0112] 1. Device: The device that a user uses to input ideas. This can include a computer, tablet, smartphone, etc.

[0113] 2. Server: A central processing unit that receives and analyzes user input data and generates digital art. This server has advanced hardware capabilities and is capable of running deep learning algorithms.

[0114] 3. Generative models: Algorithms for generating digital art, such as generative adversarial networks (GANs) and transformer models.

[0115] Program processing

[0116] User data entry

[0117] Users use the device to input their creative ideas, which can be done by typing ideas into a text field or uploading sketch images.

[0118] As a concrete example, consider the case where a user types "flying cat" into a text field, and this string is used in a later processing step.

[0119] Data transmission

[0120] The terminal transmits the data entered by the user to the server, and the transmission process is carried out using a secure communication protocol (e.g. HTTPS) to ensure the confidentiality of the data.

[0121] Data analysis

[0122] The server receives and analyzes the data sent. For text data, it uses natural language processing (NLP) algorithms (e.g., NLTK or spaCy) to tokenize and analyze grammar. For sketch images, it uses image preprocessing algorithms (e.g., OpenCV or TensorFlow) to extract the necessary components.

[0123] Digital Art Generation

[0124] The server inputs the preprocessed data into a generative model to generate digital art. Generative models such as generative adversarial networks (GANs) and transformer models are used. For example, based on the prompt "a cat flying in the sky," a GAN generates visual art of a flying cat.

[0125] Digital Art Submission

[0126] The server then sends the generated digital art to the device, where it is provided in a high-resolution image format (e.g., PNG or JPEG).

[0127] View and Share

[0128] The device displays the generated digital art to the user, who can then view and save it. Users can also share their artwork with other users within the platform and receive feedback.

[0129] Specific examples

[0130] For example, if a user inputs the idea "a panda exploring space," the following process occurs:

[0131] Idea input: The user types "Panda exploring space" into the text field.

[0132] Data transmission: The device sends this data to the server.

[0133] Data analysis: The server tokenizes the text data and performs grammatical analysis.

[0134] Digital Art Generation: The server uses GAN to generate visual art of a "panda exploring space."

[0135] Send digital art: sent to your device as a high-resolution image.

[0136] View and share: Users can view the art generated on their device and share it with others.

[0137] The system allows users to easily visualize their creative ideas as digital art and share it with others. Using generative AI models, the process fosters children's imaginations and provides a new outlet for self-expression.

[0138] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0139] Step 1: User Data Entry

[0140] How it works: A user uses a terminal to input a creative idea. For example, they might type "flying cat" into a text field. At this point, the data entered is the user's idea (prompt text and sketch image).

[0141] Input: User's creative idea (text and / or images).

[0142] Output: User input data (text or image).

[0143] Step 2: Send data

[0144] Operational details: The device sends the data entered by the user to the server using a secure communication protocol (e.g., HTTPS). The data is encrypted during the transmission process, reducing the risk of data leakage during transmission.

[0145] Input: User input data (text or image).

[0146] Output: Encrypted data to be transmitted.

[0147] Step 3: Data reception and analysis

[0148] How it works: The server receives the encrypted data and begins parsing it. If it's text data, it uses natural language processing (NLP) algorithms to tokenize and parse it, converting it into a format that the generative model can understand. If it's a sketch image, it uses image preprocessing algorithms to extract the necessary components.

[0149] Input: Encrypted data (text or image) sent from the device.

[0150] Output: Preprocessed text or image data.

[0151] Step 4: Generate digital art

[0152] How it works: The server inputs the preprocessed data into a generative model to generate digital art. Generative models such as generative adversarial networks (GANs) and transformer models are used. For example, based on the prompt "a cat flying in the sky," a highly accurate visual art of a flying cat is generated.

[0153] Input: Preprocessed data (text or images).

[0154] Output: Generated digital art (high resolution images).

[0155] Step 5: Submit your digital art

[0156] How it works: The server sends the generated digital art to the device. The art is provided in a high-resolution image format (e.g. PNG or JPEG). The server takes care to ensure that the data reaches the device completely and accurately.

[0157] Input: Generated digital art (high resolution image).

[0158] Output: High resolution image data sent to the device.

[0159] Step 6: View and share

[0160] Operational Details: The device displays the received digital art to the user. The user can save the displayed artwork and share it with other users. Through this sharing function, the user can receive feedback on the created art.

[0161] Input: High resolution image data sent from the server.

[0162] Output: Digital art displayed on the device and data shared on the platform.

[0163] (Application example 1)

[0164] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0165] There is a demand for digital art generation systems that not only automatically generate creative ideas input by users, but also display the generated art in an actual physical exhibition space and allow interactive manipulation. Furthermore, to encourage children's creativity, it is necessary to provide an environment in which they can share the art they create with other users and receive feedback. The present invention aims to solve these problems.

[0166] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0167] In this invention, the server includes means for receiving creative ideas input by users, terminal means for transmitting the user's ideas to the server, means for analyzing the received idea data, generation model means for automatically generating digital art based on the analyzed data, means for transmitting the generated digital art to the terminal, means for displaying the transmitted digital art to the user, and means for displaying and enabling interactive manipulation of the generated digital art in a physical exhibition space, thereby enabling users to visualize their creative ideas in real time, share them with other users, and experience interacting with them in the real world.

[0168] "Creative ideas entered by the user" refers to content or concepts that the user has thought up and conceived himself, and includes forms such as sketches and text.

[0169] "Terminal means" refers to a device that allows a user to input ideas and send them to a server, and specifically includes a PC, tablet, smartphone, etc.

[0170] "Server" refers to a central processing unit that receives, analyzes, generates, and transmits data from users, and communicates with multiple terminals via the Internet.

[0171] "Means for analyzing" refers to software and algorithms that convert the received user idea data into an easy-to-understand format and perform processing to create input data suitable for the generative model.

[0172] "Generative modeling methods" refers to the use of algorithms and software, specifically generative adversarial networks (GANs) and transformer models, to automatically generate digital art based on analyzed data.

[0173] "Means of transmission" refers to the means of communication for transferring the generated digital art to the user's device, and refers to the use of a secure communication protocol (e.g., HTTPS).

[0174] "Displaying means" refers to an interface for visually displaying the generated digital art on the user's terminal, and includes a display or screen display function.

[0175] "Physical exhibition space" refers to a space where digital art generated in the real world can be displayed and interacted with, such as a museum or learning facility.

[0176] "Interactive" refers to a function that allows a user to directly touch and manipulate the generated art.

[0177] "Preprocessing" refers to the initial processing required to convert the sketch images and text data received from the user into a format suitable for the generative model, including image resizing and tokenization.

[0178] This invention relates to a system that generates digital art based on creative ideas input by users and allows them to display and manipulate it in a physical exhibition space in the real world. The specific configuration and processing steps of this system are described below.

[0179] System configuration

[0180] The system mainly consists of the following components:

[0181] 1. Terminal means: Includes devices such as PCs, tablets, and smartphones, and has the function of allowing users to input ideas and send them to the server.

[0182] 2. Server: A central processing unit that receives and analyzes data from users and generates digital art. Specifically, a high-performance cloud server is used.

[0183] 3. Generative modeling: Algorithms that automatically generate digital art using generative adversarial networks (GANs) and transformer models.

[0184] 4. Display means: Includes displays and interfaces for displaying the generated digital art on devices or in physical exhibition spaces.

[0185] 5. Interactive means: including touchscreens and sensor technology to allow users to directly manipulate the generated art in the physical exhibition space.

[0186] Program processing procedure

[0187] 1. User idea input:

[0188] Users use the device to input creative ideas in the form of sketches or text, which can be uploaded as an image file or entered into a text field.

[0189] 2. Data transmission:

[0190] The device sends the entered data to the server, and this communication is carried out using a secure protocol (e.g. HTTPS).

[0191] 3. Data Analysis:

[0192] The server analyzes the received data, performs image preprocessing on the sketch images, and natural language processing on the text data, converting the data into a format suitable for the generative modeling tool.

[0193] 4. Digital Art Generation:

[0194] The server generates digital art from the pre-processed data using pre-trained generative models, such as generative adversarial networks (GANs) and transformer models.

[0195] 5. View and interact:

[0196] The generated digital art is sent to the device and displayed to the user, while the physical exhibition space displays the generated art on large displays and touchscreens, allowing users to directly manipulate it.

[0197] Technology and software used

[0198] The specific hardware and software used in this system are:

[0199] Devices: PC, tablet, smartphone

[0200] Server: Cloud Server

[0201] Generative modeling tools: Generative Adversarial Networks (GANs), Transformer models

[0202] Display and interaction: displays, touchscreens, sensor technology

[0203] Specific examples

[0204] For example, if a user inputs the idea of ​​a "flying cat," the following specific processing is performed.

[0205] 1. Data Entry: A user draws a sketch of a "flying cat" on a tablet and then types "flying cat" into a text field.

[0206] 2. Data transmission: The sketch image and text data are sent from the device to the server.

[0207] 3. Data analysis: The server preprocesses the sketch images and analyzes the text data using natural language processing.

[0208] 4. Digital Art Generation: Using generative modeling techniques, the art of the "flying cat" is generated.

[0209] 5. Display and exhibition: The generated art is displayed on the terminal and then on a large display in the physical exhibition space.

[0210] Prompt Sentence Examples

[0211] Create a vivid and imaginative piece of digital art that captures the concept of a flying cat. The generated art should depict a cat gliding lightly through the air, with a blue sky and clouds in the background.

[0212] As described above, this system allows users to realize their creative ideas and allows them to view and manipulate them in a real environment, allowing users to visually express their ideas and share them with others.

[0213] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0214] Step 1:

[0215] A user uses the device to input creative ideas, which can be sketched images or text, and the input data is temporarily stored in the device's memory.

[0216] Input: User sketch image or text data

[0217] Action: Enter data using the input interface on the device

[0218] Output: Creative ideas stored in the device's memory

[0219] Step 2:

[0220] The data entered by the user is sent from the device to the server using a secure communication protocol (e.g. HTTPS).

[0221] Input: Creative ideas stored in your device's memory

[0222] Behavior: Uses the data transmission function to send user data from the device to the server.

[0223] Output: Sketch image or text data sent to the server

[0224] Step 3:

[0225] The server analyzes the received data, performing image preprocessing in the case of sketch images and natural language processing in the case of text data, converting the data into a format suitable for the generative modeling tool.

[0226] Input: Sketch image or text data sent to the server

[0227] What it does: Image preprocessing (image resizing, noise removal, etc.) and text tokenization and analysis.

[0228] Output: Preprocessed sketch image or text data

[0229] Step 4:

[0230] The server generates digital art based on the preprocessed data using generative AI models, such as generative adversarial networks (GANs) and transformer models.

[0231] Input: Preprocessed sketch images or text data

[0232] How it works: Applying generative AI models to generate creative digital art

[0233] Output: Generated digital art

[0234] Step 5:

[0235] The server transmits the generated digital art to the device using a secure communication protocol (e.g., HTTPS).

[0236] Input: Generated digital art

[0237] Operation: Uses the data transmission function to send the generated art from the server to the device.

[0238] Output: Digital art sent to your device

[0239] Step 6:

[0240] The device displays the received digital art to the user, and in addition, in the physical exhibition space, the generated art is displayed on a large display or touch screen, allowing the user to interact with it.

[0241] Input: Digital art sent to the device

[0242] Operation: Display digital art on the display and provide interactive operation to the user using the touch screen.

[0243] Output: Digital art that is visible to the user and can be interacted with.

[0244] The above are the specific processing steps of this program. This system allows users to instantly visualize their creative ideas, and then view and manipulate them in a real-world exhibition space.

[0245] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0246] This invention provides a more personalized experience by combining an emotion engine with a system that receives creative ideas input by users and automatically generates digital art. This system aims to provide an environment where children can visually express their creative ideas and receive emotional feedback to foster their creativity.

[0247] System Overview

[0248] The system includes the following elements:

[0249] 1. A way for users to input their ideas: An interface that allows users to upload sketches as image files or enter text into a text field.

[0250] 2. Terminal: A device through which a user inputs creative ideas. Examples include computers, tablets, and smartphones.

[0251] 3. Server: A central computer system that receives the data sent by users, analyzes it, processes it with a generative model, and performs sentiment analysis with an emotion engine.

[0252] 4. Generative model: A deep learning algorithm for generating digital art based on input data.

[0253] 5. Emotion engine: An algorithm that recognizes emotions by analyzing the content of text and sketches entered by the user, as well as the user's facial expressions.

[0254] 6. Display and exhibition means: An interface for displaying the generated digital art to the user and for sharing with other users.

[0255] Program processing

[0256] User data entry

[0257] Users can input their creative ideas into the device, for example, by uploading sketches as images or by entering text into the input field.

[0258] emotion recognition

[0259] The device acquires the user's facial expression data using a camera or other device along with the user's input data, and sends this data to the server. The emotion engine analyzes this facial expression data and the input text data to recognize the user's emotions.

[0260] Data transmission

[0261] The device sends the data entered by the user and facial expression data to the server using a secure communication protocol such as HTTPS.

[0262] Data analysis

[0263] The server receives the data and first performs sentiment analysis using an emotion engine, then analyzes the idea data. For sketch images, it performs preprocessing using an image processing library, and for text data, it performs analysis using a natural language processing library.

[0264] Digital Art Generation

[0265] The server then inputs the pre-processed idea data and sentiment analysis results into a generative model, which uses pre-trained deep learning algorithms (e.g., generative adversarial networks and transformer models) to generate digital art.

[0266] Digital Art Submission

[0267] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[0268] Display and Exhibition

[0269] The device displays the received high-resolution image files for the user to view, and the user can share the generated art with other users within the platform and receive feedback from them.

[0270] Specific examples

[0271] For example, when a user inputs the idea "a flying cat" and smiles at the time, the following specific processing is performed.

[0272] 1. Data Entry

[0273] The user types "flying cat" into the text field, and the device camera captures the user's smile.

[0274] 2. Emotion recognition

[0275] The terminal transmits the text data of "Flying Cat" and the image data of the user's smiling face to the server.

[0276] 3. Data Analysis

[0277] The server first analyzes the facial expression data using an emotion engine to determine whether the user is smiling. Next, it analyzes the text data, "Flying Cat."

[0278] 4. Digital Art Generation

[0279] The server inputs the emotional data of "smile" and the idea data of "flying cat" into the generative model, and generates visual art of a flying cat with a bright and cheerful atmosphere.

[0280] 5. Submitting Digital Art

[0281] The generated artwork is sent to the device as a high-resolution image.

[0282] 6. Display and Exhibition

[0283] The device displays the art to the user, who can then view it, while simultaneously sharing it with other users within the platform and receiving feedback.

[0284] In this way, the combination of emotion engines provides a more personalized art creation experience that responds to the user's emotions.

[0285] The processing flow will be explained below.

[0286] Step 1:

[0287] Users input their creative ideas into the device, for example, by uploading a sketch as an image file or by typing a text idea such as "flying cat" into the text field.

[0288] Step 2:

[0289] The device uses a camera to capture the user's facial expression data, such as a smile, along with the user's input data (sketch image and text data).

[0290] Step 3:

[0291] The device sends the acquired idea data (sketch image or text data) and facial expression data to a server using a secure communication protocol (e.g., HTTPS).

[0292] Step 4:

[0293] The server first analyzes the received data using an emotion engine. The emotion engine recognizes the emotion from the user's facial expression and stores the result. For example, it recognizes that the user is smiling.

[0294] Step 5:

[0295] The server then analyzes the idea data. For sketch images, it uses an image processing library for preprocessing, and for text data, it uses a natural language processing library for tokenization and grammar analysis.

[0296] Step 6:

[0297] The server inputs the preprocessed idea data and the emotion analysis results into a generative model, which then generates digital art based on a deep learning algorithm. For example, using the emotion data of a smile and the idea data of a "flying cat," the model generates brightly colored visual art of a flying cat.

[0298] Step 7:

[0299] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[0300] Step 8:

[0301] The terminal displays the received high-resolution image file to the user, who can then appreciate the generated digital art.

[0302] Step 9:

[0303] The device allows users to share their generated art with other users within the platform and receive feedback, who can view, comment on, and rate the art.

[0304] For example, if a user inputs the idea of ​​a "flying cat" and smiles at the device, the resulting art generated by this flow will be a bright, positive, and visual art of a flying cat. This art can then be shared with other users, who can provide feedback through comments and ratings.

[0305] In this way, the system combined with the emotion engine provides a more personalized digital art creation experience that responds to the user's emotions.

[0306] Example 2

[0307] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0308] Conventional digital art generation systems often generate artworks based solely on user-entered text or sketches, making it difficult to reflect the emotions and intentions of individual users. Furthermore, because the generated digital art is not based on the user's emotions, it is difficult to provide a personalized experience. Therefore, a means for users to receive more creative and emotional feedback is needed.

[0309] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving creative ideas input by a user, an emotion engine means for analyzing the user's emotions, and a generative model means for automatically generating digital art based on the analyzed data. This makes it possible to generate personalized digital art that reflects the user's emotions and intentions.

[0310] The "means for receiving creative ideas input by the user" is an interface that allows the user to upload sketches as image files or input text into a text field.

[0311] "Terminal means for transmitting user ideas to the server" refers to devices used by users, such as PCs, tablets, and smartphones, which include a transmission function.

[0312] The "means for analyzing received idea data" refers to an algorithm that analyzes data entered by a user using an image processing library, natural language processing library, or the like installed on the server.

[0313] The "emotion engine means for analyzing the user's emotions" is an algorithm that analyzes the contents of input text or sketches and the user's facial expressions to recognize the user's emotions.

[0314] The "generative model means for automatically generating digital art based on analyzed data" uses a deep learning algorithm to generate digital art based on preprocessed idea data and emotion analysis results.

[0315] "Means for transmitting the generated digital art to the terminal" refers to a communication protocol or mechanism for transmitting the high-resolution digital art image generated by the server to the terminal.

[0316] The "means for displaying the transmitted digital art to the user" refers to a display or interface that visually displays the digital art received by the terminal to the user.

[0317] This invention combines an emotion engine with a system that receives creative ideas input by users and automatically generates digital art based on those ideas to provide a more personalized experience. The aim is to foster creativity in children by allowing them to express their own creativity and receiving emotional feedback in the process.

[0318] System Components

[0319] 1. How users enter their ideas:

[0320] Users can upload their sketches as image files or use the interface to enter text into a text field on devices such as PCs, tablets, and smartphones.

[0321] 2. Terminal:

[0322] It refers to a device where users input their creative ideas and send them to a server. The device also uses a camera to capture the user's facial expression data and sends it to the server.

[0323] 3. Server:

[0324] This is a central computer system that receives and analyzes data sent by users. The server analyzes the data using natural language processing and image processing libraries. For example, OpenNLP and SpaCy are used for natural language processing, and OpenCV is used for image processing.

[0325] 4. Analysis method:

[0326] The emotion engine installed on the server performs emotion analysis and then preprocesses the idea data. The emotion engine includes algorithms that analyze the content of input text and sketches, as well as the user's facial expressions, to recognize the user's emotions.

[0327] 5. Digital Art Generation:

[0328] Deep learning algorithms, such as generative adversarial networks (GANs) and transformer models, are used to generate digital art based on preprocessed idea data and sentiment analysis results.

[0329] 6. Display and Exhibit:

[0330] An interface is provided for displaying the generated digital art to the user, and for sharing it with other users.

[0331] Specific examples

[0332] For example, a specific example is given in which a user inputs the idea "a flying cat" and smiles at the time.

[0333] The user enters "Cat flying in the sky" into the text field, and the device's camera captures the user's smile. The device sends this input data and facial expression data to the server. The server first analyzes the user's facial expression using an emotion engine and recognizes that it is a "smile." It then analyzes the text data "Cat flying in the sky."

[0334] Next, the server inputs the emotion data of "smile" and the idea data of "flying cat" into the generative model, generating visual art of a cheerful and fun-loving cat flying in the sky. The generated artwork is sent to the device as a high-resolution image, which the device displays to the user, who can then view it. The artwork can also be shared with other users and receive feedback.

[0335] Prompt Sentence Examples

[0336] Examples of specific prompts include the following:

[0337] "Enter the following text into the input field: Flying Cat"

[0338] or

[0339] "Upload your next sketch: Flying Cat"

[0340] This allows users to clearly understand the specific input content and provide the creative ideas that the system expects.

[0341] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0342] Step 1: User Data Entry

[0343] Users input their creative ideas into the device. They can type "flying cat" into the text field or upload a sketch as an image file. At the same time, the device's camera captures facial expression data, such as the user's smile. The input data is in text or image format, and the output is to store it in the device memory.

[0344] Specific behavior:

[0345] The user takes a photo of themselves smiling in front of the device's camera.

[0346] Users can type "flying cat" into a text field or upload a sketch as an image file.

[0347] The device stores text or image data in memory, while also storing facial expression data captured by the camera.

[0348] Step 2: Emotion recognition and data transmission

[0349] The device receives the idea data (text or image) and facial expression data entered by the user and sends them to the server using the HTTPS protocol.

[0350] Specific behavior:

[0351] The device sends the saved text data, sketch image data, and facial expression data to the server via HTTPS communication.

[0352] The input is text data, sketch image data, and facial expression data, and the output is data transmission to a server.

[0353] Step 3: Preprocessing input data

[0354] The server analyzes the received data. First, it uses an emotion engine to analyze the user's facial expression data and recognize their emotions. Next, it passes the text data to a natural language processing library (e.g., SpaCy) to analyze the idea, and then passes the sketch image data to an image processing library (e.g., OpenCV) for preprocessing.

[0355] Specific behavior:

[0356] The server inputs the facial expression data into an emotion engine and performs emotion analysis.

[0357] The text data is passed to a natural language processing library to analyze the idea content.

[0358] The image data is passed to an image processing library to perform any necessary preprocessing.

[0359] The inputs are facial expression data, text data, and sketch image data, and the outputs are emotion analysis results and preprocessed idea data.

[0360] Step 4: Generate digital art

[0361] The server inputs the pre-processed idea data and the sentiment analysis results into a generative model, which uses a pre-trained deep learning algorithm (e.g., GAN, Transformer model), to generate digital art.

[0362] Specific behavior:

[0363] The server inputs the emotion analysis results and text and image data into a generative model to generate digital art.

[0364] The server generates a high resolution image of the generated artwork.

[0365] The input is the sentiment analysis results and preprocessed idea data, and the output is the generated high-resolution digital art image.

[0366] Step 5: Submit your digital art

[0367] The server then sends a high-resolution image of the generated digital art to the device, again using the HTTPS protocol.

[0368] Specific behavior:

[0369] The server sends the generated high-resolution image file to the terminal via HTTPS communication.

[0370] The input is a high-resolution digital art image, and the output is data transmission to a terminal.

[0371] Step 6: Display and exhibit

[0372] The device displays the received high-resolution image to the user, who can then share this art with other users on the platform and receive feedback.

[0373] Specific behavior:

[0374] The terminal displays the received high-resolution image on its display.

[0375] Users can view the art images and press the share button to share them with other users.

[0376] The input is a received high-resolution digital art image, and the output is a display and sharing for the user. In this way, personalized digital art that reflects the user's emotions and intentions is generated.

[0377] (Application example 2)

[0378] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0379] In today's world, there is a demand for ways to bring out and nurture the creativity of users, especially children. However, conventional digital art generation systems have difficulty providing truly personalized experiences because they do not take into account the emotions of individual users. In particular, the lack of a means to generate content that reflects the user's emotions has led to a uniform, unindividualized user experience.

[0380] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving creative ideas input by a user, terminal means for transmitting the user's ideas to the server, means for analyzing the received idea data, generative model means for automatically generating digital art based on the analyzed data, emotion engine means for acquiring the user's facial expression data and performing emotion analysis, means for transmitting the generated digital art to the terminal, and means for displaying the transmitted digital art to the user. This makes it possible to generate digital art personalized according to the user's emotions.

[0381] "Means for receiving user-input creative ideas" means an interface through which users can input their thoughts and concepts, including a text field and the ability to upload sketch images.

[0382] "Terminal means for transmitting user ideas to the server" refers to hardware and software for transferring data entered by the user to the server, and includes devices such as personal computers and smartphones.

[0383] "Means for analyzing received idea data" refers to algorithms and libraries that the server uses to process and analyze data sent by users.

[0384] The "generative model means for automatically generating digital art based on analyzed data" is a system that uses a deep learning algorithm to create digital art from analyzed user idea data.

[0385] "Emotion engine means for acquiring facial expression data of a user and performing emotion analysis" refers to an algorithm or device for recognizing and analyzing emotions from the user's facial expression.

[0386] "Means for transmitting the generated digital art to the terminal" refers to a function for transferring the digital art generated on the server side to the user's terminal.

[0387] "Means for displaying submitted digital art to a user" refers to an interface that allows a user to view the generated digital art on their device.

[0388] The present invention is a personalized digital art generation system that combines an emotion engine based on a creative idea input by a user. The system includes the following means.

[0389] A way for users to input ideas

[0390] Users use devices such as smartphones, tablets, and PCs to input their creative ideas. The devices are provided with text fields and the ability to upload image files. Users can enter keywords and short ideas in the text fields, as well as upload sketch images.

[0391] Emotion Engine Means

[0392] The system is equipped with an emotion engine that acquires the user's facial expression data and analyzes their emotions. The facial expression data acquired through the camera is then used by an emotion analysis algorithm to recognize the user's emotions. This emotion data is then reflected in the subsequent digital art generation process.

[0393] Data analysis by server

[0394] The server receives idea data and facial expression data submitted by users. The received sketch images are preprocessed using an image processing library (e.g., OpenCV), and the text data is analyzed using a natural language processing library (e.g., Transformers). The data, along with the emotion analysis results from the emotion engine, are then input into the generative model.

[0395] Generative Model Means

[0396] Generative models use pre-trained deep learning algorithms (e.g., GPT-2 and Generative Adversarial Networks) to automatically generate personalized digital art based on analyzed user idea and emotion data.

[0397] Submitting and displaying digital art

[0398] The generated digital art is sent from the server to the user's device as a high-resolution image file, where it is displayed and the user can appreciate it. The user can also share the generated art with other users and receive feedback.

[0399] Specific examples

[0400] As a concrete example of a prompt, let's say the user inputs the idea of ​​a "flying cat" and smiles. The following digital art is generated:

[0401] 1. The user types "flying cat" into the text field, and the device camera simultaneously captures the user's smiling face.

[0402] 2. The server receives the text data of "Flying Cat" and the smiling facial expression data.

[0403] 3. The emotion engine recognizes the "smile" and the generative model generates visual art of a flying cat with a bright and joyful atmosphere that reflects the emotion of "flying cat" and "smile."

[0404] 4. The generated art is sent to the user's device as a high-resolution image, where the user can view it and share it with others.

[0405] In this way, a more personalized art creation experience is provided that responds to the user's emotions.

[0406] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0407] Step 1:

[0408] The user inputs creative ideas using the idea input method. The user inputs ideas in the text field and uploads sketch images. The input data (text and images) is saved on the device.

[0409] Step 2:

[0410] The user captures their own facial expression using the device camera, and the captured facial expression data is saved as an image file on the device.

[0411] Step 3:

[0412] The device sends the user's text data, sketch image data, and facial expression data to the server. This data is securely transmitted using the HTTPS protocol. The server receives the transmitted data.

[0413] Step 4:

[0414] The server analyzes the received data. First, it preprocesses the sketch image data using an image processing library, then analyzes the text data using a natural language processing library. For facial expression data, it performs emotion analysis using an emotion engine. The output of this step is the preprocessed sketch data and analyzed text and emotion data.

[0415] Step 5:

[0416] The server inputs the preprocessed sketch data, parsed text data, and emotion data into a generative model, which uses deep learning algorithms to automatically generate digital art based on the input data. The output of this step is the generated digital art.

[0417] Step 6:

[0418] The server sends the generated digital art as a high-resolution image file to the user's device, also using a secure communication protocol. The device receives the image file.

[0419] Step 7:

[0420] The device displays the received digital art. The user can view the displayed art, share it with other users in the virtual store, and receive feedback. The output of this step is the displayed digital art.

[0421] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0422] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0423] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0424] [Second embodiment]

[0425] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0426] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0427] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0428] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0429] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0430] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0431] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0432] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0433] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0434] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0435] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0436] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0437] This invention relates to a digital art creation system that allows children to visually express their creative ideas. This system provides the functionality to automatically create, display, and exhibit digital art based on creative ideas input by users.

[0438] System Overview

[0439] The system mainly consists of the following elements:

[0440] 1. A way for users to input their ideas: This could include, for example, an image upload feature that allows users to upload sketches, or a text field that allows users to type their ideas.

[0441] 2. Terminal: The device on which the user inputs ideas, such as a PC, tablet, or smartphone.

[0442] 3. Server: A computer system that receives and analyzes users' idea data (sketch images and text data) and generates digital art using a generative model.

[0443] 4. Generative models: Algorithms that take analyzed data as input and generate digital art, such as generative adversarial networks (GANs) or transformer models.

[0444] 5. Display and exhibition means: The ability to display the generated digital art on a device so that the user can view it, and also to exhibit it for sharing with other users.

[0445] Program processing

[0446] User data entry

[0447] Users input their creative ideas into the device, either by uploading sketches as images or by entering text into a text input field.

[0448] Data transmission

[0449] The terminal transmits the data entered by the user to the server using a secure communication protocol (e.g., HTTPS).

[0450] Data analysis

[0451] The server receives and analyzes the data, performing preprocessing in the case of sketch images and natural language processing in the case of text data, converting the data into a format suitable for the generative model.

[0452] Digital Art Generation

[0453] The server then inputs the pre-processed data into a generative model, which uses a pre-trained deep learning algorithm, to generate the digital art.

[0454] Digital Art Submission

[0455] The server then transmits the generated digital art to the device, where it is presented in a high-resolution image format.

[0456] Display and Exhibition

[0457] The device displays the received digital art to the user, who can then view it. The user can also exhibit the generated art within the platform and receive feedback from other users.

[0458] Specific examples

[0459] For example, if a user inputs the idea of ​​a "flying cat," the following specific processing is performed.

[0460] 1. Data Entry

[0461] The user types "flying cat" into the text field.

[0462] 2. Data Transmission

[0463] The terminal transmits this text data to the server.

[0464] 3. Data Analysis

[0465] The server tokenizes and grammatically analyzes the received text data and converts it into a format suitable for the generative model.

[0466] 4. Digital Art Generation

[0467] Based on the information about the "flying cat," the server uses a generative model to generate visual art of a flying cat.

[0468] 5. Submitting Digital Art

[0469] The generated artwork is sent to the device as a high-resolution image.

[0470] 6. Display and Exhibition

[0471] The device displays the received art to the user, who can then view it and share it with other users within the platform to receive feedback.

[0472] In this way, a system is provided that allows users to easily visually express and share their creative ideas with others, thereby fostering children's artistic talent and self-esteem.

[0473] The processing flow will be explained below.

[0474] Step 1:

[0475] Users input their creative ideas into the device, either by uploading sketches as image files or by entering text ideas into a text field.

[0476] Step 2:

[0477] The device sends the idea data (sketch image and text data) entered by the user to the server using a secure communication protocol such as HTTPS.

[0478] Step 3:

[0479] The server first analyzes the received idea data. If it is a sketch image, it uses an image processing library for preprocessing, and if it is text data, it uses a natural language processing library for analysis.

[0480] Step 4:

[0481] The server inputs the pre-processed data into a generative model, which uses pre-trained deep learning algorithms (e.g., generative adversarial networks or transformer models) to generate digital art.

[0482] Step 5:

[0483] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[0484] Step 6:

[0485] The device displays the received high-resolution image files for the user to view, and the user can share the generated art with other users within the platform.

[0486] Step 7:

[0487] Users can receive feedback from other users within the platform, which can help improve self-esteem and creativity.

[0488] In this way, the "Future Artist" AI Art Studio provides a series of processes that allow users to easily visually express their creative ideas and share them with others.

[0489] Example 1

[0490] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0491] In the modern educational environment and the field of digital art, there is a lack of effective means for children to easily visually express their creative ideas and share them with others. In particular, there is a need for a system that provides a user-friendly interface and allows them to safely and quickly generate digital art. There is also a lack of an easy-to-use platform for sharing the generated artwork with others and receiving feedback.

[0492] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0493] In this invention, the server includes: means for receiving creative ideas input by a user; terminal means for transmitting the user's ideas to the server; means for transmitting the received idea data to the server using a secure communication protocol; means for analyzing and preprocessing the received idea data; generative model means for automatically generating digital art based on the preprocessed data; means for transmitting the generated digital art to the terminal in high resolution; and means for displaying the transmitted digital art to the user and sharing it with other users. This allows users to easily visualize their creative ideas as digital art and share it securely. Furthermore, it makes it easy to share the generated artwork with other users and receive feedback. This system contributes to fostering children's artistic talent and self-esteem.

[0494] A "creative idea" is an original idea or artistic concept that a user has in mind.

[0495] A "terminal" is a computing device that a user uses to input and send ideas to a server.

[0496] A "server" is a central processing unit that receives and analyzes data sent by users and generates digital art.

[0497] The "data transmission means" is a function for safely transmitting the user's idea data from the terminal to the server.

[0498] The "analysis means" is a method for preprocessing the received idea data and converting it into a format that can be understood by the generative model.

[0499] A "generative model" is an algorithm for automatically generating digital art based on preprocessed data.

[0500] "Digital art" is a visual work of art that is automatically generated by a generative model.

[0501] "High resolution" refers to an image quality that allows images to be displayed clearly down to the fine details.

[0502] "Display means" is a function for displaying the transmitted digital art on the user's terminal.

[0503] "Sharing means" is a function for sharing the created digital art with other users and receiving feedback.

[0504] "Preprocessing" is the process of analyzing the received data and converting it into a format that can be properly processed by the generative model.

[0505] "Natural language processing" is a technology for analyzing text data and understanding and extracting meaning.

[0506] An "encrypted protocol" is a technique for encrypting transmitted data in order to communicate the data securely.

[0507] MODE FOR CARRYING OUT THE INVENTION

[0508] This invention is a system that automatically generates digital art based on creative ideas input by users, and allows users to display and share it with other users. This system allows users to input creative ideas through digital devices, and the server analyzes and generates the data, providing artistic digital works.

[0509] Hardware and software used

[0510] 1. Device: The device that a user uses to input ideas. This can include a computer, tablet, smartphone, etc.

[0511] 2. Server: A central processing unit that receives and analyzes user input data and generates digital art. This server has advanced hardware capabilities and is capable of running deep learning algorithms.

[0512] 3. Generative models: Algorithms for generating digital art, such as generative adversarial networks (GANs) and transformer models.

[0513] Program processing

[0514] User data entry

[0515] Users use the device to input their creative ideas, which can be done by typing ideas into a text field or uploading sketch images.

[0516] As a concrete example, consider the case where a user types "flying cat" into a text field, and this string is used in a later processing step.

[0517] Data transmission

[0518] The terminal transmits the data entered by the user to the server, and the transmission process is carried out using a secure communication protocol (e.g. HTTPS) to ensure the confidentiality of the data.

[0519] Data analysis

[0520] The server receives and analyzes the data sent. For text data, it uses natural language processing (NLP) algorithms (e.g., NLTK or spaCy) to tokenize and analyze grammar. For sketch images, it uses image preprocessing algorithms (e.g., OpenCV or TensorFlow) to extract the necessary components.

[0521] Digital Art Generation

[0522] The server inputs the preprocessed data into a generative model to generate digital art. Generative models such as generative adversarial networks (GANs) and transformer models are used. For example, based on the prompt "a cat flying in the sky," a GAN generates visual art of a flying cat.

[0523] Digital Art Submission

[0524] The server then sends the generated digital art to the device, where it is provided in a high-resolution image format (e.g., PNG or JPEG).

[0525] View and Share

[0526] The device displays the generated digital art to the user, who can then view and save it. Users can also share their artwork with other users within the platform and receive feedback.

[0527] Specific examples

[0528] For example, if a user inputs the idea "a panda exploring space," the following process occurs:

[0529] Idea input: The user types "Panda exploring space" into the text field.

[0530] Data transmission: The device sends this data to the server.

[0531] Data analysis: The server tokenizes the text data and performs grammatical analysis.

[0532] Digital Art Generation: The server uses GAN to generate visual art of a "panda exploring space."

[0533] Send digital art: sent to your device as a high-resolution image.

[0534] View and share: Users can view the art generated on their device and share it with others.

[0535] The system allows users to easily visualize their creative ideas as digital art and share it with others. Using generative AI models, the process fosters children's imaginations and provides a new outlet for self-expression.

[0536] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0537] Step 1: User Data Entry

[0538] How it works: A user uses a terminal to input a creative idea. For example, they might type "flying cat" into a text field. At this point, the data entered is the user's idea (prompt text and sketch image).

[0539] Input: User's creative idea (text and / or images).

[0540] Output: User input data (text or image).

[0541] Step 2: Send data

[0542] Operational details: The device sends the data entered by the user to the server using a secure communication protocol (e.g., HTTPS). The data is encrypted during the transmission process, reducing the risk of data leakage during transmission.

[0543] Input: User input data (text or image).

[0544] Output: Encrypted data to be transmitted.

[0545] Step 3: Data reception and analysis

[0546] How it works: The server receives the encrypted data and begins parsing it. If it's text data, it uses natural language processing (NLP) algorithms to tokenize and parse it, converting it into a format that the generative model can understand. If it's a sketch image, it uses image preprocessing algorithms to extract the necessary components.

[0547] Input: Encrypted data (text or image) sent from the device.

[0548] Output: Preprocessed text or image data.

[0549] Step 4: Generate digital art

[0550] How it works: The server inputs the preprocessed data into a generative model to generate digital art. Generative models such as generative adversarial networks (GANs) and transformer models are used. For example, based on the prompt "a cat flying in the sky," a highly accurate visual art of a flying cat is generated.

[0551] Input: Preprocessed data (text or images).

[0552] Output: Generated digital art (high resolution images).

[0553] Step 5: Submit your digital art

[0554] How it works: The server sends the generated digital art to the device. The art is provided in a high-resolution image format (e.g. PNG or JPEG). The server takes care to ensure that the data reaches the device completely and accurately.

[0555] Input: Generated digital art (high resolution image).

[0556] Output: High resolution image data sent to the device.

[0557] Step 6: View and share

[0558] Operational Details: The device displays the received digital art to the user. The user can save the displayed artwork and share it with other users. Through this sharing function, the user can receive feedback on the created art.

[0559] Input: High resolution image data sent from the server.

[0560] Output: Digital art displayed on the device and data shared on the platform.

[0561] (Application example 1)

[0562] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0563] There is a demand for digital art generation systems that not only automatically generate creative ideas input by users, but also display the generated art in an actual physical exhibition space and allow interactive manipulation. Furthermore, to encourage children's creativity, it is necessary to provide an environment in which they can share the art they create with other users and receive feedback. The present invention aims to solve these problems.

[0564] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0565] In this invention, the server includes means for receiving creative ideas input by users, terminal means for transmitting the user's ideas to the server, means for analyzing the received idea data, generation model means for automatically generating digital art based on the analyzed data, means for transmitting the generated digital art to the terminal, means for displaying the transmitted digital art to the user, and means for displaying and enabling interactive manipulation of the generated digital art in a physical exhibition space, thereby enabling users to visualize their creative ideas in real time, share them with other users, and experience interacting with them in the real world.

[0566] "Creative ideas entered by the user" refers to content or concepts that the user has thought up and conceived himself, and includes forms such as sketches and text.

[0567] "Terminal means" refers to a device that allows a user to input ideas and send them to a server, and specifically includes a PC, tablet, smartphone, etc.

[0568] "Server" refers to a central processing unit that receives, analyzes, generates, and transmits data from users, and communicates with multiple terminals via the Internet.

[0569] "Means for analyzing" refers to software and algorithms that convert the received user idea data into an easy-to-understand format and perform processing to create input data suitable for the generative model.

[0570] "Generative modeling methods" refers to the use of algorithms and software, specifically generative adversarial networks (GANs) and transformer models, to automatically generate digital art based on analyzed data.

[0571] "Means of transmission" refers to the means of communication for transferring the generated digital art to the user's device, and refers to the use of a secure communication protocol (e.g., HTTPS).

[0572] "Displaying means" refers to an interface for visually displaying the generated digital art on the user's terminal, and includes a display or screen display function.

[0573] "Physical exhibition space" refers to a space where digital art generated in the real world can be displayed and interacted with, such as a museum or learning facility.

[0574] "Interactive" refers to a function that allows a user to directly touch and manipulate the generated art.

[0575] "Preprocessing" refers to the initial processing required to convert the sketch images and text data received from the user into a format suitable for the generative model, including image resizing and tokenization.

[0576] This invention relates to a system that generates digital art based on creative ideas input by users and allows them to display and manipulate it in a physical exhibition space in the real world. The specific configuration and processing steps of this system are described below.

[0577] System configuration

[0578] The system mainly consists of the following components:

[0579] 1. Terminal means: Includes devices such as PCs, tablets, and smartphones, and has the function of allowing users to input ideas and send them to the server.

[0580] 2. Server: A central processing unit that receives and analyzes data from users and generates digital art. Specifically, a high-performance cloud server is used.

[0581] 3. Generative modeling: Algorithms that automatically generate digital art using generative adversarial networks (GANs) and transformer models.

[0582] 4. Display means: Includes displays and interfaces for displaying the generated digital art on devices or in physical exhibition spaces.

[0583] 5. Interactive means: including touchscreens and sensor technology to allow users to directly manipulate the generated art in the physical exhibition space.

[0584] Program processing procedure

[0585] 1. User idea input:

[0586] Users use the device to input creative ideas in the form of sketches or text, which can be uploaded as an image file or entered into a text field.

[0587] 2. Data transmission:

[0588] The device sends the entered data to the server, and this communication is carried out using a secure protocol (e.g. HTTPS).

[0589] 3. Data Analysis:

[0590] The server analyzes the received data, performs image preprocessing on the sketch images, and natural language processing on the text data, converting the data into a format suitable for the generative modeling tool.

[0591] 4. Digital Art Generation:

[0592] The server generates digital art from the pre-processed data using pre-trained generative models, such as generative adversarial networks (GANs) and transformer models.

[0593] 5. View and interact:

[0594] The generated digital art is sent to the device and displayed to the user, while the physical exhibition space displays the generated art on large displays and touchscreens, allowing users to directly manipulate it.

[0595] Technology and software used

[0596] The specific hardware and software used in this system are:

[0597] Devices: PC, tablet, smartphone

[0598] Server: Cloud Server

[0599] Generative modeling tools: Generative Adversarial Networks (GANs), Transformer models

[0600] Display and interaction: displays, touchscreens, sensor technology

[0601] Specific examples

[0602] For example, if a user inputs the idea of ​​a "flying cat," the following specific processing is performed.

[0603] 1. Data Entry: A user draws a sketch of a "flying cat" on a tablet and then types "flying cat" into a text field.

[0604] 2. Data transmission: The sketch image and text data are sent from the device to the server.

[0605] 3. Data analysis: The server preprocesses the sketch images and analyzes the text data using natural language processing.

[0606] 4. Digital Art Generation: Using generative modeling techniques, the art of the "flying cat" is generated.

[0607] 5. Display and exhibition: The generated art is displayed on the terminal and then on a large display in the physical exhibition space.

[0608] Prompt Sentence Examples

[0609] Create a vivid and imaginative piece of digital art that captures the concept of a flying cat. The generated art should depict a cat gliding lightly through the air, with a blue sky and clouds in the background.

[0610] As described above, this system allows users to realize their creative ideas and allows them to view and manipulate them in a real environment, allowing users to visually express their ideas and share them with others.

[0611] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0612] Step 1:

[0613] A user uses the device to input creative ideas, which can be sketched images or text, and the input data is temporarily stored in the device's memory.

[0614] Input: User sketch image or text data

[0615] Action: Enter data using the input interface on the device

[0616] Output: Creative ideas stored in the device's memory

[0617] Step 2:

[0618] The data entered by the user is sent from the device to the server using a secure communication protocol (e.g. HTTPS).

[0619] Input: Creative ideas stored in your device's memory

[0620] Behavior: Uses the data transmission function to send user data from the device to the server.

[0621] Output: Sketch image or text data sent to the server

[0622] Step 3:

[0623] The server analyzes the received data, performing image preprocessing in the case of sketch images and natural language processing in the case of text data, converting the data into a format suitable for the generative modeling tool.

[0624] Input: Sketch image or text data sent to the server

[0625] What it does: Image preprocessing (image resizing, noise removal, etc.) and text tokenization and analysis.

[0626] Output: Preprocessed sketch image or text data

[0627] Step 4:

[0628] The server generates digital art based on the preprocessed data using generative AI models, such as generative adversarial networks (GANs) and transformer models.

[0629] Input: Preprocessed sketch images or text data

[0630] How it works: Applying generative AI models to generate creative digital art

[0631] Output: Generated digital art

[0632] Step 5:

[0633] The server transmits the generated digital art to the device using a secure communication protocol (e.g., HTTPS).

[0634] Input: Generated digital art

[0635] Operation: Uses the data transmission function to send the generated art from the server to the device.

[0636] Output: Digital art sent to your device

[0637] Step 6:

[0638] The device displays the received digital art to the user, and in addition, in the physical exhibition space, the generated art is displayed on a large display or touch screen, allowing the user to interact with it.

[0639] Input: Digital art sent to the device

[0640] Operation: Display digital art on the display and provide interactive operation to the user using the touch screen.

[0641] Output: Digital art that is visible to the user and can be interacted with.

[0642] The above are the specific processing steps of this program. This system allows users to instantly visualize their creative ideas, and then view and manipulate them in a real-world exhibition space.

[0643] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0644] This invention provides a more personalized experience by combining an emotion engine with a system that receives creative ideas input by users and automatically generates digital art. This system aims to provide an environment where children can visually express their creative ideas and receive emotional feedback to foster their creativity.

[0645] System Overview

[0646] The system includes the following elements:

[0647] 1. A way for users to input their ideas: An interface that allows users to upload sketches as image files or enter text into a text field.

[0648] 2. Terminal: A device through which a user inputs creative ideas. Examples include computers, tablets, and smartphones.

[0649] 3. Server: A central computer system that receives the data sent by users, analyzes it, processes it with a generative model, and performs sentiment analysis with an emotion engine.

[0650] 4. Generative model: A deep learning algorithm for generating digital art based on input data.

[0651] 5. Emotion engine: An algorithm that recognizes emotions by analyzing the content of text and sketches entered by the user, as well as the user's facial expressions.

[0652] 6. Display and exhibition means: An interface for displaying the generated digital art to the user and for sharing with other users.

[0653] Program processing

[0654] User data entry

[0655] Users can input their creative ideas into the device, for example, by uploading sketches as images or by entering text into the input field.

[0656] emotion recognition

[0657] The device acquires the user's facial expression data using a camera or other device along with the user's input data, and sends this data to the server. The emotion engine analyzes this facial expression data and the input text data to recognize the user's emotions.

[0658] Data transmission

[0659] The device sends the data entered by the user and facial expression data to the server using a secure communication protocol such as HTTPS.

[0660] Data analysis

[0661] The server receives the data and first performs sentiment analysis using an emotion engine, then analyzes the idea data. For sketch images, it performs preprocessing using an image processing library, and for text data, it performs analysis using a natural language processing library.

[0662] Digital Art Generation

[0663] The server then inputs the pre-processed idea data and sentiment analysis results into a generative model, which uses pre-trained deep learning algorithms (e.g., generative adversarial networks and transformer models) to generate digital art.

[0664] Digital Art Submission

[0665] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[0666] Display and Exhibition

[0667] The device displays the received high-resolution image files for the user to view, and the user can share the generated art with other users within the platform and receive feedback from them.

[0668] Specific examples

[0669] For example, when a user inputs the idea "a flying cat" and smiles at the time, the following specific processing is performed.

[0670] 1. Data Entry

[0671] The user types "flying cat" into the text field, and the device camera captures the user's smile.

[0672] 2. Emotion recognition

[0673] The terminal transmits the text data of "Flying Cat" and the image data of the user's smiling face to the server.

[0674] 3. Data Analysis

[0675] The server first analyzes the facial expression data using an emotion engine to determine whether the user is smiling. Next, it analyzes the text data, "Flying Cat."

[0676] 4. Digital Art Generation

[0677] The server inputs the emotional data of "smile" and the idea data of "flying cat" into the generative model, and generates visual art of a flying cat with a bright and cheerful atmosphere.

[0678] 5. Submitting Digital Art

[0679] The generated artwork is sent to the device as a high-resolution image.

[0680] 6. Display and Exhibition

[0681] The device displays the art to the user, who can then view it, while simultaneously sharing it with other users within the platform and receiving feedback.

[0682] In this way, the combination of emotion engines provides a more personalized art creation experience that responds to the user's emotions.

[0683] The processing flow will be explained below.

[0684] Step 1:

[0685] Users input their creative ideas into the device, for example, by uploading a sketch as an image file or by typing a text idea such as "flying cat" into the text field.

[0686] Step 2:

[0687] The device uses a camera to capture the user's facial expression data, such as a smile, along with the user's input data (sketch image and text data).

[0688] Step 3:

[0689] The device sends the acquired idea data (sketch image or text data) and facial expression data to a server using a secure communication protocol (e.g., HTTPS).

[0690] Step 4:

[0691] The server first analyzes the received data using an emotion engine. The emotion engine recognizes the emotion from the user's facial expression and stores the result. For example, it recognizes that the user is smiling.

[0692] Step 5:

[0693] The server then analyzes the idea data. For sketch images, it uses an image processing library for preprocessing, and for text data, it uses a natural language processing library for tokenization and grammar analysis.

[0694] Step 6:

[0695] The server inputs the preprocessed idea data and the emotion analysis results into a generative model, which then generates digital art based on a deep learning algorithm. For example, using the emotion data of a smile and the idea data of a "flying cat," the model generates brightly colored visual art of a flying cat.

[0696] Step 7:

[0697] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[0698] Step 8:

[0699] The terminal displays the received high-resolution image file to the user, who can then appreciate the generated digital art.

[0700] Step 9:

[0701] The device allows users to share their generated art with other users within the platform and receive feedback, who can view, comment on, and rate the art.

[0702] For example, if a user inputs the idea of ​​a "flying cat" and smiles at the device, the resulting art generated by this flow will be a bright, positive, and visual art of a flying cat. This art can then be shared with other users, who can provide feedback through comments and ratings.

[0703] In this way, the system combined with the emotion engine provides a more personalized digital art creation experience that responds to the user's emotions.

[0704] Example 2

[0705] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0706] Conventional digital art generation systems often generate artworks based solely on user-entered text or sketches, making it difficult to reflect the emotions and intentions of individual users. Furthermore, because the generated digital art is not based on the user's emotions, it is difficult to provide a personalized experience. Therefore, a means for users to receive more creative and emotional feedback is needed.

[0707] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving creative ideas input by a user, an emotion engine means for analyzing the user's emotions, and a generative model means for automatically generating digital art based on the analyzed data. This makes it possible to generate personalized digital art that reflects the user's emotions and intentions.

[0708] The "means for receiving creative ideas input by the user" is an interface that allows the user to upload sketches as image files or input text into a text field.

[0709] "Terminal means for transmitting user ideas to the server" refers to devices used by users, such as PCs, tablets, and smartphones, which include a transmission function.

[0710] The "means for analyzing received idea data" refers to an algorithm that analyzes data entered by a user using an image processing library, natural language processing library, or the like installed on the server.

[0711] The "emotion engine means for analyzing the user's emotions" is an algorithm that analyzes the contents of input text or sketches and the user's facial expressions to recognize the user's emotions.

[0712] The "generative model means for automatically generating digital art based on analyzed data" uses a deep learning algorithm to generate digital art based on preprocessed idea data and emotion analysis results.

[0713] "Means for transmitting the generated digital art to the terminal" refers to a communication protocol or mechanism for transmitting the high-resolution digital art image generated by the server to the terminal.

[0714] The "means for displaying the transmitted digital art to the user" refers to a display or interface that visually displays the digital art received by the terminal to the user.

[0715] This invention combines an emotion engine with a system that receives creative ideas input by users and automatically generates digital art based on those ideas to provide a more personalized experience. The aim is to foster creativity in children by allowing them to express their own creativity and receiving emotional feedback in the process.

[0716] System Components

[0717] 1. How users enter their ideas:

[0718] Users can upload their sketches as image files or use the interface to enter text into a text field on devices such as PCs, tablets, and smartphones.

[0719] 2. Terminal:

[0720] It refers to a device where users input their creative ideas and send them to a server. The device also uses a camera to capture the user's facial expression data and sends it to the server.

[0721] 3. Server:

[0722] This is a central computer system that receives and analyzes data sent by users. The server analyzes the data using natural language processing and image processing libraries. For example, OpenNLP and SpaCy are used for natural language processing, and OpenCV is used for image processing.

[0723] 4. Analysis method:

[0724] The emotion engine installed on the server performs emotion analysis and then preprocesses the idea data. The emotion engine includes algorithms that analyze the content of input text and sketches, as well as the user's facial expressions, to recognize the user's emotions.

[0725] 5. Digital Art Generation:

[0726] Deep learning algorithms, such as generative adversarial networks (GANs) and transformer models, are used to generate digital art based on preprocessed idea data and sentiment analysis results.

[0727] 6. Display and Exhibit:

[0728] An interface is provided for displaying the generated digital art to the user, and for sharing it with other users.

[0729] Specific examples

[0730] For example, a specific example is given in which a user inputs the idea "a flying cat" and smiles at the time.

[0731] The user enters "Cat flying in the sky" into the text field, and the device's camera captures the user's smile. The device sends this input data and facial expression data to the server. The server first analyzes the user's facial expression using an emotion engine and recognizes that it is a "smile." It then analyzes the text data "Cat flying in the sky."

[0732] Next, the server inputs the emotion data of "smile" and the idea data of "flying cat" into the generative model, generating visual art of a cheerful and fun-loving cat flying in the sky. The generated artwork is sent to the device as a high-resolution image, which the device displays to the user, who can then view it. The artwork can also be shared with other users and receive feedback.

[0733] Prompt Sentence Examples

[0734] Examples of specific prompts include the following:

[0735] "Enter the following text into the input field: Flying Cat"

[0736] or

[0737] "Upload your next sketch: Flying Cat"

[0738] This allows users to clearly understand the specific input content and provide the creative ideas that the system expects.

[0739] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0740] Step 1: User Data Entry

[0741] Users input their creative ideas into the device. They can type "flying cat" into the text field or upload a sketch as an image file. At the same time, the device's camera captures facial expression data, such as the user's smile. The input data is in text or image format, and the output is to store it in the device memory.

[0742] Specific behavior:

[0743] The user takes a photo of themselves smiling in front of the device's camera.

[0744] Users can type "flying cat" into a text field or upload a sketch as an image file.

[0745] The device stores text or image data in memory, while also storing facial expression data captured by the camera.

[0746] Step 2: Emotion recognition and data transmission

[0747] The device receives the idea data (text or image) and facial expression data entered by the user and sends them to the server using the HTTPS protocol.

[0748] Specific behavior:

[0749] The device sends the saved text data, sketch image data, and facial expression data to the server via HTTPS communication.

[0750] The input is text data, sketch image data, and facial expression data, and the output is data transmission to a server.

[0751] Step 3: Preprocessing input data

[0752] The server analyzes the received data. First, it uses an emotion engine to analyze the user's facial expression data and recognize their emotions. Next, it passes the text data to a natural language processing library (e.g., SpaCy) to analyze the idea, and then passes the sketch image data to an image processing library (e.g., OpenCV) for preprocessing.

[0753] Specific behavior:

[0754] The server inputs the facial expression data into an emotion engine and performs emotion analysis.

[0755] The text data is passed to a natural language processing library to analyze the idea content.

[0756] The image data is passed to an image processing library to perform any necessary preprocessing.

[0757] The inputs are facial expression data, text data, and sketch image data, and the outputs are emotion analysis results and preprocessed idea data.

[0758] Step 4: Generate digital art

[0759] The server inputs the pre-processed idea data and the sentiment analysis results into a generative model, which uses a pre-trained deep learning algorithm (e.g., GAN, Transformer model), to generate digital art.

[0760] Specific behavior:

[0761] The server inputs the emotion analysis results and text and image data into a generative model to generate digital art.

[0762] The server generates a high resolution image of the generated artwork.

[0763] The input is the sentiment analysis results and preprocessed idea data, and the output is the generated high-resolution digital art image.

[0764] Step 5: Submit your digital art

[0765] The server then sends a high-resolution image of the generated digital art to the device, again using the HTTPS protocol.

[0766] Specific behavior:

[0767] The server sends the generated high-resolution image file to the terminal via HTTPS communication.

[0768] The input is a high-resolution digital art image, and the output is data transmission to a terminal.

[0769] Step 6: Display and exhibit

[0770] The device displays the received high-resolution image to the user, who can then share this art with other users on the platform and receive feedback.

[0771] Specific behavior:

[0772] The terminal displays the received high-resolution image on its display.

[0773] Users can view the art images and press the share button to share them with other users.

[0774] The input is a received high-resolution digital art image, and the output is a display and sharing for the user. In this way, personalized digital art that reflects the user's emotions and intentions is generated.

[0775] (Application example 2)

[0776] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0777] In today's world, there is a demand for ways to bring out and nurture the creativity of users, especially children. However, conventional digital art generation systems have difficulty providing truly personalized experiences because they do not take into account the emotions of individual users. In particular, the lack of a means to generate content that reflects the user's emotions has led to a uniform, unindividualized user experience.

[0778] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving creative ideas input by a user, terminal means for transmitting the user's ideas to the server, means for analyzing the received idea data, generative model means for automatically generating digital art based on the analyzed data, emotion engine means for acquiring the user's facial expression data and performing emotion analysis, means for transmitting the generated digital art to the terminal, and means for displaying the transmitted digital art to the user. This makes it possible to generate digital art personalized according to the user's emotions.

[0779] "Means for receiving user-input creative ideas" means an interface through which users can input their thoughts and concepts, including a text field and the ability to upload sketch images.

[0780] "Terminal means for transmitting user ideas to the server" refers to hardware and software for transferring data entered by the user to the server, and includes devices such as personal computers and smartphones.

[0781] "Means for analyzing received idea data" refers to algorithms and libraries that the server uses to process and analyze data sent by users.

[0782] The "generative model means for automatically generating digital art based on analyzed data" is a system that uses a deep learning algorithm to create digital art from analyzed user idea data.

[0783] "Emotion engine means for acquiring facial expression data of a user and performing emotion analysis" refers to an algorithm or device for recognizing and analyzing emotions from the user's facial expression.

[0784] "Means for transmitting the generated digital art to the terminal" refers to a function for transferring the digital art generated on the server side to the user's terminal.

[0785] "Means for displaying submitted digital art to a user" refers to an interface that allows a user to view the generated digital art on their device.

[0786] The present invention is a personalized digital art generation system that combines an emotion engine based on a creative idea input by a user. The system includes the following means.

[0787] A way for users to input ideas

[0788] Users use devices such as smartphones, tablets, and PCs to input their creative ideas. The devices are provided with text fields and the ability to upload image files. Users can enter keywords and short ideas in the text fields, as well as upload sketch images.

[0789] Emotion Engine Means

[0790] The system is equipped with an emotion engine that acquires the user's facial expression data and analyzes their emotions. The facial expression data acquired through the camera is then used by an emotion analysis algorithm to recognize the user's emotions. This emotion data is then reflected in the subsequent digital art generation process.

[0791] Data analysis by server

[0792] The server receives idea data and facial expression data submitted by users. The received sketch images are preprocessed using an image processing library (e.g., OpenCV), and the text data is analyzed using a natural language processing library (e.g., Transformers). The data, along with the emotion analysis results from the emotion engine, are then input into the generative model.

[0793] Generative Model Means

[0794] Generative models use pre-trained deep learning algorithms (e.g., GPT-2 and Generative Adversarial Networks) to automatically generate personalized digital art based on analyzed user idea and emotion data.

[0795] Submitting and displaying digital art

[0796] The generated digital art is sent from the server to the user's device as a high-resolution image file, where it is displayed and the user can appreciate it. The user can also share the generated art with other users and receive feedback.

[0797] Specific examples

[0798] As a concrete example of a prompt, let's say the user inputs the idea of ​​a "flying cat" and smiles. The following digital art is generated:

[0799] 1. The user types "flying cat" into the text field, and the device camera simultaneously captures the user's smiling face.

[0800] 2. The server receives the text data of "Flying Cat" and the smiling facial expression data.

[0801] 3. The emotion engine recognizes the "smile" and the generative model generates visual art of a flying cat with a bright and joyful atmosphere that reflects the emotion of "flying cat" and "smile."

[0802] 4. The generated art is sent to the user's device as a high-resolution image, where the user can view it and share it with others.

[0803] In this way, a more personalized art creation experience is provided that responds to the user's emotions.

[0804] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0805] Step 1:

[0806] The user inputs creative ideas using the idea input method. The user inputs ideas in the text field and uploads sketch images. The input data (text and images) is saved on the device.

[0807] Step 2:

[0808] The user captures their own facial expression using the device camera, and the captured facial expression data is saved as an image file on the device.

[0809] Step 3:

[0810] The device sends the user's text data, sketch image data, and facial expression data to the server. This data is securely transmitted using the HTTPS protocol. The server receives the transmitted data.

[0811] Step 4:

[0812] The server analyzes the received data. First, it preprocesses the sketch image data using an image processing library, then analyzes the text data using a natural language processing library. For facial expression data, it performs emotion analysis using an emotion engine. The output of this step is the preprocessed sketch data and analyzed text and emotion data.

[0813] Step 5:

[0814] The server inputs the preprocessed sketch data, parsed text data, and emotion data into a generative model, which uses deep learning algorithms to automatically generate digital art based on the input data. The output of this step is the generated digital art.

[0815] Step 6:

[0816] The server sends the generated digital art as a high-resolution image file to the user's device, also using a secure communication protocol. The device receives the image file.

[0817] Step 7:

[0818] The device displays the received digital art. The user can view the displayed art, share it with other users in the virtual store, and receive feedback. The output of this step is the displayed digital art.

[0819] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0820] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0821] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0822] [Third embodiment]

[0823] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0824] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0825] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0826] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0827] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0828] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0829] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0830] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0831] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0832] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0833] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0834] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0835] This invention relates to a digital art creation system that allows children to visually express their creative ideas. This system provides the functionality to automatically create, display, and exhibit digital art based on creative ideas input by users.

[0836] System Overview

[0837] The system mainly consists of the following elements:

[0838] 1. A way for users to input their ideas: This could include, for example, an image upload feature that allows users to upload sketches, or a text field that allows users to type their ideas.

[0839] 2. Terminal: The device on which the user inputs ideas, such as a PC, tablet, or smartphone.

[0840] 3. Server: A computer system that receives and analyzes users' idea data (sketch images and text data) and generates digital art using a generative model.

[0841] 4. Generative models: Algorithms that take analyzed data as input and generate digital art, such as generative adversarial networks (GANs) or transformer models.

[0842] 5. Display and exhibition means: The ability to display the generated digital art on a device so that the user can view it, and also to exhibit it for sharing with other users.

[0843] Program processing

[0844] User data entry

[0845] Users input their creative ideas into the device, either by uploading sketches as images or by entering text into a text input field.

[0846] Data transmission

[0847] The terminal transmits the data entered by the user to the server using a secure communication protocol (e.g., HTTPS).

[0848] Data analysis

[0849] The server receives and analyzes the data, performing preprocessing in the case of sketch images and natural language processing in the case of text data, converting the data into a format suitable for the generative model.

[0850] Digital Art Generation

[0851] The server then inputs the pre-processed data into a generative model, which uses a pre-trained deep learning algorithm, to generate the digital art.

[0852] Digital Art Submission

[0853] The server then transmits the generated digital art to the device, where it is presented in a high-resolution image format.

[0854] Display and Exhibition

[0855] The device displays the received digital art to the user, who can then view it. The user can also exhibit the generated art within the platform and receive feedback from other users.

[0856] Specific examples

[0857] For example, if a user inputs the idea of ​​a "flying cat," the following specific processing is performed.

[0858] 1. Data Entry

[0859] The user types "flying cat" into the text field.

[0860] 2. Data Transmission

[0861] The terminal transmits this text data to the server.

[0862] 3. Data Analysis

[0863] The server tokenizes and grammatically analyzes the received text data and converts it into a format suitable for the generative model.

[0864] 4. Digital Art Generation

[0865] Based on the information about the "flying cat," the server uses a generative model to generate visual art of a flying cat.

[0866] 5. Submitting Digital Art

[0867] The generated artwork is sent to the device as a high-resolution image.

[0868] 6. Display and Exhibition

[0869] The device displays the received art to the user, who can then view it and share it with other users within the platform to receive feedback.

[0870] In this way, a system is provided that allows users to easily visually express and share their creative ideas with others, thereby fostering children's artistic talent and self-esteem.

[0871] The processing flow will be explained below.

[0872] Step 1:

[0873] Users input their creative ideas into the device, either by uploading sketches as image files or by entering text ideas into a text field.

[0874] Step 2:

[0875] The device sends the idea data (sketch image and text data) entered by the user to the server using a secure communication protocol such as HTTPS.

[0876] Step 3:

[0877] The server first analyzes the received idea data. If it is a sketch image, it uses an image processing library for preprocessing, and if it is text data, it uses a natural language processing library for analysis.

[0878] Step 4:

[0879] The server inputs the pre-processed data into a generative model, which uses pre-trained deep learning algorithms (e.g., generative adversarial networks or transformer models) to generate digital art.

[0880] Step 5:

[0881] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[0882] Step 6:

[0883] The device displays the received high-resolution image files for the user to view, and the user can share the generated art with other users within the platform.

[0884] Step 7:

[0885] Users can receive feedback from other users within the platform, which can help improve self-esteem and creativity.

[0886] In this way, the "Future Artist" AI Art Studio provides a series of processes that allow users to easily visually express their creative ideas and share them with others.

[0887] Example 1

[0888] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0889] In the modern educational environment and the field of digital art, there is a lack of effective means for children to easily visually express their creative ideas and share them with others. In particular, there is a need for a system that provides a user-friendly interface and allows them to safely and quickly generate digital art. There is also a lack of an easy-to-use platform for sharing the generated artwork with others and receiving feedback.

[0890] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0891] In this invention, the server includes: means for receiving creative ideas input by a user; terminal means for transmitting the user's ideas to the server; means for transmitting the received idea data to the server using a secure communication protocol; means for analyzing and preprocessing the received idea data; generative model means for automatically generating digital art based on the preprocessed data; means for transmitting the generated digital art to the terminal in high resolution; and means for displaying the transmitted digital art to the user and sharing it with other users. This allows users to easily visualize their creative ideas as digital art and share it securely. Furthermore, it makes it easy to share the generated artwork with other users and receive feedback. This system contributes to fostering children's artistic talent and self-esteem.

[0892] A "creative idea" is an original idea or artistic concept that a user has in mind.

[0893] A "terminal" is a computing device that a user uses to input and send ideas to a server.

[0894] A "server" is a central processing unit that receives and analyzes data sent by users and generates digital art.

[0895] The "data transmission means" is a function for safely transmitting the user's idea data from the terminal to the server.

[0896] The "analysis means" is a method for preprocessing the received idea data and converting it into a format that can be understood by the generative model.

[0897] A "generative model" is an algorithm for automatically generating digital art based on preprocessed data.

[0898] "Digital art" is a visual work of art that is automatically generated by a generative model.

[0899] "High resolution" refers to an image quality that allows images to be displayed clearly down to the fine details.

[0900] "Display means" is a function for displaying the transmitted digital art on the user's terminal.

[0901] "Sharing means" is a function for sharing the created digital art with other users and receiving feedback.

[0902] "Preprocessing" is the process of analyzing the received data and converting it into a format that can be properly processed by the generative model.

[0903] "Natural language processing" is a technology for analyzing text data and understanding and extracting meaning.

[0904] An "encrypted protocol" is a technique for encrypting transmitted data in order to communicate the data securely.

[0905] MODE FOR CARRYING OUT THE INVENTION

[0906] This invention is a system that automatically generates digital art based on creative ideas input by users, and allows users to display and share it with other users. This system allows users to input creative ideas through digital devices, and the server analyzes and generates the data, providing artistic digital works.

[0907] Hardware and software used

[0908] 1. Device: The device that a user uses to input ideas. This can include a computer, tablet, smartphone, etc.

[0909] 2. Server: A central processing unit that receives and analyzes user input data and generates digital art. This server has advanced hardware capabilities and is capable of running deep learning algorithms.

[0910] 3. Generative models: Algorithms for generating digital art, such as generative adversarial networks (GANs) and transformer models.

[0911] Program processing

[0912] User data entry

[0913] Users use the device to input their creative ideas, which can be done by typing ideas into a text field or uploading sketch images.

[0914] As a concrete example, consider the case where a user types "flying cat" into a text field, and this string is used in a later processing step.

[0915] Data transmission

[0916] The terminal transmits the data entered by the user to the server, and the transmission process is carried out using a secure communication protocol (e.g. HTTPS) to ensure the confidentiality of the data.

[0917] Data analysis

[0918] The server receives and analyzes the data sent. For text data, it uses natural language processing (NLP) algorithms (e.g., NLTK or spaCy) to tokenize and analyze grammar. For sketch images, it uses image preprocessing algorithms (e.g., OpenCV or TensorFlow) to extract the necessary components.

[0919] Digital Art Generation

[0920] The server inputs the preprocessed data into a generative model to generate digital art. Generative models such as generative adversarial networks (GANs) and transformer models are used. For example, based on the prompt "a cat flying in the sky," a GAN generates visual art of a flying cat.

[0921] Digital Art Submission

[0922] The server then sends the generated digital art to the device, where it is provided in a high-resolution image format (e.g., PNG or JPEG).

[0923] View and Share

[0924] The device displays the generated digital art to the user, who can then view and save it. Users can also share their artwork with other users within the platform and receive feedback.

[0925] Specific examples

[0926] For example, if a user inputs the idea "a panda exploring space," the following process occurs:

[0927] Idea input: The user types "Panda exploring space" into the text field.

[0928] Data transmission: The device sends this data to the server.

[0929] Data analysis: The server tokenizes the text data and performs grammatical analysis.

[0930] Digital Art Generation: The server uses GAN to generate visual art of a "panda exploring space."

[0931] Send digital art: sent to your device as a high-resolution image.

[0932] View and share: Users can view the art generated on their device and share it with others.

[0933] The system allows users to easily visualize their creative ideas as digital art and share it with others. Using generative AI models, the process fosters children's imaginations and provides a new outlet for self-expression.

[0934] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0935] Step 1: User Data Entry

[0936] How it works: A user uses a terminal to input a creative idea. For example, they might type "flying cat" into a text field. At this point, the data entered is the user's idea (prompt text and sketch image).

[0937] Input: User's creative idea (text and / or images).

[0938] Output: User input data (text or image).

[0939] Step 2: Send data

[0940] Operational details: The device sends the data entered by the user to the server using a secure communication protocol (e.g., HTTPS). The data is encrypted during the transmission process, reducing the risk of data leakage during transmission.

[0941] Input: User input data (text or image).

[0942] Output: Encrypted data to be transmitted.

[0943] Step 3: Data reception and analysis

[0944] How it works: The server receives the encrypted data and begins parsing it. If it's text data, it uses natural language processing (NLP) algorithms to tokenize and parse it, converting it into a format that the generative model can understand. If it's a sketch image, it uses image preprocessing algorithms to extract the necessary components.

[0945] Input: Encrypted data (text or image) sent from the device.

[0946] Output: Preprocessed text or image data.

[0947] Step 4: Generate digital art

[0948] How it works: The server inputs the preprocessed data into a generative model to generate digital art. Generative models such as generative adversarial networks (GANs) and transformer models are used. For example, based on the prompt "a cat flying in the sky," a highly accurate visual art of a flying cat is generated.

[0949] Input: Preprocessed data (text or images).

[0950] Output: Generated digital art (high resolution images).

[0951] Step 5: Submit your digital art

[0952] How it works: The server sends the generated digital art to the device. The art is provided in a high-resolution image format (e.g. PNG or JPEG). The server takes care to ensure that the data reaches the device completely and accurately.

[0953] Input: Generated digital art (high resolution image).

[0954] Output: High resolution image data sent to the device.

[0955] Step 6: View and share

[0956] Operational Details: The device displays the received digital art to the user. The user can save the displayed artwork and share it with other users. Through this sharing function, the user can receive feedback on the created art.

[0957] Input: High resolution image data sent from the server.

[0958] Output: Digital art displayed on the device and data shared on the platform.

[0959] (Application example 1)

[0960] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[0961] There is a demand for digital art generation systems that not only automatically generate creative ideas input by users, but also display the generated art in an actual physical exhibition space and allow interactive manipulation. Furthermore, to encourage children's creativity, it is necessary to provide an environment in which they can share the art they create with other users and receive feedback. The present invention aims to solve these problems.

[0962] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0963] In this invention, the server includes means for receiving creative ideas input by users, terminal means for transmitting the user's ideas to the server, means for analyzing the received idea data, generation model means for automatically generating digital art based on the analyzed data, means for transmitting the generated digital art to the terminal, means for displaying the transmitted digital art to the user, and means for displaying and enabling interactive manipulation of the generated digital art in a physical exhibition space, thereby enabling users to visualize their creative ideas in real time, share them with other users, and experience interacting with them in the real world.

[0964] "Creative ideas entered by the user" refers to content or concepts that the user has thought up and conceived himself, and includes forms such as sketches and text.

[0965] "Terminal means" refers to a device that allows a user to input ideas and send them to a server, and specifically includes a PC, tablet, smartphone, etc.

[0966] "Server" refers to a central processing unit that receives, analyzes, generates, and transmits data from users, and communicates with multiple terminals via the Internet.

[0967] "Means for analyzing" refers to software and algorithms that convert the received user idea data into an easy-to-understand format and perform processing to create input data suitable for the generative model.

[0968] "Generative modeling methods" refers to the use of algorithms and software, specifically generative adversarial networks (GANs) and transformer models, to automatically generate digital art based on analyzed data.

[0969] "Means of transmission" refers to the means of communication for transferring the generated digital art to the user's device, and refers to the use of a secure communication protocol (e.g., HTTPS).

[0970] "Displaying means" refers to an interface for visually displaying the generated digital art on the user's terminal, and includes a display or screen display function.

[0971] "Physical exhibition space" refers to a space where digital art generated in the real world can be displayed and interacted with, such as a museum or learning facility.

[0972] "Interactive" refers to a function that allows a user to directly touch and manipulate the generated art.

[0973] "Preprocessing" refers to the initial processing required to convert the sketch images and text data received from the user into a format suitable for the generative model, including image resizing and tokenization.

[0974] This invention relates to a system that generates digital art based on creative ideas input by users and allows them to display and manipulate it in a physical exhibition space in the real world. The specific configuration and processing steps of this system are described below.

[0975] System configuration

[0976] The system mainly consists of the following components:

[0977] 1. Terminal means: Includes devices such as PCs, tablets, and smartphones, and has the function of allowing users to input ideas and send them to the server.

[0978] 2. Server: A central processing unit that receives and analyzes data from users and generates digital art. Specifically, a high-performance cloud server is used.

[0979] 3. Generative modeling: Algorithms that automatically generate digital art using generative adversarial networks (GANs) and transformer models.

[0980] 4. Display means: Includes displays and interfaces for displaying the generated digital art on devices or in physical exhibition spaces.

[0981] 5. Interactive means: including touchscreens and sensor technology to allow users to directly manipulate the generated art in the physical exhibition space.

[0982] Program processing procedure

[0983] 1. User idea input:

[0984] Users use the device to input creative ideas in the form of sketches or text, which can be uploaded as an image file or entered into a text field.

[0985] 2. Data transmission:

[0986] The device sends the entered data to the server, and this communication is carried out using a secure protocol (e.g. HTTPS).

[0987] 3. Data Analysis:

[0988] The server analyzes the received data, performs image preprocessing on the sketch images, and natural language processing on the text data, converting the data into a format suitable for the generative modeling tool.

[0989] 4. Digital Art Generation:

[0990] The server generates digital art from the pre-processed data using pre-trained generative models, such as generative adversarial networks (GANs) and transformer models.

[0991] 5. View and interact:

[0992] The generated digital art is sent to the device and displayed to the user, while the physical exhibition space displays the generated art on large displays and touchscreens, allowing users to directly manipulate it.

[0993] Technology and software used

[0994] The specific hardware and software used in this system are:

[0995] Devices: PC, tablet, smartphone

[0996] Server: Cloud Server

[0997] Generative modeling tools: Generative Adversarial Networks (GANs), Transformer models

[0998] Display and interaction: displays, touchscreens, sensor technology

[0999] Specific examples

[1000] For example, if a user inputs the idea of ​​a "flying cat," the following specific processing is performed.

[1001] 1. Data Entry: A user draws a sketch of a "flying cat" on a tablet and then types "flying cat" into a text field.

[1002] 2. Data transmission: The sketch image and text data are sent from the device to the server.

[1003] 3. Data analysis: The server preprocesses the sketch images and analyzes the text data using natural language processing.

[1004] 4. Digital Art Generation: Using generative modeling techniques, the art of the "flying cat" is generated.

[1005] 5. Display and exhibition: The generated art is displayed on the terminal and then on a large display in the physical exhibition space.

[1006] Prompt Sentence Examples

[1007] Create a vivid and imaginative piece of digital art that captures the concept of a flying cat. The generated art should depict a cat gliding lightly through the air, with a blue sky and clouds in the background.

[1008] As described above, this system allows users to realize their creative ideas and allows them to view and manipulate them in a real environment, allowing users to visually express their ideas and share them with others.

[1009] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1010] Step 1:

[1011] A user uses the device to input creative ideas, which can be sketched images or text, and the input data is temporarily stored in the device's memory.

[1012] Input: User sketch image or text data

[1013] Action: Enter data using the input interface on the device

[1014] Output: Creative ideas stored in the device's memory

[1015] Step 2:

[1016] The data entered by the user is sent from the device to the server using a secure communication protocol (e.g. HTTPS).

[1017] Input: Creative ideas stored in your device's memory

[1018] Behavior: Uses the data transmission function to send user data from the device to the server.

[1019] Output: Sketch image or text data sent to the server

[1020] Step 3:

[1021] The server analyzes the received data, performing image preprocessing in the case of sketch images and natural language processing in the case of text data, converting the data into a format suitable for the generative modeling tool.

[1022] Input: Sketch image or text data sent to the server

[1023] What it does: Image preprocessing (image resizing, noise removal, etc.) and text tokenization and analysis.

[1024] Output: Preprocessed sketch image or text data

[1025] Step 4:

[1026] The server generates digital art based on the preprocessed data using generative AI models, such as generative adversarial networks (GANs) and transformer models.

[1027] Input: Preprocessed sketch images or text data

[1028] How it works: Applying generative AI models to generate creative digital art

[1029] Output: Generated digital art

[1030] Step 5:

[1031] The server transmits the generated digital art to the device using a secure communication protocol (e.g., HTTPS).

[1032] Input: Generated digital art

[1033] Operation: Uses the data transmission function to send the generated art from the server to the device.

[1034] Output: Digital art sent to your device

[1035] Step 6:

[1036] The device displays the received digital art to the user, and in addition, in the physical exhibition space, the generated art is displayed on a large display or touch screen, allowing the user to interact with it.

[1037] Input: Digital art sent to the device

[1038] Operation: Display digital art on the display and provide interactive operation to the user using the touch screen.

[1039] Output: Digital art that is visible to the user and can be interacted with.

[1040] The above are the specific processing steps of this program. This system allows users to instantly visualize their creative ideas, and then view and manipulate them in a real-world exhibition space.

[1041] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1042] This invention provides a more personalized experience by combining an emotion engine with a system that receives creative ideas input by users and automatically generates digital art. This system aims to provide an environment where children can visually express their creative ideas and receive emotional feedback to foster their creativity.

[1043] System Overview

[1044] The system includes the following elements:

[1045] 1. A way for users to input their ideas: An interface that allows users to upload sketches as image files or enter text into a text field.

[1046] 2. Terminal: A device through which a user inputs creative ideas. Examples include computers, tablets, and smartphones.

[1047] 3. Server: A central computer system that receives the data sent by users, analyzes it, processes it with a generative model, and performs sentiment analysis with an emotion engine.

[1048] 4. Generative model: A deep learning algorithm for generating digital art based on input data.

[1049] 5. Emotion engine: An algorithm that recognizes emotions by analyzing the content of text and sketches entered by the user, as well as the user's facial expressions.

[1050] 6. Display and exhibition means: An interface for displaying the generated digital art to the user and for sharing with other users.

[1051] Program processing

[1052] User data entry

[1053] Users can input their creative ideas into the device, for example, by uploading sketches as images or by entering text into the input field.

[1054] emotion recognition

[1055] The device acquires the user's facial expression data using a camera or other device along with the user's input data, and sends this data to the server. The emotion engine analyzes this facial expression data and the input text data to recognize the user's emotions.

[1056] Data transmission

[1057] The device sends the data entered by the user and facial expression data to the server using a secure communication protocol such as HTTPS.

[1058] Data analysis

[1059] The server receives the data and first performs sentiment analysis using an emotion engine, then analyzes the idea data. For sketch images, it performs preprocessing using an image processing library, and for text data, it performs analysis using a natural language processing library.

[1060] Digital Art Generation

[1061] The server then inputs the pre-processed idea data and sentiment analysis results into a generative model, which uses pre-trained deep learning algorithms (e.g., generative adversarial networks and transformer models) to generate digital art.

[1062] Digital Art Submission

[1063] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[1064] Display and Exhibition

[1065] The device displays the received high-resolution image files for the user to view, and the user can share the generated art with other users within the platform and receive feedback from them.

[1066] Specific examples

[1067] For example, when a user inputs the idea "a flying cat" and smiles at the time, the following specific processing is performed.

[1068] 1. Data Entry

[1069] The user types "flying cat" into the text field, and the device camera captures the user's smile.

[1070] 2. Emotion recognition

[1071] The terminal transmits the text data of "Flying Cat" and the image data of the user's smiling face to the server.

[1072] 3. Data Analysis

[1073] The server first analyzes the facial expression data using an emotion engine to determine whether the user is smiling. Next, it analyzes the text data, "Flying Cat."

[1074] 4. Digital Art Generation

[1075] The server inputs the emotional data of "smile" and the idea data of "flying cat" into the generative model, and generates visual art of a flying cat with a bright and cheerful atmosphere.

[1076] 5. Submitting Digital Art

[1077] The generated artwork is sent to the device as a high-resolution image.

[1078] 6. Display and Exhibition

[1079] The device displays the art to the user, who can then view it, while simultaneously sharing it with other users within the platform and receiving feedback.

[1080] In this way, the combination of emotion engines provides a more personalized art creation experience that responds to the user's emotions.

[1081] The processing flow will be explained below.

[1082] Step 1:

[1083] Users input their creative ideas into the device, for example, by uploading a sketch as an image file or by typing a text idea such as "flying cat" into the text field.

[1084] Step 2:

[1085] The device uses a camera to capture the user's facial expression data, such as a smile, along with the user's input data (sketch image and text data).

[1086] Step 3:

[1087] The device sends the acquired idea data (sketch image or text data) and facial expression data to a server using a secure communication protocol (e.g., HTTPS).

[1088] Step 4:

[1089] The server first analyzes the received data using an emotion engine. The emotion engine recognizes the emotion from the user's facial expression and stores the result. For example, it recognizes that the user is smiling.

[1090] Step 5:

[1091] The server then analyzes the idea data. For sketch images, it uses an image processing library for preprocessing, and for text data, it uses a natural language processing library for tokenization and grammar analysis.

[1092] Step 6:

[1093] The server inputs the preprocessed idea data and the emotion analysis results into a generative model, which then generates digital art based on a deep learning algorithm. For example, using the emotion data of a smile and the idea data of a "flying cat," the model generates brightly colored visual art of a flying cat.

[1094] Step 7:

[1095] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[1096] Step 8:

[1097] The terminal displays the received high-resolution image file to the user, who can then appreciate the generated digital art.

[1098] Step 9:

[1099] The device allows users to share their generated art with other users within the platform and receive feedback, who can view, comment on, and rate the art.

[1100] For example, if a user inputs the idea of ​​a "flying cat" and smiles at the device, the resulting art generated by this flow will be a bright, positive, and visual art of a flying cat. This art can then be shared with other users, who can provide feedback through comments and ratings.

[1101] In this way, the system combined with the emotion engine provides a more personalized digital art creation experience that responds to the user's emotions.

[1102] Example 2

[1103] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1104] Conventional digital art generation systems often generate artworks based solely on user-entered text or sketches, making it difficult to reflect the emotions and intentions of individual users. Furthermore, because the generated digital art is not based on the user's emotions, it is difficult to provide a personalized experience. Therefore, a means for users to receive more creative and emotional feedback is needed.

[1105] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving creative ideas input by a user, an emotion engine means for analyzing the user's emotions, and a generative model means for automatically generating digital art based on the analyzed data. This makes it possible to generate personalized digital art that reflects the user's emotions and intentions.

[1106] The "means for receiving creative ideas input by the user" is an interface that allows the user to upload sketches as image files or input text into a text field.

[1107] "Terminal means for transmitting user ideas to the server" refers to devices used by users, such as PCs, tablets, and smartphones, which include a transmission function.

[1108] The "means for analyzing received idea data" refers to an algorithm that analyzes data entered by a user using an image processing library, natural language processing library, or the like installed on the server.

[1109] The "emotion engine means for analyzing the user's emotions" is an algorithm that analyzes the contents of input text or sketches and the user's facial expressions to recognize the user's emotions.

[1110] The "generative model means for automatically generating digital art based on analyzed data" uses a deep learning algorithm to generate digital art based on preprocessed idea data and emotion analysis results.

[1111] "Means for transmitting the generated digital art to the terminal" refers to a communication protocol or mechanism for transmitting the high-resolution digital art image generated by the server to the terminal.

[1112] The "means for displaying the transmitted digital art to the user" refers to a display or interface that visually displays the digital art received by the terminal to the user.

[1113] This invention combines an emotion engine with a system that receives creative ideas input by users and automatically generates digital art based on those ideas to provide a more personalized experience. The aim is to foster creativity in children by allowing them to express their own creativity and receiving emotional feedback in the process.

[1114] System Components

[1115] 1. How users enter their ideas:

[1116] Users can upload their sketches as image files or use the interface to enter text into a text field on devices such as PCs, tablets, and smartphones.

[1117] 2. Terminal:

[1118] It refers to a device where users input their creative ideas and send them to a server. The device also uses a camera to capture the user's facial expression data and sends it to the server.

[1119] 3. Server:

[1120] This is a central computer system that receives and analyzes data sent by users. The server analyzes the data using natural language processing and image processing libraries. For example, OpenNLP and SpaCy are used for natural language processing, and OpenCV is used for image processing.

[1121] 4. Analysis method:

[1122] The emotion engine installed on the server performs emotion analysis and then preprocesses the idea data. The emotion engine includes algorithms that analyze the content of input text and sketches, as well as the user's facial expressions, to recognize the user's emotions.

[1123] 5. Digital Art Generation:

[1124] Deep learning algorithms, such as generative adversarial networks (GANs) and transformer models, are used to generate digital art based on preprocessed idea data and sentiment analysis results.

[1125] 6. Display and Exhibit:

[1126] An interface is provided for displaying the generated digital art to the user, and for sharing it with other users.

[1127] Specific examples

[1128] For example, a specific example is given in which a user inputs the idea "a flying cat" and smiles at the time.

[1129] The user enters "Cat flying in the sky" into the text field, and the device's camera captures the user's smile. The device sends this input data and facial expression data to the server. The server first analyzes the user's facial expression using an emotion engine and recognizes that it is a "smile." It then analyzes the text data "Cat flying in the sky."

[1130] Next, the server inputs the emotion data of "smile" and the idea data of "flying cat" into the generative model, generating visual art of a cheerful and fun-loving cat flying in the sky. The generated artwork is sent to the device as a high-resolution image, which the device displays to the user, who can then view it. The artwork can also be shared with other users and receive feedback.

[1131] Prompt Sentence Examples

[1132] Examples of specific prompts include the following:

[1133] "Enter the following text into the input field: Flying Cat"

[1134] or

[1135] "Upload your next sketch: Flying Cat"

[1136] This allows users to clearly understand the specific input content and provide the creative ideas that the system expects.

[1137] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1138] Step 1: User Data Entry

[1139] Users input their creative ideas into the device. They can type "flying cat" into the text field or upload a sketch as an image file. At the same time, the device's camera captures facial expression data, such as the user's smile. The input data is in text or image format, and the output is to store it in the device memory.

[1140] Specific behavior:

[1141] The user takes a photo of themselves smiling in front of the device's camera.

[1142] Users can type "flying cat" into a text field or upload a sketch as an image file.

[1143] The device stores text or image data in memory, while also storing facial expression data captured by the camera.

[1144] Step 2: Emotion recognition and data transmission

[1145] The device receives the idea data (text or image) and facial expression data entered by the user and sends them to the server using the HTTPS protocol.

[1146] Specific behavior:

[1147] The device sends the saved text data, sketch image data, and facial expression data to the server via HTTPS communication.

[1148] The input is text data, sketch image data, and facial expression data, and the output is data transmission to a server.

[1149] Step 3: Preprocessing input data

[1150] The server analyzes the received data. First, it uses an emotion engine to analyze the user's facial expression data and recognize their emotions. Next, it passes the text data to a natural language processing library (e.g., SpaCy) to analyze the idea, and then passes the sketch image data to an image processing library (e.g., OpenCV) for preprocessing.

[1151] Specific behavior:

[1152] The server inputs the facial expression data into an emotion engine and performs emotion analysis.

[1153] The text data is passed to a natural language processing library to analyze the idea content.

[1154] The image data is passed to an image processing library to perform any necessary preprocessing.

[1155] The inputs are facial expression data, text data, and sketch image data, and the outputs are emotion analysis results and preprocessed idea data.

[1156] Step 4: Generate digital art

[1157] The server inputs the pre-processed idea data and the sentiment analysis results into a generative model, which uses a pre-trained deep learning algorithm (e.g., GAN, Transformer model), to generate digital art.

[1158] Specific behavior:

[1159] The server inputs the emotion analysis results and text and image data into a generative model to generate digital art.

[1160] The server generates a high resolution image of the generated artwork.

[1161] The input is the sentiment analysis results and preprocessed idea data, and the output is the generated high-resolution digital art image.

[1162] Step 5: Submit your digital art

[1163] The server then sends a high-resolution image of the generated digital art to the device, again using the HTTPS protocol.

[1164] Specific behavior:

[1165] The server sends the generated high-resolution image file to the terminal via HTTPS communication.

[1166] The input is a high-resolution digital art image, and the output is data transmission to a terminal.

[1167] Step 6: Display and exhibit

[1168] The device displays the received high-resolution image to the user, who can then share this art with other users on the platform and receive feedback.

[1169] Specific behavior:

[1170] The terminal displays the received high-resolution image on its display.

[1171] Users can view the art images and press the share button to share them with other users.

[1172] The input is a received high-resolution digital art image, and the output is a display and sharing for the user. In this way, personalized digital art that reflects the user's emotions and intentions is generated.

[1173] (Application example 2)

[1174] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1175] In today's world, there is a demand for ways to bring out and nurture the creativity of users, especially children. However, conventional digital art generation systems have difficulty providing truly personalized experiences because they do not take into account the emotions of individual users. In particular, the lack of a means to generate content that reflects the user's emotions has led to a uniform, unindividualized user experience.

[1176] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving creative ideas input by a user, terminal means for transmitting the user's ideas to the server, means for analyzing the received idea data, generative model means for automatically generating digital art based on the analyzed data, emotion engine means for acquiring the user's facial expression data and performing emotion analysis, means for transmitting the generated digital art to the terminal, and means for displaying the transmitted digital art to the user. This makes it possible to generate digital art personalized according to the user's emotions.

[1177] "Means for receiving user-input creative ideas" means an interface through which users can input their thoughts and concepts, including a text field and the ability to upload sketch images.

[1178] "Terminal means for transmitting user ideas to the server" refers to hardware and software for transferring data entered by the user to the server, and includes devices such as personal computers and smartphones.

[1179] "Means for analyzing received idea data" refers to algorithms and libraries that the server uses to process and analyze data sent by users.

[1180] The "generative model means for automatically generating digital art based on analyzed data" is a system that uses a deep learning algorithm to create digital art from analyzed user idea data.

[1181] "Emotion engine means for acquiring facial expression data of a user and performing emotion analysis" refers to an algorithm or device for recognizing and analyzing emotions from the user's facial expression.

[1182] "Means for transmitting the generated digital art to the terminal" refers to a function for transferring the digital art generated on the server side to the user's terminal.

[1183] "Means for displaying submitted digital art to a user" refers to an interface that allows a user to view the generated digital art on their device.

[1184] The present invention is a personalized digital art generation system that combines an emotion engine based on a creative idea input by a user. The system includes the following means.

[1185] A way for users to input ideas

[1186] Users use devices such as smartphones, tablets, and PCs to input their creative ideas. The devices are provided with text fields and the ability to upload image files. Users can enter keywords and short ideas in the text fields, as well as upload sketch images.

[1187] Emotion Engine Means

[1188] The system is equipped with an emotion engine that acquires the user's facial expression data and analyzes their emotions. The facial expression data acquired through the camera is then used by an emotion analysis algorithm to recognize the user's emotions. This emotion data is then reflected in the subsequent digital art generation process.

[1189] Data analysis by server

[1190] The server receives idea data and facial expression data submitted by users. The received sketch images are preprocessed using an image processing library (e.g., OpenCV), and the text data is analyzed using a natural language processing library (e.g., Transformers). The data, along with the emotion analysis results from the emotion engine, are then input into the generative model.

[1191] Generative Model Means

[1192] Generative models use pre-trained deep learning algorithms (e.g., GPT-2 and Generative Adversarial Networks) to automatically generate personalized digital art based on analyzed user idea and emotion data.

[1193] Submitting and displaying digital art

[1194] The generated digital art is sent from the server to the user's device as a high-resolution image file, where it is displayed and the user can appreciate it. The user can also share the generated art with other users and receive feedback.

[1195] Specific examples

[1196] As a concrete example of a prompt, let's say the user inputs the idea of ​​a "flying cat" and smiles. The following digital art is generated:

[1197] 1. The user types "flying cat" into the text field, and the device camera simultaneously captures the user's smiling face.

[1198] 2. The server receives the text data of "Flying Cat" and the smiling facial expression data.

[1199] 3. The emotion engine recognizes the "smile" and the generative model generates visual art of a flying cat with a bright and joyful atmosphere that reflects the emotion of "flying cat" and "smile."

[1200] 4. The generated art is sent to the user's device as a high-resolution image, where the user can view it and share it with others.

[1201] In this way, a more personalized art creation experience is provided that responds to the user's emotions.

[1202] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1203] Step 1:

[1204] The user inputs creative ideas using the idea input method. The user inputs ideas in the text field and uploads sketch images. The input data (text and images) is saved on the device.

[1205] Step 2:

[1206] The user captures their own facial expression using the device camera, and the captured facial expression data is saved as an image file on the device.

[1207] Step 3:

[1208] The device sends the user's text data, sketch image data, and facial expression data to the server. This data is securely transmitted using the HTTPS protocol. The server receives the transmitted data.

[1209] Step 4:

[1210] The server analyzes the received data. First, it preprocesses the sketch image data using an image processing library, then analyzes the text data using a natural language processing library. For facial expression data, it performs emotion analysis using an emotion engine. The output of this step is the preprocessed sketch data and analyzed text and emotion data.

[1211] Step 5:

[1212] The server inputs the preprocessed sketch data, parsed text data, and emotion data into a generative model, which uses deep learning algorithms to automatically generate digital art based on the input data. The output of this step is the generated digital art.

[1213] Step 6:

[1214] The server sends the generated digital art as a high-resolution image file to the user's device, also using a secure communication protocol. The device receives the image file.

[1215] Step 7:

[1216] The device displays the received digital art. The user can view the displayed art, share it with other users in the virtual store, and receive feedback. The output of this step is the displayed digital art.

[1217] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1218] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1219] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1220] [Fourth embodiment]

[1221] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1222] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1223] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1224] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1225] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1226] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1227] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1228] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1229] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1230] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1231] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1232] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1233] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1234] This invention relates to a digital art creation system that allows children to visually express their creative ideas. This system provides the functionality to automatically create, display, and exhibit digital art based on creative ideas input by users.

[1235] System Overview

[1236] The system mainly consists of the following elements:

[1237] 1. A way for users to input their ideas: This could include, for example, an image upload feature that allows users to upload sketches, or a text field that allows users to type their ideas.

[1238] 2. Terminal: The device on which the user inputs ideas, such as a PC, tablet, or smartphone.

[1239] 3. Server: A computer system that receives and analyzes users' idea data (sketch images and text data) and generates digital art using a generative model.

[1240] 4. Generative models: Algorithms that take analyzed data as input and generate digital art, such as generative adversarial networks (GANs) or transformer models.

[1241] 5. Display and exhibition means: The ability to display the generated digital art on a device so that the user can view it, and also to exhibit it for sharing with other users.

[1242] Program processing

[1243] User data entry

[1244] Users input their creative ideas into the device, either by uploading sketches as images or by entering text into a text input field.

[1245] Data transmission

[1246] The terminal transmits the data entered by the user to the server using a secure communication protocol (e.g., HTTPS).

[1247] Data analysis

[1248] The server receives and analyzes the data, performing preprocessing in the case of sketch images and natural language processing in the case of text data, converting the data into a format suitable for the generative model.

[1249] Digital Art Generation

[1250] The server then inputs the pre-processed data into a generative model, which uses a pre-trained deep learning algorithm, to generate the digital art.

[1251] Digital Art Submission

[1252] The server then transmits the generated digital art to the device, where it is presented in a high-resolution image format.

[1253] Display and Exhibition

[1254] The device displays the received digital art to the user, who can then view it. The user can also exhibit the generated art within the platform and receive feedback from other users.

[1255] Specific examples

[1256] For example, if a user inputs the idea of ​​a "flying cat," the following specific processing is performed.

[1257] 1. Data Entry

[1258] The user types "flying cat" into the text field.

[1259] 2. Data Transmission

[1260] The terminal transmits this text data to the server.

[1261] 3. Data Analysis

[1262] The server tokenizes and grammatically analyzes the received text data and converts it into a format suitable for the generative model.

[1263] 4. Digital Art Generation

[1264] Based on the information about the "flying cat," the server uses a generative model to generate visual art of a flying cat.

[1265] 5. Submitting Digital Art

[1266] The generated artwork is sent to the device as a high-resolution image.

[1267] 6. Display and Exhibition

[1268] The device displays the received art to the user, who can then view it and share it with other users within the platform to receive feedback.

[1269] In this way, a system is provided that allows users to easily visually express and share their creative ideas with others, thereby fostering children's artistic talent and self-esteem.

[1270] The processing flow will be explained below.

[1271] Step 1:

[1272] Users input their creative ideas into the device, either by uploading sketches as image files or by entering text ideas into a text field.

[1273] Step 2:

[1274] The device sends the idea data (sketch image and text data) entered by the user to the server using a secure communication protocol such as HTTPS.

[1275] Step 3:

[1276] The server first analyzes the received idea data. If it is a sketch image, it uses an image processing library for preprocessing, and if it is text data, it uses a natural language processing library for analysis.

[1277] Step 4:

[1278] The server inputs the pre-processed data into a generative model, which uses pre-trained deep learning algorithms (e.g., generative adversarial networks or transformer models) to generate digital art.

[1279] Step 5:

[1280] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[1281] Step 6:

[1282] The device displays the received high-resolution image files for the user to view, and the user can share the generated art with other users within the platform.

[1283] Step 7:

[1284] Users can receive feedback from other users within the platform, which can help improve self-esteem and creativity.

[1285] In this way, the "Future Artist" AI Art Studio provides a series of processes that allow users to easily visually express their creative ideas and share them with others.

[1286] Example 1

[1287] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1288] In the modern educational environment and the field of digital art, there is a lack of effective means for children to easily visually express their creative ideas and share them with others. In particular, there is a need for a system that provides a user-friendly interface and allows them to safely and quickly generate digital art. There is also a lack of an easy-to-use platform for sharing the generated artwork with others and receiving feedback.

[1289] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1290] In this invention, the server includes: means for receiving creative ideas input by a user; terminal means for transmitting the user's ideas to the server; means for transmitting the received idea data to the server using a secure communication protocol; means for analyzing and preprocessing the received idea data; generative model means for automatically generating digital art based on the preprocessed data; means for transmitting the generated digital art to the terminal in high resolution; and means for displaying the transmitted digital art to the user and sharing it with other users. This allows users to easily visualize their creative ideas as digital art and share it securely. Furthermore, it makes it easy to share the generated artwork with other users and receive feedback. This system contributes to fostering children's artistic talent and self-esteem.

[1291] A "creative idea" is an original idea or artistic concept that a user has in mind.

[1292] A "terminal" is a computing device that a user uses to input and send ideas to a server.

[1293] A "server" is a central processing unit that receives and analyzes data sent by users and generates digital art.

[1294] The "data transmission means" is a function for safely transmitting the user's idea data from the terminal to the server.

[1295] The "analysis means" is a method for preprocessing the received idea data and converting it into a format that can be understood by the generative model.

[1296] A "generative model" is an algorithm for automatically generating digital art based on preprocessed data.

[1297] "Digital art" is a visual work of art that is automatically generated by a generative model.

[1298] "High resolution" refers to an image quality that allows images to be displayed clearly down to the fine details.

[1299] "Display means" is a function for displaying the transmitted digital art on the user's terminal.

[1300] "Sharing means" is a function for sharing the created digital art with other users and receiving feedback.

[1301] "Preprocessing" is the process of analyzing the received data and converting it into a format that can be properly processed by the generative model.

[1302] "Natural language processing" is a technology for analyzing text data and understanding and extracting meaning.

[1303] An "encrypted protocol" is a technique for encrypting transmitted data in order to communicate the data securely.

[1304] MODE FOR CARRYING OUT THE INVENTION

[1305] This invention is a system that automatically generates digital art based on creative ideas input by users, and allows users to display and share it with other users. This system allows users to input creative ideas through digital devices, and the server analyzes and generates the data, providing artistic digital works.

[1306] Hardware and software used

[1307] 1. Device: The device that a user uses to input ideas. This can include a computer, tablet, smartphone, etc.

[1308] 2. Server: A central processing unit that receives and analyzes user input data and generates digital art. This server has advanced hardware capabilities and is capable of running deep learning algorithms.

[1309] 3. Generative models: Algorithms for generating digital art, such as generative adversarial networks (GANs) and transformer models.

[1310] Program processing

[1311] User data entry

[1312] Users use the device to input their creative ideas, which can be done by typing ideas into a text field or uploading sketch images.

[1313] As a concrete example, consider the case where a user types "flying cat" into a text field, and this string is used in a later processing step.

[1314] Data transmission

[1315] The terminal transmits the data entered by the user to the server, and the transmission process is carried out using a secure communication protocol (e.g. HTTPS) to ensure the confidentiality of the data.

[1316] Data analysis

[1317] The server receives and analyzes the data sent. For text data, it uses natural language processing (NLP) algorithms (e.g., NLTK or spaCy) to tokenize and analyze grammar. For sketch images, it uses image preprocessing algorithms (e.g., OpenCV or TensorFlow) to extract the necessary components.

[1318] Digital Art Generation

[1319] The server inputs the preprocessed data into a generative model to generate digital art. Generative models such as generative adversarial networks (GANs) and transformer models are used. For example, based on the prompt "a cat flying in the sky," a GAN generates visual art of a flying cat.

[1320] Digital Art Submission

[1321] The server then sends the generated digital art to the device, where it is provided in a high-resolution image format (e.g., PNG or JPEG).

[1322] View and Share

[1323] The device displays the generated digital art to the user, who can then view and save it. Users can also share their artwork with other users within the platform and receive feedback.

[1324] Specific examples

[1325] For example, if a user inputs the idea "a panda exploring space," the following process occurs:

[1326] Idea input: The user types "Panda exploring space" into the text field.

[1327] Data transmission: The device sends this data to the server.

[1328] Data analysis: The server tokenizes the text data and performs grammatical analysis.

[1329] Digital Art Generation: The server uses GAN to generate visual art of a "panda exploring space."

[1330] Send digital art: sent to your device as a high-resolution image.

[1331] View and share: Users can view the art generated on their device and share it with others.

[1332] The system allows users to easily visualize their creative ideas as digital art and share it with others. Using generative AI models, the process fosters children's imaginations and provides a new outlet for self-expression.

[1333] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1334] Step 1: User Data Entry

[1335] How it works: A user uses a terminal to input a creative idea. For example, they might type "flying cat" into a text field. At this point, the data entered is the user's idea (prompt text and sketch image).

[1336] Input: User's creative idea (text and / or images).

[1337] Output: User input data (text or image).

[1338] Step 2: Send data

[1339] Operational details: The device sends the data entered by the user to the server using a secure communication protocol (e.g., HTTPS). The data is encrypted during the transmission process, reducing the risk of data leakage during transmission.

[1340] Input: User input data (text or image).

[1341] Output: Encrypted data to be transmitted.

[1342] Step 3: Data reception and analysis

[1343] How it works: The server receives the encrypted data and begins parsing it. If it's text data, it uses natural language processing (NLP) algorithms to tokenize and parse it, converting it into a format that the generative model can understand. If it's a sketch image, it uses image preprocessing algorithms to extract the necessary components.

[1344] Input: Encrypted data (text or image) sent from the device.

[1345] Output: Preprocessed text or image data.

[1346] Step 4: Generate digital art

[1347] How it works: The server inputs the preprocessed data into a generative model to generate digital art. Generative models such as generative adversarial networks (GANs) and transformer models are used. For example, based on the prompt "a cat flying in the sky," a highly accurate visual art of a flying cat is generated.

[1348] Input: Preprocessed data (text or images).

[1349] Output: Generated digital art (high resolution images).

[1350] Step 5: Submit your digital art

[1351] How it works: The server sends the generated digital art to the device. The art is provided in a high-resolution image format (e.g. PNG or JPEG). The server takes care to ensure that the data reaches the device completely and accurately.

[1352] Input: Generated digital art (high resolution image).

[1353] Output: High resolution image data sent to the device.

[1354] Step 6: View and share

[1355] Operational Details: The device displays the received digital art to the user. The user can save the displayed artwork and share it with other users. Through this sharing function, the user can receive feedback on the created art.

[1356] Input: High resolution image data sent from the server.

[1357] Output: Digital art displayed on the device and data shared on the platform.

[1358] (Application example 1)

[1359] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1360] There is a demand for digital art generation systems that not only automatically generate creative ideas input by users, but also display the generated art in an actual physical exhibition space and allow interactive manipulation. Furthermore, to encourage children's creativity, it is necessary to provide an environment in which they can share the art they create with other users and receive feedback. The present invention aims to solve these problems.

[1361] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1362] In this invention, the server includes means for receiving creative ideas input by users, terminal means for transmitting the user's ideas to the server, means for analyzing the received idea data, generation model means for automatically generating digital art based on the analyzed data, means for transmitting the generated digital art to the terminal, means for displaying the transmitted digital art to the user, and means for displaying and enabling interactive manipulation of the generated digital art in a physical exhibition space, thereby enabling users to visualize their creative ideas in real time, share them with other users, and experience interacting with them in the real world.

[1363] "Creative ideas entered by the user" refers to content or concepts that the user has thought up and conceived himself, and includes forms such as sketches and text.

[1364] "Terminal means" refers to a device that allows a user to input ideas and send them to a server, and specifically includes a PC, tablet, smartphone, etc.

[1365] "Server" refers to a central processing unit that receives, analyzes, generates, and transmits data from users, and communicates with multiple terminals via the Internet.

[1366] "Means for analyzing" refers to software and algorithms that convert the received user idea data into an easy-to-understand format and perform processing to create input data suitable for the generative model.

[1367] "Generative modeling methods" refers to the use of algorithms and software, specifically generative adversarial networks (GANs) and transformer models, to automatically generate digital art based on analyzed data.

[1368] "Means of transmission" refers to the means of communication for transferring the generated digital art to the user's device, and refers to the use of a secure communication protocol (e.g., HTTPS).

[1369] "Displaying means" refers to an interface for visually displaying the generated digital art on the user's terminal, and includes a display or screen display function.

[1370] "Physical exhibition space" refers to a space where digital art generated in the real world can be displayed and interacted with, such as a museum or learning facility.

[1371] "Interactive" refers to a function that allows a user to directly touch and manipulate the generated art.

[1372] "Preprocessing" refers to the initial processing required to convert the sketch images and text data received from the user into a format suitable for the generative model, including image resizing and tokenization.

[1373] This invention relates to a system that generates digital art based on creative ideas input by users and allows them to display and manipulate it in a physical exhibition space in the real world. The specific configuration and processing steps of this system are described below.

[1374] System configuration

[1375] The system mainly consists of the following components:

[1376] 1. Terminal means: Includes devices such as PCs, tablets, and smartphones, and has the function of allowing users to input ideas and send them to the server.

[1377] 2. Server: A central processing unit that receives and analyzes data from users and generates digital art. Specifically, a high-performance cloud server is used.

[1378] 3. Generative modeling: Algorithms that automatically generate digital art using generative adversarial networks (GANs) and transformer models.

[1379] 4. Display means: Includes displays and interfaces for displaying the generated digital art on devices or in physical exhibition spaces.

[1380] 5. Interactive means: including touchscreens and sensor technology to allow users to directly manipulate the generated art in the physical exhibition space.

[1381] Program processing procedure

[1382] 1. User idea input:

[1383] Users use the device to input creative ideas in the form of sketches or text, which can be uploaded as an image file or entered into a text field.

[1384] 2. Data transmission:

[1385] The device sends the entered data to the server, and this communication is carried out using a secure protocol (e.g. HTTPS).

[1386] 3. Data Analysis:

[1387] The server analyzes the received data, performs image preprocessing on the sketch images, and natural language processing on the text data, converting the data into a format suitable for the generative modeling tool.

[1388] 4. Digital Art Generation:

[1389] The server generates digital art from the pre-processed data using pre-trained generative models, such as generative adversarial networks (GANs) and transformer models.

[1390] 5. View and interact:

[1391] The generated digital art is sent to the device and displayed to the user, while the physical exhibition space displays the generated art on large displays and touchscreens, allowing users to directly manipulate it.

[1392] Technology and software used

[1393] The specific hardware and software used in this system are:

[1394] Devices: PC, tablet, smartphone

[1395] Server: Cloud Server

[1396] Generative modeling tools: Generative Adversarial Networks (GANs), Transformer models

[1397] Display and interaction: displays, touchscreens, sensor technology

[1398] Specific examples

[1399] For example, if a user inputs the idea of ​​a "flying cat," the following specific processing is performed.

[1400] 1. Data Entry: A user draws a sketch of a "flying cat" on a tablet and then types "flying cat" into a text field.

[1401] 2. Data transmission: The sketch image and text data are sent from the device to the server.

[1402] 3. Data analysis: The server preprocesses the sketch images and analyzes the text data using natural language processing.

[1403] 4. Digital Art Generation: Using generative modeling techniques, the art of the "flying cat" is generated.

[1404] 5. Display and exhibition: The generated art is displayed on the terminal and then on a large display in the physical exhibition space.

[1405] Prompt Sentence Examples

[1406] Create a vivid and imaginative piece of digital art that captures the concept of a flying cat. The generated art should depict a cat gliding lightly through the air, with a blue sky and clouds in the background.

[1407] As described above, this system allows users to realize their creative ideas and allows them to view and manipulate them in a real environment, allowing users to visually express their ideas and share them with others.

[1408] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1409] Step 1:

[1410] A user uses the device to input creative ideas, which can be sketched images or text, and the input data is temporarily stored in the device's memory.

[1411] Input: User sketch image or text data

[1412] Action: Enter data using the input interface on the device

[1413] Output: Creative ideas stored in the device's memory

[1414] Step 2:

[1415] The data entered by the user is sent from the device to the server using a secure communication protocol (e.g. HTTPS).

[1416] Input: Creative ideas stored in your device's memory

[1417] Behavior: Uses the data transmission function to send user data from the device to the server.

[1418] Output: Sketch image or text data sent to the server

[1419] Step 3:

[1420] The server analyzes the received data, performing image preprocessing in the case of sketch images and natural language processing in the case of text data, converting the data into a format suitable for the generative modeling tool.

[1421] Input: Sketch image or text data sent to the server

[1422] What it does: Image preprocessing (image resizing, noise removal, etc.) and text tokenization and analysis.

[1423] Output: Preprocessed sketch image or text data

[1424] Step 4:

[1425] The server generates digital art based on the preprocessed data using generative AI models, such as generative adversarial networks (GANs) and transformer models.

[1426] Input: Preprocessed sketch images or text data

[1427] How it works: Applying generative AI models to generate creative digital art

[1428] Output: Generated digital art

[1429] Step 5:

[1430] The server transmits the generated digital art to the device using a secure communication protocol (e.g., HTTPS).

[1431] Input: Generated digital art

[1432] Operation: Uses the data transmission function to send the generated art from the server to the device.

[1433] Output: Digital art sent to your device

[1434] Step 6:

[1435] The device displays the received digital art to the user, and in addition, in the physical exhibition space, the generated art is displayed on a large display or touch screen, allowing the user to interact with it.

[1436] Input: Digital art sent to the device

[1437] Operation: Display digital art on the display and provide interactive operation to the user using the touch screen.

[1438] Output: Digital art that is visible to the user and can be interacted with.

[1439] The above are the specific processing steps of this program. This system allows users to instantly visualize their creative ideas, and then view and manipulate them in a real-world exhibition space.

[1440] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1441] This invention provides a more personalized experience by combining an emotion engine with a system that receives creative ideas input by users and automatically generates digital art. This system aims to provide an environment where children can visually express their creative ideas and receive emotional feedback to foster their creativity.

[1442] System Overview

[1443] The system includes the following elements:

[1444] 1. A way for users to input their ideas: An interface that allows users to upload sketches as image files or enter text into a text field.

[1445] 2. Terminal: A device through which a user inputs creative ideas. Examples include computers, tablets, and smartphones.

[1446] 3. Server: A central computer system that receives the data sent by users, analyzes it, processes it with a generative model, and performs sentiment analysis with an emotion engine.

[1447] 4. Generative model: A deep learning algorithm for generating digital art based on input data.

[1448] 5. Emotion engine: An algorithm that recognizes emotions by analyzing the content of text and sketches entered by the user, as well as the user's facial expressions.

[1449] 6. Display and exhibition means: An interface for displaying the generated digital art to the user and for sharing with other users.

[1450] Program processing

[1451] User data entry

[1452] Users can input their creative ideas into the device, for example, by uploading sketches as images or by entering text into the input field.

[1453] emotion recognition

[1454] The device acquires the user's facial expression data using a camera or other device along with the user's input data, and sends this data to the server. The emotion engine analyzes this facial expression data and the input text data to recognize the user's emotions.

[1455] Data transmission

[1456] The device sends the data entered by the user and facial expression data to the server using a secure communication protocol such as HTTPS.

[1457] Data analysis

[1458] The server receives the data and first performs sentiment analysis using an emotion engine, then analyzes the idea data. For sketch images, it performs preprocessing using an image processing library, and for text data, it performs analysis using a natural language processing library.

[1459] Digital Art Generation

[1460] The server then inputs the pre-processed idea data and sentiment analysis results into a generative model, which uses pre-trained deep learning algorithms (e.g., generative adversarial networks and transformer models) to generate digital art.

[1461] Digital Art Submission

[1462] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[1463] Display and Exhibition

[1464] The device displays the received high-resolution image files for the user to view, and the user can share the generated art with other users within the platform and receive feedback from them.

[1465] Specific examples

[1466] For example, when a user inputs the idea "a flying cat" and smiles at the time, the following specific processing is performed.

[1467] 1. Data Entry

[1468] The user types "flying cat" into the text field, and the device camera captures the user's smile.

[1469] 2. Emotion recognition

[1470] The terminal transmits the text data of "Flying Cat" and the image data of the user's smiling face to the server.

[1471] 3. Data Analysis

[1472] The server first analyzes the facial expression data using an emotion engine to determine whether the user is smiling. Next, it analyzes the text data, "Flying Cat."

[1473] 4. Digital Art Generation

[1474] The server inputs the emotional data of "smile" and the idea data of "flying cat" into the generative model, and generates visual art of a flying cat with a bright and cheerful atmosphere.

[1475] 5. Submitting Digital Art

[1476] The generated artwork is sent to the device as a high-resolution image.

[1477] 6. Display and Exhibition

[1478] The device displays the art to the user, who can then view it, while simultaneously sharing it with other users within the platform and receiving feedback.

[1479] In this way, the combination of emotion engines provides a more personalized art creation experience that responds to the user's emotions.

[1480] The processing flow will be explained below.

[1481] Step 1:

[1482] Users input their creative ideas into the device, for example, by uploading a sketch as an image file or by typing a text idea such as "flying cat" into the text field.

[1483] Step 2:

[1484] The device uses a camera to capture the user's facial expression data, such as a smile, along with the user's input data (sketch image and text data).

[1485] Step 3:

[1486] The device sends the acquired idea data (sketch image or text data) and facial expression data to a server using a secure communication protocol (e.g., HTTPS).

[1487] Step 4:

[1488] The server first analyzes the received data using an emotion engine. The emotion engine recognizes the emotion from the user's facial expression and stores the result. For example, it recognizes that the user is smiling.

[1489] Step 5:

[1490] The server then analyzes the idea data. For sketch images, it uses an image processing library for preprocessing, and for text data, it uses a natural language processing library for tokenization and grammar analysis.

[1491] Step 6:

[1492] The server inputs the preprocessed idea data and the emotion analysis results into a generative model, which then generates digital art based on a deep learning algorithm. For example, using the emotion data of a smile and the idea data of a "flying cat," the model generates brightly colored visual art of a flying cat.

[1493] Step 7:

[1494] The server generates the digital art in a high-resolution image file format and sends the data to the device. An image processing library is used to generate the image.

[1495] Step 8:

[1496] The terminal displays the received high-resolution image file to the user, who can then appreciate the generated digital art.

[1497] Step 9:

[1498] The device allows users to share their generated art with other users within the platform and receive feedback, who can view, comment on, and rate the art.

[1499] For example, if a user inputs the idea of ​​a "flying cat" and smiles at the device, the resulting art generated by this flow will be a bright, positive, and visual art of a flying cat. This art can then be shared with other users, who can provide feedback through comments and ratings.

[1500] In this way, the system combined with the emotion engine provides a more personalized digital art creation experience that responds to the user's emotions.

[1501] Example 2

[1502] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1503] Conventional digital art generation systems often generate artworks based solely on user-entered text or sketches, making it difficult to reflect the emotions and intentions of individual users. Furthermore, because the generated digital art is not based on the user's emotions, it is difficult to provide a personalized experience. Therefore, a means for users to receive more creative and emotional feedback is needed.

[1504] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means. In this invention, the server includes a means for receiving creative ideas input by a user, an emotion engine means for analyzing the user's emotions, and a generative model means for automatically generating digital art based on the analyzed data. This makes it possible to generate personalized digital art that reflects the user's emotions and intentions.

[1505] The "means for receiving creative ideas input by the user" is an interface that allows the user to upload sketches as image files or input text into a text field.

[1506] "Terminal means for transmitting user ideas to the server" refers to devices used by users, such as PCs, tablets, and smartphones, which include a transmission function.

[1507] The "means for analyzing received idea data" refers to an algorithm that analyzes data entered by a user using an image processing library, natural language processing library, or the like installed on the server.

[1508] The "emotion engine means for analyzing the user's emotions" is an algorithm that analyzes the contents of input text or sketches and the user's facial expressions to recognize the user's emotions.

[1509] The "generative model means for automatically generating digital art based on analyzed data" uses a deep learning algorithm to generate digital art based on preprocessed idea data and emotion analysis results.

[1510] "Means for transmitting the generated digital art to the terminal" refers to a communication protocol or mechanism for transmitting the high-resolution digital art image generated by the server to the terminal.

[1511] The "means for displaying the transmitted digital art to the user" refers to a display or interface that visually displays the digital art received by the terminal to the user.

[1512] This invention combines an emotion engine with a system that receives creative ideas input by users and automatically generates digital art based on those ideas to provide a more personalized experience. The aim is to foster creativity in children by allowing them to express their own creativity and receiving emotional feedback in the process.

[1513] System Components

[1514] 1. How users enter their ideas:

[1515] Users can upload their sketches as image files or use the interface to enter text into a text field on devices such as PCs, tablets, and smartphones.

[1516] 2. Terminal:

[1517] It refers to a device where users input their creative ideas and send them to a server. The device also uses a camera to capture the user's facial expression data and sends it to the server.

[1518] 3. Server:

[1519] This is a central computer system that receives and analyzes data sent by users. The server analyzes the data using natural language processing and image processing libraries. For example, OpenNLP and SpaCy are used for natural language processing, and OpenCV is used for image processing.

[1520] 4. Analysis method:

[1521] The emotion engine installed on the server performs emotion analysis and then preprocesses the idea data. The emotion engine includes algorithms that analyze the content of input text and sketches, as well as the user's facial expressions, to recognize the user's emotions.

[1522] 5. Digital Art Generation:

[1523] Deep learning algorithms, such as generative adversarial networks (GANs) and transformer models, are used to generate digital art based on preprocessed idea data and sentiment analysis results.

[1524] 6. Display and Exhibit:

[1525] An interface is provided for displaying the generated digital art to the user, and for sharing it with other users.

[1526] Specific examples

[1527] For example, a specific example is given in which a user inputs the idea "a flying cat" and smiles at the time.

[1528] The user enters "Cat flying in the sky" into the text field, and the device's camera captures the user's smile. The device sends this input data and facial expression data to the server. The server first analyzes the user's facial expression using an emotion engine and recognizes that it is a "smile." It then analyzes the text data "Cat flying in the sky."

[1529] Next, the server inputs the emotion data of "smile" and the idea data of "flying cat" into the generative model, generating visual art of a cheerful and fun-loving cat flying in the sky. The generated artwork is sent to the device as a high-resolution image, which the device displays to the user, who can then view it. The artwork can also be shared with other users and receive feedback.

[1530] Prompt Sentence Examples

[1531] Examples of specific prompts include the following:

[1532] "Enter the following text into the input field: Flying Cat"

[1533] or

[1534] "Upload your next sketch: Flying Cat"

[1535] This allows users to clearly understand the specific input content and provide the creative ideas that the system expects.

[1536] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1537] Step 1: User Data Entry

[1538] Users input their creative ideas into the device. They can type "flying cat" into the text field or upload a sketch as an image file. At the same time, the device's camera captures facial expression data, such as the user's smile. The input data is in text or image format, and the output is to store it in the device memory.

[1539] Specific behavior:

[1540] The user takes a photo of themselves smiling in front of the device's camera.

[1541] Users can type "flying cat" into a text field or upload a sketch as an image file.

[1542] The device stores text or image data in memory, while also storing facial expression data captured by the camera.

[1543] Step 2: Emotion recognition and data transmission

[1544] The device receives the idea data (text or image) and facial expression data entered by the user and sends them to the server using the HTTPS protocol.

[1545] Specific behavior:

[1546] The device sends the saved text data, sketch image data, and facial expression data to the server via HTTPS communication.

[1547] The input is text data, sketch image data, and facial expression data, and the output is data transmission to a server.

[1548] Step 3: Preprocessing input data

[1549] The server analyzes the received data. First, it uses an emotion engine to analyze the user's facial expression data and recognize their emotions. Next, it passes the text data to a natural language processing library (e.g., SpaCy) to analyze the idea, and then passes the sketch image data to an image processing library (e.g., OpenCV) for preprocessing.

[1550] Specific behavior:

[1551] The server inputs the facial expression data into an emotion engine and performs emotion analysis.

[1552] The text data is passed to a natural language processing library to analyze the idea content.

[1553] The image data is passed to an image processing library to perform any necessary preprocessing.

[1554] The inputs are facial expression data, text data, and sketch image data, and the outputs are emotion analysis results and preprocessed idea data.

[1555] Step 4: Generate digital art

[1556] The server inputs the pre-processed idea data and the sentiment analysis results into a generative model, which uses a pre-trained deep learning algorithm (e.g., GAN, Transformer model), to generate digital art.

[1557] Specific behavior:

[1558] The server inputs the emotion analysis results and text and image data into a generative model to generate digital art.

[1559] The server generates a high resolution image of the generated artwork.

[1560] The input is the sentiment analysis results and preprocessed idea data, and the output is the generated high-resolution digital art image.

[1561] Step 5: Submit your digital art

[1562] The server then sends a high-resolution image of the generated digital art to the device, again using the HTTPS protocol.

[1563] Specific behavior:

[1564] The server sends the generated high-resolution image file to the terminal via HTTPS communication.

[1565] The input is a high-resolution digital art image, and the output is data transmission to a terminal.

[1566] Step 6: Display and exhibit

[1567] The device displays the received high-resolution image to the user, who can then share this art with other users on the platform and receive feedback.

[1568] Specific behavior:

[1569] The terminal displays the received high-resolution image on its display.

[1570] Users can view the art images and press the share button to share them with other users.

[1571] The input is a received high-resolution digital art image, and the output is a display and sharing for the user. In this way, personalized digital art that reflects the user's emotions and intentions is generated.

[1572] (Application example 2)

[1573] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1574] In today's world, there is a demand for ways to bring out and nurture the creativity of users, especially children. However, conventional digital art generation systems have difficulty providing truly personalized experiences because they do not take into account the emotions of individual users. In particular, the lack of a means to generate content that reflects the user's emotions has led to a uniform, unindividualized user experience.

[1575] The specific processing by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for receiving creative ideas input by a user, terminal means for transmitting the user's ideas to the server, means for analyzing the received idea data, generative model means for automatically generating digital art based on the analyzed data, emotion engine means for acquiring the user's facial expression data and performing emotion analysis, means for transmitting the generated digital art to the terminal, and means for displaying the transmitted digital art to the user. This makes it possible to generate digital art personalized according to the user's emotions.

[1576] "Means for receiving user-input creative ideas" means an interface through which users can input their thoughts and concepts, including a text field and the ability to upload sketch images.

[1577] "Terminal means for transmitting user ideas to the server" refers to hardware and software for transferring data entered by the user to the server, and includes devices such as personal computers and smartphones.

[1578] "Means for analyzing received idea data" refers to algorithms and libraries that the server uses to process and analyze data sent by users.

[1579] The "generative model means for automatically generating digital art based on analyzed data" is a system that uses a deep learning algorithm to create digital art from analyzed user idea data.

[1580] "Emotion engine means for acquiring facial expression data of a user and performing emotion analysis" refers to an algorithm or device for recognizing and analyzing emotions from the user's facial expression.

[1581] "Means for transmitting the generated digital art to the terminal" refers to a function for transferring the digital art generated on the server side to the user's terminal.

[1582] "Means for displaying submitted digital art to a user" refers to an interface that allows a user to view the generated digital art on their device.

[1583] The present invention is a personalized digital art generation system that combines an emotion engine based on a creative idea input by a user. The system includes the following means.

[1584] A way for users to input ideas

[1585] Users use devices such as smartphones, tablets, and PCs to input their creative ideas. The devices are provided with text fields and the ability to upload image files. Users can enter keywords and short ideas in the text fields, as well as upload sketch images.

[1586] Emotion Engine Means

[1587] The system is equipped with an emotion engine that acquires the user's facial expression data and analyzes their emotions. The facial expression data acquired through the camera is then used by an emotion analysis algorithm to recognize the user's emotions. This emotion data is then reflected in the subsequent digital art generation process.

[1588] Data analysis by server

[1589] The server receives idea data and facial expression data submitted by users. The received sketch images are preprocessed using an image processing library (e.g., OpenCV), and the text data is analyzed using a natural language processing library (e.g., Transformers). The data, along with the emotion analysis results from the emotion engine, are then input into the generative model.

[1590] Generative Model Means

[1591] Generative models use pre-trained deep learning algorithms (e.g., GPT-2 and Generative Adversarial Networks) to automatically generate personalized digital art based on analyzed user idea and emotion data.

[1592] Submitting and displaying digital art

[1593] The generated digital art is sent from the server to the user's device as a high-resolution image file, where it is displayed and the user can appreciate it. The user can also share the generated art with other users and receive feedback.

[1594] Specific examples

[1595] As a concrete example of a prompt, let's say the user inputs the idea of ​​a "flying cat" and smiles. The following digital art is generated:

[1596] 1. The user types "flying cat" into the text field, and the device camera simultaneously captures the user's smiling face.

[1597] 2. The server receives the text data of "Flying Cat" and the smiling facial expression data.

[1598] 3. The emotion engine recognizes the "smile" and the generative model generates visual art of a flying cat with a bright and joyful atmosphere that reflects the emotion of "flying cat" and "smile."

[1599] 4. The generated art is sent to the user's device as a high-resolution image, where the user can view it and share it with others.

[1600] In this way, a more personalized art creation experience is provided that responds to the user's emotions.

[1601] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1602] Step 1:

[1603] The user inputs creative ideas using the idea input method. The user inputs ideas in the text field and uploads sketch images. The input data (text and images) is saved on the device.

[1604] Step 2:

[1605] The user captures their own facial expression using the device camera, and the captured facial expression data is saved as an image file on the device.

[1606] Step 3:

[1607] The device sends the user's text data, sketch image data, and facial expression data to the server. This data is securely transmitted using the HTTPS protocol. The server receives the transmitted data.

[1608] Step 4:

[1609] The server analyzes the received data. First, it preprocesses the sketch image data using an image processing library, then analyzes the text data using a natural language processing library. For facial expression data, it performs emotion analysis using an emotion engine. The output of this step is the preprocessed sketch data and analyzed text and emotion data.

[1610] Step 5:

[1611] The server inputs the preprocessed sketch data, parsed text data, and emotion data into a generative model, which uses deep learning algorithms to automatically generate digital art based on the input data. The output of this step is the generated digital art.

[1612] Step 6:

[1613] The server sends the generated digital art as a high-resolution image file to the user's device, also using a secure communication protocol. The device receives the image file.

[1614] Step 7:

[1615] The device displays the received digital art. The user can view the displayed art, share it with other users in the virtual store, and receive feedback. The output of this step is the displayed digital art.

[1616] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1617] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1618] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1619] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1620] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1621] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1622] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1623] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1624] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1625] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1626] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1627] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1628] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1629] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1630] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1631] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1632] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1633] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1634] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1635] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1636] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1637] The following is further disclosed regarding the above embodiment.

[1638] (Claim 1)

[1639] a means for receiving user-input creative ideas;

[1640] a terminal means for transmitting a user's idea to a server;

[1641] means for analyzing the received idea data;

[1642] a generative modeling means for automatically generating digital art based on the analyzed data;

[1643] means for transmitting the generated digital art to a terminal;

[1644] A means for displaying submitted digital art to a user

[1645] A system including:

[1646] (Claim 2)

[1647] 10. The system of claim 1, further comprising means for receiving sketch image and text data from a user and preprocessing them.

[1648] (Claim 3)

[1649] 10. The system of claim 1, further comprising means for displaying the generated digital art for other users to view and provide feedback.

[1650] "Example 1"

[1651] (Claim 1)

[1652] a means for receiving user-input creative ideas;

[1653] a terminal means for transmitting a user's idea to a server;

[1654] means for transmitting the received idea data to a server using a secure communication protocol;

[1655] means for analyzing and pre-processing the received idea data;

[1656] a generative modeling means for automatically generating digital art based on the preprocessed data;

[1657] a means for transmitting the generated digital art to a device in high resolution;

[1658] A means for users to view submitted digital art and share it with others

[1659] A system including:

[1660] (Claim 2)

[1661] 10. The system of claim 1, further comprising means for receiving sketch image and text data from a user and preprocessing them.

[1662] (Claim 3)

[1663] 10. The system of claim 1, further comprising means for displaying the generated digital art for other users to view and provide feedback.

[1664] "Application Example 1"

[1665] (Claim 1)

[1666] a means for receiving user-input creative ideas;

[1667] a terminal means for transmitting a user's idea to a server;

[1668] means for analyzing the received idea data;

[1669] A generative modeling means for automatically generating digital art based on the analyzed data;

[1670] means for transmitting the generated digital art to a terminal;

[1671] means for displaying the submitted digital art to the user;

[1672] A means to display and interact with the resulting digital art in a physical exhibition space

[1673] A system including:

[1674] (Claim 2)

[1675] 10. The system of claim 1, further comprising means for receiving sketch image and text data from a user and preprocessing them.

[1676] (Claim 3)

[1677] 10. The system of claim 1, further comprising means for displaying the generated digital art for other users to view and provide feedback.

[1678] "Example 2: Combining Emotion Engines"

[1679] (Claim 1)

[1680] a means for receiving user-input creative ideas;

[1681] a terminal means for transmitting a user's idea to a server;

[1682] means for analyzing the received idea data;

[1683] emotion engine means for analyzing the emotion of a user;

[1684] a generative modeling means for automatically generating digital art based on the analyzed data;

[1685] means for transmitting the generated digital art to a terminal;

[1686] A means for displaying submitted digital art to a user

[1687] A system including:

[1688] (Claim 2)

[1689] 10. The system of claim 1, further comprising means for receiving sketch image and text data from a user and preprocessing them.

[1690] (Claim 3)

[1691] 10. The system of claim 1, further comprising means for displaying the generated digital art for other users to view and provide feedback.

[1692] "Application example 2 when combining emotion engines"

[1693] (Claim 1)

[1694] a means for receiving user-input creative ideas;

[1695] a terminal means for transmitting a user's idea to a server;

[1696] means for analyzing the received idea data;

[1697] a generative modeling means for automatically generating digital art based on the analyzed data;

[1698] emotion engine means for acquiring facial expression data of a user and performing emotion analysis;

[1699] means for transmitting the generated digital art to a terminal;

[1700] A means for displaying submitted digital art to a user

[1701] A system including:

[1702] (Claim 2)

[1703] 10. The system of claim 1, further comprising means for receiving sketch image and text data from a user and preprocessing them.

[1704] (Claim 3)

[1705] 10. The system of claim 1, further comprising means for displaying the generated digital art for other users to view and provide feedback. [Explanation of symbols]

[1706] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. a means for receiving user-input creative ideas; a terminal means for transmitting a user's idea to a server; means for analyzing the received idea data; a generative modeling means for automatically generating digital art based on the analyzed data; means for transmitting the generated digital art to a terminal; A means for displaying submitted digital art to a user A system including:

2. 10. The system of claim 1, further comprising means for receiving sketch image and text data from a user and preprocessing them.

3. The system of claim 1 , further comprising means for displaying the generated digital art for other users to view and provide feedback.

Images