System

Abstract

A system is provided.SOLUTION: A system comprising: means for capturing an image of an art work drawn by a Day Care child and uploading the image to a server; means for inputting the uploaded image to a generative AI model and generating a designed art; and means for displaying the generated designed art on a marketplace so that the designed art can be sold.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Traditionally, artworks created by children in after-school care centers have often been evaluated within their homes or schools, with few opportunities to display them to a wider audience or sell them to earn income. This has also limited the opportunities for children to express their artistic sensibilities and create communication with others. Furthermore, there have been problems with online systems for exhibiting and selling artworks, or even if they exist, they are difficult to use and complex to operate. [Means for solving the problem]

[0005] To solve the above problems, the present invention provides the following means: A means for photographing artwork drawn by after-school care children and uploading the image data to a server. A means for inputting the uploaded image data into a generative AI model to generate designed art. A means for exhibiting the generated designed art on a marketplace and making it available for sale. Furthermore, a means for users to search, compare, and purchase designed art works exhibited on the marketplace is also provided. By providing users who purchase the designed art with digital or print data, the artwork of after-school care children can be appreciated by a wide range of people and promote communication with others.

[0006] "After-school care children" are elementary school children who spend their time at after-school care centers.

[0007] "Artworks" refer to artistic expressions created by children, such as paintings and handicrafts.

[0008] "Photography" refers to the acquisition of image data of artworks using camera equipment.

[0009] "Image data" refers to electronic data of artworks photographed with a camera or other device.

[0010] A "server" is a computer system that stores and processes data and is accessible from multiple terminals over a network.

[0011] "Upload" means sending data from the user's terminal to the server.

[0012] A "generative AI model" is a program that automatically generates designed art based on input image data using an artificial intelligence algorithm.

[0013] "Designification" is the process of transforming an original artwork into a new visual expression using a generative AI model.

[0014] A "marketplace" is a platform where multiple exhibitors and buyers can trade goods online.

[0015] "Exhibiting" refers to the act of listing and selling an artwork on the marketplace.

[0016] "Search" means the act of searching for items within the Marketplace based on specific criteria.

[0017] "Comparison" refers to the act of lining up multiple products and evaluating their differences in characteristics, price, etc.

[0018] "Purchase" refers to the act of selecting a product on the marketplace, paying for it, and acquiring ownership of it.

[0019] "Digital data" means data in a form that can be stored and transported electronically.

[0020] "Print data" refers to data that can be reproduced as a physical product (print) based on digital data.

[0021] "Feedback" refers to the act of a user providing an evaluation or opinion of a purchased artwork. [Brief explanation of the drawings]

[0022] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0023] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0024] First, the terms used in the following description will be explained.

[0025] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0026] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0027] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0028] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0029] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0030] [First embodiment]

[0031] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0032] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0033] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0034] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0035] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0036] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0037] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0038] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0039] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0040] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0041] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0042] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0043] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells them on a marketplace. This system can help children develop artistic sensibilities, secure income, and foster communication with others. The program's processing is explained below in natural language.

[0044] User Artwork Uploads

[0045] Artwork photography and uploading

[0046] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made. Opens the dedicated application, selects the image they have taken, and presses the upload button in the application to send the image data to the server.

[0047] Terminal: Based on the user's operation, sends image data to a specified server address.

[0048] Image acceptance by the server

[0049] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0050] Design using image generation AI models

[0051] Sending image data

[0052] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0053] Design art generation

[0054] Server (within AI model): The AI ​​model generates a new design art piece based on the input image data. The generated design art is saved as a digital file.

[0055] Preservation and Management of Designed Art

[0056] Preserving Design Art

[0057] Server: Stores the generated design art in dedicated storage. Registers the design art metadata (title, artist, creation date, etc.) in a database.

[0058] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[0059] Marketplace Exhibits and Sales

[0060] Preparing to exhibit at the marketplace

[0061] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[0062] Server: Post your design art in a category within the Marketplace.

[0063] User purchase of artwork

[0064] Users: Access the marketplace through a web browser or dedicated application, search and compare exhibited designed artworks, and then complete the purchase process.

[0065] Server: Accepts purchase requests and processes payments through a secure payment gateway. Once payment is complete, the buyer is provided with the digital or print version of the designed artwork.

[0066] Facilitating feedback and communication

[0067] Post-purchase feedback

[0068] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0069] Users can post their thoughts and feedback on artworks and communicate with the children who created them.

[0070] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, as well as providing an income and fostering communication with others.

[0071] The processing flow will be explained below.

[0072] Step 1:

[0073] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made, and then imports the image into a dedicated application.

[0074] Step 2:

[0075] Device: The user presses the "upload" button in the application to send the captured image data to the server.

[0076] Step 3:

[0077] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0078] Step 4:

[0079] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0080] Step 5:

[0081] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[0082] Step 6:

[0083] Server: The generated design art is saved as a digital file in a dedicated storage.

[0084] Step 7:

[0085] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[0086] Step 8:

[0087] Server: Refers to the metadata of the stored designed art and generates exhibition information (price, category, description) to exhibit on the marketplace.

[0088] Step 9:

[0089] Server: Add the design art exhibit information to the relevant category in the marketplace and display it in sections such as the homepage and new items.

[0090] Step 10:

[0091] Users: Access the marketplace using a web browser or dedicated application to search and compare the exhibited designed artworks.

[0092] Step 11:

[0093] User: Select the designed artwork you wish to purchase and open the details page.

[0094] Step 12:

[0095] User: Clicks the purchase button, adds the item to the cart, and proceeds to the payment screen.

[0096] Step 13:

[0097] Server: Receives payment information and processes the payment through a secure payment gateway.

[0098] Step 14:

[0099] Server: Once payment is complete, provide the buyer with digital or print data of the designed art.

[0100] Step 15:

[0101] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0102] Step 16:

[0103] Users: Post their thoughts and feedback on the artworks and communicate with the children who created them.

[0104] Example 1

[0105] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0106] In traditional after-school care programs, there were limited ways for children to widely exhibit and sell their artwork, making it difficult for their artistic activities to be recognized. Furthermore, there was a lack of efficient ways to digitize and design children's artwork, making it difficult to develop children's artistic sensibilities and secure income. Opportunities for communication with others were also limited.

[0107] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0108] In this invention, the server includes means for photographing artwork drawn by children in after-school care and uploading the image data to the server, means for temporarily storing the uploaded image data and sending it as input data to a generative AI model, means for the generative AI model to generate designed art based on the image data, means for storing the generated designed art in dedicated storage and registering its metadata in a database, and means for exhibiting the generated designed art on a marketplace and making it available for sale. This makes it possible to widely publicize children's artwork and efficiently design and sell it, thereby improving children's artistic sensibilities, securing income, and fostering communication with others.

[0109] "After-school care children" refers to children enrolled in elementary school who receive care and guidance after school and on weekends.

[0110] "Artworks" refers to visual artistic expressions such as paintings and illustrations created by after-school care children.

[0111] "Image data" refers to information obtained by photographing an artwork and expressing it in digital form.

[0112] "Server" means a centralized system connected to a computer network that stores, processes, and transmits data.

[0113] "Upload" refers to the act of sending data from a terminal to a server.

[0114] "Temporary storage" refers to the provisional storage of data for a certain period of time.

[0115] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate new designs or information based on input data.

[0116] "Designization" refers to the process of giving a new design or style to an original artwork.

[0117] "Dedicated storage" refers to a storage area reserved for storing specific data.

[0118] "Metadata" refers to information that primarily contains attribute information about data, such as title, author, and creation date.

[0119] A "database" refers to a system that organizes and manages large amounts of data and enables efficient searching and updating.

[0120] "Marketplace" refers to a virtual marketplace for selling and purchasing goods and services over the Internet.

[0121] "Exhibiting" refers to the act of listing a product (in this case, a designed artwork) on the marketplace and making it available for sale.

[0122] "User" refers to anyone who uses the system to upload or purchase artworks.

[0123] "Purchase" refers to the act of a user acquiring an art piece exhibited on the marketplace in exchange for money.

[0124] "Digital data" or "print data" refers to data that is represented electronically or printed on a physical medium such as paper.

[0125] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells them on a marketplace. This system can improve children's artistic sensibilities, secure income, and foster communication with others. The program processing of this system is explained in detail below.

[0126] User Artwork Uploads

[0127] Artwork photography and uploading

[0128] User: Uses the camera on a smartphone or tablet to take a photo of the artwork they have created. Opens the dedicated application, selects the image they have taken, and presses the "Upload" button to send the image data to the server.

[0129] Terminal: Based on the user's operation, sends image data to a specified server address.

[0130] Image acceptance by the server

[0131] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0132] Design using image generation AI models

[0133] Sending image data

[0134] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0135] Design art generation

[0136] Server (within AI model): The generative AI model generates a new design art piece based on the input image data. The generated design art is saved as a digital file.

[0137] Preservation and Management of Designed Art

[0138] Preserving Design Art

[0139] Server: Stores the generated design art in dedicated storage. Registers the design art metadata (title, artist, creation date, etc.) in a database.

[0140] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[0141] Marketplace Exhibits and Sales

[0142] Preparing to exhibit at the marketplace

[0143] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[0144] Server: Post your design art in a category within the Marketplace.

[0145] User purchase of artwork

[0146] Users access the marketplace through a web browser or a dedicated application, search and compare the exhibited designed artworks, select the artwork they like, and complete the purchase process.

[0147] Server: Accepts purchase requests, processes payments through a secure payment gateway, and once payment is complete, provides the buyer with a digital or print copy of the designed artwork.

[0148] Facilitating feedback and communication

[0149] Post-purchase feedback

[0150] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0151] Users can post their thoughts and feedback on artworks and communicate with the children who created them. For example, a purchaser can post a comment saying, "I was very moved by this piece! I'm looking forward to seeing your next piece."

[0152] The system's generative AI model uses the latest deep learning technology, which performs image analysis, style conversion, color adjustment, and other processes. For example, it can convert a simple drawing by a child into a professional design.

[0153] As a concrete example, a user opens a dedicated app and performs an operation using the following prompt sentence:

[0154] Example prompt sentence:

[0155] "Use your smartphone or tablet camera to take a photo of your artwork and upload it using the dedicated application."

[0156] In this way, the artworks of children in after-school care can be designed and distributed through a marketplace, which not only allows the children's artistic talent to be recognized, but also provides an opportunity for them to secure income and communicate with others.

[0157] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0158] Step 1: Photograph and upload your artwork

[0159] User: Uses the camera on a smartphone or tablet to take a photo of their artwork. The input is the artwork and the camera device. The output is the captured image data.

[0160] User: Opens the dedicated application and selects the captured image data. Then, presses the "Upload" button within the application. The input is the captured image data. The output is an instruction to upload.

[0161] Terminal: Sends image data to the server based on user operations. Inputs are image data and upload instructions. Output is the image data sent to the server.

[0162] Step 2: Receiving and temporarily saving image data

[0163] Server: Saves image data received from the terminal in temporary storage. The input is the transmitted image data. The output is the temporarily saved image data.

[0164] Server: Returns a notification to the terminal confirming receipt. The input is a confirmation of receipt of the image data. The output is a notification of receipt confirmation.

[0165] Step 3: Send image data to the AI ​​model

[0166] Server: Inputs the temporarily stored image data into the generative AI model. The input is the temporarily stored image data. The output is the input data to the generative AI model.

[0167] Generative AI model: Analyzes received image data and generates designed art. The input is image data. The output is a designed artwork.

[0168] Step 4: Save your design and register your metadata

[0169] Server: Saves the generated design art in a dedicated storage. The input is the generated design art. The output is the saved design art.

[0170] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in the database. The input is the information of the designed art. The output is the metadata registered in the database.

[0171] Step 5: Prepare and list on the Marketplace

[0172] Server: References the metadata of the designed art and generates exhibition information. The input is the metadata of the designed art. The output is the generated exhibition information.

[0173] Server: Posts designed art in categories within the marketplace. The input is exhibit information. The output is the art work posted on the marketplace.

[0174] Step 6: User purchases artwork

[0175] User: Accesses the marketplace through a web browser or dedicated application to search and compare exhibited designed artworks. The input is the marketplace search criteria. The output is the search results.

[0176] User: Selects a favorite work and completes the purchase procedure. The input is the selected work and purchase intention. The output is a purchase request.

[0177] Server: Accepts purchase requests and processes payments through a secure payment gateway. Inputs are the purchase request and payment information. Output is a confirmation of successful payment.

[0178] Server: Once payment is complete, the server provides the buyer with digital or print data of the designed artwork. The input is a payment completion notice and the designed artwork. The output is the provided data.

[0179] Step 7: Promote feedback and communication

[0180] Server: After a purchase, send emails and notifications to users encouraging them to post ratings and comments. Inputs are purchaser information and notification content. Output is the sent notification.

[0181] Users can post their thoughts and feedback on artworks and communicate with the children who created them. The input is the user's thoughts and feedback. The output is the posted comments.

[0182] By following the above processing steps, this system enables the design of artworks by children in after-school care and their sale on the marketplace, thereby encouraging children to engage in artistic activities, securing income, and fostering communication with others.

[0183] (Application example 1)

[0184] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0185] The conventional system lacked the means to treat the creative activities of after-school care children as digital data and to provide a venue for widely selling their works. Furthermore, there were few opportunities for the works to be evaluated in the market, and the system was not effective enough in improving the children's artistic sensibility and motivation. Furthermore, direct communication between the purchasers and the children who created the works was limited, making it difficult to provide mutual feedback.

[0186] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0187] In this invention, the server includes means for photographing artworks drawn by children in after-school care and uploading the image data to the server, means for inputting the uploaded image data into a generative AI model to generate designed art, means for exhibiting the generated designed art on a marketplace and making it available for sale, means for registering and managing the digital data, and feedback means for allowing users who purchase the artwork to post ratings and comments. This provides a platform where children's artworks can be designed and widely sold, increases children's motivation for artistic activities, and enables them to secure income and communicate with others.

[0188] "Photography" is a method of capturing artwork as digital data using a camera.

[0189] "Server" refers to a computer system that temporarily stores and manages captured image data and performs other processing.

[0190] "Uploading" refers to the act of sending image data captured by a user to a server via the Internet.

[0191] A "generative AI model" is an artificial intelligence algorithm that generates new designed artworks based on input image data.

[0192] "Designification" is the process by which a generative AI model processes a primitive artwork and adds or transforms it with new design elements.

[0193] "Marketplace" is an online platform that lists designed artworks and allows users to search, compare, and purchase them.

[0194] "Digital data" refers to the electronic data format of artworks created by photography or generative AI models.

[0195] "Feedback tools" is a function that allows purchasers to post ratings and comments on works and communicate with the creator.

[0196] "Metadata" refers to data that refers to information associated with a designed artwork (e.g., title, artist, creation date, etc.).

[0197] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells it on a marketplace. The program for realizing this system is explained in natural language. Each step and the specific hardware and software used are specified below.

[0198] Hardware and software used

[0199] Smartphone: For taking photos and uploading image data.

[0200] Server: Accepts image data, runs generative AI models, stores data, and manages the marketplace.

[0201] Generative AI model: Designing image data.

[0202] Program processing

[0203] In this system, users use their smartphones to take photos of artworks and upload the image data to a server using a dedicated application. For example, a user can take a photo of a painting they have drawn with their smartphone camera and tap the upload button in the application to send the image data to the server. The server temporarily stores the image data and inputs it into the generative AI model.

[0204] The generative AI model generates new designed art based on uploaded image data. For example, the model can take a user's drawing and add color palettes and design elements to transform it into a more appealing piece of art. This generated designed art is stored as digital data on a server.

[0205] The server stores the created designed art, registers its metadata (title, artist, creation date, etc.), and prepares it for exhibition on the marketplace. Exhibit information is automatically generated on the marketplace and posted so that users can search, compare, and purchase.

[0206] Users browsing the marketplace can browse the exhibited designed artworks through a web browser or dedicated application. For example, users can search for specific categories or price ranges to find artworks they like. Once a purchase is made, the server processes payment through a secure payment gateway and provides the buyer with a digital or print version of the designed art.

[0207] Furthermore, the server sends notifications to users after purchase, encouraging them to post ratings and comments. This allows purchasers to post their own feedback and communicate with the children who created the artwork. For example, by using a prompt such as, "I would like to design this picture I drew and sell it on the marketplace. Please upload this image and generate a design art," children's creative activities can be promoted.

[0208] As described above, this invention provides a venue where children's artworks can be designed and then exhibited and sold in a marketplace, which will help children develop their artistic sensibilities and creative motivation, secure income, and foster communication with others.

[0209] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0210] Step 1:

[0211] The user uses a smartphone to take a photo of an artwork with the camera. This captured image data becomes the input. The device temporarily stores this image data and displays an upload button through a dedicated application. When the user taps the upload button, the image data is sent to the server. As a result, the image data is saved on the server.

[0212] Step 2:

[0213] The server temporarily stores the received image data and prepares to send it as input data to the generative AI model. The server accepts this input data and sends it to the generative AI model. Specifically, the image data is converted into a specific format. This outputs data in a format that the generative AI model can process.

[0214] Step 3:

[0215] The generative AI model on the server generates a new design art piece based on the input image data. This generated design art is the output. Specifically, the generative AI model analyzes specific features and patterns in the image and adds or transforms new design elements based on this. As a result, a new digital art piece is generated.

[0216] Step 4:

[0217] The server saves the generated design art in dedicated storage and registers its metadata (title, artist, creation date, etc.) in a database. The server manages this data and prepares it for exhibition on the marketplace. Specifically, the fields (attributes) of the generated design art are entered into the database and saved as output.

[0218] Step 5:

[0219] The server generates exhibit information (price, category, description) for the designed art and posts it in categories within the marketplace. Users can browse this information and perform searches and comparisons. As an output, the product information is displayed on the marketplace screen. For example, when a user searches for a specific category or keyword, a list of relevant art works is displayed.

[0220] Step 6:

[0221] The user selects a design art piece they like from the marketplace and completes the purchase. The server accepts the purchase request and processes the payment through a secure payment gateway. After the payment is completed, the server provides the buyer with a digital or print version of the design art. Payment information is used as input, and a purchase completion notification is sent as output.

[0222] Step 7:

[0223] After a purchase, the server sends a notification to the user encouraging them to post a rating and comment. The user posts feedback, expressing their thoughts and opinions about the artwork. This feedback information becomes input, and the server organizes it and displays it on the artwork's page. Specifically, the content of the feedback is saved as text data, and the rating and comment are published as output.

[0224] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0225] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and exhibits and sells them on a marketplace. This system also incorporates an emotion engine that recognizes the user's emotions, analyzes their emotions, and provides customization and recommendation functions according to their individual emotions.

[0226] User Artwork Uploads

[0227] Artwork photography and uploading

[0228] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made. Opens the dedicated application, selects the image they have taken, and presses the upload button in the application to send the image data to the server.

[0229] Terminal: Based on the user's operation, sends image data to a specified server address.

[0230] Image acceptance by the server

[0231] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0232] Design using image generation AI models

[0233] Sending image data

[0234] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0235] Design art generation

[0236] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[0237] Preservation and Management of Designed Art

[0238] Preserving Design Art

[0239] Server: The generated design art is saved as a digital file in a dedicated storage.

[0240] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[0241] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[0242] Marketplace Exhibits and Sales

[0243] Preparing to exhibit at the marketplace

[0244] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[0245] Server: Post your design art in a category within the Marketplace and display it in sections such as the homepage and new arrivals.

[0246] User purchase of artwork

[0247] Users: Access the marketplace through a web browser or dedicated application, search and compare exhibited designed artworks, and then complete the purchase process.

[0248] Server: Accepts purchase requests and processes payments through a secure payment gateway. Once payment is complete, the buyer is provided with the digital or print version of the designed artwork.

[0249] Emotion engine for user emotion recognition and customization

[0250] Emotion recognition by emotion engine

[0251] Server (internal emotion engine): Analyzes user facial expressions and interaction data while users browse the marketplace to recognize user emotions in real time.

[0252] Emotion-based recommendations

[0253] Server: Based on the user's emotional data recognized by the emotion engine, recommends designed art that the user is likely to like.

[0254] Emotional customization

[0255] Server: Based on the user's emotional data, it provides specific customization options for the designed art (e.g., color changes, thematic emphasis, etc.).

[0256] Utilizing Emotional Data

[0257] Server: Improve the ranking and filtering functions of artworks on the marketplace based on user emotion data collected by the emotion engine.

[0258] Facilitating feedback and communication

[0259] Post-purchase feedback

[0260] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0261] Users can post their thoughts and feedback on artworks and communicate with the children who created them.

[0262] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, and by utilizing the emotion engine, it is possible to provide a more personalized user experience.

[0263] The processing flow will be explained below.

[0264] Step 1:

[0265] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made, and then imports the image into a dedicated application.

[0266] Step 2:

[0267] Device: The user presses the "upload" button in the application to send the captured image data to the server.

[0268] Step 3:

[0269] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0270] Step 4:

[0271] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0272] Step 5:

[0273] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[0274] Step 6:

[0275] Server: The generated design art is saved as a digital file in a dedicated storage.

[0276] Step 7:

[0277] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[0278] Step 8:

[0279] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[0280] Step 9:

[0281] Server: Add the design art exhibit information to the relevant category in the marketplace and display it in sections such as the homepage and new items.

[0282] Step 10:

[0283] Server (internal emotion engine): While users browse the marketplace, it collects their facial expressions and interaction data and analyzes their emotions in real time.

[0284] Step 11:

[0285] Server: Analyzes the user's emotions using an emotion engine and recommends artworks that suit the user based on the results.

[0286] Step 12:

[0287] Users: Access the marketplace using a web browser or dedicated application to search and compare the exhibited designed artworks.

[0288] Step 13:

[0289] User: Select the designed artwork you wish to purchase and open the details page.

[0290] Step 14:

[0291] User: Clicks the purchase button, adds the item to the cart, and proceeds to the payment screen.

[0292] Step 15:

[0293] Server: Receives payment information and processes the payment through a secure payment gateway.

[0294] Step 16:

[0295] Server: Once payment is complete, provide the buyer with digital or print data of the designed art.

[0296] Step 17:

[0297] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0298] Step 18:

[0299] Users: Post their thoughts and feedback on the artworks and communicate with the children who created them.

[0300] Example 2

[0301] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0302] Conventional systems limited opportunities for children in after-school care to share their artwork, making it difficult to maximize its value. Furthermore, the system lacked a personalized user experience and was unable to customize or recommend artwork based on user emotions. Furthermore, it lacked a mechanism for promoting communication between buyers and artists.

[0303] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0304] In this invention, the server includes means for photographing artworks drawn by after-school care children and uploading the image data to the server, means for inputting the uploaded image data into a generative AI model to generate designed art, means for exhibiting the generated designed art on a marketplace and making it available for sale, means for customizing and recommending based on the user's emotions using an emotion engine that recognizes the user's emotions, and means for users to post feedback on designed artworks purchased by the user and promote communication with the artist. This makes it possible to maximize the value of the artworks, realize customization and recommendations based on the user's emotions, and promote communication between purchasers and artists.

[0305] "After-school care children" are children who attend after-school care facilities and primarily spend their time at the facilities after school or during long holidays.

[0306] "Artworks" refers to visual art, including pictures and other creative works drawn by children in after-school care, and are painted on paper, canvas, etc.

[0307] "Image data" refers to data files that digitally represent artwork, and includes common image formats such as JPEG and PNG.

[0308] "Server" refers to a computer system for managing, storing, and processing data over the Internet.

[0309] A "generative AI model" refers to an artificial intelligence algorithm or structure that generates new designs based on input image data.

[0310] "Designed art" refers to new designs generated from original artworks using generative AI models.

[0311] "Marketplace" refers to an online platform where users can exhibit, search for, and purchase artworks.

[0312] An "emotion engine" is an artificial intelligence system that analyzes a user's facial expressions and interaction data and recognizes emotions in real time.

[0313] "Customization" refers to the process of changing the characteristics of designed art according to a user's specific needs and preferences.

[0314] "Recommendation" refers to the function of providing designed art that a user is likely to like based on their emotional data.

[0315] "Feedback" refers to evaluations and comments made by users on artworks, including impressions and opinions of the creators.

[0316] "Digital Data" refers to data in digital format that is transmitted electronically over the Internet.

[0317] "Print data" refers to digital data that has been printed out and put into physical form, such as an artwork printed on paper or canvas.

[0318] MODE FOR CARRYING OUT THE INVENTION

[0319] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and exhibits and sells them on a marketplace. This system also incorporates an emotion engine that recognizes the user's emotions, analyzes their emotions, and provides customization and recommendation functions according to their individual emotions.

[0320] User Artwork Uploads

[0321] Artwork photography and uploading

[0322] User: Uses the camera on their smartphone or tablet to take a picture of a picture they have drawn. They open the dedicated application, select the image they have taken, and press the upload button in the application to send the image data to the server. For example, a user can select a picture they have drawn with the title "Schoolchildren's Work" and press the upload button, and the image will be transferred to the server.

[0323] Terminal: Based on user operation, image data is sent to the specified server address. The progress during sending is indicated by a progress bar, and a success message is displayed when it is completed.

[0324] Image acceptance by the server

[0325] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model. For example, it converts the received JPEG file to PNG format and stores it in a temporary folder.

[0326] Design using image generation AI models

[0327] Sending image data

[0328] Server: Sends the temporarily saved image data to the generative AI model as input data. For example, send the image data using an HTTP POST request.

[0329] Design art generation

[0330] Server (within the AI ​​model): The generative AI model generates new designed artwork based on the input image data. Specifically, the AI ​​model extracts image features and generates new designs based on them. The model's operation is accelerated by the GPU.

[0331] Preservation and Management of Designed Art

[0332] Preserving Design Art

[0333] Server: Stores the generated design art as a digital file in dedicated storage. For example, stores the generated art in the “ / storage / designs / ” directory.

[0334] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in the database. Inserts the information into the “Designs” table in the database.

[0335] Server: Manages the designed art and prepares it for exhibition on the marketplace. Sends exhibition information to the marketplace via API.

[0336] Marketplace Exhibits and Sales

[0337] Preparing to exhibit at the marketplace

[0338] Server: References the metadata of the designed art and generates exhibit information (price, category, description). Dynamically generates exhibit pages using a template engine.

[0339] Server: List your design art in a category within the Marketplace and display it in the New Arrivals section. Use the category mapping file to register it in the correct category.

[0340] User purchase of artwork

[0341] Users access the Marketplace through a web browser or dedicated application to search, compare, and purchase the designed art on display. For example, they can use search filters to narrow down their search to artworks in the "Abstract Art" category.

[0342] Server: Accepts the purchase request and securely processes the payment through the payment gateway. After payment is complete, the buyer is emailed a download link for the designed art.

[0343] Emotion engine for user emotion recognition and customization

[0344] Emotion recognition by emotion engine

[0345] Server (internal emotion engine): While users browse the marketplace, it analyzes their facial expressions and interaction data to recognize emotions in real time, for example, by capturing their facial expressions using a webcam and analyzing them with facial recognition algorithms.

[0346] Emotion-based recommendations

[0347] Server: Based on the data recognized by the emotion engine, recommends designed art that the user is likely to like. For example, the recommendation algorithm displays artworks similar to those that the user has shown interest in.

[0348] Emotional customization

[0349] Server: Based on the user's emotional data, it offers specific customization options (color tones, thematic highlights, etc.). For example, if the emotional analysis indicates "joy," it recommends bright color options.

[0350] Utilizing Emotional Data

[0351] Server: Improve the ranking display and filtering functions of the marketplace based on the collected sentiment data. The results of the sentiment data analysis are stored in a database and incorporated into the algorithm.

[0352] Facilitating feedback and communication

[0353] Post-purchase feedback

[0354] Server: Send emails and notifications to users after purchase, encouraging them to leave a rating or comment. For example, automatically send a feedback request email within 24 hours of purchase.

[0355] User feedback and communication

[0356] Users: Post their thoughts and feedback on artworks and communicate with the artists. For example, they can enter comments in the app and send them by pressing the post button.

[0357] Prompt Sentence Examples

[0358] Below are some example prompts for the generative AI model:

[0359] "Please create a new design based on this drawing by a child in after-school care. Please emphasize the colors and use brighter tones."

[0360] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, and by utilizing the emotion engine, it is possible to provide a more personalized user experience.

[0361] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0362] Program processing flow

[0363] User Artwork Uploads

[0364] Step 1:

[0365] Users use the camera on their smartphone or tablet to take a picture of a drawing by a child in after-school care. They open the application, click the "Select Image" button, and choose the image from the device's gallery. After selecting, they press the "Upload" button to send the image data to the server.

[0366] Input: Image data of artwork photographed by the user

[0367] Output: Image data sent to the server

[0368] Step 2:

[0369] The terminal transmits the image data selected by the user to the specified server address. At this time, a progress bar is displayed, and a success message is displayed after the transmission is completed.

[0370] Input: User-selected image data

[0371] Output: Image data sent to the server

[0372] Step 3:

[0373] The server temporarily stores the received image data and prepares it for transmission to the generative AI model. Specifically, it converts the received JPEG file into PNG format and stores it in a temporary folder.

[0374] Input: Image data sent to the server

[0375] Output: Temporarily saved image data (PNG format)

[0376] Design using image generation AI models

[0377] Step 4:

[0378] The server sends the temporarily saved image data to the generative AI model as input data. Specifically, the image data is sent using an HTTP POST request.

[0379] Input: Temporarily saved image data (PNG format)

[0380] Output: Image data sent to the generative AI model

[0381] Step 5:

[0382] The server (within the AI ​​model) generates a new design artwork based on the input image data. The AI ​​model extracts image features, performs style conversion based on them, and generates a new design. This process is accelerated by the GPU.

[0383] Input: Image data sent to the generative AI model

[0384] Output: Generated designed artwork

[0385] Preservation and Management of Designed Art

[0386] Step 6:

[0387] The server saves the generated design art as a digital file in dedicated storage. The server saves the generated art in the “ / storage / designs / ” directory.

[0388] Input: Generated designed artwork

[0389] Output: Saved digital file

[0390] Step 7:

[0391] The server registers the metadata of the designed art (title, artist, creation date, etc.) in a database and inserts the information into the “Designs” table in the database.

[0392] Input: Metadata of the designed artwork

[0393] Output: Metadata registered in the database

[0394] Step 8:

[0395] The server manages the designed art and prepares it for exhibition on the marketplace. It sends the exhibition information to the marketplace via API.

[0396] Input: A designed artwork and its metadata

[0397] Output: Ready to be listed on the marketplace

[0398] Marketplace Exhibits and Sales

[0399] Step 9:

[0400] The server references the metadata of the designed art and generates exhibit information (price, category, description), and dynamically generates the exhibit page using a template engine.

[0401] Input: Metadata of the designed artwork

[0402] Output: Generated exhibit information

[0403] Step 10:

[0404] The server posts the design art to a category within the marketplace and displays it in the new arrivals section, using a category mapping file to register it in the correct category.

[0405] Input: Generated exhibit information

[0406] Output: Designed art posted in the Marketplace

[0407] Step 11:

[0408] Users can access the marketplace through a web browser or a dedicated application to search, compare, and purchase the designed art on display. For example, they can use search filters to narrow down their search to artworks in the "Abstract Art" category.

[0409] Input: User search queries and purchase requests

[0410] Output: Purchase procedure completed

[0411] Step 12:

[0412] The server accepts the purchase request, securely processes the payment through the payment gateway, and then emails the buyer a download link for the designed art.

[0413] Input: User purchase request and payment information

[0414] Output: Download link sent

[0415] Emotion engine for user emotion recognition and customization

[0416] Step 13:

[0417] The server (within the emotion engine) analyzes facial expressions and interaction data while users browse the marketplace, recognizing emotions in real time. Facial expressions are captured using a webcam and analyzed with facial recognition algorithms.

[0418] Input: User facial expression data and interaction data

[0419] Output: Real-time recognized emotion data

[0420] Step 14:

[0421] The server recommends designed art that the user is likely to like based on the emotion data recognized by the emotion engine. For example, the recommendation algorithm displays artworks similar to artworks in which the user has shown interest.

[0422] Input: Real-time recognized emotion data

[0423] Output: Recommended designed artwork

[0424] Step 15:

[0425] The server offers specific customization options (color tones, thematic highlights, etc.) based on the user's emotional data. For example, if the emotional analysis indicates "joy," it recommends bright color options.

[0426] Input: Real-time recognized emotion data

[0427] Output: Customization options provided

[0428] Step 16:

[0429] The server uses the collected emotional data to improve the ranking and filtering functions of the marketplace, storing the results of the analysis of the emotional data in a database and incorporating them into the algorithm.

[0430] Input: Collected emotion data

[0431] Output: Improved ranking display and filtering capabilities

[0432] Facilitating feedback and communication

[0433] Step 17:

[0434] The server sends emails and notifications to users after purchase, encouraging them to post ratings and comments. Feedback request emails are automatically sent within 24 hours of purchase.

[0435] Input: Purchase completion information

[0436] Output: Feedback request sent

[0437] Step 18:

[0438] Users can post their thoughts and feedback on artworks and communicate with the artists. They can enter their comments in the app and send them by pressing the post button.

[0439] Input: User feedback

[0440] Output: Communication with the author has been completed

[0441] (Application example 2)

[0442] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0443] Conventional art sales systems lack the ability to customize artworks or recommend products based on individual user preferences, making it difficult to meet diverse user needs. Furthermore, they lack the ability to generate effective visual content based on emotions, especially in advertising campaigns. Furthermore, there is a lack of a mechanism for effectively utilizing artworks drawn by after-school care children.

[0444] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0445] In this invention, the server includes a means for photographing artwork drawn by after-school children and uploading the image data to the server, a means for inputting the uploaded image data into a generative AI model to generate designed art, a means for exhibiting the generated designed art on a marketplace and making it available for sale, and a means for analyzing user emotion data and customizing the designed art as advertising material based on the emotions. This enables customization of artwork and recommendations according to user needs, and can generate effective visual content based on emotions, particularly in advertising campaigns. It also enables widespread and effective use of artwork drawn by after-school children.

[0446] "After-school care children" refers to children who attend after-school care facilities.

[0447] "Artworks" refers to creative works, including paintings and illustrations, drawn by after-school care children.

[0448] A "generative AI model" refers to an artificial intelligence algorithm that generates new images or designs based on input data.

[0449] "Customization" refers to adjusting or changing design or functionality to suit a specific purpose or user preference.

[0450] "Emotional data" refers to data that indicates the user's emotional state, obtained by analyzing the user's facial expressions, voice, interactions, etc.

[0451] "Marketplace" refers to a platform where products can be exhibited, searched for, and purchased online.

[0452] "Advertising Materials" means the visual content and designs used in an Advertising Campaign.

[0453] "User" refers to an individual who uses an artwork or purchases an artwork on the Marketplace.

[0454] "Image data" refers to the digital image files obtained when photographing an artwork.

[0455] "Designed art" refers to artworks that have been processed and transformed using generative AI models.

[0456] This invention is a system that photographs artwork drawn by children in after-school care, uploads the image data to a server, and generates designed art using a generative AI model. This system can exhibit and sell the designed art on a marketplace. It also includes a function to analyze user emotion data and customize it as advertising material based on the emotion. Specific embodiments of the system are described below.

[0457] System Overview

[0458] Hardware

[0459] Smartphone: Used to take photos and upload artwork.

[0460] Server: Stores image data, processes designs using generative AI models, analyzes emotional data, and manages the marketplace.

[0461] User terminal: Used as access to the marketplace and as a user interface.

[0462] software

[0463] OpenCV: A library used to process and save images.

[0464] face_recognition: A library used to analyze the user's facial landmarks.

[0465] EmotionRecognizer: Software for recognizing user emotions.

[0466] design_generator: Software that generates design art using generative AI models.

[0467] Processing Description

[0468] 1. Upload your artwork

[0469] Users use their smartphones to take pictures of artworks drawn by children in daycare centers. The image data is then uploaded to the server via a dedicated application. The images taken with the smartphone camera are converted into an appropriate format using OpenCV.

[0470] 2. Designing with generative AI models

[0471] The server inputs the uploaded image data into a generative AI model to generate new designed art. This generation process uses a generative AI model such as Stable Diffusion.

[0472] 3. Emotion Data Analysis

[0473] When a user uses the marketplace, the server collects the user's facial images and interaction data, and analyzes the user's emotions using face_recognition and EmotionRecognizer. The analyzed emotional data is used to customize the designed art as advertising materials.

[0474] 4. Exhibiting on the Marketplace

[0475] The generated design art is displayed on the marketplace by the server, and users can access the marketplace using their own devices to search, compare, and purchase the displayed design art works.

[0476] Specific examples

[0477] Example prompt for a generative AI model:

[0478] Prompt: "Create a bright and cheerful advertisement using children's art that resonates with a happy mood. Emphasize positive message in vibrant colors."

[0479] By inputting this prompt into a generative AI model, it is possible to generate customized ads based on the user's emotions.

[0480] This system not only effectively utilizes the artworks of children in after-school care, but also generates personalized advertising materials according to the user's emotions.In addition, by selling artworks widely through the marketplace, the value of the artworks can be increased.

[0481] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0482] Step 1:

[0483] The user uses a smartphone to take a photo of the artwork drawn by the after-school child. At this time, the smartphone's camera app is used to capture high-resolution image data. Next, the user opens a dedicated application, selects the captured image, and presses the upload button to send the image data to the server. The input is the captured image data, and the output is the image data sent to the server. During this process, the image data is converted into a standard format such as JPEG or PNG and sent to the server.

[0484] Step 2:

[0485] The server temporarily stores the received image data. It then sends the temporarily stored image data to the generative AI model as input data. Specifically, it uses the OpenCV library to preprocess the image data (resize, remove noise, etc.). The input is the uploaded image data, and the output is the preprocessed image data sent to the generative AI model.

[0486] Step 3:

[0487] The generative AI model in the server generates a new designed artwork based on the input image data. For example, a generative AI model such as Stable Diffusion is used. The input is preprocessed image data and a prompt, and the output is the generated designed artwork. An example of the prompt is: "Create a bright and cheerful advertisement using children's art that resonates with a happy mood. Emphasize a positive message in vibrant colors."

[0488] Step 4:

[0489] The server saves the generated designed art as a digital file in dedicated storage and registers its metadata (title, artist, creation date, etc.) in a database. The input is the generated designed art work, and the output is the digital file saved in dedicated storage and the metadata registered in the database.

[0490] Step 5:

[0491] The server prepares the designed art to be exhibited on the marketplace. It references the generated metadata of the designed art, generates exhibit information (price, category, description), and lists it in the appropriate category within the marketplace. The input is the digital file and metadata, and the output is the designed art work listed on the marketplace.

[0492] Step 6:

[0493] Users access the marketplace through a web browser or dedicated application, search for and compare the displayed designed art works, select the work they wish to purchase, and complete the purchase procedure. The input is the designed art work displayed on the marketplace, and the output is the user's purchase request.

[0494] Step 7:

[0495] The server accepts the user's purchase request and processes payment through a secure payment gateway. After payment is complete, the server provides the buyer with a digital or print copy of the designed artwork. The input is the user's purchase request and payment information, and the output is the digital or print copy.

[0496] Step 8:

[0497] The emotion engine in the server analyzes the user's facial expressions and interaction data while the user is browsing the marketplace, and recognizes the user's emotions in real time. The input is the user's facial expression data and interaction data, and the output is the user's emotional data.

[0498] Step 9:

[0499] The server customizes the stylized art as advertising material based on the user's emotional data recognized by the emotion engine. For example, if the emotion is recognized as "joy," advertising material containing bright colors and a positive message is generated. The input is the user's emotional data and the generated stylized art, and the output is customized advertising material.

[0500] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0501] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0502] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0503] [Second embodiment]

[0504] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0505] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0506] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0507] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0508] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0509] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0510] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0511] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0512] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0513] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0514] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0515] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0516] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells them on a marketplace. This system can help children develop artistic sensibilities, secure income, and foster communication with others. The program's processing is explained below in natural language.

[0517] User Artwork Uploads

[0518] Artwork photography and uploading

[0519] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made. Opens the dedicated application, selects the image they have taken, and presses the upload button in the application to send the image data to the server.

[0520] Terminal: Based on the user's operation, sends image data to a specified server address.

[0521] Image acceptance by the server

[0522] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0523] Design using image generation AI models

[0524] Sending image data

[0525] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0526] Design art generation

[0527] Server (within AI model): The AI ​​model generates a new design art piece based on the input image data. The generated design art is saved as a digital file.

[0528] Preservation and Management of Designed Art

[0529] Preserving Design Art

[0530] Server: Stores the generated design art in dedicated storage. Registers the design art metadata (title, artist, creation date, etc.) in a database.

[0531] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[0532] Marketplace Exhibits and Sales

[0533] Preparing to exhibit at the marketplace

[0534] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[0535] Server: Post your design art in a category within the Marketplace.

[0536] User purchase of artwork

[0537] Users: Access the marketplace through a web browser or dedicated application, search and compare exhibited designed artworks, and then complete the purchase process.

[0538] Server: Accepts purchase requests and processes payments through a secure payment gateway. Once payment is complete, the buyer is provided with the digital or print version of the designed artwork.

[0539] Facilitating feedback and communication

[0540] Post-purchase feedback

[0541] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0542] Users can post their thoughts and feedback on artworks and communicate with the children who created them.

[0543] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, as well as providing an income and fostering communication with others.

[0544] The processing flow will be explained below.

[0545] Step 1:

[0546] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made, and then imports the image into a dedicated application.

[0547] Step 2:

[0548] Device: The user presses the "upload" button in the application to send the captured image data to the server.

[0549] Step 3:

[0550] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0551] Step 4:

[0552] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0553] Step 5:

[0554] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[0555] Step 6:

[0556] Server: The generated design art is saved as a digital file in a dedicated storage.

[0557] Step 7:

[0558] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[0559] Step 8:

[0560] Server: Refers to the metadata of the stored designed art and generates exhibition information (price, category, description) to exhibit on the marketplace.

[0561] Step 9:

[0562] Server: Add the design art exhibit information to the relevant category in the marketplace and display it in sections such as the homepage and new items.

[0563] Step 10:

[0564] Users: Access the marketplace using a web browser or dedicated application to search and compare the exhibited designed artworks.

[0565] Step 11:

[0566] User: Select the designed artwork you wish to purchase and open the details page.

[0567] Step 12:

[0568] User: Clicks the purchase button, adds the item to the cart, and proceeds to the payment screen.

[0569] Step 13:

[0570] Server: Receives payment information and processes the payment through a secure payment gateway.

[0571] Step 14:

[0572] Server: Once payment is complete, provide the buyer with digital or print data of the designed art.

[0573] Step 15:

[0574] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0575] Step 16:

[0576] Users: Post their thoughts and feedback on the artworks and communicate with the children who created them.

[0577] Example 1

[0578] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0579] In traditional after-school care programs, there were limited ways for children to widely exhibit and sell their artwork, making it difficult for their artistic activities to be recognized. Furthermore, there was a lack of efficient ways to digitize and design children's artwork, making it difficult to develop children's artistic sensibilities and secure income. Opportunities for communication with others were also limited.

[0580] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0581] In this invention, the server includes means for photographing artwork drawn by children in after-school care and uploading the image data to the server, means for temporarily storing the uploaded image data and sending it as input data to a generative AI model, means for the generative AI model to generate designed art based on the image data, means for storing the generated designed art in dedicated storage and registering its metadata in a database, and means for exhibiting the generated designed art on a marketplace and making it available for sale. This makes it possible to widely publicize children's artwork and efficiently design and sell it, thereby improving children's artistic sensibilities, securing income, and fostering communication with others.

[0582] "After-school care children" refers to children enrolled in elementary school who receive care and guidance after school and on weekends.

[0583] "Artworks" refers to visual artistic expressions such as paintings and illustrations created by after-school care children.

[0584] "Image data" refers to information obtained by photographing an artwork and expressing it in digital form.

[0585] "Server" means a centralized system connected to a computer network that stores, processes, and transmits data.

[0586] "Upload" refers to the act of sending data from a terminal to a server.

[0587] "Temporary storage" refers to the provisional storage of data for a certain period of time.

[0588] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate new designs or information based on input data.

[0589] "Designization" refers to the process of giving a new design or style to an original artwork.

[0590] "Dedicated storage" refers to a storage area reserved for storing specific data.

[0591] "Metadata" refers to information that primarily contains attribute information about data, such as title, author, and creation date.

[0592] A "database" refers to a system that organizes and manages large amounts of data and enables efficient searching and updating.

[0593] "Marketplace" refers to a virtual marketplace for selling and purchasing goods and services over the Internet.

[0594] "Exhibiting" refers to the act of listing a product (in this case, a designed artwork) on the marketplace and making it available for sale.

[0595] "User" refers to anyone who uses the system to upload or purchase artworks.

[0596] "Purchase" refers to the act of a user acquiring an art piece exhibited on the marketplace in exchange for money.

[0597] "Digital data" or "print data" refers to data that is represented electronically or printed on a physical medium such as paper.

[0598] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells them on a marketplace. This system can improve children's artistic sensibilities, secure income, and foster communication with others. The program processing of this system is explained in detail below.

[0599] User Artwork Uploads

[0600] Artwork photography and uploading

[0601] User: Uses the camera on a smartphone or tablet to take a photo of the artwork they have created. Opens the dedicated application, selects the image they have taken, and presses the "Upload" button to send the image data to the server.

[0602] Terminal: Based on the user's operation, sends image data to a specified server address.

[0603] Image acceptance by the server

[0604] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0605] Design using image generation AI models

[0606] Sending image data

[0607] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0608] Design art generation

[0609] Server (within AI model): The generative AI model generates a new design art piece based on the input image data. The generated design art is saved as a digital file.

[0610] Preservation and Management of Designed Art

[0611] Preserving Design Art

[0612] Server: Stores the generated design art in dedicated storage. Registers the design art metadata (title, artist, creation date, etc.) in a database.

[0613] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[0614] Marketplace Exhibits and Sales

[0615] Preparing to exhibit at the marketplace

[0616] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[0617] Server: Post your design art in a category within the Marketplace.

[0618] User purchase of artwork

[0619] Users access the marketplace through a web browser or a dedicated application, search and compare the exhibited designed artworks, select the artwork they like, and complete the purchase process.

[0620] Server: Accepts purchase requests, processes payments through a secure payment gateway, and once payment is complete, provides the buyer with a digital or print copy of the designed artwork.

[0621] Facilitating feedback and communication

[0622] Post-purchase feedback

[0623] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0624] Users can post their thoughts and feedback on artworks and communicate with the children who created them. For example, a purchaser can post a comment saying, "I was very moved by this piece! I'm looking forward to seeing your next piece."

[0625] The system's generative AI model uses the latest deep learning technology, which performs image analysis, style conversion, color adjustment, and other processes. For example, it can convert a simple drawing by a child into a professional design.

[0626] As a concrete example, a user opens a dedicated app and performs an operation using the following prompt sentence:

[0627] Example prompt sentence:

[0628] "Use your smartphone or tablet camera to take a photo of your artwork and upload it using the dedicated application."

[0629] In this way, the artworks of children in after-school care can be designed and distributed through a marketplace, which not only allows the children's artistic talent to be recognized, but also provides an opportunity for them to secure income and communicate with others.

[0630] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0631] Step 1: Photograph and upload your artwork

[0632] User: Uses the camera on a smartphone or tablet to take a photo of their artwork. The input is the artwork and the camera device. The output is the captured image data.

[0633] User: Opens the dedicated application and selects the captured image data. Then, presses the "Upload" button within the application. The input is the captured image data. The output is an instruction to upload.

[0634] Terminal: Sends image data to the server based on user operations. Inputs are image data and upload instructions. Output is the image data sent to the server.

[0635] Step 2: Receiving and temporarily saving image data

[0636] Server: Saves image data received from the terminal in temporary storage. The input is the transmitted image data. The output is the temporarily saved image data.

[0637] Server: Returns a notification to the terminal confirming receipt. The input is a confirmation of receipt of the image data. The output is a notification of receipt confirmation.

[0638] Step 3: Send image data to the AI ​​model

[0639] Server: Inputs the temporarily stored image data into the generative AI model. The input is the temporarily stored image data. The output is the input data to the generative AI model.

[0640] Generative AI model: Analyzes received image data and generates designed art. The input is image data. The output is a designed artwork.

[0641] Step 4: Save your design and register your metadata

[0642] Server: Saves the generated design art in a dedicated storage. The input is the generated design art. The output is the saved design art.

[0643] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in the database. The input is the information of the designed art. The output is the metadata registered in the database.

[0644] Step 5: Prepare and list on the Marketplace

[0645] Server: References the metadata of the designed art and generates exhibition information. The input is the metadata of the designed art. The output is the generated exhibition information.

[0646] Server: Posts designed art in categories within the marketplace. The input is exhibit information. The output is the art work posted on the marketplace.

[0647] Step 6: User purchases artwork

[0648] User: Accesses the marketplace through a web browser or dedicated application to search and compare exhibited designed artworks. The input is the marketplace search criteria. The output is the search results.

[0649] User: Selects a favorite work and completes the purchase procedure. The input is the selected work and purchase intention. The output is a purchase request.

[0650] Server: Accepts purchase requests and processes payments through a secure payment gateway. Inputs are the purchase request and payment information. Output is a confirmation of successful payment.

[0651] Server: Once payment is complete, the server provides the buyer with digital or print data of the designed artwork. The input is a payment completion notice and the designed artwork. The output is the provided data.

[0652] Step 7: Promote feedback and communication

[0653] Server: After a purchase, send emails and notifications to users encouraging them to post ratings and comments. Inputs are purchaser information and notification content. Output is the sent notification.

[0654] Users can post their thoughts and feedback on artworks and communicate with the children who created them. The input is the user's thoughts and feedback. The output is the posted comments.

[0655] By following the above processing steps, this system enables the design of artworks by children in after-school care and their sale on the marketplace, thereby encouraging children to engage in artistic activities, securing income, and fostering communication with others.

[0656] (Application example 1)

[0657] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0658] The conventional system lacked the means to treat the creative activities of after-school care children as digital data and to provide a venue for widely selling their works. Furthermore, there were few opportunities for the works to be evaluated in the market, and the system was not effective enough in improving the children's artistic sensibility and motivation. Furthermore, direct communication between the purchasers and the children who created the works was limited, making it difficult to provide mutual feedback.

[0659] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0660] In this invention, the server includes means for photographing artworks drawn by children in after-school care and uploading the image data to the server, means for inputting the uploaded image data into a generative AI model to generate designed art, means for exhibiting the generated designed art on a marketplace and making it available for sale, means for registering and managing the digital data, and feedback means for allowing users who purchase the artwork to post ratings and comments. This provides a platform where children's artworks can be designed and widely sold, increases children's motivation for artistic activities, and enables them to secure income and communicate with others.

[0661] "Photography" is a method of capturing artwork as digital data using a camera.

[0662] "Server" refers to a computer system that temporarily stores and manages captured image data and performs other processing.

[0663] "Uploading" refers to the act of sending image data captured by a user to a server via the Internet.

[0664] A "generative AI model" is an artificial intelligence algorithm that generates new designed artworks based on input image data.

[0665] "Designification" is the process by which a generative AI model processes a primitive artwork and adds or transforms it with new design elements.

[0666] "Marketplace" is an online platform that lists designed artworks and allows users to search, compare, and purchase them.

[0667] "Digital data" refers to the electronic data format of artworks created by photography or generative AI models.

[0668] "Feedback tools" is a function that allows purchasers to post ratings and comments on works and communicate with the creator.

[0669] "Metadata" refers to data that refers to information associated with a designed artwork (e.g., title, artist, creation date, etc.).

[0670] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells it on a marketplace. The program for realizing this system is explained in natural language. Each step and the specific hardware and software used are specified below.

[0671] Hardware and software used

[0672] Smartphone: For taking photos and uploading image data.

[0673] Server: Accepts image data, runs generative AI models, stores data, and manages the marketplace.

[0674] Generative AI model: Designing image data.

[0675] Program processing

[0676] In this system, users use their smartphones to take photos of artworks and upload the image data to a server using a dedicated application. For example, a user can take a photo of a painting they have drawn with their smartphone camera and tap the upload button in the application to send the image data to the server. The server temporarily stores the image data and inputs it into the generative AI model.

[0677] The generative AI model generates new designed art based on uploaded image data. For example, the model can take a user's drawing and add color palettes and design elements to transform it into a more appealing piece of art. This generated designed art is stored as digital data on a server.

[0678] The server stores the created designed art, registers its metadata (title, artist, creation date, etc.), and prepares it for exhibition on the marketplace. Exhibit information is automatically generated on the marketplace and posted so that users can search, compare, and purchase.

[0679] Users browsing the marketplace can browse the exhibited designed artworks through a web browser or dedicated application. For example, users can search for specific categories or price ranges to find artworks they like. Once a purchase is made, the server processes payment through a secure payment gateway and provides the buyer with a digital or print version of the designed art.

[0680] Furthermore, the server sends notifications to users after purchase, encouraging them to post ratings and comments. This allows purchasers to post their own feedback and communicate with the children who created the artwork. For example, by using a prompt such as, "I would like to design this picture I drew and sell it on the marketplace. Please upload this image and generate a design art," children's creative activities can be promoted.

[0681] As described above, this invention provides a venue where children's artworks can be designed and then exhibited and sold in a marketplace, which will help children develop their artistic sensibilities and creative motivation, secure income, and foster communication with others.

[0682] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0683] Step 1:

[0684] The user uses a smartphone to take a photo of an artwork with the camera. This captured image data becomes the input. The device temporarily stores this image data and displays an upload button through a dedicated application. When the user taps the upload button, the image data is sent to the server. As a result, the image data is saved on the server.

[0685] Step 2:

[0686] The server temporarily stores the received image data and prepares to send it as input data to the generative AI model. The server accepts this input data and sends it to the generative AI model. Specifically, the image data is converted into a specific format. This outputs data in a format that the generative AI model can process.

[0687] Step 3:

[0688] The generative AI model on the server generates a new design art piece based on the input image data. This generated design art is the output. Specifically, the generative AI model analyzes specific features and patterns in the image and adds or transforms new design elements based on this. As a result, a new digital art piece is generated.

[0689] Step 4:

[0690] The server saves the generated design art in dedicated storage and registers its metadata (title, artist, creation date, etc.) in a database. The server manages this data and prepares it for exhibition on the marketplace. Specifically, the fields (attributes) of the generated design art are entered into the database and saved as output.

[0691] Step 5:

[0692] The server generates exhibit information (price, category, description) for the designed art and posts it in categories within the marketplace. Users can browse this information and perform searches and comparisons. As an output, the product information is displayed on the marketplace screen. For example, when a user searches for a specific category or keyword, a list of relevant art works is displayed.

[0693] Step 6:

[0694] The user selects a design art piece they like from the marketplace and completes the purchase. The server accepts the purchase request and processes the payment through a secure payment gateway. After the payment is completed, the server provides the buyer with a digital or print version of the design art. Payment information is used as input, and a purchase completion notification is sent as output.

[0695] Step 7:

[0696] After a purchase, the server sends a notification to the user encouraging them to post a rating and comment. The user posts feedback, expressing their thoughts and opinions about the artwork. This feedback information becomes input, and the server organizes it and displays it on the artwork's page. Specifically, the content of the feedback is saved as text data, and the rating and comment are published as output.

[0697] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0698] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and exhibits and sells them on a marketplace. This system also incorporates an emotion engine that recognizes the user's emotions, analyzes their emotions, and provides customization and recommendation functions according to their individual emotions.

[0699] User Artwork Uploads

[0700] Artwork photography and uploading

[0701] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made. Opens the dedicated application, selects the image they have taken, and presses the upload button in the application to send the image data to the server.

[0702] Terminal: Based on the user's operation, sends image data to a specified server address.

[0703] Image acceptance by the server

[0704] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0705] Design using image generation AI models

[0706] Sending image data

[0707] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0708] Design art generation

[0709] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[0710] Preservation and Management of Designed Art

[0711] Preserving Design Art

[0712] Server: The generated design art is saved as a digital file in a dedicated storage.

[0713] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[0714] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[0715] Marketplace Exhibits and Sales

[0716] Preparing to exhibit at the marketplace

[0717] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[0718] Server: Post your design art in a category within the Marketplace and display it in sections such as the homepage and new arrivals.

[0719] User purchase of artwork

[0720] Users: Access the marketplace through a web browser or dedicated application, search and compare exhibited designed artworks, and then complete the purchase process.

[0721] Server: Accepts purchase requests and processes payments through a secure payment gateway. Once payment is complete, the buyer is provided with the digital or print version of the designed artwork.

[0722] Emotion engine for user emotion recognition and customization

[0723] Emotion recognition by emotion engine

[0724] Server (internal emotion engine): Analyzes user facial expressions and interaction data while users browse the marketplace to recognize user emotions in real time.

[0725] Emotion-based recommendations

[0726] Server: Based on the user's emotional data recognized by the emotion engine, recommends designed art that the user is likely to like.

[0727] Emotional customization

[0728] Server: Based on the user's emotional data, it provides specific customization options for the designed art (e.g., color changes, thematic emphasis, etc.).

[0729] Utilizing Emotional Data

[0730] Server: Improve the ranking and filtering functions of artworks on the marketplace based on user emotion data collected by the emotion engine.

[0731] Facilitating feedback and communication

[0732] Post-purchase feedback

[0733] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0734] Users can post their thoughts and feedback on artworks and communicate with the children who created them.

[0735] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, and by utilizing the emotion engine, it is possible to provide a more personalized user experience.

[0736] The processing flow will be explained below.

[0737] Step 1:

[0738] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made, and then imports the image into a dedicated application.

[0739] Step 2:

[0740] Device: The user presses the "upload" button in the application to send the captured image data to the server.

[0741] Step 3:

[0742] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0743] Step 4:

[0744] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0745] Step 5:

[0746] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[0747] Step 6:

[0748] Server: The generated design art is saved as a digital file in a dedicated storage.

[0749] Step 7:

[0750] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[0751] Step 8:

[0752] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[0753] Step 9:

[0754] Server: Add the design art exhibit information to the relevant category in the marketplace and display it in sections such as the homepage and new items.

[0755] Step 10:

[0756] Server (internal emotion engine): While users browse the marketplace, it collects their facial expressions and interaction data and analyzes their emotions in real time.

[0757] Step 11:

[0758] Server: Analyzes the user's emotions using an emotion engine and recommends artworks that suit the user based on the results.

[0759] Step 12:

[0760] Users: Access the marketplace using a web browser or dedicated application to search and compare the exhibited designed artworks.

[0761] Step 13:

[0762] User: Select the designed artwork you wish to purchase and open the details page.

[0763] Step 14:

[0764] User: Clicks the purchase button, adds the item to the cart, and proceeds to the payment screen.

[0765] Step 15:

[0766] Server: Receives payment information and processes the payment through a secure payment gateway.

[0767] Step 16:

[0768] Server: Once payment is complete, provide the buyer with digital or print data of the designed art.

[0769] Step 17:

[0770] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[0771] Step 18:

[0772] Users: Post their thoughts and feedback on the artworks and communicate with the children who created them.

[0773] Example 2

[0774] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0775] Conventional systems limited opportunities for children in after-school care to share their artwork, making it difficult to maximize its value. Furthermore, the system lacked a personalized user experience and was unable to customize or recommend artwork based on user emotions. Furthermore, it lacked a mechanism for promoting communication between buyers and artists.

[0776] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0777] In this invention, the server includes means for photographing artworks drawn by after-school care children and uploading the image data to the server, means for inputting the uploaded image data into a generative AI model to generate designed art, means for exhibiting the generated designed art on a marketplace and making it available for sale, means for customizing and recommending based on the user's emotions using an emotion engine that recognizes the user's emotions, and means for users to post feedback on designed artworks purchased by the user and promote communication with the artist. This makes it possible to maximize the value of the artworks, realize customization and recommendations based on the user's emotions, and promote communication between purchasers and artists.

[0778] "After-school care children" are children who attend after-school care facilities and primarily spend their time at the facilities after school or during long holidays.

[0779] "Artworks" refers to visual art, including pictures and other creative works drawn by children in after-school care, and are painted on paper, canvas, etc.

[0780] "Image data" refers to data files that digitally represent artwork, and includes common image formats such as JPEG and PNG.

[0781] "Server" refers to a computer system for managing, storing, and processing data over the Internet.

[0782] A "generative AI model" refers to an artificial intelligence algorithm or structure that generates new designs based on input image data.

[0783] "Designed art" refers to new designs generated from original artworks using generative AI models.

[0784] "Marketplace" refers to an online platform where users can exhibit, search for, and purchase artworks.

[0785] An "emotion engine" is an artificial intelligence system that analyzes a user's facial expressions and interaction data and recognizes emotions in real time.

[0786] "Customization" refers to the process of changing the characteristics of designed art according to a user's specific needs and preferences.

[0787] "Recommendation" refers to the function of providing designed art that a user is likely to like based on their emotional data.

[0788] "Feedback" refers to evaluations and comments made by users on artworks, including impressions and opinions of the creators.

[0789] "Digital Data" refers to data in digital format that is transmitted electronically over the Internet.

[0790] "Print data" refers to digital data that has been printed out and put into physical form, such as an artwork printed on paper or canvas.

[0791] MODE FOR CARRYING OUT THE INVENTION

[0792] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and exhibits and sells them on a marketplace. This system also incorporates an emotion engine that recognizes the user's emotions, analyzes their emotions, and provides customization and recommendation functions according to their individual emotions.

[0793] User Artwork Uploads

[0794] Artwork photography and uploading

[0795] User: Uses the camera on their smartphone or tablet to take a picture of a picture they have drawn. They open the dedicated application, select the image they have taken, and press the upload button in the application to send the image data to the server. For example, a user can select a picture they have drawn with the title "Schoolchildren's Work" and press the upload button, and the image will be transferred to the server.

[0796] Terminal: Based on user operation, image data is sent to the specified server address. The progress during sending is indicated by a progress bar, and a success message is displayed when it is completed.

[0797] Image acceptance by the server

[0798] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model. For example, it converts the received JPEG file to PNG format and stores it in a temporary folder.

[0799] Design using image generation AI models

[0800] Sending image data

[0801] Server: Sends the temporarily saved image data to the generative AI model as input data. For example, send the image data using an HTTP POST request.

[0802] Design art generation

[0803] Server (within the AI ​​model): The generative AI model generates new designed artwork based on the input image data. Specifically, the AI ​​model extracts image features and generates new designs based on them. The model's operation is accelerated by the GPU.

[0804] Preservation and Management of Designed Art

[0805] Preserving Design Art

[0806] Server: Stores the generated design art as a digital file in dedicated storage. For example, stores the generated art in the " / storage / designs / " directory.

[0807] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in the database. Inserts the information into the "Designs" table in the database.

[0808] Server: Manages the designed art and prepares it for exhibition on the marketplace. Sends exhibition information to the marketplace via API.

[0809] Marketplace Exhibits and Sales

[0810] Preparing to exhibit at the marketplace

[0811] Server: References the metadata of the designed art and generates exhibit information (price, category, description). Dynamically generates exhibit pages using a template engine.

[0812] Server: List your design art in a category within the Marketplace and display it in the New Arrivals section. Use the category mapping file to register it in the correct category.

[0813] User purchase of artwork

[0814] Users access the Marketplace through a web browser or dedicated application to search, compare, and purchase the designed art on display. For example, they can use search filters to narrow down their search to artworks in the "Abstract Art" category.

[0815] Server: Accepts the purchase request and securely processes the payment through the payment gateway. After payment is complete, the buyer is emailed a download link for the designed art.

[0816] Emotion engine for user emotion recognition and customization

[0817] Emotion recognition by emotion engine

[0818] Server (internal emotion engine): While users browse the marketplace, it analyzes their facial expressions and interaction data to recognize emotions in real time, for example, by capturing their facial expressions using a webcam and analyzing them with facial recognition algorithms.

[0819] Emotion-based recommendations

[0820] Server: Based on the data recognized by the emotion engine, recommends designed art that the user is likely to like. For example, the recommendation algorithm displays artworks similar to those that the user has shown interest in.

[0821] Emotional customization

[0822] Server: Based on the user's emotional data, it offers specific customization options (color tones, thematic highlights, etc.). For example, if the emotional analysis indicates "joy," it recommends bright color options.

[0823] Utilizing Emotional Data

[0824] Server: Improve the ranking display and filtering functions of the marketplace based on the collected sentiment data. The results of the sentiment data analysis are stored in a database and incorporated into the algorithm.

[0825] Facilitating feedback and communication

[0826] Post-purchase feedback

[0827] Server: Send emails and notifications to users after purchase, encouraging them to leave a rating or comment. For example, automatically send a feedback request email within 24 hours of purchase.

[0828] User feedback and communication

[0829] Users: Post their thoughts and feedback on artworks and communicate with the artists. For example, they can enter comments in the app and send them by pressing the post button.

[0830] Prompt Sentence Examples

[0831] Below are some example prompts for the generative AI model:

[0832] "Please create a new design based on this drawing by a child in after-school care. Please emphasize the colors and use brighter tones."

[0833] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, and by utilizing the emotion engine, it is possible to provide a more personalized user experience.

[0834] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0835] Program processing flow

[0836] User Artwork Uploads

[0837] Step 1:

[0838] Users use the camera on their smartphone or tablet to take a picture of a drawing by a child in after-school care. They open the application, click the "Select Image" button, and choose the image from the device's gallery. After selecting, they press the "Upload" button to send the image data to the server.

[0839] Input: Image data of artwork photographed by the user

[0840] Output: Image data sent to the server

[0841] Step 2:

[0842] The terminal transmits the image data selected by the user to the specified server address. At this time, a progress bar is displayed, and a success message is displayed after the transmission is completed.

[0843] Input: User-selected image data

[0844] Output: Image data sent to the server

[0845] Step 3:

[0846] The server temporarily stores the received image data and prepares it for transmission to the generative AI model. Specifically, it converts the received JPEG file into PNG format and stores it in a temporary folder.

[0847] Input: Image data sent to the server

[0848] Output: Temporarily saved image data (PNG format)

[0849] Design using image generation AI models

[0850] Step 4:

[0851] The server sends the temporarily saved image data to the generative AI model as input data. Specifically, the image data is sent using an HTTP POST request.

[0852] Input: Temporarily saved image data (PNG format)

[0853] Output: Image data sent to the generative AI model

[0854] Step 5:

[0855] The server (within the AI ​​model) generates a new design artwork based on the input image data. The AI ​​model extracts image features, performs style conversion based on them, and generates a new design. This process is accelerated by the GPU.

[0856] Input: Image data sent to the generative AI model

[0857] Output: Generated designed artwork

[0858] Preservation and Management of Designed Art

[0859] Step 6:

[0860] The server saves the generated design art as a digital file in dedicated storage. The generated art is saved in the " / storage / designs / " directory.

[0861] Input: Generated designed artwork

[0862] Output: Saved digital file

[0863] Step 7:

[0864] The server registers the metadata of the designed art (title, artist, creation date, etc.) in a database and inserts the information into the "Designs" table in the database.

[0865] Input: Metadata of the designed artwork

[0866] Output: Metadata registered in the database

[0867] Step 8:

[0868] The server manages the designed art and prepares it for exhibition on the marketplace. It sends the exhibition information to the marketplace via API.

[0869] Input: A designed artwork and its metadata

[0870] Output: Ready to be listed on the marketplace

[0871] Marketplace Exhibits and Sales

[0872] Step 9:

[0873] The server references the metadata of the designed art and generates exhibit information (price, category, description), and dynamically generates the exhibit page using a template engine.

[0874] Input: Metadata of the designed artwork

[0875] Output: Generated exhibit information

[0876] Step 10:

[0877] The server posts the design art to a category within the marketplace and displays it in the new arrivals section, using a category mapping file to register it in the correct category.

[0878] Input: Generated exhibit information

[0879] Output: Designed art posted in the Marketplace

[0880] Step 11:

[0881] Users can access the marketplace through a web browser or a dedicated application to search, compare, and purchase the designed art on display. For example, they can use search filters to narrow down their search to artworks in the "Abstract Art" category.

[0882] Input: User search queries and purchase requests

[0883] Output: Purchase procedure completed

[0884] Step 12:

[0885] The server accepts the purchase request, securely processes the payment through the payment gateway, and then emails the buyer a download link for the designed art.

[0886] Input: User purchase request and payment information

[0887] Output: Download link sent

[0888] Emotion engine for user emotion recognition and customization

[0889] Step 13:

[0890] The server (within the emotion engine) analyzes facial expressions and interaction data while users browse the marketplace, recognizing emotions in real time. Facial expressions are captured using a webcam and analyzed with facial recognition algorithms.

[0891] Input: User facial expression data and interaction data

[0892] Output: Real-time recognized emotion data

[0893] Step 14:

[0894] The server recommends designed art that the user is likely to like based on the emotion data recognized by the emotion engine. For example, the recommendation algorithm displays artworks similar to artworks in which the user has shown interest.

[0895] Input: Real-time recognized emotion data

[0896] Output: Recommended designed artwork

[0897] Step 15:

[0898] The server offers specific customization options (color tones, thematic highlights, etc.) based on the user's emotional data. For example, if the emotional analysis indicates "joy," it recommends bright color options.

[0899] Input: Real-time recognized emotion data

[0900] Output: Customization options provided

[0901] Step 16:

[0902] The server uses the collected emotional data to improve the ranking and filtering functions of the marketplace, storing the results of the analysis of the emotional data in a database and incorporating them into the algorithm.

[0903] Input: Collected emotion data

[0904] Output: Improved ranking display and filtering capabilities

[0905] Facilitating feedback and communication

[0906] Step 17:

[0907] The server sends emails and notifications to users after purchase, encouraging them to post ratings and comments. Feedback request emails are automatically sent within 24 hours of purchase.

[0908] Input: Purchase completion information

[0909] Output: Feedback request sent

[0910] Step 18:

[0911] Users can post their thoughts and feedback on artworks and communicate with the artists. They can enter their comments in the app and send them by pressing the post button.

[0912] Input: User feedback

[0913] Output: Communication with the author has been completed

[0914] (Application example 2)

[0915] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0916] Conventional art sales systems lack the ability to customize artworks or recommend products based on individual user preferences, making it difficult to meet diverse user needs. Furthermore, they lack the ability to generate effective visual content based on emotions, especially in advertising campaigns. Furthermore, there is a lack of a mechanism for effectively utilizing artworks drawn by after-school care children.

[0917] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[0918] In this invention, the server includes a means for photographing artwork drawn by after-school children and uploading the image data to the server, a means for inputting the uploaded image data into a generative AI model to generate designed art, a means for exhibiting the generated designed art on a marketplace and making it available for sale, and a means for analyzing user emotion data and customizing the designed art as advertising material based on the emotions. This enables customization of artwork and recommendations according to user needs, and can generate effective visual content based on emotions, particularly in advertising campaigns. It also enables widespread and effective use of artwork drawn by after-school children.

[0919] "After-school care children" refers to children who attend after-school care facilities.

[0920] "Artworks" refers to creative works, including paintings and illustrations, drawn by after-school care children.

[0921] A "generative AI model" refers to an artificial intelligence algorithm that generates new images or designs based on input data.

[0922] "Customization" refers to adjusting or changing design or functionality to suit a specific purpose or user preference.

[0923] "Emotional data" refers to data that indicates the user's emotional state, obtained by analyzing the user's facial expressions, voice, interactions, etc.

[0924] "Marketplace" refers to a platform where products can be exhibited, searched for, and purchased online.

[0925] "Advertising Materials" means the visual content and designs used in an Advertising Campaign.

[0926] "User" refers to an individual who uses an artwork or purchases an artwork on the Marketplace.

[0927] "Image data" refers to the digital image files obtained when photographing an artwork.

[0928] "Designed art" refers to artworks that have been processed and transformed using generative AI models.

[0929] This invention is a system that photographs artwork drawn by children in after-school care, uploads the image data to a server, and generates designed art using a generative AI model. This system can exhibit and sell the designed art on a marketplace. It also includes a function to analyze user emotion data and customize it as advertising material based on the emotion. Specific embodiments of the system are described below.

[0930] System Overview

[0931] Hardware

[0932] Smartphone: Used to take photos and upload artwork.

[0933] Server: Stores image data, processes designs using generative AI models, analyzes emotional data, and manages the marketplace.

[0934] User terminal: Used as access to the marketplace and as a user interface.

[0935] software

[0936] OpenCV: A library used to process and save images.

[0937] face_recognition: A library used to analyze the user's facial landmarks.

[0938] EmotionRecognizer: Software for recognizing user emotions.

[0939] design_generator: Software that generates design art using generative AI models.

[0940] Processing Description

[0941] 1. Upload your artwork

[0942] Users use their smartphones to take pictures of artworks drawn by children in daycare centers. The image data is then uploaded to the server via a dedicated application. The images taken with the smartphone camera are converted into an appropriate format using OpenCV.

[0943] 2. Designing with generative AI models

[0944] The server inputs the uploaded image data into a generative AI model to generate new designed art. This generation process uses a generative AI model such as Stable Diffusion.

[0945] 3. Emotion Data Analysis

[0946] When a user uses the marketplace, the server collects the user's facial images and interaction data, and analyzes the user's emotions using face_recognition and EmotionRecognizer. The analyzed emotional data is used to customize the designed art as advertising materials.

[0947] 4. Exhibiting on the Marketplace

[0948] The generated design art is displayed on the marketplace by the server, and users can access the marketplace using their own devices to search, compare, and purchase the displayed design art works.

[0949] Specific examples

[0950] Example prompt for a generative AI model:

[0951] Prompt: "Create a bright and cheerful advertisement using children's art that resonates with a happy mood. Emphasize positive message in vibrant colors."

[0952] By inputting this prompt into a generative AI model, it is possible to generate customized ads based on the user's emotions.

[0953] This system not only effectively utilizes the artworks of children in after-school care, but also generates personalized advertising materials according to the user's emotions.In addition, by selling artworks widely through the marketplace, the value of the artworks can be increased.

[0954] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0955] Step 1:

[0956] The user uses a smartphone to take a photo of the artwork drawn by the after-school child. At this time, the smartphone's camera app is used to capture high-resolution image data. Next, the user opens a dedicated application, selects the captured image, and presses the upload button to send the image data to the server. The input is the captured image data, and the output is the image data sent to the server. During this process, the image data is converted into a standard format such as JPEG or PNG and sent to the server.

[0957] Step 2:

[0958] The server temporarily stores the received image data. It then sends the temporarily stored image data to the generative AI model as input data. Specifically, it uses the OpenCV library to preprocess the image data (resize, remove noise, etc.). The input is the uploaded image data, and the output is the preprocessed image data sent to the generative AI model.

[0959] Step 3:

[0960] The generative AI model in the server generates a new designed artwork based on the input image data. For example, a generative AI model such as Stable Diffusion is used. The input is preprocessed image data and a prompt, and the output is the generated designed artwork. An example of the prompt is: "Create a bright and cheerful advertisement using children's art that resonates with a happy mood. Emphasize a positive message in vibrant colors."

[0961] Step 4:

[0962] The server saves the generated designed art as a digital file in dedicated storage and registers its metadata (title, artist, creation date, etc.) in a database. The input is the generated designed art work, and the output is the digital file saved in dedicated storage and the metadata registered in the database.

[0963] Step 5:

[0964] The server prepares the designed art to be exhibited on the marketplace. It references the generated metadata of the designed art, generates exhibit information (price, category, description), and lists it in the appropriate category within the marketplace. The input is the digital file and metadata, and the output is the designed art work listed on the marketplace.

[0965] Step 6:

[0966] Users access the marketplace through a web browser or dedicated application, search for and compare the displayed designed art works, select the work they wish to purchase, and complete the purchase procedure. The input is the designed art work displayed on the marketplace, and the output is the user's purchase request.

[0967] Step 7:

[0968] The server accepts the user's purchase request and processes payment through a secure payment gateway. After payment is complete, the server provides the buyer with a digital or print copy of the designed artwork. The input is the user's purchase request and payment information, and the output is the digital or print copy.

[0969] Step 8:

[0970] The emotion engine in the server analyzes the user's facial expressions and interaction data while the user is browsing the marketplace, and recognizes the user's emotions in real time. The input is the user's facial expression data and interaction data, and the output is the user's emotional data.

[0971] Step 9:

[0972] The server customizes the stylized art as advertising material based on the user's emotional data recognized by the emotion engine. For example, if the emotion is recognized as "joy," advertising material containing bright colors and a positive message is generated. The input is the user's emotional data and the generated stylized art, and the output is customized advertising material.

[0973] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0974] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0975] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[0976] [Third embodiment]

[0977] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[0978] 5, the data processing system 310 includes the data processing device 12 and a headset type terminal 314. An example of the data processing device 12 is a server.

[0979] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0980] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[0981] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0982] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0983] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0984] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0985] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0986] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0987] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0988] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[0989] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells them on a marketplace. This system can help children develop artistic sensibilities, secure income, and foster communication with others. The program's processing is explained below in natural language.

[0990] User Artwork Uploads

[0991] Artwork photography and uploading

[0992] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made. Opens the dedicated application, selects the image they have taken, and presses the upload button in the application to send the image data to the server.

[0993] Terminal: Based on the user's operation, sends image data to a specified server address.

[0994] Image acceptance by the server

[0995] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[0996] Design using image generation AI models

[0997] Sending image data

[0998] Server: Sends the temporarily saved image data to the generative AI model as input data.

[0999] Design art generation

[1000] Server (within AI model): The AI ​​model generates a new design art piece based on the input image data. The generated design art is saved as a digital file.

[1001] Preservation and Management of Designed Art

[1002] Preserving Design Art

[1003] Server: Stores the generated design art in dedicated storage. Registers the design art metadata (title, artist, creation date, etc.) in a database.

[1004] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[1005] Marketplace Exhibits and Sales

[1006] Preparing to exhibit at the marketplace

[1007] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[1008] Server: Post your design art in a category within the Marketplace.

[1009] User purchase of artwork

[1010] Users: Access the marketplace through a web browser or dedicated application, search and compare exhibited designed artworks, and then complete the purchase process.

[1011] Server: Accepts purchase requests and processes payments through a secure payment gateway. Once payment is complete, the buyer is provided with the digital or print version of the designed artwork.

[1012] Facilitating feedback and communication

[1013] Post-purchase feedback

[1014] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1015] Users can post their thoughts and feedback on artworks and communicate with the children who created them.

[1016] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, as well as providing an income and fostering communication with others.

[1017] The processing flow will be explained below.

[1018] Step 1:

[1019] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made, and then imports the image into a dedicated application.

[1020] Step 2:

[1021] Device: The user presses the "upload" button in the application to send the captured image data to the server.

[1022] Step 3:

[1023] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[1024] Step 4:

[1025] Server: Sends the temporarily saved image data to the generative AI model as input data.

[1026] Step 5:

[1027] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[1028] Step 6:

[1029] Server: The generated design art is saved as a digital file in a dedicated storage.

[1030] Step 7:

[1031] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[1032] Step 8:

[1033] Server: Refers to the metadata of the stored designed art and generates exhibition information (price, category, description) to exhibit on the marketplace.

[1034] Step 9:

[1035] Server: Add the design art exhibit information to the relevant category in the marketplace and display it in sections such as the homepage and new items.

[1036] Step 10:

[1037] Users: Access the marketplace using a web browser or dedicated application to search and compare the exhibited designed artworks.

[1038] Step 11:

[1039] User: Select the designed artwork you wish to purchase and open the details page.

[1040] Step 12:

[1041] User: Clicks the purchase button, adds the item to the cart, and proceeds to the payment screen.

[1042] Step 13:

[1043] Server: Receives payment information and processes the payment through a secure payment gateway.

[1044] Step 14:

[1045] Server: Once payment is complete, provide the buyer with digital or print data of the designed art.

[1046] Step 15:

[1047] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1048] Step 16:

[1049] Users: Post their thoughts and feedback on the artworks and communicate with the children who created them.

[1050] Example 1

[1051] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1052] In traditional after-school care programs, there were limited ways for children to widely exhibit and sell their artwork, making it difficult for their artistic activities to be recognized. Furthermore, there was a lack of efficient ways to digitize and design children's artwork, making it difficult to develop children's artistic sensibilities and secure income. Opportunities for communication with others were also limited.

[1053] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1054] In this invention, the server includes means for photographing artwork drawn by children in after-school care and uploading the image data to the server, means for temporarily storing the uploaded image data and sending it as input data to a generative AI model, means for the generative AI model to generate designed art based on the image data, means for storing the generated designed art in dedicated storage and registering its metadata in a database, and means for exhibiting the generated designed art on a marketplace and making it available for sale. This makes it possible to widely publicize children's artwork and efficiently design and sell it, thereby improving children's artistic sensibilities, securing income, and fostering communication with others.

[1055] "After-school care children" refers to children enrolled in elementary school who receive care and guidance after school and on weekends.

[1056] "Artworks" refers to visual artistic expressions such as paintings and illustrations created by after-school care children.

[1057] "Image data" refers to information obtained by photographing an artwork and expressing it in digital form.

[1058] "Server" means a centralized system connected to a computer network that stores, processes, and transmits data.

[1059] "Upload" refers to the act of sending data from a terminal to a server.

[1060] "Temporary storage" refers to the provisional storage of data for a certain period of time.

[1061] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate new designs or information based on input data.

[1062] "Designization" refers to the process of giving a new design or style to an original artwork.

[1063] "Dedicated storage" refers to a storage area reserved for storing specific data.

[1064] "Metadata" refers to information that primarily contains attribute information about data, such as title, author, and creation date.

[1065] A "database" refers to a system that organizes and manages large amounts of data and enables efficient searching and updating.

[1066] "Marketplace" refers to a virtual marketplace for selling and purchasing goods and services over the Internet.

[1067] "Exhibiting" refers to the act of listing a product (in this case, a designed artwork) on the marketplace and making it available for sale.

[1068] "User" refers to anyone who uses the system to upload or purchase artworks.

[1069] "Purchase" refers to the act of a user acquiring an art piece exhibited on the marketplace in exchange for money.

[1070] "Digital data" or "print data" refers to data that is represented electronically or printed on a physical medium such as paper.

[1071] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells them on a marketplace. This system can improve children's artistic sensibilities, secure income, and foster communication with others. The program processing of this system is explained in detail below.

[1072] User Artwork Uploads

[1073] Artwork photography and uploading

[1074] User: Uses the camera on a smartphone or tablet to take a photo of the artwork they have created. Opens the dedicated application, selects the image they have taken, and presses the "Upload" button to send the image data to the server.

[1075] Terminal: Based on the user's operation, sends image data to a specified server address.

[1076] Image acceptance by the server

[1077] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[1078] Design using image generation AI models

[1079] Sending image data

[1080] Server: Sends the temporarily saved image data to the generative AI model as input data.

[1081] Design art generation

[1082] Server (within AI model): The generative AI model generates a new design art piece based on the input image data. The generated design art is saved as a digital file.

[1083] Preservation and Management of Designed Art

[1084] Preserving Design Art

[1085] Server: Stores the generated design art in dedicated storage. Registers the design art metadata (title, artist, creation date, etc.) in a database.

[1086] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[1087] Marketplace Exhibits and Sales

[1088] Preparing to exhibit at the marketplace

[1089] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[1090] Server: Post your design art in a category within the Marketplace.

[1091] User purchase of artwork

[1092] Users access the marketplace through a web browser or a dedicated application, search and compare the exhibited designed artworks, select the artwork they like, and complete the purchase process.

[1093] Server: Accepts purchase requests, processes payments through a secure payment gateway, and once payment is complete, provides the buyer with a digital or print copy of the designed artwork.

[1094] Facilitating feedback and communication

[1095] Post-purchase feedback

[1096] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1097] Users can post their thoughts and feedback on artworks and communicate with the children who created them. For example, a purchaser can post a comment saying, "I was very moved by this piece! I'm looking forward to seeing your next piece."

[1098] The system's generative AI model uses the latest deep learning technology, which performs image analysis, style conversion, color adjustment, and other processes. For example, it can convert a simple drawing by a child into a professional design.

[1099] As a concrete example, a user opens a dedicated app and performs an operation using the following prompt sentence:

[1100] Example prompt sentence:

[1101] "Use your smartphone or tablet camera to take a photo of your artwork and upload it using the dedicated application."

[1102] In this way, the artworks of children in after-school care can be designed and distributed through a marketplace, which not only allows the children's artistic talent to be recognized, but also provides an opportunity for them to secure income and communicate with others.

[1103] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1104] Step 1: Photograph and upload your artwork

[1105] User: Uses the camera on a smartphone or tablet to take a photo of their artwork. The input is the artwork and the camera device. The output is the captured image data.

[1106] User: Opens the dedicated application and selects the captured image data. Then, presses the "Upload" button within the application. The input is the captured image data. The output is an instruction to upload.

[1107] Terminal: Sends image data to the server based on user operations. Inputs are image data and upload instructions. Output is the image data sent to the server.

[1108] Step 2: Receiving and temporarily saving image data

[1109] Server: Saves image data received from the terminal in temporary storage. The input is the transmitted image data. The output is the temporarily saved image data.

[1110] Server: Returns a notification to the terminal confirming receipt. The input is a confirmation of receipt of the image data. The output is a notification of receipt confirmation.

[1111] Step 3: Send image data to the AI ​​model

[1112] Server: Inputs the temporarily stored image data into the generative AI model. The input is the temporarily stored image data. The output is the input data to the generative AI model.

[1113] Generative AI model: Analyzes received image data and generates designed art. The input is image data. The output is a designed artwork.

[1114] Step 4: Save your design and register your metadata

[1115] Server: Saves the generated design art in a dedicated storage. The input is the generated design art. The output is the saved design art.

[1116] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in the database. The input is the information of the designed art. The output is the metadata registered in the database.

[1117] Step 5: Prepare and list on the Marketplace

[1118] Server: References the metadata of the designed art and generates exhibition information. The input is the metadata of the designed art. The output is the generated exhibition information.

[1119] Server: Posts designed art in categories within the marketplace. The input is exhibit information. The output is the art work posted on the marketplace.

[1120] Step 6: User purchases artwork

[1121] User: Accesses the marketplace through a web browser or dedicated application to search and compare exhibited designed artworks. The input is the marketplace search criteria. The output is the search results.

[1122] User: Selects a favorite work and completes the purchase procedure. The input is the selected work and purchase intention. The output is a purchase request.

[1123] Server: Accepts purchase requests and processes payments through a secure payment gateway. Inputs are the purchase request and payment information. Output is a confirmation of successful payment.

[1124] Server: Once payment is complete, the server provides the buyer with digital or print data of the designed artwork. The input is a payment completion notice and the designed artwork. The output is the provided data.

[1125] Step 7: Promote feedback and communication

[1126] Server: After a purchase, send emails and notifications to users encouraging them to post ratings and comments. Inputs are purchaser information and notification content. Output is the sent notification.

[1127] Users can post their thoughts and feedback on artworks and communicate with the children who created them. The input is the user's thoughts and feedback. The output is the posted comments.

[1128] By following the above processing steps, this system enables the design of artworks by children in after-school care and their sale on the marketplace, thereby encouraging children to engage in artistic activities, securing income, and fostering communication with others.

[1129] (Application example 1)

[1130] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1131] The conventional system lacked the means to treat the creative activities of after-school care children as digital data and to provide a venue for widely selling their works. Furthermore, there were few opportunities for the works to be evaluated in the market, and the system was not effective enough in improving the children's artistic sensibility and motivation. Furthermore, direct communication between the purchasers and the children who created the works was limited, making it difficult to provide mutual feedback.

[1132] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1133] In this invention, the server includes means for photographing artworks drawn by children in after-school care and uploading the image data to the server, means for inputting the uploaded image data into a generative AI model to generate designed art, means for exhibiting the generated designed art on a marketplace and making it available for sale, means for registering and managing the digital data, and feedback means for allowing users who purchase the artwork to post ratings and comments. This provides a platform where children's artworks can be designed and widely sold, increases children's motivation for artistic activities, and enables them to secure income and communicate with others.

[1134] "Photography" is a method of capturing artwork as digital data using a camera.

[1135] "Server" refers to a computer system that temporarily stores and manages captured image data and performs other processing.

[1136] "Uploading" refers to the act of sending image data captured by a user to a server via the Internet.

[1137] A "generative AI model" is an artificial intelligence algorithm that generates new designed artworks based on input image data.

[1138] "Designification" is the process by which a generative AI model processes a primitive artwork and adds or transforms it with new design elements.

[1139] "Marketplace" is an online platform that lists designed artworks and allows users to search, compare, and purchase them.

[1140] "Digital data" refers to the electronic data format of artworks created by photography or generative AI models.

[1141] "Feedback tools" is a function that allows purchasers to post ratings and comments on works and communicate with the creator.

[1142] "Metadata" refers to data that refers to information associated with a designed artwork (e.g., title, artist, creation date, etc.).

[1143] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells it on a marketplace. The program for realizing this system is explained in natural language. Each step and the specific hardware and software used are specified below.

[1144] Hardware and software used

[1145] Smartphone: For taking photos and uploading image data.

[1146] Server: Accepts image data, runs generative AI models, stores data, and manages the marketplace.

[1147] Generative AI model: Designing image data.

[1148] Program processing

[1149] In this system, users use their smartphones to take photos of artworks and upload the image data to a server using a dedicated application. For example, a user can take a photo of a painting they have drawn with their smartphone camera and tap the upload button in the application to send the image data to the server. The server temporarily stores the image data and inputs it into the generative AI model.

[1150] The generative AI model generates new designed art based on uploaded image data. For example, the model can take a user's drawing and add color palettes and design elements to transform it into a more appealing piece of art. This generated designed art is stored as digital data on a server.

[1151] The server stores the created designed art, registers its metadata (title, artist, creation date, etc.), and prepares it for exhibition on the marketplace. Exhibit information is automatically generated on the marketplace and posted so that users can search, compare, and purchase.

[1152] Users browsing the marketplace can browse the exhibited designed artworks through a web browser or dedicated application. For example, users can search for specific categories or price ranges to find artworks they like. Once a purchase is made, the server processes payment through a secure payment gateway and provides the buyer with a digital or print version of the designed art.

[1153] Furthermore, the server sends notifications to users after purchase, encouraging them to post ratings and comments. This allows purchasers to post their own feedback and communicate with the children who created the artwork. For example, by using a prompt such as, "I would like to design this picture I drew and sell it on the marketplace. Please upload this image and generate a design art," children's creative activities can be promoted.

[1154] As described above, this invention provides a venue where children's artworks can be designed and then exhibited and sold in a marketplace, which will help children develop their artistic sensibilities and creative motivation, secure income, and foster communication with others.

[1155] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1156] Step 1:

[1157] The user uses a smartphone to take a photo of an artwork with the camera. This captured image data becomes the input. The device temporarily stores this image data and displays an upload button through a dedicated application. When the user taps the upload button, the image data is sent to the server. As a result, the image data is saved on the server.

[1158] Step 2:

[1159] The server temporarily stores the received image data and prepares to send it as input data to the generative AI model. The server accepts this input data and sends it to the generative AI model. Specifically, the image data is converted into a specific format. This outputs data in a format that the generative AI model can process.

[1160] Step 3:

[1161] The generative AI model on the server generates a new design art piece based on the input image data. This generated design art is the output. Specifically, the generative AI model analyzes specific features and patterns in the image and adds or transforms new design elements based on this. As a result, a new digital art piece is generated.

[1162] Step 4:

[1163] The server saves the generated design art in dedicated storage and registers its metadata (title, artist, creation date, etc.) in a database. The server manages this data and prepares it for exhibition on the marketplace. Specifically, the fields (attributes) of the generated design art are entered into the database and saved as output.

[1164] Step 5:

[1165] The server generates exhibit information (price, category, description) for the designed art and posts it in categories within the marketplace. Users can browse this information and perform searches and comparisons. As an output, the product information is displayed on the marketplace screen. For example, when a user searches for a specific category or keyword, a list of relevant art works is displayed.

[1166] Step 6:

[1167] The user selects a design art piece they like from the marketplace and completes the purchase. The server accepts the purchase request and processes the payment through a secure payment gateway. After the payment is completed, the server provides the buyer with a digital or print version of the design art. Payment information is used as input, and a purchase completion notification is sent as output.

[1168] Step 7:

[1169] After a purchase, the server sends a notification to the user encouraging them to post a rating and comment. The user posts feedback, expressing their thoughts and opinions about the artwork. This feedback information becomes input, and the server organizes it and displays it on the artwork's page. Specifically, the content of the feedback is saved as text data, and the rating and comment are published as output.

[1170] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1171] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and exhibits and sells them on a marketplace. This system also incorporates an emotion engine that recognizes the user's emotions, analyzes their emotions, and provides customization and recommendation functions according to their individual emotions.

[1172] User Artwork Uploads

[1173] Artwork photography and uploading

[1174] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made. Opens the dedicated application, selects the image they have taken, and presses the upload button in the application to send the image data to the server.

[1175] Terminal: Based on the user's operation, sends image data to a specified server address.

[1176] Image acceptance by the server

[1177] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[1178] Design using image generation AI models

[1179] Sending image data

[1180] Server: Sends the temporarily saved image data to the generative AI model as input data.

[1181] Design art generation

[1182] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[1183] Preservation and Management of Designed Art

[1184] Preserving Design Art

[1185] Server: The generated design art is saved as a digital file in a dedicated storage.

[1186] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[1187] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[1188] Marketplace Exhibits and Sales

[1189] Preparing to exhibit at the marketplace

[1190] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[1191] Server: Post your design art in a category within the Marketplace and display it in sections such as the homepage and new arrivals.

[1192] User purchase of artwork

[1193] Users: Access the marketplace through a web browser or dedicated application, search and compare exhibited designed artworks, and then complete the purchase process.

[1194] Server: Accepts purchase requests and processes payments through a secure payment gateway. Once payment is complete, the buyer is provided with the digital or print version of the designed artwork.

[1195] Emotion engine for user emotion recognition and customization

[1196] Emotion recognition by emotion engine

[1197] Server (internal emotion engine): Analyzes user facial expressions and interaction data while users browse the marketplace to recognize user emotions in real time.

[1198] Emotion-based recommendations

[1199] Server: Based on the user's emotional data recognized by the emotion engine, recommends designed art that the user is likely to like.

[1200] Emotional customization

[1201] Server: Based on the user's emotional data, it provides specific customization options for the designed art (e.g., color changes, thematic emphasis, etc.).

[1202] Utilizing Emotional Data

[1203] Server: Improve the ranking and filtering functions of artworks on the marketplace based on user emotion data collected by the emotion engine.

[1204] Facilitating feedback and communication

[1205] Post-purchase feedback

[1206] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1207] Users can post their thoughts and feedback on artworks and communicate with the children who created them.

[1208] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, and by utilizing the emotion engine, it is possible to provide a more personalized user experience.

[1209] The processing flow will be explained below.

[1210] Step 1:

[1211] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made, and then imports the image into a dedicated application.

[1212] Step 2:

[1213] Device: The user presses the "upload" button in the application to send the captured image data to the server.

[1214] Step 3:

[1215] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[1216] Step 4:

[1217] Server: Sends the temporarily saved image data to the generative AI model as input data.

[1218] Step 5:

[1219] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[1220] Step 6:

[1221] Server: The generated design art is saved as a digital file in a dedicated storage.

[1222] Step 7:

[1223] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[1224] Step 8:

[1225] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[1226] Step 9:

[1227] Server: Add the design art exhibit information to the relevant category in the marketplace and display it in sections such as the homepage and new items.

[1228] Step 10:

[1229] Server (internal emotion engine): While users browse the marketplace, it collects their facial expressions and interaction data and analyzes their emotions in real time.

[1230] Step 11:

[1231] Server: Analyzes the user's emotions using an emotion engine and recommends artworks that suit the user based on the results.

[1232] Step 12:

[1233] Users: Access the marketplace using a web browser or dedicated application to search and compare the exhibited designed artworks.

[1234] Step 13:

[1235] User: Select the designed artwork you wish to purchase and open the details page.

[1236] Step 14:

[1237] User: Clicks the purchase button, adds the item to the cart, and proceeds to the payment screen.

[1238] Step 15:

[1239] Server: Receives payment information and processes the payment through a secure payment gateway.

[1240] Step 16:

[1241] Server: Once payment is complete, provide the buyer with digital or print data of the designed art.

[1242] Step 17:

[1243] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1244] Step 18:

[1245] Users: Post their thoughts and feedback on the artworks and communicate with the children who created them.

[1246] Example 2

[1247] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1248] Conventional systems limited opportunities for children in after-school care to share their artwork, making it difficult to maximize its value. Furthermore, the system lacked a personalized user experience and was unable to customize or recommend artwork based on user emotions. Furthermore, it lacked a mechanism for promoting communication between buyers and artists.

[1249] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1250] In this invention, the server includes means for photographing artworks drawn by after-school care children and uploading the image data to the server, means for inputting the uploaded image data into a generative AI model to generate designed art, means for exhibiting the generated designed art on a marketplace and making it available for sale, means for customizing and recommending based on the user's emotions using an emotion engine that recognizes the user's emotions, and means for users to post feedback on designed artworks purchased by the user and promote communication with the artist. This makes it possible to maximize the value of the artworks, realize customization and recommendations based on the user's emotions, and promote communication between purchasers and artists.

[1251] "After-school care children" are children who attend after-school care facilities and primarily spend their time at the facilities after school or during long holidays.

[1252] "Artworks" refers to visual art, including pictures and other creative works drawn by children in after-school care, and are painted on paper, canvas, etc.

[1253] "Image data" refers to data files that digitally represent artwork, and includes common image formats such as JPEG and PNG.

[1254] "Server" refers to a computer system for managing, storing, and processing data over the Internet.

[1255] A "generative AI model" refers to an artificial intelligence algorithm or structure that generates new designs based on input image data.

[1256] "Designed art" refers to new designs generated from original artworks using generative AI models.

[1257] "Marketplace" refers to an online platform where users can exhibit, search for, and purchase artworks.

[1258] An "emotion engine" is an artificial intelligence system that analyzes a user's facial expressions and interaction data and recognizes emotions in real time.

[1259] "Customization" refers to the process of changing the characteristics of designed art according to a user's specific needs and preferences.

[1260] "Recommendation" refers to the function of providing designed art that a user is likely to like based on their emotional data.

[1261] "Feedback" refers to evaluations and comments made by users on artworks, including impressions and opinions of the creators.

[1262] "Digital Data" refers to data in digital format that is transmitted electronically over the Internet.

[1263] "Print data" refers to digital data that has been printed out and put into physical form, such as an artwork printed on paper or canvas.

[1264] MODE FOR CARRYING OUT THE INVENTION

[1265] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and exhibits and sells them on a marketplace. This system also incorporates an emotion engine that recognizes the user's emotions, analyzes their emotions, and provides customization and recommendation functions according to their individual emotions.

[1266] User Artwork Uploads

[1267] Artwork photography and uploading

[1268] User: Uses the camera on their smartphone or tablet to take a picture of a picture they have drawn. They open the dedicated application, select the image they have taken, and press the upload button in the application to send the image data to the server. For example, a user can select a picture they have drawn with the title "Schoolchildren's Work" and press the upload button, and the image will be transferred to the server.

[1269] Terminal: Based on user operation, image data is sent to the specified server address. The progress during sending is indicated by a progress bar, and a success message is displayed when it is completed.

[1270] Image acceptance by the server

[1271] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model. For example, it converts the received JPEG file to PNG format and stores it in a temporary folder.

[1272] Design using image generation AI models

[1273] Sending image data

[1274] Server: Sends the temporarily saved image data to the generative AI model as input data. For example, send the image data using an HTTP POST request.

[1275] Design art generation

[1276] Server (within the AI ​​model): The generative AI model generates new designed artwork based on the input image data. Specifically, the AI ​​model extracts image features and generates new designs based on them. The model's operation is accelerated by the GPU.

[1277] Preservation and Management of Designed Art

[1278] Preserving Design Art

[1279] Server: Stores the generated design art as a digital file in dedicated storage. For example, stores the generated art in the " / storage / designs / " directory.

[1280] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in the database. Inserts the information into the "Designs" table in the database.

[1281] Server: Manages the designed art and prepares it for exhibition on the marketplace. Sends exhibition information to the marketplace via API.

[1282] Marketplace Exhibits and Sales

[1283] Preparing to exhibit at the marketplace

[1284] Server: References the metadata of the designed art and generates exhibit information (price, category, description). Dynamically generates exhibit pages using a template engine.

[1285] Server: List your design art in a category within the Marketplace and display it in the New Arrivals section. Use the category mapping file to register it in the correct category.

[1286] User purchase of artwork

[1287] Users access the Marketplace through a web browser or dedicated application to search, compare, and purchase the designed art on display. For example, they can use search filters to narrow down their search to artworks in the "Abstract Art" category.

[1288] Server: Accepts the purchase request and securely processes the payment through the payment gateway. After payment is complete, the buyer is emailed a download link for the designed art.

[1289] Emotion engine for user emotion recognition and customization

[1290] Emotion recognition by emotion engine

[1291] Server (internal emotion engine): While users browse the marketplace, it analyzes their facial expressions and interaction data to recognize emotions in real time, for example, by capturing their facial expressions using a webcam and analyzing them with facial recognition algorithms.

[1292] Emotion-based recommendations

[1293] Server: Based on the data recognized by the emotion engine, recommends designed art that the user is likely to like. For example, the recommendation algorithm displays artworks similar to those that the user has shown interest in.

[1294] Emotional customization

[1295] Server: Based on the user's emotional data, it offers specific customization options (color tones, thematic highlights, etc.). For example, if the emotional analysis indicates "joy," it recommends bright color options.

[1296] Utilizing Emotional Data

[1297] Server: Improve the ranking display and filtering functions of the marketplace based on the collected sentiment data. The results of the sentiment data analysis are stored in a database and incorporated into the algorithm.

[1298] Facilitating feedback and communication

[1299] Post-purchase feedback

[1300] Server: Send emails and notifications to users after purchase, encouraging them to leave a rating or comment. For example, automatically send a feedback request email within 24 hours of purchase.

[1301] User feedback and communication

[1302] Users: Post their thoughts and feedback on artworks and communicate with the artists. For example, they can enter comments in the app and send them by pressing the post button.

[1303] Prompt Sentence Examples

[1304] Below are some example prompts for the generative AI model:

[1305] "Please create a new design based on this drawing by a child in after-school care. Please emphasize the colors and use brighter tones."

[1306] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, and by utilizing the emotion engine, it is possible to provide a more personalized user experience.

[1307] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1308] Program processing flow

[1309] User Artwork Uploads

[1310] Step 1:

[1311] Users use the camera on their smartphone or tablet to take a picture of a drawing by a child in after-school care. They open the application, click the "Select Image" button, and choose the image from the device's gallery. After selecting, they press the "Upload" button to send the image data to the server.

[1312] Input: Image data of artwork photographed by the user

[1313] Output: Image data sent to the server

[1314] Step 2:

[1315] The terminal transmits the image data selected by the user to the specified server address. At this time, a progress bar is displayed, and a success message is displayed after the transmission is completed.

[1316] Input: User-selected image data

[1317] Output: Image data sent to the server

[1318] Step 3:

[1319] The server temporarily stores the received image data and prepares it for transmission to the generative AI model. Specifically, it converts the received JPEG file into PNG format and stores it in a temporary folder.

[1320] Input: Image data sent to the server

[1321] Output: Temporarily saved image data (PNG format)

[1322] Design using image generation AI models

[1323] Step 4:

[1324] The server sends the temporarily saved image data to the generative AI model as input data. Specifically, the image data is sent using an HTTP POST request.

[1325] Input: Temporarily saved image data (PNG format)

[1326] Output: Image data sent to the generative AI model

[1327] Step 5:

[1328] The server (within the AI ​​model) generates a new design artwork based on the input image data. The AI ​​model extracts image features, performs style conversion based on them, and generates a new design. This process is accelerated by the GPU.

[1329] Input: Image data sent to the generative AI model

[1330] Output: Generated designed artwork

[1331] Preservation and Management of Designed Art

[1332] Step 6:

[1333] The server saves the generated design art as a digital file in dedicated storage. The generated art is saved in the " / storage / designs / " directory.

[1334] Input: Generated designed artwork

[1335] Output: Saved digital file

[1336] Step 7:

[1337] The server registers the metadata of the designed art (title, artist, creation date, etc.) in a database and inserts the information into the "Designs" table in the database.

[1338] Input: Metadata of the designed artwork

[1339] Output: Metadata registered in the database

[1340] Step 8:

[1341] The server manages the designed art and prepares it for exhibition on the marketplace. It sends the exhibition information to the marketplace via API.

[1342] Input: A designed artwork and its metadata

[1343] Output: Ready to be listed on the marketplace

[1344] Marketplace Exhibits and Sales

[1345] Step 9:

[1346] The server references the metadata of the designed art and generates exhibit information (price, category, description), and dynamically generates the exhibit page using a template engine.

[1347] Input: Metadata of the designed artwork

[1348] Output: Generated exhibit information

[1349] Step 10:

[1350] The server posts the design art to a category within the marketplace and displays it in the new arrivals section, using a category mapping file to register it in the correct category.

[1351] Input: Generated exhibit information

[1352] Output: Designed art posted in the Marketplace

[1353] Step 11:

[1354] Users can access the marketplace through a web browser or a dedicated application to search, compare, and purchase the designed art on display. For example, they can use search filters to narrow down their search to artworks in the "Abstract Art" category.

[1355] Input: User search queries and purchase requests

[1356] Output: Purchase procedure completed

[1357] Step 12:

[1358] The server accepts the purchase request, securely processes the payment through the payment gateway, and then emails the buyer a download link for the designed art.

[1359] Input: User purchase request and payment information

[1360] Output: Download link sent

[1361] Emotion engine for user emotion recognition and customization

[1362] Step 13:

[1363] The server (within the emotion engine) analyzes facial expressions and interaction data while users browse the marketplace, recognizing emotions in real time. Facial expressions are captured using a webcam and analyzed with facial recognition algorithms.

[1364] Input: User facial expression data and interaction data

[1365] Output: Real-time recognized emotion data

[1366] Step 14:

[1367] The server recommends designed art that the user is likely to like based on the emotion data recognized by the emotion engine. For example, the recommendation algorithm displays artworks similar to artworks in which the user has shown interest.

[1368] Input: Real-time recognized emotion data

[1369] Output: Recommended designed artwork

[1370] Step 15:

[1371] The server offers specific customization options (color tones, thematic highlights, etc.) based on the user's emotional data. For example, if the emotional analysis indicates "joy," it recommends bright color options.

[1372] Input: Real-time recognized emotion data

[1373] Output: Customization options provided

[1374] Step 16:

[1375] The server uses the collected emotional data to improve the ranking and filtering functions of the marketplace, storing the results of the analysis of the emotional data in a database and incorporating them into the algorithm.

[1376] Input: Collected emotion data

[1377] Output: Improved ranking display and filtering capabilities

[1378] Facilitating feedback and communication

[1379] Step 17:

[1380] The server sends emails and notifications to users after purchase, encouraging them to post ratings and comments. Feedback request emails are automatically sent within 24 hours of purchase.

[1381] Input: Purchase completion information

[1382] Output: Feedback request sent

[1383] Step 18:

[1384] Users can post their thoughts and feedback on artworks and communicate with the artists. They can enter their comments in the app and send them by pressing the post button.

[1385] Input: User feedback

[1386] Output: Communication with the author has been completed

[1387] (Application example 2)

[1388] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1389] Conventional art sales systems lack the ability to customize artworks or recommend products based on individual user preferences, making it difficult to meet diverse user needs. Furthermore, they lack the ability to generate effective visual content based on emotions, especially in advertising campaigns. Furthermore, there is a lack of a mechanism for effectively utilizing artworks drawn by after-school care children.

[1390] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1391] In this invention, the server includes a means for photographing artwork drawn by after-school children and uploading the image data to the server, a means for inputting the uploaded image data into a generative AI model to generate designed art, a means for exhibiting the generated designed art on a marketplace and making it available for sale, and a means for analyzing user emotion data and customizing the designed art as advertising material based on the emotions. This enables customization of artwork and recommendations according to user needs, and can generate effective visual content based on emotions, particularly in advertising campaigns. It also enables widespread and effective use of artwork drawn by after-school children.

[1392] "After-school care children" refers to children who attend after-school care facilities.

[1393] "Artworks" refers to creative works, including paintings and illustrations, drawn by after-school care children.

[1394] A "generative AI model" refers to an artificial intelligence algorithm that generates new images or designs based on input data.

[1395] "Customization" refers to adjusting or changing design or functionality to suit a specific purpose or user preference.

[1396] "Emotional data" refers to data that indicates the user's emotional state, obtained by analyzing the user's facial expressions, voice, interactions, etc.

[1397] "Marketplace" refers to a platform where products can be exhibited, searched for, and purchased online.

[1398] "Advertising Materials" means the visual content and designs used in an Advertising Campaign.

[1399] "User" refers to an individual who uses an artwork or purchases an artwork on the Marketplace.

[1400] "Image data" refers to the digital image files obtained when photographing an artwork.

[1401] "Designed art" refers to artworks that have been processed and transformed using generative AI models.

[1402] This invention is a system that photographs artwork drawn by children in after-school care, uploads the image data to a server, and generates designed art using a generative AI model. This system can exhibit and sell the designed art on a marketplace. It also includes a function to analyze user emotion data and customize it as advertising material based on the emotion. Specific embodiments of the system are described below.

[1403] System Overview

[1404] Hardware

[1405] Smartphone: Used to take photos and upload artwork.

[1406] Server: Stores image data, processes designs using generative AI models, analyzes emotional data, and manages the marketplace.

[1407] User terminal: Used as access to the marketplace and as a user interface.

[1408] software

[1409] OpenCV: A library used to process and save images.

[1410] face_recognition: A library used to analyze the user's facial landmarks.

[1411] EmotionRecognizer: Software for recognizing user emotions.

[1412] design_generator: Software that generates design art using generative AI models.

[1413] Processing Description

[1414] 1. Upload your artwork

[1415] Users use their smartphones to take pictures of artworks drawn by children in daycare centers. The image data is then uploaded to the server via a dedicated application. The images taken with the smartphone camera are converted into an appropriate format using OpenCV.

[1416] 2. Designing with generative AI models

[1417] The server inputs the uploaded image data into a generative AI model to generate new designed art. This generation process uses a generative AI model such as Stable Diffusion.

[1418] 3. Emotion Data Analysis

[1419] When a user uses the marketplace, the server collects the user's facial images and interaction data, and analyzes the user's emotions using face_recognition and EmotionRecognizer. The analyzed emotional data is used to customize the designed art as advertising materials.

[1420] 4. Exhibiting on the Marketplace

[1421] The generated design art is displayed on the marketplace by the server, and users can access the marketplace using their own devices to search, compare, and purchase the displayed design art works.

[1422] Specific examples

[1423] Example prompt for a generative AI model:

[1424] Prompt: "Create a bright and cheerful advertisement using children's art that resonates with a happy mood. Emphasize positive message in vibrant colors."

[1425] By inputting this prompt into a generative AI model, it is possible to generate customized ads based on the user's emotions.

[1426] This system not only effectively utilizes the artworks of children in after-school care, but also generates personalized advertising materials according to the user's emotions.In addition, by selling artworks widely through the marketplace, the value of the artworks can be increased.

[1427] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1428] Step 1:

[1429] The user uses a smartphone to take a photo of the artwork drawn by the after-school child. At this time, the smartphone's camera app is used to capture high-resolution image data. Next, the user opens a dedicated application, selects the captured image, and presses the upload button to send the image data to the server. The input is the captured image data, and the output is the image data sent to the server. During this process, the image data is converted into a standard format such as JPEG or PNG and sent to the server.

[1430] Step 2:

[1431] The server temporarily stores the received image data. It then sends the temporarily stored image data to the generative AI model as input data. Specifically, it uses the OpenCV library to preprocess the image data (resize, remove noise, etc.). The input is the uploaded image data, and the output is the preprocessed image data sent to the generative AI model.

[1432] Step 3:

[1433] The generative AI model in the server generates a new designed artwork based on the input image data. For example, a generative AI model such as Stable Diffusion is used. The input is preprocessed image data and a prompt, and the output is the generated designed artwork. An example of the prompt is: "Create a bright and cheerful advertisement using children's art that resonates with a happy mood. Emphasize a positive message in vibrant colors."

[1434] Step 4:

[1435] The server saves the generated designed art as a digital file in dedicated storage and registers its metadata (title, artist, creation date, etc.) in a database. The input is the generated designed art work, and the output is the digital file saved in dedicated storage and the metadata registered in the database.

[1436] Step 5:

[1437] The server prepares the designed art to be exhibited on the marketplace. It references the generated metadata of the designed art, generates exhibit information (price, category, description), and lists it in the appropriate category within the marketplace. The input is the digital file and metadata, and the output is the designed art work listed on the marketplace.

[1438] Step 6:

[1439] Users access the marketplace through a web browser or dedicated application, search for and compare the displayed designed art works, select the work they wish to purchase, and complete the purchase procedure. The input is the designed art work displayed on the marketplace, and the output is the user's purchase request.

[1440] Step 7:

[1441] The server accepts the user's purchase request and processes payment through a secure payment gateway. After payment is complete, the server provides the buyer with a digital or print copy of the designed artwork. The input is the user's purchase request and payment information, and the output is the digital or print copy.

[1442] Step 8:

[1443] The emotion engine in the server analyzes the user's facial expressions and interaction data while the user is browsing the marketplace, and recognizes the user's emotions in real time. The input is the user's facial expression data and interaction data, and the output is the user's emotional data.

[1444] Step 9:

[1445] The server customizes the stylized art as advertising material based on the user's emotional data recognized by the emotion engine. For example, if the emotion is recognized as "joy," advertising material containing bright colors and a positive message is generated. The input is the user's emotional data and the generated stylized art, and the output is customized advertising material.

[1446] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1447] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1448] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1449] [Fourth embodiment]

[1450] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1451] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1452] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1453] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1454] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1455] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1456] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1457] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1458] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1459] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1460] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1461] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1462] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1463] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells them on a marketplace. This system can help children develop artistic sensibilities, secure income, and foster communication with others. The program's processing is explained below in natural language.

[1464] User Artwork Uploads

[1465] Artwork photography and uploading

[1466] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made. Opens the dedicated application, selects the image they have taken, and presses the upload button in the application to send the image data to the server.

[1467] Terminal: Based on the user's operation, sends image data to a specified server address.

[1468] Image acceptance by the server

[1469] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[1470] Design using image generation AI models

[1471] Sending image data

[1472] Server: Sends the temporarily saved image data to the generative AI model as input data.

[1473] Design art generation

[1474] Server (within AI model): The AI ​​model generates a new design art piece based on the input image data. The generated design art is saved as a digital file.

[1475] Preservation and Management of Designed Art

[1476] Preserving Design Art

[1477] Server: Stores the generated design art in dedicated storage. Registers the design art metadata (title, artist, creation date, etc.) in a database.

[1478] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[1479] Marketplace exhibits and sales

[1480] Preparing to exhibit at the marketplace

[1481] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[1482] Server: Post your design art in a category within the Marketplace.

[1483] User purchase of artwork

[1484] Users: Access the marketplace through a web browser or dedicated application, search and compare exhibited designed artworks, and then complete the purchase process.

[1485] Server: Accepts purchase requests and processes payments through a secure payment gateway. Once payment is complete, the buyer is provided with the digital or print version of the designed artwork.

[1486] Facilitating feedback and communication

[1487] Post-purchase feedback

[1488] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1489] Users can post their thoughts and feedback on artworks and communicate with the children who created them.

[1490] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, as well as providing an income and fostering communication with others.

[1491] The processing flow will be explained below.

[1492] Step 1:

[1493] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made, and then imports the image into a dedicated application.

[1494] Step 2:

[1495] Device: The user presses the "upload" button in the application to send the captured image data to the server.

[1496] Step 3:

[1497] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[1498] Step 4:

[1499] Server: Sends the temporarily saved image data to the generative AI model as input data.

[1500] Step 5:

[1501] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[1502] Step 6:

[1503] Server: The generated design art is saved as a digital file in a dedicated storage.

[1504] Step 7:

[1505] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[1506] Step 8:

[1507] Server: Refers to the metadata of the stored designed art and generates exhibition information (price, category, description) to exhibit on the marketplace.

[1508] Step 9:

[1509] Server: Add the design art exhibit information to the relevant category in the marketplace and display it in sections such as the homepage and new items.

[1510] Step 10:

[1511] Users: Access the marketplace using a web browser or dedicated application to search and compare the exhibited designed artworks.

[1512] Step 11:

[1513] User: Select the designed artwork you wish to purchase and open the details page.

[1514] Step 12:

[1515] User: Clicks the purchase button, adds the item to the cart, and proceeds to the payment screen.

[1516] Step 13:

[1517] Server: Receives payment information and processes the payment through a secure payment gateway.

[1518] Step 14:

[1519] Server: Once payment is complete, provide the buyer with digital or print data of the designed art.

[1520] Step 15:

[1521] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1522] Step 16:

[1523] Users: Post their thoughts and feedback on the artworks and communicate with the children who created them.

[1524] Example 1

[1525] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1526] In traditional after-school care programs, there were limited ways for children to widely exhibit and sell their artwork, making it difficult for their artistic activities to be recognized. Furthermore, there was a lack of efficient ways to digitize and design children's artwork, making it difficult to develop children's artistic sensibilities and secure income. Opportunities for communication with others were also limited.

[1527] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1528] In this invention, the server includes means for photographing artwork drawn by children in after-school care and uploading the image data to the server, means for temporarily storing the uploaded image data and sending it as input data to a generative AI model, means for the generative AI model to generate designed art based on the image data, means for storing the generated designed art in dedicated storage and registering its metadata in a database, and means for exhibiting the generated designed art on a marketplace and making it available for sale. This makes it possible to widely publicize children's artwork and efficiently design and sell it, thereby improving children's artistic sensibilities, securing income, and fostering communication with others.

[1529] "After-school care children" refers to children enrolled in elementary school who receive care and guidance after school and on weekends.

[1530] "Artworks" refers to visual artistic expressions such as paintings and illustrations created by after-school care children.

[1531] "Image data" refers to information obtained by photographing an artwork and expressing it in digital form.

[1532] "Server" means a centralized system connected to a computer network that stores, processes, and transmits data.

[1533] "Upload" refers to the act of sending data from a terminal to a server.

[1534] "Temporary storage" refers to the provisional storage of data for a certain period of time.

[1535] A "generative AI model" refers to an algorithm or program that uses artificial intelligence technology to generate new designs or information based on input data.

[1536] "Designization" refers to the process of giving a new design or style to an original artwork.

[1537] "Dedicated storage" refers to a storage area reserved for storing specific data.

[1538] "Metadata" refers to information that primarily contains attribute information about data, such as title, author, and creation date.

[1539] A "database" refers to a system that organizes and manages large amounts of data and enables efficient searching and updating.

[1540] "Marketplace" refers to a virtual marketplace for selling and purchasing goods and services over the Internet.

[1541] "Exhibiting" refers to the act of listing a product (in this case, a designed artwork) on the marketplace and making it available for sale.

[1542] "User" refers to anyone who uses the system to upload or purchase artworks.

[1543] "Purchase" refers to the act of a user acquiring an art piece exhibited on the marketplace in exchange for money.

[1544] "Digital data" or "print data" refers to data that is represented electronically or printed on a physical medium such as paper.

[1545] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells them on a marketplace. This system can improve children's artistic sensibilities, secure income, and foster communication with others. The program processing of this system is explained in detail below.

[1546] User Artwork Uploads

[1547] Artwork photography and uploading

[1548] User: Uses the camera on a smartphone or tablet to take a photo of the artwork they have created. Opens the dedicated application, selects the image they have taken, and presses the "Upload" button to send the image data to the server.

[1549] Terminal: Based on the user's operation, sends image data to a specified server address.

[1550] Image acceptance by the server

[1551] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[1552] Design using image generation AI models

[1553] Sending image data

[1554] Server: Sends the temporarily saved image data to the generative AI model as input data.

[1555] Design art generation

[1556] Server (within AI model): The generative AI model generates a new design art piece based on the input image data. The generated design art is saved as a digital file.

[1557] Preservation and Management of Designed Art

[1558] Preserving Design Art

[1559] Server: Stores the generated design art in dedicated storage. Registers the design art metadata (title, artist, creation date, etc.) in a database.

[1560] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[1561] Marketplace exhibits and sales

[1562] Preparing to exhibit at the marketplace

[1563] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[1564] Server: Post your design art in a category within the Marketplace.

[1565] User purchase of artwork

[1566] Users access the marketplace through a web browser or a dedicated application, search and compare the exhibited designed artworks, select the artwork they like, and complete the purchase process.

[1567] Server: Accepts purchase requests, processes payments through a secure payment gateway, and once payment is complete, provides the buyer with a digital or print copy of the designed artwork.

[1568] Facilitating feedback and communication

[1569] Post-purchase feedback

[1570] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1571] Users can post their thoughts and feedback on artworks and communicate with the children who created them. For example, a purchaser can post a comment saying, "I was very moved by this piece! I'm looking forward to seeing your next piece."

[1572] The system's generative AI model uses the latest deep learning technology, which performs image analysis, style conversion, color adjustment, and other processes. For example, it can convert a simple drawing by a child into a professional design.

[1573] As a concrete example, a user opens a dedicated app and performs an operation using the following prompt sentence:

[1574] Example prompt sentence:

[1575] "Use your smartphone or tablet camera to take a photo of your artwork and upload it using the dedicated application."

[1576] In this way, the artworks of children in after-school care can be designed and distributed through a marketplace, which not only allows the children's artistic talent to be recognized, but also provides an opportunity for them to secure income and communicate with others.

[1577] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1578] Step 1: Photograph and upload your artwork

[1579] User: Uses the camera on a smartphone or tablet to take a photo of their artwork. The input is the artwork and the camera device. The output is the captured image data.

[1580] User: Opens the dedicated application and selects the captured image data. Then, presses the "Upload" button within the application. The input is the captured image data. The output is an instruction to upload.

[1581] Terminal: Sends image data to the server based on user operations. Inputs are image data and upload instructions. Output is the image data sent to the server.

[1582] Step 2: Receiving and temporarily saving image data

[1583] Server: Saves image data received from the terminal in temporary storage. The input is the transmitted image data. The output is the temporarily saved image data.

[1584] Server: Returns a notification to the terminal confirming receipt. The input is a confirmation of receipt of the image data. The output is a notification of receipt confirmation.

[1585] Step 3: Send image data to the AI ​​model

[1586] Server: Inputs the temporarily saved image data into the generative AI model. The input is the temporarily saved image data. The output is the input data to the generative AI model.

[1587] Generative AI model: Analyzes received image data and generates designed art. The input is image data. The output is a designed artwork.

[1588] Step 4: Save your design and register your metadata

[1589] Server: Saves the generated design art in a dedicated storage. The input is the generated design art. The output is the saved design art.

[1590] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in the database. The input is the information of the designed art. The output is the metadata registered in the database.

[1591] Step 5: Prepare and list on the Marketplace

[1592] Server: References the metadata of the designed art and generates exhibition information. The input is the metadata of the designed art. The output is the generated exhibition information.

[1593] Server: Posts designed art in categories within the marketplace. The input is exhibit information. The output is the art work posted on the marketplace.

[1594] Step 6: User purchases artwork

[1595] User: Accesses the marketplace through a web browser or dedicated application to search and compare exhibited designed artworks. The input is the marketplace search criteria. The output is the search results.

[1596] User: Selects the work they like and completes the purchase process. The input is the selected work and their intention to purchase. The output is a purchase request.

[1597] Server: Accepts purchase requests and processes payments through a secure payment gateway. Inputs are the purchase request and payment information. Output is a payment completion notification.

[1598] Server: Once payment is complete, the server provides the buyer with digital or print data of the designed artwork. The input is a payment completion notice and the designed artwork. The output is the provided data.

[1599] Step 7: Promote feedback and communication

[1600] Server: After a purchase, send emails and notifications to users encouraging them to post ratings and comments. Inputs are purchaser information and notification content. Output is the sent notification.

[1601] Users can post their thoughts and feedback on artworks and communicate with the children who created them. The input is the user's thoughts and feedback. The output is the posted comments.

[1602] By following the above processing steps, this system enables the design of artworks by children in after-school care and their sale on the marketplace, thereby encouraging children to engage in artistic activities, securing income, and fostering communication with others.

[1603] (Application example 1)

[1604] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1605] The conventional system lacked the means to treat the creative activities of after-school care children as digital data and to provide a venue for widely selling their works. Furthermore, there were few opportunities for the works to be evaluated in the market, and the system was not effective enough in improving the children's artistic sensibility and motivation. Furthermore, direct communication between the purchasers and the children who created the works was limited, making it difficult to provide mutual feedback.

[1606] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1607] In this invention, the server includes means for photographing artworks drawn by children in after-school care and uploading the image data to the server, means for inputting the uploaded image data into a generative AI model to generate designed art, means for exhibiting the generated designed art on a marketplace and making it available for sale, means for registering and managing the digital data, and feedback means for allowing users who purchase the artwork to post ratings and comments. This provides a platform where children's artworks can be designed and widely sold, increases children's motivation for artistic activities, and enables them to secure income and communicate with others.

[1608] "Photography" is a method of capturing artwork as digital data using a camera.

[1609] "Server" refers to a computer system that temporarily stores and manages captured image data and performs other processing.

[1610] "Uploading" refers to the act of sending image data captured by a user to a server via the Internet.

[1611] A "generative AI model" is an artificial intelligence algorithm that generates new designed artworks based on input image data.

[1612] "Designification" is the process by which a generative AI model processes a primitive artwork and adds or transforms it into new design elements.

[1613] "Marketplace" is an online platform that lists designed artworks and allows users to search, compare, and purchase them.

[1614] "Digital data" refers to the electronic data format of artworks created by photography or generative AI models.

[1615] "Feedback tools" is a function that allows purchasers to post ratings and comments on works and communicate with the creator.

[1616] "Metadata" refers to data that refers to information associated with a designed artwork (e.g., title, artist, creation date, etc.).

[1617] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and then exhibits and sells it on a marketplace. The program for realizing this system is explained in natural language. Each step and the specific hardware and software used are specified below.

[1618] Hardware and software used

[1619] Smartphone: For taking photos and uploading image data.

[1620] Server: Accepts image data, runs generative AI models, stores data, and manages the marketplace.

[1621] Generative AI model: Designing image data.

[1622] Program processing

[1623] In this system, users use their smartphones to take photos of artworks and upload the image data to a server using a dedicated application. For example, a user can take a photo of a painting they have drawn with their smartphone camera and tap the upload button in the application to send the image data to the server. The server temporarily stores the image data and inputs it into the generative AI model.

[1624] The generative AI model generates new designed art based on uploaded image data. For example, the model can take a user's drawing and add color palettes and design elements to transform it into a more appealing piece of art. This generated designed art is stored as digital data on a server.

[1625] The server stores the created designed art, registers its metadata (title, artist, creation date, etc.), and prepares it for exhibition on the marketplace. Exhibit information is automatically generated on the marketplace and posted so that users can search, compare, and purchase.

[1626] Users browsing the marketplace can browse the exhibited designed artworks through a web browser or dedicated application. For example, users can search for specific categories or price ranges to find artworks they like. Once a purchase is made, the server processes payment through a secure payment gateway and provides the buyer with a digital or print version of the designed art.

[1627] Furthermore, the server sends notifications to users after purchase, encouraging them to post ratings and comments. This allows purchasers to post their own feedback and communicate with the children who created the artwork. For example, by using a prompt such as, "I would like to design this picture I drew and sell it on the marketplace. Please upload this image and generate a design art," children's creative activities can be promoted.

[1628] As described above, this invention provides a venue where children's artworks can be designed and then exhibited and sold in a marketplace, which will help children develop their artistic sensibilities and creative motivation, secure income, and foster communication with others.

[1629] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1630] Step 1:

[1631] The user uses a smartphone to take a photo of an artwork with the camera. This captured image data becomes the input. The device temporarily stores this image data and displays an upload button through a dedicated application. When the user taps the upload button, the image data is sent to the server. As a result, the image data is saved on the server.

[1632] Step 2:

[1633] The server temporarily stores the received image data and prepares to send it as input data to the generative AI model. The server accepts this input data and sends it to the generative AI model. Specifically, the image data is converted into a specific format. This outputs data in a format that the generative AI model can process.

[1634] Step 3:

[1635] The generative AI model on the server generates a new design art piece based on the input image data. This generated design art is the output. Specifically, the generative AI model analyzes specific features and patterns in the image and adds or transforms new design elements based on this. As a result, a new digital art piece is generated.

[1636] Step 4:

[1637] The server saves the generated design art in dedicated storage and registers its metadata (title, artist, creation date, etc.) in a database. The server manages this data and prepares it for exhibition on the marketplace. Specifically, the fields (attributes) of the generated design art are entered into the database and saved as output.

[1638] Step 5:

[1639] The server generates exhibit information (price, category, description) for the designed art and posts it in categories within the marketplace. Users can browse this information and perform searches and comparisons. As an output, the product information is displayed on the marketplace screen. For example, when a user searches for a specific category or keyword, a list of relevant art works is displayed.

[1640] Step 6:

[1641] The user selects a design art piece they like from the marketplace and completes the purchase. The server accepts the purchase request and processes the payment through a secure payment gateway. After the payment is completed, the server provides the buyer with a digital or print version of the design art. Payment information is used as input, and a purchase completion notification is sent as output.

[1642] Step 7:

[1643] After a purchase, the server sends a notification to the user encouraging them to post a rating and comment. The user posts feedback, expressing their thoughts and opinions about the artwork. This feedback information becomes input, and the server organizes it and displays it on the artwork's page. Specifically, the content of the feedback is saved as text data, and the rating and comment are published as output.

[1644] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1645] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and exhibits and sells them on a marketplace. This system also incorporates an emotion engine that recognizes the user's emotions, analyzes their emotions, and provides customization and recommendation functions according to their individual emotions.

[1646] User Artwork Uploads

[1647] Artwork photography and uploading

[1648] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made. Opens the dedicated application, selects the image they have taken, and presses the upload button in the application to send the image data to the server.

[1649] Terminal: Based on the user's operation, sends image data to a specified server address.

[1650] Image acceptance by the server

[1651] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[1652] Design using image generation AI models

[1653] Sending image data

[1654] Server: Sends the temporarily saved image data to the generative AI model as input data.

[1655] Design art generation

[1656] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[1657] Preservation and Management of Designed Art

[1658] Preserving Design Art

[1659] Server: The generated design art is saved as a digital file in a dedicated storage.

[1660] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[1661] Server: Manages the designed art and prepares it for exhibition on the marketplace.

[1662] Marketplace Exhibits and Sales

[1663] Preparing to exhibit at the marketplace

[1664] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[1665] Server: Post your design art in a category within the Marketplace and display it in sections such as the homepage and new arrivals.

[1666] User purchase of artwork

[1667] Users: Access the marketplace through a web browser or dedicated application, search and compare exhibited designed artworks, and then complete the purchase process.

[1668] Server: Accepts purchase requests and processes payments through a secure payment gateway. Once payment is complete, the buyer is provided with the digital or print version of the designed artwork.

[1669] Emotion engine for user emotion recognition and customization

[1670] Emotion recognition by emotion engine

[1671] Server (internal emotion engine): Analyzes user facial expressions and interaction data while users browse the marketplace to recognize user emotions in real time.

[1672] Emotion-based recommendations

[1673] Server: Based on the user's emotional data recognized by the emotion engine, recommends designed art that the user is likely to like.

[1674] Emotional customization

[1675] Server: Based on the user's emotional data, it provides specific customization options for the designed art (e.g., color changes, thematic emphasis, etc.).

[1676] Utilizing Emotional Data

[1677] Server: Improve the ranking and filtering functions of artworks on the marketplace based on user emotion data collected by the emotion engine.

[1678] Facilitating feedback and communication

[1679] Post-purchase feedback

[1680] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1681] Users can post their thoughts and feedback on artworks and communicate with the children who created them.

[1682] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, and by utilizing the emotion engine, it is possible to provide a more personalized user experience.

[1683] The processing flow will be explained below.

[1684] Step 1:

[1685] User: Uses the camera on a smartphone or tablet to take a picture of the drawing they have made, and then imports the image into a dedicated application.

[1686] Step 2:

[1687] Device: The user presses the "upload" button in the application to send the captured image data to the server.

[1688] Step 3:

[1689] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model.

[1690] Step 4:

[1691] Server: Sends the temporarily saved image data to the generative AI model as input data.

[1692] Step 5:

[1693] Server (within AI model): The generative AI model generates a new design art piece based on the input image data.

[1694] Step 6:

[1695] Server: The generated design art is saved as a digital file in a dedicated storage.

[1696] Step 7:

[1697] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in a database.

[1698] Step 8:

[1699] Server: References the metadata of the designed art and generates exhibit information (price, category, description).

[1700] Step 9:

[1701] Server: Add the design art exhibit information to the relevant category in the marketplace and display it in sections such as the homepage and new items.

[1702] Step 10:

[1703] Server (internal emotion engine): While users browse the marketplace, it collects their facial expressions and interaction data and analyzes their emotions in real time.

[1704] Step 11:

[1705] Server: Analyzes the user's emotions using an emotion engine and recommends artworks that suit the user based on the results.

[1706] Step 12:

[1707] Users: Access the marketplace using a web browser or dedicated application to search and compare the exhibited designed artworks.

[1708] Step 13:

[1709] User: Select the designed artwork you wish to purchase and open the details page.

[1710] Step 14:

[1711] User: Clicks the purchase button, adds the item to the cart, and proceeds to the payment screen.

[1712] Step 15:

[1713] Server: Receives payment information and processes the payment through a secure payment gateway.

[1714] Step 16:

[1715] Server: Once payment is complete, provide the buyer with digital or print data of the designed art.

[1716] Step 17:

[1717] Server: After a purchase, users are sent emails and notifications encouraging them to leave ratings and comments.

[1718] Step 18:

[1719] Users: Post their thoughts and feedback on the artworks and communicate with the children who created them.

[1720] Example 2

[1721] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1722] Conventional systems limited opportunities for children in after-school care to share their artwork, making it difficult to maximize its value. Furthermore, the system lacked a personalized user experience and was unable to customize or recommend artwork based on user emotions. Furthermore, it lacked a mechanism for promoting communication between buyers and artists.

[1723] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1724] In this invention, the server includes means for photographing artworks drawn by after-school care children and uploading the image data to the server, means for inputting the uploaded image data into a generative AI model to generate designed art, means for exhibiting the generated designed art on a marketplace and making it available for sale, means for customizing and recommending based on the user's emotions using an emotion engine that recognizes the user's emotions, and means for users to post feedback on designed artworks purchased by the user and promote communication with the artist. This makes it possible to maximize the value of the artworks, realize customization and recommendations based on the user's emotions, and promote communication between purchasers and artists.

[1725] "After-school care children" are children who attend after-school care facilities and primarily spend their time at the facilities after school or during long holidays.

[1726] "Artworks" refers to visual art, including pictures and other creative works drawn by children in after-school care, and are painted on paper, canvas, etc.

[1727] "Image data" refers to data files that digitally represent artwork, and includes common image formats such as JPEG and PNG.

[1728] "Server" refers to a computer system for managing, storing, and processing data over the Internet.

[1729] A "generative AI model" refers to an artificial intelligence algorithm or structure that generates new designs based on input image data.

[1730] "Designed art" refers to new designs generated from original artworks using generative AI models.

[1731] "Marketplace" refers to an online platform where users can exhibit, search for, and purchase artworks.

[1732] An "emotion engine" is an artificial intelligence system that analyzes a user's facial expressions and interaction data and recognizes emotions in real time.

[1733] "Customization" refers to the process of changing the characteristics of designed art according to a user's specific needs and preferences.

[1734] "Recommendation" refers to the function of providing designed art that a user is likely to like based on their emotional data.

[1735] "Feedback" refers to evaluations and comments made by users on artworks, including impressions and opinions of the creators.

[1736] "Digital Data" refers to data in digital format that is transmitted electronically over the Internet.

[1737] "Print data" refers to digital data that has been printed out and put into physical form, such as an artwork printed on paper or canvas.

[1738] MODE FOR CARRYING OUT THE INVENTION

[1739] This invention is a system that uses a generative AI model to design artwork drawn by children in after-school care, and exhibits and sells them on a marketplace. This system also incorporates an emotion engine that recognizes the user's emotions, analyzes their emotions, and provides customization and recommendation functions according to their individual emotions.

[1740] User Artwork Uploads

[1741] Artwork photography and uploading

[1742] User: Uses the camera on their smartphone or tablet to take a picture of a picture they have drawn. They open the dedicated application, select the image they have taken, and press the upload button in the application to send the image data to the server. For example, a user can select a picture they have drawn with the title "Schoolchildren's Work" and press the upload button, and the image will be transferred to the server.

[1743] Terminal: Based on user operation, image data is sent to the specified server address. The progress during sending is indicated by a progress bar, and a success message is displayed when it is completed.

[1744] Image acceptance by the server

[1745] Server: Temporarily stores the received image data and prepares it for transmission to the generative AI model. For example, it converts the received JPEG file to PNG format and stores it in a temporary folder.

[1746] Design using image generation AI models

[1747] Sending image data

[1748] Server: Sends the temporarily saved image data to the generative AI model as input data. For example, send the image data using an HTTP POST request.

[1749] Design art generation

[1750] Server (within the AI ​​model): The generative AI model generates new designed artwork based on the input image data. Specifically, the AI ​​model extracts image features and generates new designs based on them. The model's operation is accelerated by the GPU.

[1751] Preservation and Management of Designed Art

[1752] Preserving Design Art

[1753] Server: Stores the generated design art as a digital file in dedicated storage. For example, stores the generated art in the " / storage / designs / " directory.

[1754] Server: Registers the metadata of the designed art (title, artist, creation date, etc.) in the database. Inserts the information into the "Designs" table in the database.

[1755] Server: Manages the designed art and prepares it for exhibition on the marketplace. Sends exhibition information to the marketplace via API.

[1756] Marketplace Exhibits and Sales

[1757] Preparing to exhibit at the marketplace

[1758] Server: References the metadata of the designed art and generates exhibit information (price, category, description). Dynamically generates exhibit pages using a template engine.

[1759] Server: List your design art in a category within the Marketplace and display it in the New Arrivals section. Use the category mapping file to register it in the correct category.

[1760] User purchase of artwork

[1761] Users access the Marketplace through a web browser or dedicated application to search, compare, and purchase the designed art on display. For example, they can use search filters to narrow down their search to artworks in the "Abstract Art" category.

[1762] Server: Accepts the purchase request and securely processes the payment through the payment gateway. After payment is complete, the buyer is emailed a download link for the designed art.

[1763] Emotion engine for user emotion recognition and customization

[1764] Emotion recognition by emotion engine

[1765] Server (internal emotion engine): While users browse the marketplace, it analyzes their facial expressions and interaction data to recognize emotions in real time, for example, by capturing their facial expressions using a webcam and analyzing them with facial recognition algorithms.

[1766] Emotion-based recommendations

[1767] Server: Based on the data recognized by the emotion engine, recommends designed art that the user is likely to like. For example, the recommendation algorithm displays artworks similar to those that the user has shown interest in.

[1768] Emotional customization

[1769] Server: Based on the user's emotional data, it offers specific customization options (color tones, thematic highlights, etc.). For example, if the emotional analysis indicates "joy," it recommends bright color options.

[1770] Utilizing Emotional Data

[1771] Server: Improve the ranking display and filtering functions of the marketplace based on the collected sentiment data. The results of the sentiment data analysis are stored in a database and incorporated into the algorithm.

[1772] Facilitating feedback and communication

[1773] Post-purchase feedback

[1774] Server: Send emails and notifications to users after purchase, encouraging them to leave a rating or comment. For example, automatically send a feedback request email within 24 hours of purchase.

[1775] User feedback and communication

[1776] Users: Post their thoughts and feedback on artworks and communicate with the artists. For example, they can enter comments in the app and send them by pressing the post button.

[1777] Prompt Sentence Examples

[1778] Below are some example prompts for the generative AI model:

[1779] "Please create a new design based on this drawing by a child in after-school care. Please emphasize the colors and use brighter tones."

[1780] By implementing the invention in the above manner, it is possible to provide a venue for designing and disseminating the art of after-school care children, thereby increasing the children's motivation for artistic activities, and by utilizing the emotion engine, it is possible to provide a more personalized user experience.

[1781] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1782] Program processing flow

[1783] User Artwork Uploads

[1784] Step 1:

[1785] Users use the camera on their smartphone or tablet to take a picture of a drawing by a child in after-school care. They open the application, click the "Select Image" button, and choose the image from the device's gallery. After selecting, they press the "Upload" button to send the image data to the server.

[1786] Input: Image data of artwork photographed by the user

[1787] Output: Image data sent to the server

[1788] Step 2:

[1789] The terminal transmits the image data selected by the user to the specified server address. At this time, a progress bar is displayed, and a success message is displayed after the transmission is completed.

[1790] Input: User-selected image data

[1791] Output: Image data sent to the server

[1792] Step 3:

[1793] The server temporarily stores the received image data and prepares it for transmission to the generative AI model. Specifically, it converts the received JPEG file into PNG format and stores it in a temporary folder.

[1794] Input: Image data sent to the server

[1795] Output: Temporarily saved image data (PNG format)

[1796] Design using image generation AI models

[1797] Step 4:

[1798] The server sends the temporarily saved image data to the generative AI model as input data. Specifically, the image data is sent using an HTTP POST request.

[1799] Input: Temporarily saved image data (PNG format)

[1800] Output: Image data sent to the generative AI model

[1801] Step 5:

[1802] The server (within the AI ​​model) generates a new design artwork based on the input image data. The AI ​​model extracts image features, performs style conversion based on them, and generates a new design. This process is accelerated by the GPU.

[1803] Input: Image data sent to the generative AI model

[1804] Output: Generated designed artwork

[1805] Preservation and Management of Designed Art

[1806] Step 6:

[1807] The server saves the generated design art as a digital file in dedicated storage. The generated art is saved in the " / storage / designs / " directory.

[1808] Input: Generated designed artwork

[1809] Output: Saved digital file

[1810] Step 7:

[1811] The server registers the metadata of the designed art (title, artist, creation date, etc.) in a database and inserts the information into the "Designs" table in the database.

[1812] Input: Metadata of the designed artwork

[1813] Output: Metadata registered in the database

[1814] Step 8:

[1815] The server manages the designed art and prepares it for exhibition on the marketplace. It sends the exhibition information to the marketplace via API.

[1816] Input: A designed artwork and its metadata

[1817] Output: Ready to be listed on the marketplace

[1818] Marketplace Exhibits and Sales

[1819] Step 9:

[1820] The server references the metadata of the designed art and generates exhibit information (price, category, description), and dynamically generates the exhibit page using a template engine.

[1821] Input: Metadata of the designed artwork

[1822] Output: Generated exhibit information

[1823] Step 10:

[1824] The server posts the design art to a category within the marketplace and displays it in the new arrivals section, using a category mapping file to register it in the correct category.

[1825] Input: Generated exhibit information

[1826] Output: Designed art posted in the Marketplace

[1827] Step 11:

[1828] Users can access the marketplace through a web browser or a dedicated application to search, compare, and purchase the designed art on display. For example, they can use search filters to narrow down their search to artworks in the "Abstract Art" category.

[1829] Input: User search queries and purchase requests

[1830] Output: Purchase procedure completed

[1831] Step 12:

[1832] The server accepts the purchase request, securely processes the payment through the payment gateway, and then emails the buyer a download link for the designed art.

[1833] Input: User purchase request and payment information

[1834] Output: Download link sent

[1835] Emotion engine for user emotion recognition and customization

[1836] Step 13:

[1837] The server (within the emotion engine) analyzes facial expressions and interaction data while users browse the marketplace, recognizing emotions in real time. Facial expressions are captured using a webcam and analyzed with facial recognition algorithms.

[1838] Input: User facial expression data and interaction data

[1839] Output: Real-time recognized emotion data

[1840] Step 14:

[1841] The server recommends designed art that the user is likely to like based on the emotion data recognized by the emotion engine. For example, the recommendation algorithm displays artworks similar to artworks in which the user has shown interest.

[1842] Input: Real-time recognized emotion data

[1843] Output: Recommended designed artwork

[1844] Step 15:

[1845] The server offers specific customization options (color tones, thematic highlights, etc.) based on the user's emotional data. For example, if the emotional analysis indicates "joy," it recommends bright color options.

[1846] Input: Real-time recognized emotion data

[1847] Output: Customization options provided

[1848] Step 16:

[1849] The server uses the collected emotional data to improve the ranking and filtering functions of the marketplace, storing the results of the analysis of the emotional data in a database and incorporating them into the algorithm.

[1850] Input: Collected emotion data

[1851] Output: Improved ranking display and filtering capabilities

[1852] Facilitating feedback and communication

[1853] Step 17:

[1854] The server sends emails and notifications to users after purchase, encouraging them to post ratings and comments. Feedback request emails are automatically sent within 24 hours of purchase.

[1855] Input: Purchase completion information

[1856] Output: Feedback request sent

[1857] Step 18:

[1858] Users can post their thoughts and feedback on artworks and communicate with the artists. They can enter their comments in the app and send them by pressing the post button.

[1859] Input: User feedback

[1860] Output: Communication with the author has been completed

[1861] (Application example 2)

[1862] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1863] Conventional art sales systems lack the ability to customize artworks or recommend products based on individual user preferences, making it difficult to meet diverse user needs. Furthermore, they lack the ability to generate effective visual content based on emotions, especially in advertising campaigns. Furthermore, there is a lack of a mechanism for effectively utilizing artworks drawn by after-school care children.

[1864] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 2 is realized by the following means.

[1865] In this invention, the server includes a means for photographing artwork drawn by after-school children and uploading the image data to the server, a means for inputting the uploaded image data into a generative AI model to generate designed art, a means for exhibiting the generated designed art on a marketplace and making it available for sale, and a means for analyzing user emotion data and customizing the designed art as advertising material based on the emotions. This enables customization of artwork and recommendations according to user needs, and can generate effective visual content based on emotions, particularly in advertising campaigns. It also enables widespread and effective use of artwork drawn by after-school children.

[1866] "After-school care children" refers to children who attend after-school care facilities.

[1867] "Artworks" refers to creative works, including paintings and illustrations, drawn by after-school care children.

[1868] A "generative AI model" refers to an artificial intelligence algorithm that generates new images or designs based on input data.

[1869] "Customization" refers to adjusting or changing design or functionality to suit a specific purpose or user preference.

[1870] "Emotional data" refers to data that indicates the user's emotional state, obtained by analyzing the user's facial expressions, voice, interactions, etc.

[1871] "Marketplace" refers to a platform where products can be exhibited, searched for, and purchased online.

[1872] "Advertising Materials" means the visual content and designs used in an Advertising Campaign.

[1873] "User" refers to an individual who uses an artwork or purchases an artwork on the Marketplace.

[1874] "Image data" refers to the digital image files obtained when photographing an artwork.

[1875] "Designed art" refers to artworks that have been processed and transformed using generative AI models.

[1876] This invention is a system that photographs artwork drawn by children in after-school care, uploads the image data to a server, and generates designed art using a generative AI model. This system can exhibit and sell the designed art on a marketplace. It also includes a function to analyze user emotion data and customize it as advertising material based on the emotion. Specific embodiments of the system are described below.

[1877] System Overview

[1878] Hardware

[1879] Smartphone: Used to take photos and upload artwork.

[1880] Server: Stores image data, processes designs using generative AI models, analyzes emotional data, and manages the marketplace.

[1881] User terminal: Used as access to the marketplace and as a user interface.

[1882] software

[1883] OpenCV: A library used to process and save images.

[1884] face_recognition: A library used to analyze the user's facial landmarks.

[1885] EmotionRecognizer: Software for recognizing user emotions.

[1886] design_generator: Software that generates design art using generative AI models.

[1887] Processing Description

[1888] 1. Upload your artwork

[1889] Users use their smartphones to take pictures of artworks drawn by children in daycare centers. The image data is then uploaded to the server via a dedicated application. The images taken with the smartphone camera are converted into an appropriate format using OpenCV.

[1890] 2. Designing with generative AI models

[1891] The server inputs the uploaded image data into a generative AI model to generate new designed art. This generation process uses a generative AI model such as Stable Diffusion.

[1892] 3. Emotion Data Analysis

[1893] When a user uses the marketplace, the server collects the user's facial images and interaction data, and analyzes the user's emotions using face_recognition and EmotionRecognizer. The analyzed emotional data is used to customize the designed art as advertising materials.

[1894] 4. Exhibiting on the Marketplace

[1895] The generated design art is displayed on the marketplace by the server, and users can access the marketplace using their own devices to search, compare, and purchase the displayed design art works.

[1896] Specific examples

[1897] Example prompt for a generative AI model:

[1898] Prompt: "Create a bright and cheerful advertisement using children's art that resonates with a happy mood. Emphasize positive message in vibrant colors."

[1899] By inputting this prompt into a generative AI model, it is possible to generate customized ads based on the user's emotions.

[1900] This system not only effectively utilizes the artworks of children in after-school care, but also generates personalized advertising materials according to the user's emotions.In addition, by selling artworks widely through the marketplace, the value of the artworks can be increased.

[1901] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1902] Step 1:

[1903] The user uses a smartphone to take a photo of the artwork drawn by the after-school child. At this time, the smartphone's camera app is used to capture high-resolution image data. Next, the user opens a dedicated application, selects the captured image, and presses the upload button to send the image data to the server. The input is the captured image data, and the output is the image data sent to the server. During this process, the image data is converted into a standard format such as JPEG or PNG and sent to the server.

[1904] Step 2:

[1905] The server temporarily stores the received image data. It then sends the temporarily stored image data to the generative AI model as input data. Specifically, it uses the OpenCV library to preprocess the image data (resize, remove noise, etc.). The input is the uploaded image data, and the output is the preprocessed image data sent to the generative AI model.

[1906] Step 3:

[1907] The generative AI model in the server generates a new designed artwork based on the input image data. For example, a generative AI model such as Stable Diffusion is used. The input is preprocessed image data and a prompt, and the output is the generated designed artwork. An example of the prompt is: "Create a bright and cheerful advertisement using children's art that resonates with a happy mood. Emphasize a positive message in vibrant colors."

[1908] Step 4:

[1909] The server saves the generated designed art as a digital file in dedicated storage and registers its metadata (title, artist, creation date, etc.) in a database. The input is the generated designed art work, and the output is the digital file saved in dedicated storage and the metadata registered in the database.

[1910] Step 5:

[1911] The server prepares the designed art to be exhibited on the marketplace. It references the generated metadata of the designed art, generates exhibit information (price, category, description), and lists it in the appropriate category within the marketplace. The input is the digital file and metadata, and the output is the designed art work listed on the marketplace.

[1912] Step 6:

[1913] Users access the marketplace through a web browser or dedicated application, search for and compare the displayed designed art works, select the work they wish to purchase, and complete the purchase procedure. The input is the designed art work displayed on the marketplace, and the output is the user's purchase request.

[1914] Step 7:

[1915] The server accepts the user's purchase request and processes payment through a secure payment gateway. After payment is complete, the server provides the buyer with a digital or print copy of the designed artwork. The input is the user's purchase request and payment information, and the output is the digital or print copy.

[1916] Step 8:

[1917] The emotion engine in the server analyzes the user's facial expressions and interaction data while the user is browsing the marketplace, and recognizes the user's emotions in real time. The input is the user's facial expression data and interaction data, and the output is the user's emotional data.

[1918] Step 9:

[1919] The server customizes the stylized art as advertising material based on the user's emotional data recognized by the emotion engine. For example, if the emotion is recognized as "joy," advertising material containing bright colors and a positive message is generated. The input is the user's emotional data and the generated stylized art, and the output is customized advertising material.

[1920] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[1921] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1922] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[1923] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[1924] FIG. 9 is a diagram illustrating an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and actions arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[1925] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[1926] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[1927] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[1928] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[1929] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[1930] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[1931] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[1932] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[1933] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[1934] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[1935] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[1936] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[1937] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[1938] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[1939] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[1940] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[1941] The following is further disclosed regarding the above embodiment.

[1942] (Claim 1)

[1943] A means to photograph artworks drawn by after-school care children and upload the image data to a server,

[1944] A means for inputting the uploaded image data into a generative AI model to generate designed art;

[1945] A means for displaying and selling the generated designed art on a marketplace;

[1946] A system including:

[1947] (Claim 2)

[1948] The system according to claim 1, further comprising means for users to search, compare, and purchase designed art works exhibited in the marketplace.

[1949] (Claim 3)

[1950] 2. The system according to claim 1, further comprising means for providing digital data or print data to a user who has purchased the designed artwork.

[1951] "Example 1"

[1952] (Claim 1)

[1953] A means to photograph artworks drawn by after-school care children and upload the image data to a server,

[1954] A means for temporarily storing the uploaded image data and transmitting it as input data to a generative AI model;

[1955] A means for a generative AI model to generate designed art based on the image data;

[1956] A means for storing the generated designed art in a dedicated storage and registering its metadata in a database;

[1957] A means for displaying and selling the generated designed art on a marketplace;

[1958] A system including:

[1959] (Claim 2)

[1960] The system according to claim 1, further comprising means for users to search, compare, and purchase designed art works exhibited in the marketplace.

[1961] (Claim 3)

[1962] 2. The system according to claim 1, further comprising means for providing digital data or print data to a user who has purchased the designed artwork.

[1963] "Application Example 1"

[1964] (Claim 1)

[1965] A means to photograph artworks drawn by after-school care children and upload the image data to a server,

[1966] A means for inputting the uploaded image data into a generative AI model to generate designed art;

[1967] A means for displaying and selling the generated designed art on a marketplace;

[1968] means for registering and managing said digital data;

[1969] a feedback means for allowing users who have purchased the artwork to post ratings and comments;

[1970] A system including:

[1971] (Claim 2)

[1972] The system according to claim 1, further comprising means for users to search, compare, and purchase designed art works exhibited in the marketplace.

[1973] (Claim 3)

[1974] 2. The system according to claim 1, further comprising means for providing digital data or print data to a user who has purchased the designed artwork.

[1975] "Example 2: Combining Emotion Engines"

[1976] (Claim 1)

[1977] A means to photograph artworks drawn by after-school care children and upload the image data to a server,

[1978] A means for inputting the uploaded image data into a generative AI model to generate designed art;

[1979] A means for displaying and selling the generated designed art on a marketplace;

[1980] A means for performing customization and recommendations based on the user's emotions using an emotion engine that recognizes the user's emotions;

[1981] A means for users to post feedback on the designed artworks they have purchased and promote communication with the artists;

[1982] A system including:

[1983] (Claim 2)

[1984] The system according to claim 1, further comprising means for users to search, compare, and purchase designed art works exhibited in the marketplace.

[1985] (Claim 3)

[1986] 2. The system according to claim 1, further comprising means for providing digital data or print data to a user who has purchased the designed artwork.

[1987] "Application example 2 when combining emotion engines"

[1988] (Claim 1)

[1989] A means to photograph artworks drawn by after-school care children and upload the image data to a server,

[1990] A means for inputting the uploaded image data into a generative AI model to generate designed art;

[1991] A means for displaying and selling the generated designed art on a marketplace;

[1992] A means for analyzing user emotional data and customizing emotionally designed art as advertising materials;

[1993] A system including:

[1994] (Claim 2)

[1995] The system according to claim 1, further comprising means for users to search, compare, and purchase designed art works exhibited in the marketplace.

[1996] (Claim 3)

[1997] 2. The system according to claim 1, further comprising means for providing digital data or print data to a user who has purchased the designed artwork. [Explanation of symbols]

[1998] 10, 210, 310, 410 Data Processing Systems 12 Data Processing Device 14 Smart Devices 214 Smart Glasses 314 Headset-type terminal 414 Robot< / url:> < / url:> < / url:> < / url:>

Claims

1. A means to photograph artworks drawn by after-school care children and upload the image data to a server, A means for inputting the uploaded image data into a generative AI model to generate designed art; A means for displaying and selling the generated designed art on a marketplace; A system including:

2. The system according to claim 1, further comprising means for users to search, compare and purchase designed artworks exhibited in the marketplace.

3. 2. The system according to claim 1, further comprising means for providing digital data or print data to a user who has purchased the designed artwork.

Images