system

Abstract

We provide the system. [Solution] A system including means for receiving multiple inputs from the user regarding character characteristics and the idol's assigned color, means for generating abstract images or monograms based on said input, and means for providing the user with a method for creating the most suitable fan activity item based on the generated result.

Description

Technical Field

[0001] The technology of the present disclosure relates to a system.

Background Art

[0002] Patent Document 1 discloses a method for controlling a persona chatbot, which is performed by at least one processor, and includes steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to an explanation of a character of the chatbot, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance that responds to the user utterance.

Prior Art Documents

Patent Documents

[0003]

Patent Document 1

Summary of the Invention

Problems to be Solved by the Invention

[0004] In order to enjoy character promotion activities, items that reflect the characteristics of individual characters or idols are required. However, creating these items by oneself requires technical skills and time, and is difficult for ordinary users. There is also a problem that users do not know how to utilize the created items.

Means for Solving the Problems

[0005] This invention accepts multiple inputs from the user, such as character characteristics and the assigned color of an idol, and generates abstract images or monograms based on these inputs. Furthermore, it provides the user with instructions on how to create the most suitable fan-related item based on the generated result. This allows users to easily create items that reflect their favorite idol and understand how to use them. [Brief explanation of the drawing]

[0006] [Figure 1] This is a conceptual diagram showing an example of the configuration of a data processing system according to the first embodiment. [Figure 2] This is a conceptual diagram showing an example of the essential functions of a data processing device and a smart device according to the first embodiment. [Figure 3] This is a conceptual diagram showing an example of the configuration of a data processing system according to the second embodiment. [Figure 4] This is a conceptual diagram showing an example of the main functions of a data processing device and smart glasses according to the second embodiment. [Figure 5] This is a conceptual diagram showing an example of the configuration of a data processing system according to the third embodiment. [Figure 6] This is a conceptual diagram showing an example of the main functions of a data processing device and a headset-type terminal according to the third embodiment. [Figure 7] This is a conceptual diagram showing an example of the configuration of a data processing system according to the fourth embodiment. [Figure 8] This is a conceptual diagram showing an example of the main functions of a data processing device and a robot according to the fourth embodiment. [Figure 9] This shows an emotion map where multiple emotions are mapped. [Figure 10] This shows an emotion map where multiple emotions are mapped. [Figure 11] This is a sequence diagram showing the processing flow of the data processing system in Embodiment 1 of Example 1. [Figure 12] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1 of Form Example 1. [Figure 13]This is a sequence diagram showing the processing flow of the data processing system in Example 2 of Embodiment 2. [Figure 14] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2 of Form Example 2. [Figure 15] This is a sequence diagram showing the processing flow of the data processing system in Embodiment 3 of Example 3. [Figure 16] This is a sequence diagram showing the processing flow of the data processing system in Application Example 3 of Form Example 3. [Figure 17] This is a sequence diagram showing the processing flow of the data processing system in Example 1 of the Form 1 when an emotion engine is combined. [Figure 18] This is a sequence diagram showing the processing flow of the data processing system in Application Example 1 of Form Example 1 when an emotion engine is combined. [Figure 19] This is a sequence diagram showing the processing flow of the data processing system in Example 2 of the Form 2 when an emotion engine is combined. [Figure 20] This is a sequence diagram showing the processing flow of the data processing system in Application Example 2 of Form Example 2 when an emotion engine is combined. [Figure 21] This is a sequence diagram showing the processing flow of the data processing system in Example 3 of the Form 3 when an emotion engine is combined. [Figure 22] This is a sequence diagram showing the processing flow of the data processing system in Application Example 3 of Form Example 3 when an emotion engine is combined. [Figure 23] This is a sequence diagram showing the processing flow of a data processing system in another embodiment. [Modes for carrying out the invention]

[0007] Hereinafter, an example of an embodiment of the system relating to the technology of this disclosure will be described with reference to the attached drawings.

[0008] First, let's explain the terminology used in the following explanation.

[0009] In the following embodiments, the labeled processor (hereinafter simply referred to as "processor") may be a single arithmetic unit or a combination of multiple arithmetic units. Also, the processor may be a single type of arithmetic unit or a combination of multiple types of arithmetic units. Examples of arithmetic units include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), an APU (Accelerated Processing Unit), or a TPU (TENSOR PROCESSING UNIT (registered trademark)), etc.

[0010] In the following embodiments, the labeled RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a work memory by the processor.

[0011] In the following embodiments, the labeled storage is one or more non-volatile storage devices that store various programs and various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), or magnetic tapes, etc.

[0012] In the following embodiments, the labeled communication I / F (Interface) is an interface including a communication processor and an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), or Bluetooth (registered trademark), etc.

[0013] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." That is, "A and / or B" means that it may be A alone, or B alone, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" applies when expressing three or more things linked by "and / or."

[0014] [First Embodiment]

[0015] Figure 1 shows an example of the configuration of the data processing system 10 according to the first embodiment.

[0016] As shown in Figure 1, the data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0017] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0018] The smart device 14 comprises a computer 36, a reception device 38, an output device 40, a camera 42, and a communication interface 44. The computer 36 comprises a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The reception device 38, output device 40, and camera 42 are also connected to the bus 52.

[0019] The reception device 38 is equipped with a touch panel 38A and a microphone 38B, etc., and receives user input. The touch panel 38A receives user input by detecting contact with an object (e.g., a pen or finger). The microphone 38B receives user input by detecting the user's voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0020] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form perceptible to the user 20 (e.g., audio and / or text). The display 40A displays visible information such as text and images according to instructions from the processor 46. The speaker 40B outputs audio according to instructions from the processor 46. The camera 42 is a small digital camera equipped with an optical system such as a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0021] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various types of information between processor 46 and processor 28 via network 54.

[0022] Figure 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0023] As shown in Figure 2, in the data processing device 12, a specific processing is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" related to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 according to the specific processing program 56 executed on the RAM 30.

[0024] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0025] In the smart device 14, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The reception output program 60 is used in conjunction with a specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0026] Next, the identification process performed by the identification processing unit 290 of the data processing device 12 will be described.

[0027] "Example of form 1"

[0028] The system of this invention receives information about character characteristics and the idol's assigned color from the user through a user interface. This interface may include text input fields, color selection tools, etc. For example, the user inputs information such as "Character characteristics: cat ears, assigned color: pink".

[0029] "Example of form 2"

[0030] Next, the system generates abstract images or monograms based on the information it receives. This generation process is carried out using preset templates and algorithms. For example, a monogram combining the features of cat ears with the color pink is generated.

[0031] "Example of form 3"

[0032] Furthermore, the system provides users with instructions on how to create merchandise related to their favorite idols, based on the generated images and monograms. This can include specific step-by-step instructions and lists of necessary materials. For example, it may provide instructions on how to create a dot art icon using the generated monogram, or how to create embroidered art and frame it.

[0033] The following describes the processing flow for each example of the form.

[0034] "Example of form 1"

[0035] Step 1: Receive information about the character's characteristics and the idol's assigned color from the user through the user interface. This interface can include text input fields, color selection tools, etc. For example, the user might input information such as "Character characteristics: cat ears, assigned color: pink".

[0036] Step 2: Based on the received information, the system's internal algorithms generate abstract images or monograms. This generation process uses preset templates and algorithms. For example, a monogram combining cat ears with the color pink is generated.

[0037] Step 3: Provide users with instructions on how to create fan merchandise based on the generated images and monograms. This can include specific step-by-step instructions and a list of necessary materials. For example, instructions could be provided on how to create a dot art icon using the generated monogram, or how to create embroidery art and frame it.

[0038] (Example 1)

[0039] Next, we will describe Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0040] Conventional information processing systems have struggled to efficiently generate and provide relevant content based on feature and color information entered by users. Furthermore, there has been a lack of means to provide the generated content in a format that users can easily utilize.

[0041] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0042] In this invention, the server includes means for receiving multiple inputs of feature information and color information from a user via an information processing device, means for generating relevant content using a generative model based on the inputs, and means for providing the generated content to the user. This makes it possible to efficiently generate relevant content based on information input by the user and provide it in a form that the user can easily utilize.

[0043] An "information processing device" is a device that receives input from users and processes the data.

[0044] A "user" is an individual or group that operates the system and inputs information.

[0045] "Feature information" refers to information that indicates the characteristics and attributes of characters and items.

[0046] "Color information" refers to information about specific colors or color combinations.

[0047] A "generative model" is an algorithm or program that generates relevant content based on input information.

[0048] "Content" refers to the visual or text-based output created by a generative model.

[0049] A "communication network" is the infrastructure used to send and receive information.

[0050] A "profile picture" is a visual representation used to identify an individual or group on a communication network.

[0051] "Decorative items" are items used to physically or digitally display generated content.

[0052] "Display instructions" are guidelines on how to arrange or use the generated content.

[0053] This invention is a system that receives feature information and color information from a user via an information processing device, generates related content using a generation AI model, and provides it to the user. Specific embodiments of this system are shown below.

[0054] The user accesses the system's user interface using a terminal. This interface includes text input fields and color selection tools, which the user uses to input character characteristics and color information. For example, the user might enter "Character characteristics: cat ears, assigned color: pink."

[0055] The server receives and analyzes information sent from the user's terminal. This analysis may utilize natural language processing techniques. Specifically, it tokenizes the text entered by the user and extracts keywords as needed. The analyzed data is then converted into a format suitable for generative AI models.

[0056] The server calls a generative AI model based on the analyzed data. Here, a model specialized in natural language processing is used as a general generative AI model. The server generates a prompt and inputs it into the model. For example, it creates a prompt such as, "Generate an illustration of a character with cat ears wearing a pink outfit."

[0057] The generative AI model generates relevant content based on the input prompts. The server receives the generated content and sends it to the user's device. The user can then view this content on their device screen, specifically displaying generated illustrations or stories.

[0058] This system allows users to visualize their ideas in a concrete form or enjoy them as a story. An example of a prompt would be, "Please create a short story featuring a blue robot character."

[0059] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0060] Step 1:

[0061] The user accesses the system's user interface using a terminal. The user enters character characteristics and color information using text input fields and color selection tools. For example, they might enter "Character characteristics: cat ears, assigned color: pink." This input becomes the data sent to the system.

[0062] Step 2:

[0063] The server receives input data sent from the user's terminal. The server analyzes the received data, tokenizes the text using natural language processing techniques, and extracts keywords. This analysis converts the data into a format suitable for the generative AI model. The analyzed data then becomes the input for the next processing step.

[0064] Step 3:

[0065] The server calls a generative AI model based on the analyzed data. The server generates a prompt and inputs it into the model. For example, it might create a prompt such as, "Generate an illustration of a character with cat ears wearing a pink outfit." This prompt becomes the input to the generative AI model.

[0066] Step 4:

[0067] The generative AI model generates relevant content based on the input prompts. The generated content is returned to the server. This output becomes the content provided to the user.

[0068] Step 5:

[0069] The server receives the generated content and sends it to the user's device. The user can then view this content on their device screen. Specifically, the generated illustrations and stories are displayed. This allows the user to visualize their ideas in a concrete form.

[0070] (Application Example 1)

[0071] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server," and the smart device 14 will be referred to as a "terminal."

[0072] In modern content generation using information processing devices, there is a need for systems that allow users to easily generate and enjoy visual content tailored to their preferences. However, conventional systems have struggled to generate and distribute content intuitively and quickly based on user input. Furthermore, there has been a lack of means for sharing the generated content with other users.

[0073] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0074] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and assigned colors, means for generating visual content using a generative AI model, and means for distributing the generated visual content to the user's information processing device. This allows the user to easily generate visual content based on their preferences and enjoy it visually through the information processing device. It also makes it easy to share the generated content with other users.

[0075] A "user" is the entity that operates the information processing device and inputs character characteristics and assigned colors.

[0076] "Character characteristics" refer to information about the character's appearance and personality that the user inputs.

[0077] "Assigned color" refers to a specific color associated with a character or idol, as entered by the user.

[0078] "Means for receiving input" refers to interfaces or devices for obtaining information from users.

[0079] A "generative AI model" is an artificial intelligence technology used to generate visual content based on user input.

[0080] "Visual content" refers to visually represented data such as illustrations and animations created by generative AI models.

[0081] An "information processing device" is an electronic device used to receive and display visual content.

[0082] "Means of distribution" refers to communication technologies used to transmit generated visual content to a user's information processing device.

[0083] "Sharing instructions" refer to information that shows how to share the generated visual content with other users, including instructions and procedures.

[0084] The system for carrying out this invention consists of a user, a server, and an information processing device. The user inputs character characteristics and assigned colors using the information processing device. The information processing device is equipped with an interface that accepts input from the user, thereby allowing the user to input information intuitively.

[0085] The server generates visual content using a generative AI model based on input information received from the user. The generative AI model receives the input character characteristics and assigned colors as prompts and generates visual content such as illustrations and animations based on that. This process utilizes artificial intelligence technologies such as the OpenAI® API.

[0086] The generated visual content is delivered from the server to the information processing device. The information processing device visually displays the received visual content on a display device, allowing the user to enjoy it. The information processing device can also provide instructions for sharing the generated content with other users.

[0087] For example, if a user inputs "cat ears" and "pink," the server sends a prompt to the AI ​​model saying, "Create an illustration of a pink character with cat ears." The visual content generated based on this prompt is delivered to the information processing device, and the user can enjoy it visually.

[0088] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0089] Step 1:

[0090] The user inputs character characteristics and assigned colors through the information processing device's interface. The input information is then transmitted to the information processing device in text format.

[0091] Step 2:

[0092] The information processing device sends the input information received from the user to the server. The server analyzes the received information and generates prompt statements suitable for the AI ​​model. These prompt statements include specific instructions based on the user's input.

[0093] Step 3:

[0094] The server sends the generated prompt text to the generative AI model. The generative AI model receives the prompt text as input and generates visual content. The generative AI model performs data calculations based on the input features and colors and outputs illustrations or animations.

[0095] Step 4:

[0096] The server delivers the visual content obtained from the generated AI model to the information processing device. The information processing device displays the received content on a display device, allowing the user to enjoy it visually.

[0097] Step 5:

[0098] The information processing device provides the user with instructions for sharing the generated visual content with other users. The user can then share the content by following the provided instructions.

[0099] (Example 2)

[0100] Next, we will describe Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0101] Conventional image generation systems have struggled to effectively analyze user input and generate abstract visual representations that align with the user's intent. Furthermore, there has been a lack of means to provide the generated visual representations in a format easily usable by the user. This has limited the generation and utilization of customized visual representations tailored to user needs.

[0102] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0103] In this invention, the server includes means for receiving characteristic information from a user, means for analyzing the characteristic information and converting it into a format suitable for a generative artificial intelligence model, and means for generating an abstract visual representation using the generative artificial intelligence model based on the converted information. This makes it possible to generate a customized visual representation based on user input and provide it in a format that can be easily used by the user.

[0104] A "user" is an entity that uses the system to input characteristic information and requests the generation of a visual representation.

[0105] "Feature information" refers to information that includes specific elements and attributes that the user inputs and wants to be reflected in the generated visual representation.

[0106] A "generative artificial intelligence model" is a model that uses machine learning algorithms to generate visual representations based on input information.

[0107] "Visual representation" refers to a visual output, such as an abstract image or monogram, generated based on user input.

[0108] A "server" is a computer system that receives input from users and performs information analysis, transformation, and generation of visual representations.

[0109] A "terminal" is a device that a user uses to access a system and receive visual representations.

[0110] This invention is a system that generates abstract visual representations based on feature information entered by the user. The user accesses the system using a terminal and inputs the features of the visual representation they want to generate as prompt text. For example, they can input a specific request such as, "Please generate a monogram that combines the features of cat ears with the color pink."

[0111] The server receives prompt messages sent by the user and analyzes them using natural language processing techniques. This analysis extracts keywords and features from the prompt messages and converts them into a format suitable for generative AI models. Generative AI models used include machine learning algorithms such as Stable Diffusion and DALL-E.

[0112] The server inputs the transformed information into a generating AI model, which then generates a visual representation based on the user's request. The generated visual representation is sent to the user's device, where the user can review it and save or share it as needed.

[0113] This system allows users to easily generate customized visual representations and use them for a variety of purposes.

[0114] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0115] Step 1:

[0116] The user accesses the system using a terminal and inputs the features of the visual representation they want to generate as prompt statements. For example, they might input a specific request such as, "Please generate a monogram that combines the features of cat ears with the color pink." These prompt statements become the input to the system.

[0117] Step 2:

[0118] The server receives prompt messages sent by the user. Natural language processing techniques are used to analyze the received prompt messages. Specifically, keywords such as "cat ears" and "pink" are extracted from the prompt messages and converted into a format suitable for the generative AI model. This converted information becomes the input for the next process.

[0119] Step 3:

[0120] The server inputs the transformed information into a generative AI model. Examples of generative AI models used include Stable Diffusion and DALL-E. The model performs data calculations based on the input information and generates a visual representation that matches the user's requirements. This generated visual representation becomes the output for the next process.

[0121] Step 4:

[0122] The server sends the generated visual representation to the user's device. The user's device displays the received visual representation for the user to review. The user can download the generated visual representation or use it for other purposes. This provides a customized visual representation based on the user's requests.

[0123] (Application Example 2)

[0124] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0125] The modern advertising industry demands the rapid and effective generation of visually appealing content. However, traditional methods require design expertise and time, making it difficult to efficiently create visual content for advertising. To solve this problem, a system is needed that allows users to easily generate and utilize visual content for advertising.

[0126] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0127] In this invention, the server includes means for receiving information from a user, means for generating abstract visual content based on said information, and means for providing the generated visual content for advertising purposes. This enables users to quickly generate and use visual content for advertising without requiring specialized knowledge.

[0128] "Means for receiving information from users" refers to the interface through which the system acquires data and keywords entered by the user.

[0129] "Means for generating abstract visual content" refers to algorithms and processes for generating visually represented content based on received information.

[0130] "Means for providing generated visual content for advertising purposes" refers to a function for providing users with generated visual content in a format that can be used as an advertising medium.

[0131] "Means of inputting prompts into the generating AI model" refers to the process of creating and inputting text that provides appropriate instructions to the generating AI model based on keywords specified by the user.

[0132] "Means for previewing generated visual content" refers to a function that displays the generated content so that the user can check it.

[0133] The system for carrying out this invention provides a process for generating visual content for advertising using a device such as a smartphone or smart glasses. The user can input keywords through the device's interface. These keywords form the basis of prompt sentences input to the generating AI model.

[0134] The server converts keywords received from the user into prompt sentences and inputs them into a generative AI model. Examples of such generative AI models include DALL-E and Stable Diffusion. The generative AI model then generates abstract visual content based on the prompt sentences.

[0135] The generated visual content can be previewed on the device, allowing users to review its contents. Users can save or share the generated content for advertising purposes. For example, if a user enters "summer sale" as a keyword, the prompt will be "a bright, colorful abstract image themed around a summer sale." This prompt can be input into the AI ​​generation model, and the generated image can be used for advertising.

[0136] This system allows users to quickly and efficiently generate and utilize visual content for advertising without requiring specialized design knowledge.

[0137] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0138] Step 1:

[0139] The user enters keywords through the terminal's interface. The entered keywords are sent to the server as basic data for generating visual content for advertising.

[0140] Step 2:

[0141] The server generates a prompt based on the received keyword. This prompt is an instruction to be input into the generating AI model. For example, if the keyword is "summer sale," the prompt will be "a bright, colorful abstract image with a summer sale theme."

[0142] Step 3:

[0143] The server inputs the generated prompt text into the generative AI model. DALL-E and Stable Diffusion are used as the generative AI model. The model performs data calculations based on the prompt text and generates abstract visual content.

[0144] Step 4:

[0145] The generated visual content is sent from the server to the terminal. The terminal displays a preview of the received visual content to the user. The user can review this preview and request modifications or regeneration as needed.

[0146] Step 5:

[0147] If a user is satisfied with the generated visual content, their device will save or share that content for advertising purposes. This allows for the rapid deployment of advertising campaigns.

[0148] (Example 3)

[0149] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0150] Conventional information processing systems made it difficult for users to generate visual information based on specific characteristic information and then obtain specific methods and necessary material information for manufacturing items using that information. This resulted in a challenge in that users could not efficiently manufacture items according to their own preferences.

[0151] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0152] In this invention, the server includes means for receiving characteristic information input from a user, means for generating visual information using a generative model based on the characteristic information, and means for providing a method for manufacturing an article based on the generated visual information. This makes it possible for users to easily obtain specific methods and necessary material information for efficiently manufacturing articles according to their preferences.

[0153] An "information processing device" is a device used for inputting, processing, and outputting data, and includes devices such as computers and servers.

[0154] "User" refers to an individual or group that operates an information processing device and utilizes specific functions or services.

[0155] "Feature information" refers to information that indicates specific attributes or conditions entered by the user, and is data used to generate visual information.

[0156] A "generative model" refers to an algorithm or program that generates visual information based on input feature information.

[0157] "Visual information" refers to visually recognizable data such as images and monograms generated by generative models.

[0158] "Items" refer to specific items or products that are created based on visual information.

[0159] "Manufacturing method" refers to information that describes the specific steps and processes for manufacturing an item.

[0160] "Material information" refers to information about the materials and tools necessary for the manufacture of an item.

[0161] A "communication network" is the infrastructure for sending and receiving digital data, and includes the internet and local networks.

[0162] "Handicrafts" refer to crafts and works of art that are produced by hand.

[0163] "Ornaments" refer to items that are created based on visual information and used for decorative purposes.

[0164] This invention is a system that uses an information processing device to allow a user to input specific characteristic information, generate visual information based on that information, and further provides specific methods and material information for manufacturing an item based on that visual information.

[0165] The server provides an interface for receiving feature information from the user. The user uses a terminal to input a prompt, such as "Generate a monogram of a blue bird." This prompt is sent to a generative AI model, and the server uses this model to generate visual information. A common generative algorithm is used as the generative AI model.

[0166] The generated visual information is analyzed by a server, and methods for producing the items are devised. For example, a procedure is provided to convert the generated monogram into a dot art icon using image processing software such as Adobe Photoshop. If embroidery art is to be created, the required types and quantities of embroidery thread and fabric are listed.

[0167] The user receives production method and material information provided by the server and confirms it through the terminal. This allows the user to efficiently produce items according to their preferences. For example, if the user enters the prompt "Generate a blue bird monogram," the server generates a monogram with a blue bird motif and provides instructions for producing dot art or embroidery art based on it. The flow of a specific process in Example 3 will be explained using Figure 15.

[0168] Step 1:

[0169] The user enters prompt messages using a terminal. For example, they might enter specific instructions such as "Generate a monogram of a blue bird." This input is then sent to the server.

[0170] Step 2:

[0171] The server analyzes the received prompt and sends instructions to the generative AI model. The generative AI model generates visual information based on the prompt. In this process, the AI ​​model performs data calculations based on the input feature information to generate image data. The generated visual information is returned to the server.

[0172] Step 3:

[0173] The server devises a method for producing the item based on the generated visual information. Specifically, it uses image processing software to create procedures for converting the visual information into dot art or embroidery art. This process analyzes the visual information and determines how to process it.

[0174] Step 4:

[0175] The server lists the material information required to create an item. For example, in the case of embroidery art, it specifically lists the required embroidery thread colors and fabric types. This information is necessary for the user to create the item.

[0176] Step 5:

[0177] The server sends the generated visual information, manufacturing method, and material information to the user's terminal. The user receives this information and verifies it through the terminal. This allows the user to manufacture the item based on the provided information.

[0178] (Application Example 3)

[0179] Next, we will explain Application Example 3 of Form Example 3. In the following explanation, the data processing device 12 will be referred to as a "server," and the smart device 14 will be referred to as a "terminal."

[0180] There is a need for a system that allows users to easily create custom items tailored to their preferences, thereby enhancing their in-store experience. However, conventional systems have difficulty providing specific creation procedures based on the user's selected design, and have not been able to provide real-time customization procedures using generative AI models.

[0181] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[0182] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and the idol's assigned color, means for generating abstract images or monograms based on said input, and means for providing the user with a method for creating the most suitable fan activity item based on the generated result. This makes it possible to provide a real-time procedure for creating custom items using a generation AI model based on the design selected by the user, thereby improving the customer experience in physical stores.

[0183] A "user" is an individual who wishes to create custom items by using the system to input character characteristics and the idol's assigned color.

[0184] "Character characteristics" refer to information about attributes and traits associated with a specific character, as entered by the user.

[0185] "Idol's assigned color" refers to the color associated with a specific idol, and is information entered by the user.

[0186] An "abstract image" is a visual representation that does not have a specific shape or design, and is generated based on user input.

[0187] A "monogram" is a design that combines letters and symbols, generated based on user input.

[0188] "Fan-related items" are custom items related to the characters or idols that users support.

[0189] A "generative AI model" is an artificial intelligence model used to generate images or monograms based on user input.

[0190] A "prompt statement" is an instruction given to a generative AI model to obtain a specific output.

[0191] An "in-store information processing device" is an electronic device installed in a physical store and used to provide users with instructions for creating custom items.

[0192] The system for implementing this invention provides users with an experience of creating custom items in a physical store. The system is implemented using an information processing device (e.g., a tablet device) installed in the store. Users input character characteristics and the idol's assigned color through the device. Based on this input, the server generates abstract images or monograms.

[0193] The generated images and monograms are created using a generative AI model. The server sends prompts to the generative AI model to obtain instructions for creating a custom item based on the design selected by the user. An example of a prompt is, "Please tell me how to create dot art using a cat monogram. Please also list the materials needed."

[0194] The server displays the generated instructions on the terminal and provides them to the user. This allows the user to see the steps for creating a custom item in real time and understand the necessary materials. For example, if the user selects "Cat Monogram," the server generates "Instructions for Creating Dot Art Using a Cat Monogram" and lists the necessary materials (e.g., canvas, paint, brushes).

[0195] This system will enhance the in-store experience for users and allow them to easily create custom items tailored to their preferences.

[0196] The flow of the specific processing in Application Example 3 will be explained using Figure 16.

[0197] Step 1:

[0198] Users use terminals in the store to input character characteristics and the idol's assigned color. The entered information is then sent from the terminal to the server.

[0199] Step 2:

[0200] The server creates and sends prompt messages to the generating AI model based on the user's input information. These prompt messages include instructions for creating a custom item based on the design selected by the user.

[0201] Step 3:

[0202] The generative AI model processes prompts received from the server and generates instructions for creating a custom item based on user input. These instructions are then returned to the server.

[0203] Step 4:

[0204] The server receives the creation instructions returned from the generated AI model and converts them into a user-friendly format. During this process, it also processes the data, including a list of necessary materials.

[0205] Step 5:

[0206] The server sends the processed instructions and material list to the terminal. The terminal displays this information to the user in real time.

[0207] Step 6:

[0208] Users review the creation instructions and material list displayed on their device and prepare to create their custom items at a physical store.

[0209] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0210] "Example of form 1"

[0211] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[0212] "Example of form 2"

[0213] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[0214] "Example of form 3"

[0215] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[0216] The following describes the processing flow for each example of the form.

[0217] "Example of form 1"

[0218] Step 1: Accept input from users regarding character characteristics and the idol's assigned color.

[0219] Step 2: Generate abstract images or monograms based on the input.

[0220] Step 3: Provide the user with instructions on how to create the most suitable fan activity item based on the generated results.

[0221] Step 4: Activate the emotion engine to recognize the user's emotions.

[0222] Step 5: The emotion engine analyzes the user's emotions from their facial expressions, tone of voice, text input, etc.

[0223] Step 6: The emotion engine feeds the analysis results back into the system.

[0224] Step 7: The system adjusts the generation of abstract images and monograms based on feedback from the emotion engine.

[0225] (Example 1)

[0226] Next, we will describe Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0227] Conventional systems struggled to generate personalized visual data tailored to individual user emotions and preferences, resulting in an inability to suggest appropriate items based on user sentiment. Furthermore, there was a need for a system that could output the generated visual data in various formats to meet diverse user needs.

[0228] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0229] In this invention, the server includes means for receiving multiple inputs of characteristic information and color information from the user, means for generating abstract visual data using a generative model based on said input, and means for analyzing the user's emotions and adjusting the color tone of the visual data based on the analysis results. This makes it possible to generate personalized visual data that corresponds to the user's emotions and preferences, and to suggest appropriate items.

[0230] "Characteristic information" refers to information that indicates the characteristics and attributes of a character or idol, as entered by the user.

[0231] "Color information" refers to information that users input regarding the assigned color of a character or idol.

[0232] A "generative model" refers to an algorithm or program that generates abstract visual data based on input information.

[0233] "Visual data" refers to digital data such as abstract images and monograms created by generative models.

[0234] "Emotional analysis" is the process of reading a user's emotions from their facial expressions, tone of voice, text input, etc., and reflecting the results in the system.

[0235] "Adjusting the color tone" means changing the hue and brightness of the generated visual data based on the results of the user's sentiment analysis.

[0236] "How to create an item" refers to a method of providing users with the steps and instructions to actually create an item based on the generated visual data.

[0237] The following system is constructed as an embodiment of this invention.

[0238] The server receives feature information and color information from the user through the user interface. This interface includes text input fields and a color selection tool, allowing the user to enter information such as "Character features: cat ears, assigned color: pink."

[0239] After receiving input from the user, the device generates abstract visual data using a generative AI model. This generative AI model includes an algorithm that generates visual data based on the input feature information and color information. Furthermore, the device analyzes the user's emotions using an emotion engine. The emotion engine reads emotions from the user's facial expressions, tone of voice, and text input, and feeds the results back into the system.

[0240] Based on the generated visual data, users are provided with instructions on how to create the most suitable item. For example, a specific example such as "Generate a bright pink monogram for a cat-eared character" can be used as a prompt to input into the generating AI model. This enables the creation of personalized items that reflect the user's emotions and preferences.

[0241] This system can provide a more personalized experience by adjusting the color tone of visual data according to the user's emotions. The generated visual data is output as digital art and provided in a format usable as a profile picture on communication networks. Instructions are also provided for outputting it as handcrafted art and displaying it as a decorative item.

[0242] The flow of the specific processing in Example 1 will be explained using Figure 17.

[0243] Step 1:

[0244] Users input characteristic and color information through the user interface. Specifically, they enter information such as "Character characteristics: cat ears, assigned color: pink" into a text input field. This input is sent to the server and becomes the basis data for the next processing step.

[0245] Step 2:

[0246] The server generates abstract visual data using a generative AI model based on the received feature and color information. The input information is passed to the generative AI model as prompts to generate visual data. In this process, the algorithm processes the data based on the input features and colors, and outputs the visual data.

[0247] Step 3:

[0248] The device receives the generated visual data and uses an emotion engine to analyze the user's emotions. The emotion engine analyzes the user's facial expressions, tone of voice, and text input, and adjusts the color tone of the visual data based on the results. For example, if the user is showing emotion (joy), the color tone of the visual data will be adjusted to be brighter.

[0249] Step 4:

[0250] Based on the adjusted visual data, users are provided with instructions on how to create the optimal item. The device outputs the generated visual data as digital art, providing it in a format usable as a profile picture on a communication network. It also provides instructions for outputting it as handcrafted art and displaying it as a decorative item. This allows users to create personalized items.

[0251] (Application Example 1)

[0252] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as a "server," and the smart device 14 will be referred to as a "terminal."

[0253] Modern consumers demand personalized products and services that cater to their individual preferences and emotions. However, traditional brick-and-mortar stores struggle to offer products that reflect customers' emotions and individual preferences, making it difficult to improve the customer experience. Furthermore, there is a lack of effective systems for providing product recommendations based on user emotions.

[0254] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0255] In this invention, the server includes means for receiving multiple inputs of character characteristics and colors from the user, means for generating abstract visual information based on said input, means for providing the user with a method for creating cheering activity items that are best suited to the generated results, means for analyzing the user's emotions and adjusting the color tone and design of the generated visual information based on the analysis results, and means for making product suggestions that correspond to the user's emotions. This makes it possible to make personalized product suggestions that correspond to the customer's emotions and individual preferences in physical stores, thereby improving the customer experience.

[0256] A "user" is an individual who uses the system to input character characteristics and colors, and receives personalized product recommendations.

[0257] "Character characteristics" refer to information about attributes and traits associated with a specific character, as entered by the user.

[0258] "Color" refers to information about specific colors associated with characters or idols that users input.

[0259] "Abstract visual information" refers to images or designs that are generated based on user input, and which do not have a concrete form but are visually recognizable.

[0260] "Support activity items" are items used by users when engaging in activities related to their favorite idols or idols, and are created based on generated visual information.

[0261] "Emotional analysis" is the process of reading a user's emotions from their facial expressions, tone of voice, text input, etc., and feeding the results back into the system.

[0262] "Product suggestion" refers to the act of a system presenting appropriate products or services to a user based on their emotions and preferences.

[0263] The system for implementing this invention begins with the user inputting character features and colors using a device such as a smartphone or smart glasses. The device receives this information through a user interface and sends it to a server. Based on the received information, the server generates abstract visual information using a generative AI model. This generation uses the OpenAI DALL-E model.

[0264] The server further analyzes the user's emotions using Google Cloud's Natural Language API. Based on the analysis results, it adjusts the color tone and design of the generated visual information. For example, if the user is expressing joy, the server generates visual information with brighter colors.

[0265] The generated visual information is sent to the terminal and presented to the user. Based on this information, the user can create items for their support activities. The server also provides product suggestions tailored to the user's emotions, improving the in-store purchasing experience.

[0266] For example, if a user enters "Character characteristics: cat ears, assigned color: pink" and expresses joy, the server will suggest bright pink cat ear-related products. An example of a prompt in this case would be, "Generate an image with bright colors based on cat ears, pink, and joy."

[0267] In this way, personalized product suggestions tailored to the user's emotions and preferences become possible, improving the customer experience in physical stores.

[0268] The flow of a specific process in Application Example 1 will be explained using Figure 18.

[0269] Step 1:

[0270] The user uses a smartphone or smart glasses to input the characteristics and colors of the character. The input information is sent to the server through the user interface of the terminal. The input data is in text format and specifically represents the user's preferences.

[0271] Step 2:

[0272] The server analyzes the received user input data and inputs it as a prompt sentence into the generative AI model. The generative AI model used here is OpenAI's DALL-E. The prompt sentence is configured like "Please generate an image with bright color tones based on cat ears, pink, and the emotion of joy." The server generates abstract visual information based on this prompt sentence.

[0273] Step 3:

[0274] The server uses Google Cloud's Natural Language API to analyze the user's emotion. It analyzes the user's input data and the voice and facial expression data obtained from the terminal to identify the user's emotion. The analysis result is used to adjust the color tone and design of the generated visual information.

[0275] Step 4:

[0276] The server sends the generated visual information to the terminal. The terminal presents the visual information to the user and supports the creation of cheering activity items. The user can conduct purchasing activities at physical stores based on the presented visual information.

[0277] <000 / / Step 5:

[0278] The server makes product recommendations according to the user's emotion. Based on the analyzed emotion data, it recommends the most suitable products and services to the user. In this way, the user can enjoy a personalized purchasing experience.

[0279] (Example 2)

[0280] Next, Example 2 of Form Example 2 will be described. In the following description, the data processing device 12 is referred to as a "server", and the smart device 14 is referred to as a "terminal".

[0281] In a conventional system, it is difficult to generate visual data according to a user's emotions and individual characteristics, and the creation of articles according to a user's personality and emotions has not been sufficiently carried out. For this reason, there is a demand for a system that can easily create personalized articles that reflect a user's emotions and personality.

[0282] The specific processing by the specific processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0283] In this invention, the server includes means for receiving a plurality of inputs of feature information and color information from a user, means for performing emotion analysis based on the inputs, and means for generating abstract visual data based on the results of the emotion analysis. As a result, it becomes possible to create personalized articles according to a user's emotions and personality.

[0284] "Feature information" is information indicating the characteristics of characters or articles input by the user.

[0285] "Color information" is information related to colors input by the user, and indicates specific colors or combinations of colors.

[0286] "Emotion analysis" is a process of identifying and analyzing emotions from a user's input, expression, voice tone, etc.

[0287] "Visual data" is data visually expressed, such as abstract images and monograms.

[0288] "Individually customized articles" are articles personalized based on a user's feature information and emotions.

[0289] A "communication network" is a network used to send and receive digital data, and includes the internet.

[0290] A "profile picture" is an image used to identify a user on a communication network.

[0291] "Handicrafts" are crafts made by hand, and include embroidery, carving, and other similar activities.

[0292] A "support structure" is a structure used to hold items for display.

[0293] This invention begins with the user inputting feature information and color information using a terminal. The terminal is equipped with an interface that accepts text input and voice input. The information entered by the user is transmitted to a server via a communication network.

[0294] The server performs sentiment analysis based on the received information. This sentiment analysis utilizes a sentiment engine that analyzes the user's facial expressions, voice tone, and text content. This sentiment engine identifies the user's emotions and provides guidelines for generating visual data based on the results.

[0295] A generative AI model is used to generate visual data. The server inputs user characteristic information, color information, and sentiment analysis results as prompts into the generative AI model, generating abstract visual data. This visual data is personalized according to the user's personality and emotions.

[0296] The generated visual data is output as digital art and provided in a format usable as a profile picture on a communication network. It can also be output as a handcrafted item, with instructions provided for displaying it in a support structure.

[0297] As a specific example, when the user inputs "a character with blue hair" and "the assigned color of the idol is red", and the emotion engine analyzes the emotion of "excitement", the server inputs the prompts of "blue hair", "red", and "excitement" into the generative AI model to generate visual data of a character with blue hair based on bright red. This visual data is provided as digital art reflecting the user's personality.

[0298] The flow of the specific process in Example 2 will be described using FIG. 19.

[0299] Step 1:

[0300] The user uses the terminal to input feature information and color information. The input is performed in text or voice, and the terminal has an interface for receiving this. For example, the user inputs "cat ears" and "pink". The input information is transmitted to the server via the communication network.

[0301] Step 2:

[0302] Based on the information received by the server, emotion analysis is performed. The input includes the user's text information and voice data. The server uses the emotion engine to analyze the user's emotion. For example, when the text says "happy", the server identifies the emotion of "joy". The result of this analysis serves as a guideline for generating visual data in the next step.

[0303] Step 3:

[0304] Based on the result of the emotion analysis and the user's input information, the server uses the generative AI model to generate visual data. The input includes feature information, color information, and the result of the emotion analysis. The server inputs these as prompts into the generative AI model to generate abstract visual data. For example, by inputting the prompts of "cat ears", "pink", and "joy", visual data of pink with bright-colored cat ears is generated.

[0305] Step 4:

[0306] The server provides the user with generated visual data. The output includes visual data in digital art format. The server transmits this data to the terminal via a communication network, and the user can use it as a profile picture or receive instructions to print it out as a craft item. For example, it can guide the user on how to create an original sticker using the generated visual data.

[0307] (Application Example 2)

[0308] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 as a "terminal".

[0309] In modern commercial facilities, providing personalized product recommendations that respond to customer emotions contributes to an improved customer experience. However, conventional systems have struggled to analyze customer emotions in real time and generate visual information based on them. This has prevented product recommendations that meet customer needs, hindering improvements in customer satisfaction.

[0310] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0311] In this invention, the server includes means for receiving multiple inputs of characteristic information from a user, means for generating abstract visual information based on said input, means for providing the user with a method for creating an activity item best suited to the generated result, means for analyzing the user's emotions, means for generating visual information based on said emotion analysis means, and means for outputting the generated visual information to a display device. This enables personalized product suggestions that respond to the customer's emotions.

[0312] "Characteristic information" refers to information provided by users that describes the characteristics of a character or individual.

[0313] "Visual information" refers to abstract images and monograms that are generated based on user input and emotions.

[0314] "Activity-enhancing items" are items that are suggested based on the generated visual information and are intended to support the user's activities.

[0315] "Emotion analysis methods" are technologies that analyze a user's facial expressions, tone of voice, and other factors to determine the user's emotions.

[0316] A "display device" is a device that visually presents generated visual information to the user.

[0317] The system for carrying out this invention receives user characteristic information as input and generates abstract visual information based on it. The system is equipped with emotion analysis means for analyzing the user's emotions, thereby analyzing the user's facial expressions and tone of voice to determine their emotions. For emotion analysis, a camera and microphone mounted on smart glasses are used to acquire data in real time.

[0318] The server generates visual information using a generative AI model based on data obtained from emotion analysis. This visual information is personalized according to the user's emotions; for example, if the user is expressing joy, a bright-toned image is generated. The generated visual information is displayed on the smart glasses' display and in-store displays to provide personalized product suggestions to the user.

[0319] As a concrete example, when a user visits a store, the smart glasses detect the user's smile and generate a bright, abstract image. This image is then displayed on the screen as the background for recommended products. An example of a prompt would be, "Generate a bright, abstract image that matches the smiling customer."

[0320] The flow of a specific process in Application Example 2 will be explained using Figure 20.

[0321] Step 1:

[0322] The user wears smart glasses and walks around the store. The camera and microphone built into the smart glasses capture the user's facial expressions and voice tone in real time. This provides input data for analyzing the user's emotions.

[0323] Step 2:

[0324] The device transmits captured facial and voice data to an emotion analysis system. The emotion analysis system analyzes this data to determine the user's emotions. For example, it might determine that the user is expressing joy based on a smile and a cheerful tone of voice. This analysis result is then output.

[0325] Step 3:

[0326] The server receives emotion data obtained from the emotion analysis device and inputs it into the generative AI model. The generative AI model generates abstract visual information based on the user's emotions. For example, a bright-toned image is generated for the emotion of joy. This visual information is then output.

[0327] Step 4:

[0328] The server transmits the generated visual information to the smart glasses' display. The device displays the visual information on the display and provides personalized product suggestions to the user. This allows the user to visually see products that match their mood.

[0329] (Example 3)

[0330] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server," and the smart device 14 will be referred to as the "terminal."

[0331] Conventional systems struggled to generate personalized visual data tailored to individual user emotions and preferences, resulting in an inability to provide activity items that resonated with users' feelings. Furthermore, a lack of specific instructions on how to utilize the generated visual data made it difficult for users to effectively use it.

[0332] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0333] In this invention, the server includes means for receiving multiple inputs of characteristic information from the user, means for generating abstract visual data based on said input, means for providing the user with a method for creating activity items best suited to the generation results, means for analyzing the user's emotions, and means for adjusting the visual data based on the results of said emotion analysis. This makes it possible to generate personalized visual data that corresponds to the user's emotions and preferences, and to provide specific activity items that utilize that data.

[0334] "Feature information" refers to information about the attributes and colors of characters or objects that the user inputs.

[0335] "Visual data" refers to digital data such as abstract images and monograms that are generated based on user input.

[0336] "Activity items" are specific objects or works that users can create based on the generated visual data.

[0337] "Emotion analysis means" refers to a function that analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back into the system.

[0338] "Digital art" refers to an image format that outputs generated visual data in a digital format and can be used on a communication network.

[0339] "Handcrafted art" refers to decorative items and works of art that are created by hand based on generated visual data.

[0340] This invention begins with the user inputting characteristic information through a terminal. This characteristic information includes information about the character's attributes and colors. The terminal transmits this information to a server. The server uses emotion analysis means to analyze the user's emotions from their facial expressions, voice tone, text input, etc. The results of this analysis classify the user's emotions into categories such as "joy" or "sadness" and feed this information back to the server.

[0341] The server uses a generative AI model to generate abstract visual data based on the user's input and the results of sentiment analysis. This visual data is adjusted in terms of color tone and design according to the user's emotions. For example, if the user inputs "I like blue" and the emotion is analyzed as "joy," the server will generate visual data based on bright blue.

[0342] Based on the generated visual data, the server provides the user with instructions on how to create activity items. This includes specific step-by-step instructions and a list of necessary materials. For example, it can provide instructions on how to create dot art using the generated visual data.

[0343] As a concrete example, if a user inputs "I want to create a monogram of a character who likes the color blue," the server generates an abstract monogram based on the color blue and provides instructions for creating dot art using that monogram. An example of a prompt to the generating AI model could be, "Generate a monogram of a character based on the color blue and tell me the steps to create dot art." The flow of specific processing in Example 3 will be explained using Figure 21.

[0344] Step 1:

[0345] The user inputs information about the character's characteristics and colors through the terminal. The terminal sends this input information to the server. The input information includes the character's attributes and the idol's assigned color. The server receives this information and prepares for the next processing step.

[0346] Step 2:

[0347] The server analyzes the user's emotions using emotion analysis tools. The inputs used are the user's facial expressions, voice tone, and text input. The emotion analysis tools analyze this data and classify the user's emotions into categories such as "joy" or "sadness." The analysis results are fed back to the server and used to generate visual data.

[0348] Step 3:

[0349] The server generates abstract visual data using a generative AI model based on user input and sentiment analysis results. Feature information and sentiment analysis results are used as input. The generative AI model processes this data to output visual data with colors and designs that correspond to the user's emotions. For example, if the user inputs "I like blue" and the emotion is analyzed as "joy," visual data based on bright blue will be generated.

[0350] Step 4:

[0351] The server provides the user with instructions on how to create activity items based on the generated visual data. The generated visual data is used as input. Based on this data, the server creates specific step-by-step instructions and a list of necessary materials, and sends them to the terminal. For example, it provides instructions on how to create dot art using the generated visual data.

[0352] Step 5:

[0353] The device displays instructions to the user on how to create activity items received from the server. The user can then create activity items based on the generated visual data by following the displayed instructions. This allows the user to create personalized items that reflect their individual emotions and preferences.

[0354] (Application Example 3)

[0355] Next, we will explain Application Example 3 of Form Example 3. In the following explanation, the data processing device 12 will be referred to as a "server," and the smart device 14 will be referred to as a "terminal."

[0356] Traditional methods for creating merchandise for fans of specific interests have presented challenges, including the difficulty of personalizing items to reflect user emotions and individual preferences, and the cumbersome process from creation to actual purchase. Furthermore, color adjustments based on user emotions and the provision of customized products in virtual stores have not been adequately addressed.

[0357] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[0358] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and the idol's assigned color; means for generating abstract images and monograms based on said input; means for providing the user with the most suitable method for creating fan merchandise based on the generated results; means for analyzing the user's emotions and adjusting the color tone of the generated images and monograms based on the results; and means for providing customized products in a virtual store using the generated images and monograms. This enables the creation of personalized fan merchandise that matches the user's emotions and preferences, and facilitates smooth purchases in the virtual store.

[0359] A "user" refers to an individual who uses the system to create items related to their favorite idol or celebrity.

[0360] "Character characteristics" refers to the attributes and personality traits of a character that users consider important when creating merchandise for their favorite characters.

[0361] "An idol's assigned color" refers to a color associated with a particular idol and is an important element in fan activities.

[0362] An "abstract image" refers to a visual design that lacks specific shapes or patterns and is expressed through combinations of colors and shapes.

[0363] A "monogram" refers to a design created by combining letters or symbols, and is used to symbolize an individual or brand.

[0364] "Fan activity items" refer to items created by users to support their favorite characters or idols.

[0365] "Emotional analysis" refers to the process of reading a user's emotions from their facial expressions, tone of voice, text input, etc., and feeding that information back into the system.

[0366] "Adjusting the color tone" refers to changing the color scheme of the generated images or monograms according to the user's emotions.

[0367] A "virtual store" refers to a virtual store that sells goods on the internet, providing a platform where users can purchase products online.

[0368] A "customized product" refers to a product that is individually designed based on the user's input and preferences.

[0369] The system for carrying out this invention includes a user terminal and a server. The user terminal is a device such as a smartphone or smart glasses, and provides an interface for receiving input from the user. The user inputs character characteristics and the idol's assigned color, and also provides information to express emotions.

[0370] The server receives input data from the user and analyzes the user's emotions using an emotion engine. This analysis uses emotion analysis software such as Microsoft® Azure® Emotion API. Based on the analysis results, a generative AI model (e.g., OpenAI's DALL-E) is used to generate abstract images or monograms that correspond to the user's emotions and input.

[0371] The generated images and monograms are sent to the virtual store platform, allowing users to select and purchase customized products. The virtual store has an API for offering products online and enables users to customize products using the generated designs.

[0372] For example, if a user enters "a character who likes the color blue" and expresses joy, the server will generate a bright blue abstract image and suggest T-shirt designs using that image in a virtual store.

[0373] Examples of prompts for a generative AI model include the following:

[0374] "Create an abstract image with bright blue tones based on the user's favorite character traits and joyful emotion."

[0375] In this way, users can easily create unique fan-related items that reflect their emotions and preferences, and purchase them in virtual stores.

[0376] The flow of the specific processing in Application Example 3 will be explained using Figure 22.

[0377] Step 1:

[0378] Users input character characteristics and the idol's assigned color using a terminal. The entered data is sent to the server through the terminal's interface. The input data includes character attributes and color information in text format.

[0379] Step 2:

[0380] The server analyzes the received input data and uses an emotion engine to analyze the user's emotions. Specifically, it uses the Microsoft Azure Emotion API to identify emotions from the user's facial expressions, tone of voice, and text input. The analysis results output the user's emotional state (e.g., joy, sadness).

[0381] Step 3:

[0382] The server generates abstract images and monograms using a generative AI model based on analyzed sentiment data and user input data. By using models such as OpenAI's DALL-E and inputting prompt text into the generative AI model, images with color tones corresponding to the user's emotions are output.

[0383] Step 4:

[0384] The generated images and monograms are sent from the server to the virtual store platform. The virtual store offers the designs received via the API as product customization options. Users can access the virtual store through their devices and select and purchase products using the generated designs.

[0385] Step 5:

[0386] The user completes the purchase process at the virtual store and orders customized products. The order information is processed by the virtual store's system, and a confirmation email is sent to the user. The products are delivered to the specified shipping address.

[0387] In this way, it becomes possible to create and purchase personalized fan-related items based on user input and emotions.

[0388] (Other examples)

[0389] Next, other embodiments will be described. In the following description, the data processing device 12 will be referred to as the "server" and the smart device 14 as the "terminal".

[0390] There is a challenge in that it is difficult for users to generate individually customized visual content based on character characteristics or the idol's assigned color, and to obtain specific procedures for utilizing it. Furthermore, there is a lack of systems that automatically adjust content in response to user emotions.

[0391] The identification process performed by the identification processing unit 290 of the data processing device 12 in other embodiments is realized by the following means.

[0392] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and the idol's assigned color; means for creating prompts to instruct a generating AI model to generate abstract images or monograms based on the inputs and inputting the prompts into the generating AI model; means for applying an emotion analysis algorithm to analyze the user's emotions and adjusting the color tone of the generated images or monograms based on the analysis results; and means for presenting specific steps to provide the user with instructions on how to create fan-related items based on the generated images or monograms. This enables the user to generate individually customized visual content, make adjustments according to their emotions, and obtain specific instructions on how to use it.

[0393] "Character characteristics" refer to the physical or personality attributes that users associate with a particular character, including hair color and style, clothing, and personality traits.

[0394] "Idol's assigned color" refers to a color associated with a particular idol or group member, which fans use to identify that idol.

[0395] A "generative AI model" refers to an artificial intelligence algorithm or system used to generate abstract images or monograms based on user input data.

[0396] A "prompt" refers to a set of instructions entered into a generative AI model to perform a specific task, and is created based on user input data.

[0397] An "emotion analysis algorithm" refers to a computational method used to predict a user's emotional state by analyzing user input and past data.

[0398] "Fan-related items" refer to items created or used by users to support a specific character or idol, and include clothing, accessories, digital content, and other items.

[0399] This invention is a system implemented using a user's terminal, a server, and a generative AI model. The user uses the terminal to input character characteristics and the idol's assigned color. This input data is transmitted from the terminal to the server.

[0400] The server generates prompt statements to instruct the AI ​​model based on the user's input data. The natural language processing library NLTK is used to generate these prompt statements. An example of a specific prompt statement is, "Generate an abstract image combining a character with blue hair and a red outfit."

[0401] The generated prompt text is input to a generative AI model (e.g., OpenAI's DALL-E) running on the server. The generative AI model generates abstract images or monograms based on this prompt text. The generated images are temporarily stored in the server's storage.

[0402] Furthermore, the server uses TextBlob, a sentiment analysis library, to analyze the user's emotions. It infers emotions from the user's input and past data, and adjusts the color tone of generated images and monograms based on the results. For example, if the user is expressing joy, the server adjusts the color tone of the image to be brighter.

[0403] Ultimately, the server creates specific instructions based on the generated images and monograms to provide users with how to create their fan merchandise. These instructions are sent to the user's device, allowing them to refer to them and create their items. For example, a specific guide such as "Instructions for creating a T-shirt based on the generated image" is provided.

[0404] In this way, users can generate individually customized visual content, make adjustments based on their emotions, and then gain concrete ways to use it.

[0405] The flow of specific processing in other embodiments will be explained using Figure 23.

[0406] Step 1:

[0407] The user uses a terminal to input character characteristics and the idol's assigned color. The entered data is sent to the server through the terminal's interface. Specifically, the user inputs "blue hair" and "red costume," and this information is sent to the server in JSON format.

[0408] Step 2:

[0409] The server generates prompts to instruct the AI ​​model based on the user's input data. It analyzes the input data and uses the natural language processing library NLTK to create the prompts. A concrete example of a prompt that might be generated is, "Generate an abstract image combining a character with blue hair and a red outfit."

[0410] Step 3:

[0411] The server inputs the generated prompt text into a generative AI model (for example, OpenAI's DALL-E). The generative AI model analyzes the prompt text and generates abstract images or monograms. The generated images are temporarily stored in the server's storage. The generated image data is obtained as output.

[0412] Step 4:

[0413] The server uses TextBlob, a sentiment analysis library, to analyze the user's emotions. It infers emotions based on user input and past data, and uses the results to adjust the color tones of generated images and monograms. For example, if the user is expressing joy, the image's color tone is brightened. The adjusted image data is output.

[0414] Step 5:

[0415] The server creates specific instructions for users to create merchandise based on the generated images and monograms. These instructions are sent to the user's device. For example, a guide such as "Instructions for creating a T-shirt based on the generated image" is provided. The output is the instruction data provided to the user.

[0416] Step 6:

[0417] Users receive images and creation instructions sent from the server via their device and create items related to their favorite idols. Users can use the generated images as icons on social media or create items by following the provided instructions. The output is the items created by the user.

[0418] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0419] Data generation model 58 is a form of so-called generative AI (Artificial Intelligence). An example of data generation model 58 is ChatGPT (registered trademark) (Internet search).<URL: https: / / openai.com / blog / chatgpt> Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0420] Other examples of generative AI include Gemini® (registered trademark) (Internet search). <url: https: gemini.google.com ?hl="ja">) are some examples.

[0421] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart device 14.

[0422] [Second Embodiment]

[0423] Figure 3 shows an example of the configuration of the data processing system 210 according to the second embodiment.

[0424] As shown in Figure 3, the data processing system 210 includes a data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0425] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0426] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication interface 44. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, and camera 42 are also connected to the bus 52.

[0427] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0428] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0429] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0430] Figure 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Figure 4, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0431] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0432] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0433] In the smart glasses 214, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0434] Next, the identification process performed by the identification processing unit 290 of the data processing device 12 will be described.

[0435] "Example of form 1"

[0436] The system of this invention receives information about character characteristics and the idol's assigned color from the user through a user interface. This interface may include text input fields, color selection tools, etc. For example, the user inputs information such as "Character characteristics: cat ears, assigned color: pink".

[0437] "Example of form 2"

[0438] Next, the system generates abstract images or monograms based on the information it receives. This generation process is carried out using preset templates and algorithms. For example, a monogram combining the features of cat ears with the color pink is generated.

[0439] "Example of form 3"

[0440] Furthermore, the system provides users with instructions on how to create merchandise related to their favorite idols, based on the generated images and monograms. This can include specific step-by-step instructions and lists of necessary materials. For example, it may provide instructions on how to create a dot art icon using the generated monogram, or how to create embroidered art and frame it.

[0441] The following describes the processing flow for each example of the form.

[0442] "Example of form 1"

[0443] Step 1: Receive information about the character's characteristics and the idol's assigned color from the user through the user interface. This interface can include text input fields, color selection tools, etc. For example, the user might input information such as "Character characteristics: cat ears, assigned color: pink".

[0444] Step 2: Based on the received information, the system's internal algorithms generate abstract images or monograms. This generation process uses preset templates and algorithms. For example, a monogram combining cat ears with the color pink is generated.

[0445] Step 3: Provide users with instructions on how to create fan merchandise based on the generated images and monograms. This can include specific step-by-step instructions and a list of necessary materials. For example, instructions could be provided on how to create a dot art icon using the generated monogram, or how to create embroidery art and frame it.

[0446] (Example 1)

[0447] Next, we will describe Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0448] Conventional information processing systems have struggled to efficiently generate and provide relevant content based on feature and color information entered by users. Furthermore, there has been a lack of means to provide the generated content in a format that users can easily utilize.

[0449] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0450] In this invention, the server includes means for receiving multiple inputs of feature information and color information from a user via an information processing device, means for generating relevant content using a generative model based on the inputs, and means for providing the generated content to the user. This makes it possible to efficiently generate relevant content based on information input by the user and provide it in a form that the user can easily utilize.

[0451] An "information processing device" is a device that receives input from users and processes the data.

[0452] A "user" is an individual or group that operates the system and inputs information.

[0453] "Feature information" refers to information that indicates the characteristics and attributes of characters and items.

[0454] "Color information" refers to information about specific colors or color combinations.

[0455] A "generative model" is an algorithm or program that generates relevant content based on input information.

[0456] "Content" refers to the visual or text-based output created by a generative model.

[0457] A "communication network" is the infrastructure used to send and receive information.

[0458] A "profile picture" is a visual representation used to identify an individual or group on a communication network.

[0459] "Decorative items" are items used to physically or digitally display generated content.

[0460] "Display instructions" are guidelines on how to arrange or use the generated content.

[0461] This invention is a system that receives feature information and color information from a user via an information processing device, generates related content using a generation AI model, and provides it to the user. Specific embodiments of this system are shown below.

[0462] The user accesses the system's user interface using a terminal. This interface includes text input fields and color selection tools, which the user uses to input character characteristics and color information. For example, the user might enter "Character characteristics: cat ears, assigned color: pink."

[0463] The server receives and analyzes information sent from the user's terminal. This analysis may utilize natural language processing techniques. Specifically, it tokenizes the text entered by the user and extracts keywords as needed. The analyzed data is then converted into a format suitable for generative AI models.

[0464] The server calls a generative AI model based on the analyzed data. Here, a model specialized in natural language processing is used as a general generative AI model. The server generates a prompt and inputs it into the model. For example, it creates a prompt such as, "Generate an illustration of a character with cat ears wearing a pink outfit."

[0465] The generative AI model generates relevant content based on the input prompts. The server receives the generated content and sends it to the user's device. The user can then view this content on their device screen, specifically displaying generated illustrations or stories.

[0466] This system allows users to visualize their ideas in a concrete form or enjoy them as a story. An example of a prompt would be, "Please create a short story featuring a blue robot character."

[0467] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0468] Step 1:

[0469] The user accesses the system's user interface using a terminal. The user enters character characteristics and color information using text input fields and color selection tools. For example, they might enter "Character characteristics: cat ears, assigned color: pink." This input becomes the data sent to the system.

[0470] Step 2:

[0471] The server receives input data sent from the user's terminal. The server analyzes the received data, tokenizes the text using natural language processing techniques, and extracts keywords. This analysis converts the data into a format suitable for the generative AI model. The analyzed data then becomes the input for the next processing step.

[0472] Step 3:

[0473] The server calls a generative AI model based on the analyzed data. The server generates a prompt and inputs it into the model. For example, it might create a prompt such as, "Generate an illustration of a character with cat ears wearing a pink outfit." This prompt becomes the input to the generative AI model.

[0474] Step 4:

[0475] The generative AI model generates relevant content based on the input prompts. The generated content is returned to the server. This output becomes the content provided to the user.

[0476] Step 5:

[0477] The server receives the generated content and sends it to the user's device. The user can then view this content on their device screen. Specifically, the generated illustrations and stories are displayed. This allows the user to visualize their ideas in a concrete form.

[0478] (Application Example 1)

[0479] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0480] In modern content generation using information processing devices, there is a need for systems that allow users to easily generate and enjoy visual content tailored to their preferences. However, conventional systems have struggled to generate and distribute content intuitively and quickly based on user input. Furthermore, there has been a lack of means for sharing the generated content with other users.

[0481] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0482] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and assigned colors, means for generating visual content using a generative AI model, and means for distributing the generated visual content to the user's information processing device. This allows the user to easily generate visual content based on their preferences and enjoy it visually through the information processing device. It also makes it easy to share the generated content with other users.

[0483] A "user" is the entity that operates the information processing device and inputs character characteristics and assigned colors.

[0484] "Character characteristics" refer to information about the character's appearance and personality that the user inputs.

[0485] "Assigned color" refers to a specific color associated with a character or idol, as entered by the user.

[0486] "Means for receiving input" refers to interfaces or devices for obtaining information from users.

[0487] A "generative AI model" is an artificial intelligence technology used to generate visual content based on user input.

[0488] "Visual content" refers to visually represented data such as illustrations and animations created by generative AI models.

[0489] An "information processing device" is an electronic device used to receive and display visual content.

[0490] "Means of distribution" refers to communication technologies used to transmit generated visual content to a user's information processing device.

[0491] "Sharing instructions" refer to information that shows how to share the generated visual content with other users, including instructions and procedures.

[0492] The system for carrying out this invention consists of a user, a server, and an information processing device. The user inputs character characteristics and assigned colors using the information processing device. The information processing device is equipped with an interface that accepts input from the user, thereby allowing the user to input information intuitively.

[0493] The server generates visual content using a generative AI model based on input information received from the user. The generative AI model receives the input character characteristics and assigned colors as prompts and generates visual content such as illustrations and animations based on that. This process utilizes artificial intelligence technologies such as the OpenAI API.

[0494] The generated visual content is delivered from the server to the information processing device. The information processing device visually displays the received visual content on a display device, allowing the user to enjoy it. The information processing device can also provide instructions for sharing the generated content with other users.

[0495] For example, if a user inputs "cat ears" and "pink," the server sends a prompt to the AI ​​model saying, "Create an illustration of a pink character with cat ears." The visual content generated based on this prompt is delivered to the information processing device, and the user can enjoy it visually.

[0496] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0497] Step 1:

[0498] The user inputs character characteristics and assigned colors through the information processing device's interface. The input information is then transmitted to the information processing device in text format.

[0499] Step 2:

[0500] The information processing device sends the input information received from the user to the server. The server analyzes the received information and generates prompt statements suitable for the AI ​​model. These prompt statements include specific instructions based on the user's input.

[0501] Step 3:

[0502] The server sends the generated prompt text to the generative AI model. The generative AI model receives the prompt text as input and generates visual content. The generative AI model performs data calculations based on the input features and colors and outputs illustrations or animations.

[0503] Step 4:

[0504] The server delivers the visual content obtained from the generated AI model to the information processing device. The information processing device displays the received content on a display device, allowing the user to enjoy it visually.

[0505] Step 5:

[0506] The information processing device provides the user with instructions for sharing the generated visual content with other users. The user can then share the content by following the provided instructions.

[0507] (Example 2)

[0508] Next, we will describe Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0509] Conventional image generation systems have struggled to effectively analyze user input and generate abstract visual representations that align with the user's intent. Furthermore, there has been a lack of means to provide the generated visual representations in a format easily usable by the user. This has limited the generation and utilization of customized visual representations tailored to user needs.

[0510] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0511] In this invention, the server includes means for receiving characteristic information from a user, means for analyzing the characteristic information and converting it into a format suitable for a generative artificial intelligence model, and means for generating an abstract visual representation using the generative artificial intelligence model based on the converted information. This makes it possible to generate a customized visual representation based on user input and provide it in a format that can be easily used by the user.

[0512] A "user" is an entity that uses the system to input characteristic information and requests the generation of a visual representation.

[0513] "Feature information" refers to information that includes specific elements and attributes that the user inputs and wants to be reflected in the generated visual representation.

[0514] A "generative artificial intelligence model" is a model that uses machine learning algorithms to generate visual representations based on input information.

[0515] "Visual representation" refers to a visual output, such as an abstract image or monogram, generated based on user input.

[0516] A "server" is a computer system that receives input from users and performs information analysis, transformation, and generation of visual representations.

[0517] A "terminal" is a device that a user uses to access a system and receive visual representations.

[0518] This invention is a system that generates abstract visual representations based on feature information entered by the user. The user accesses the system using a terminal and inputs the features of the visual representation they want to generate as prompt text. For example, they can input a specific request such as, "Please generate a monogram that combines the features of cat ears with the color pink."

[0519] The server receives prompt messages sent by the user and analyzes them using natural language processing techniques. This analysis extracts keywords and features from the prompt messages and converts them into a format suitable for generative AI models. Generative AI models used include machine learning algorithms such as Stable Diffusion and DALL-E.

[0520] The server inputs the transformed information into a generating AI model, which then generates a visual representation based on the user's request. The generated visual representation is sent to the user's device, where the user can review it and save or share it as needed.

[0521] This system allows users to easily generate customized visual representations and use them for a variety of purposes.

[0522] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0523] Step 1:

[0524] The user accesses the system using a terminal and inputs the features of the visual representation they want to generate as prompt statements. For example, they might input a specific request such as, "Please generate a monogram that combines the features of cat ears with the color pink." These prompt statements become the input to the system.

[0525] Step 2:

[0526] The server receives prompt messages sent by the user. Natural language processing techniques are used to analyze the received prompt messages. Specifically, keywords such as "cat ears" and "pink" are extracted from the prompt messages and converted into a format suitable for the generative AI model. This converted information becomes the input for the next process.

[0527] Step 3:

[0528] The server inputs the transformed information into a generative AI model. Examples of generative AI models used include Stable Diffusion and DALL-E. The model performs data calculations based on the input information and generates a visual representation that matches the user's requirements. This generated visual representation becomes the output for the next process.

[0529] Step 4:

[0530] The server sends the generated visual representation to the user's device. The user's device displays the received visual representation for the user to review. The user can download the generated visual representation or use it for other purposes. This provides a customized visual representation based on the user's requests.

[0531] (Application Example 2)

[0532] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0533] The modern advertising industry demands the rapid and effective generation of visually appealing content. However, traditional methods require design expertise and time, making it difficult to efficiently create visual content for advertising. To solve this problem, a system is needed that allows users to easily generate and utilize visual content for advertising.

[0534] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0535] In this invention, the server includes means for receiving information from a user, means for generating abstract visual content based on said information, and means for providing the generated visual content for advertising purposes. This enables users to quickly generate and use visual content for advertising without requiring specialized knowledge.

[0536] "Means for receiving information from users" refers to the interface through which the system acquires data and keywords entered by the user.

[0537] "Means for generating abstract visual content" refers to algorithms and processes for generating visually represented content based on received information.

[0538] "Means for providing generated visual content for advertising purposes" refers to a function for providing users with generated visual content in a format that can be used as an advertising medium.

[0539] "Means of inputting prompts into the generating AI model" refers to the process of creating and inputting text that provides appropriate instructions to the generating AI model based on keywords specified by the user.

[0540] "Means for previewing generated visual content" refers to a function that displays the generated content so that the user can check it.

[0541] The system for carrying out this invention provides a process for generating visual content for advertising using a device such as a smartphone or smart glasses. The user can input keywords through the device's interface. These keywords form the basis of prompt sentences input to the generating AI model.

[0542] The server converts keywords received from the user into prompt sentences and inputs them into a generative AI model. Examples of such generative AI models include DALL-E and Stable Diffusion. The generative AI model then generates abstract visual content based on the prompt sentences.

[0543] The generated visual content can be previewed on the device, allowing users to review its contents. Users can save or share the generated content for advertising purposes. For example, if a user enters "summer sale" as a keyword, the prompt will be "a bright, colorful abstract image themed around a summer sale." This prompt can be input into the AI ​​generation model, and the generated image can be used for advertising.

[0544] This system allows users to quickly and efficiently generate and utilize visual content for advertising without requiring specialized design knowledge.

[0545] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0546] Step 1:

[0547] The user enters keywords through the terminal's interface. The entered keywords are sent to the server as basic data for generating visual content for advertising.

[0548] Step 2:

[0549] The server generates a prompt based on the received keyword. This prompt is an instruction to be input into the generating AI model. For example, if the keyword is "summer sale," the prompt will be "a bright, colorful abstract image with a summer sale theme."

[0550] Step 3:

[0551] The server inputs the generated prompt text into the generative AI model. DALL-E and Stable Diffusion are used as the generative AI model. The model performs data calculations based on the prompt text and generates abstract visual content.

[0552] Step 4:

[0553] The generated visual content is sent from the server to the terminal. The terminal displays a preview of the received visual content to the user. The user can review this preview and request modifications or regeneration as needed.

[0554] Step 5:

[0555] If a user is satisfied with the generated visual content, their device will save or share that content for advertising purposes. This allows for the rapid deployment of advertising campaigns.

[0556] (Example 3)

[0557] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0558] Conventional information processing systems made it difficult for users to generate visual information based on specific characteristic information and then obtain specific methods and necessary material information for manufacturing items using that information. This resulted in a challenge in that users could not efficiently manufacture items according to their own preferences.

[0559] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0560] In this invention, the server includes means for receiving characteristic information input from a user, means for generating visual information using a generative model based on the characteristic information, and means for providing a method for manufacturing an article based on the generated visual information. This makes it possible for users to easily obtain specific methods and necessary material information for efficiently manufacturing articles according to their preferences.

[0561] An "information processing device" is a device used for inputting, processing, and outputting data, and includes devices such as computers and servers.

[0562] "User" refers to an individual or group that operates an information processing device and utilizes specific functions or services.

[0563] "Feature information" refers to information that indicates specific attributes or conditions entered by the user, and is data used to generate visual information.

[0564] A "generative model" refers to an algorithm or program that generates visual information based on input feature information.

[0565] "Visual information" refers to visually recognizable data such as images and monograms generated by generative models.

[0566] "Items" refer to specific items or products that are created based on visual information.

[0567] "Manufacturing method" refers to information that describes the specific steps and processes for manufacturing an item.

[0568] "Material information" refers to information about the materials and tools necessary for the manufacture of an item.

[0569] A "communication network" is the infrastructure for sending and receiving digital data, and includes the internet and local networks.

[0570] "Handicrafts" refer to crafts and works of art that are produced by hand.

[0571] "Ornaments" refer to items that are created based on visual information and used for decorative purposes.

[0572] This invention is a system that uses an information processing device to allow a user to input specific characteristic information, generate visual information based on that information, and further provides specific methods and material information for manufacturing an item based on that visual information.

[0573] The server provides an interface for receiving feature information from the user. The user uses a terminal to input a prompt, such as "Generate a monogram of a blue bird." This prompt is sent to a generative AI model, and the server uses this model to generate visual information. A common generative algorithm is used as the generative AI model.

[0574] The generated visual information is analyzed by a server, and methods for producing the items are devised. For example, a procedure is provided to convert the generated monogram into a dot art icon using image processing software such as Adobe Photoshop. If embroidery art is to be created, the required types and quantities of embroidery thread and fabric are listed.

[0575] The user receives production method and material information provided by the server and confirms it through the terminal. This allows the user to efficiently produce items according to their preferences. For example, if the user enters the prompt "Generate a blue bird monogram," the server generates a monogram with a blue bird motif and provides instructions for producing dot art or embroidery art based on it. The flow of a specific process in Example 3 will be explained using Figure 15.

[0576] Step 1:

[0577] The user enters prompt messages using a terminal. For example, they might enter specific instructions such as "Generate a monogram of a blue bird." This input is then sent to the server.

[0578] Step 2:

[0579] The server analyzes the received prompt and sends instructions to the generative AI model. The generative AI model generates visual information based on the prompt. In this process, the AI ​​model performs data calculations based on the input feature information to generate image data. The generated visual information is returned to the server.

[0580] Step 3:

[0581] The server devises a method for producing the item based on the generated visual information. Specifically, it uses image processing software to create procedures for converting the visual information into dot art or embroidery art. This process analyzes the visual information and determines how to process it.

[0582] Step 4:

[0583] The server lists the material information required to create an item. For example, in the case of embroidery art, it specifically lists the required embroidery thread colors and fabric types. This information is necessary for the user to create the item.

[0584] Step 5:

[0585] The server sends the generated visual information, manufacturing method, and material information to the user's terminal. The user receives this information and verifies it through the terminal. This allows the user to manufacture the item based on the provided information.

[0586] (Application Example 3)

[0587] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0588] There is a need for a system that allows users to easily create custom items tailored to their preferences, thereby enhancing their in-store experience. However, conventional systems have difficulty providing specific creation procedures based on the user's selected design, and have not been able to provide real-time customization procedures using generative AI models.

[0589] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[0590] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and the idol's assigned color, means for generating abstract images or monograms based on said input, and means for providing the user with a method for creating the most suitable fan activity item based on the generated result. This makes it possible to provide a real-time procedure for creating custom items using a generation AI model based on the design selected by the user, thereby improving the customer experience in physical stores.

[0591] A "user" is an individual who wishes to create custom items by using the system to input character characteristics and the idol's assigned color.

[0592] "Character characteristics" refer to information about attributes and traits associated with a specific character, as entered by the user.

[0593] "Idol's assigned color" refers to the color associated with a specific idol, and is information entered by the user.

[0594] An "abstract image" is a visual representation that does not have a specific shape or design, and is generated based on user input.

[0595] A "monogram" is a design that combines letters and symbols, generated based on user input.

[0596] "Fan-related items" are custom items related to the characters or idols that users support.

[0597] A "generative AI model" is an artificial intelligence model used to generate images or monograms based on user input.

[0598] A "prompt statement" is an instruction given to a generative AI model to obtain a specific output.

[0599] An "in-store information processing device" is an electronic device installed in a physical store and used to provide users with instructions for creating custom items.

[0600] The system for implementing this invention provides users with an experience of creating custom items in a physical store. The system is implemented using an information processing device (e.g., a tablet device) installed in the store. Users input character characteristics and the idol's assigned color through the device. Based on this input, the server generates abstract images or monograms.

[0601] The generated images and monograms are created using a generative AI model. The server sends prompts to the generative AI model to obtain instructions for creating a custom item based on the design selected by the user. An example of a prompt is, "Please tell me how to create dot art using a cat monogram. Please also list the materials needed."

[0602] The server displays the generated instructions on the terminal and provides them to the user. This allows the user to see the steps for creating a custom item in real time and understand the necessary materials. For example, if the user selects "Cat Monogram," the server generates "Instructions for Creating Dot Art Using a Cat Monogram" and lists the necessary materials (e.g., canvas, paint, brushes).

[0603] This system will enhance the in-store experience for users and allow them to easily create custom items tailored to their preferences.

[0604] The flow of the specific processing in Application Example 3 will be explained using Figure 16.

[0605] Step 1:

[0606] Users use terminals in the store to input character characteristics and the idol's assigned color. The entered information is then sent from the terminal to the server.

[0607] Step 2:

[0608] The server creates and sends prompt messages to the generating AI model based on the user's input information. These prompt messages include instructions for creating a custom item based on the design selected by the user.

[0609] Step 3:

[0610] The generative AI model processes prompts received from the server and generates instructions for creating a custom item based on user input. These instructions are then returned to the server.

[0611] Step 4:

[0612] The server receives the creation instructions returned from the generated AI model and converts them into a user-friendly format. During this process, it also processes the data, including a list of necessary materials.

[0613] Step 5:

[0614] The server sends the processed instructions and material list to the terminal. The terminal displays this information to the user in real time.

[0615] Step 6:

[0616] Users review the creation instructions and material list displayed on their device and prepare to create their custom items at a physical store.

[0617] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0618] "Example of form 1"

[0619] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[0620] "Example of form 2"

[0621] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[0622] "Example of form 3"

[0623] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[0624] The following describes the processing flow for each example of the form.

[0625] "Example of form 1"

[0626] Step 1: Accept input from users regarding character characteristics and the idol's assigned color.

[0627] Step 2: Generate abstract images or monograms based on the input.

[0628] Step 3: Provide the user with instructions on how to create the most suitable fan activity item based on the generated results.

[0629] Step 4: Activate the emotion engine to recognize the user's emotions.

[0630] Step 5: The emotion engine analyzes the user's emotions from their facial expressions, tone of voice, text input, etc.

[0631] Step 6: The emotion engine feeds the analysis results back into the system.

[0632] Step 7: The system adjusts the generation of abstract images and monograms based on feedback from the emotion engine.

[0633] (Example 1)

[0634] Next, we will describe Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0635] Conventional systems struggled to generate personalized visual data tailored to individual user emotions and preferences, resulting in an inability to suggest appropriate items based on user sentiment. Furthermore, there was a need for a system that could output the generated visual data in various formats to meet diverse user needs.

[0636] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0637] In this invention, the server includes means for receiving multiple inputs of characteristic information and color information from the user, means for generating abstract visual data using a generative model based on said input, and means for analyzing the user's emotions and adjusting the color tone of the visual data based on the analysis results. This makes it possible to generate personalized visual data that corresponds to the user's emotions and preferences, and to suggest appropriate items.

[0638] "Characteristic information" refers to information that indicates the characteristics and attributes of a character or idol, as entered by the user.

[0639] "Color information" refers to information that users input regarding the assigned color of a character or idol.

[0640] A "generative model" refers to an algorithm or program that generates abstract visual data based on input information.

[0641] "Visual data" refers to digital data such as abstract images and monograms created by generative models.

[0642] "Emotional analysis" is the process of reading a user's emotions from their facial expressions, tone of voice, text input, etc., and reflecting the results in the system.

[0643] "Adjusting the color tone" means changing the hue and brightness of the generated visual data based on the results of the user's sentiment analysis.

[0644] "How to create an item" refers to a method of providing users with the steps and instructions to actually create an item based on the generated visual data.

[0645] The following system is constructed as an embodiment of this invention.

[0646] The server receives feature information and color information from the user through the user interface. This interface includes text input fields and a color selection tool, allowing the user to enter information such as "Character features: cat ears, assigned color: pink."

[0647] After receiving input from the user, the device generates abstract visual data using a generative AI model. This generative AI model includes an algorithm that generates visual data based on the input feature information and color information. Furthermore, the device analyzes the user's emotions using an emotion engine. The emotion engine reads emotions from the user's facial expressions, tone of voice, and text input, and feeds the results back into the system.

[0648] Based on the generated visual data, users are provided with instructions on how to create the most suitable item. For example, a specific example such as "Generate a bright pink monogram for a cat-eared character" can be used as a prompt to input into the generating AI model. This enables the creation of personalized items that reflect the user's emotions and preferences.

[0649] This system can provide a more personalized experience by adjusting the color tone of visual data according to the user's emotions. The generated visual data is output as digital art and provided in a format usable as a profile picture on communication networks. Instructions are also provided for outputting it as handcrafted art and displaying it as a decorative item.

[0650] The flow of the specific processing in Example 1 will be explained using Figure 17.

[0651] Step 1:

[0652] Users input characteristic and color information through the user interface. Specifically, they enter information such as "Character characteristics: cat ears, assigned color: pink" into a text input field. This input is sent to the server and becomes the basis data for the next processing step.

[0653] Step 2:

[0654] The server generates abstract visual data using a generative AI model based on the received feature and color information. The input information is passed to the generative AI model as prompts to generate visual data. In this process, the algorithm processes the data based on the input features and colors, and outputs the visual data.

[0655] Step 3:

[0656] The device receives the generated visual data and uses an emotion engine to analyze the user's emotions. The emotion engine analyzes the user's facial expressions, tone of voice, and text input, and adjusts the color tone of the visual data based on the results. For example, if the user is showing emotion (joy), the color tone of the visual data will be adjusted to be brighter.

[0657] Step 4:

[0658] Based on the adjusted visual data, users are provided with instructions on how to create the optimal item. The device outputs the generated visual data as digital art, providing it in a format usable as a profile picture on a communication network. It also provides instructions for outputting it as handcrafted art and displaying it as a decorative item. This allows users to create personalized items.

[0659] (Application Example 1)

[0660] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the smart glasses 214 will be referred to as the "terminal."

[0661] Modern consumers demand personalized products and services that cater to their individual preferences and emotions. However, traditional brick-and-mortar stores struggle to offer products that reflect customers' emotions and individual preferences, making it difficult to improve the customer experience. Furthermore, there is a lack of effective systems for providing product recommendations based on user emotions.

[0662] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0663] In this invention, the server includes means for receiving multiple inputs of character characteristics and colors from the user, means for generating abstract visual information based on said input, means for providing the user with a method for creating cheering activity items that are best suited to the generated results, means for analyzing the user's emotions and adjusting the color tone and design of the generated visual information based on the analysis results, and means for making product suggestions that correspond to the user's emotions. This makes it possible to make personalized product suggestions that correspond to the customer's emotions and individual preferences in physical stores, thereby improving the customer experience.

[0664] A "user" is an individual who uses the system to input character characteristics and colors, and receives personalized product recommendations.

[0665] "Character characteristics" refer to information about attributes and traits associated with a specific character, as entered by the user.

[0666] "Color" refers to information about specific colors associated with characters or idols that users input.

[0667] "Abstract visual information" refers to images or designs that are generated based on user input, and which do not have a concrete form but are visually recognizable.

[0668] "Support activity items" are items used by users when engaging in activities related to their favorite idols or idols, and are created based on generated visual information.

[0669] "Emotional analysis" is the process of reading a user's emotions from their facial expressions, tone of voice, text input, etc., and feeding the results back into the system.

[0670] "Product suggestion" refers to the act of a system presenting appropriate products or services to a user based on their emotions and preferences.

[0671] The system for implementing this invention begins with the user inputting character features and colors using a device such as a smartphone or smart glasses. The device receives this information through a user interface and sends it to a server. Based on the received information, the server generates abstract visual information using a generative AI model. This generation uses the OpenAI DALL-E model.

[0672] The server further analyzes the user's emotions using Google Cloud's Natural Language API. Based on the analysis results, it adjusts the color tone and design of the generated visual information. For example, if the user is expressing joy, the server will generate visual information with brighter colors.

[0673] The generated visual information is sent to the terminal and presented to the user. Based on this information, the user can create items for their support activities. The server also provides product suggestions tailored to the user's emotions, improving the in-store purchasing experience.

[0674] For example, if a user enters "Character characteristics: cat ears, assigned color: pink" and expresses joy, the server will suggest bright pink cat ear-related products. An example of a prompt in this case would be, "Generate an image with bright colors based on cat ears, pink, and joy."

[0675] In this way, personalized product suggestions tailored to the user's emotions and preferences become possible, improving the customer experience in physical stores.

[0676] The flow of a specific process in Application Example 1 will be explained using Figure 18.

[0677] Step 1:

[0678] Users input character features and colors using their smartphones or smart glasses. The entered information is sent to the server through the device's user interface. The input data is in text format and specifically expresses the user's preferences.

[0679] Step 2:

[0680] The server analyzes the user's input data and inputs it as a prompt to the generative AI model. The generative AI model used here is OpenAI's DALL-E. The prompt is structured like this: "Generate an image with cat ears, pink color, and a bright color scheme based on the emotion of joy." The server generates abstract visual information based on this prompt.

[0681] Step 3:

[0682] The server uses Google Cloud's Natural Language API to analyze the user's emotions. It analyzes the user's input data and audio and facial expression data obtained from the device to identify the user's feelings. The analysis results are used to adjust the color tone and design of the generated visual information.

[0683] Step 4:

[0684] The server transmits the generated visual information to the terminal. The terminal displays the visual information to the user and assists in creating items for cheering activities. Based on the displayed visual information, the user can then make purchases at physical stores.

[0685] Step 5:

[0686] The server provides product recommendations based on the user's emotions. Based on analyzed emotional data, it suggests the most suitable products and services for the user. This allows users to enjoy a personalized purchasing experience.

[0687] (Example 2)

[0688] Next, we will describe Example 2 of Form Example 2. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0689] Conventional systems have struggled to generate visual data that reflects users' emotions and individual characteristics, resulting in insufficient creation of personalized items that reflect users' individuality and feelings. Therefore, there is a need for a system that can easily create personalized items that reflect users' emotions and individuality.

[0690] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0691] In this invention, the server includes means for receiving multiple inputs of characteristic information and color information from the user, means for performing sentiment analysis based on the inputs, and means for generating abstract visual data based on the results of the sentiment analysis. This makes it possible to create personalized items that correspond to the user's emotions and personality.

[0692] "Feature information" refers to information that describes the characteristics of characters or items entered by the user.

[0693] "Color information" refers to information about colors entered by the user, indicating specific colors or color combinations.

[0694] "Emotion analysis" is the process of identifying and analyzing emotions from a user's input, facial expressions, tone of voice, and other factors.

[0695] "Visual data" refers to data that is visually represented, such as abstract images or monograms.

[0696] "Personalized items" are items that are personalized based on the user's characteristics and emotions.

[0697] A "communication network" is a network used to send and receive digital data, and includes the internet.

[0698] A "profile picture" is an image used to identify a user on a communication network.

[0699] "Handicrafts" are crafts made by hand, and include embroidery, carving, and other similar activities.

[0700] A "support structure" is a structure used to hold items for display.

[0701] This invention begins with the user inputting feature information and color information using a terminal. The terminal is equipped with an interface that accepts text input and voice input. The information entered by the user is transmitted to a server via a communication network.

[0702] The server performs sentiment analysis based on the received information. This sentiment analysis utilizes a sentiment engine that analyzes the user's facial expressions, voice tone, and text content. This sentiment engine identifies the user's emotions and provides guidelines for generating visual data based on the results.

[0703] A generative AI model is used to generate visual data. The server inputs user characteristic information, color information, and sentiment analysis results as prompts into the generative AI model, generating abstract visual data. This visual data is personalized according to the user's personality and emotions.

[0704] The generated visual data is output as digital art and provided in a format usable as a profile picture on a communication network. It can also be output as a handcrafted item, with instructions provided for displaying it in a support structure.

[0705] As a concrete example, if a user inputs "a character with blue hair" and "the idol's assigned color is red," and the emotion engine analyzes this to indicate the emotion of "excitement," the server will input the prompts "blue hair," "red," and "excitement" into the generating AI model, and generate visual data of a blue-haired character with a bright red base. This visual data is then provided as digital art that reflects the user's personality.

[0706] The flow of the specific processing in Example 2 will be explained using Figure 19.

[0707] Step 1:

[0708] The user inputs feature information and color information using a device. Input can be in text or voice, and the device has an interface to accept this. For example, the user might input "cat ears" and "pink." The input information is then sent to the server via a communication network.

[0709] Step 2:

[0710] The server performs sentiment analysis based on the information it receives. Input includes user text and audio data. The server uses a sentiment engine to analyze the user's emotions. For example, if the text says "happy," the server identifies the emotion as "joy." This analysis result guides the generation of visual data in the next step.

[0711] Step 3:

[0712] The server generates visual data using a generative AI model based on the results of sentiment analysis and user input. Input includes feature information, color information, and the results of sentiment analysis. The server inputs these as prompts into the generative AI model to generate abstract visual data. For example, if the prompts are "cat ears," "pink," and "joy," the server will generate visual data of a pink cat with brightly colored cat ears.

[0713] Step 4:

[0714] The server provides the user with generated visual data. The output includes visual data in digital art format. The server transmits this data to the terminal via a communication network, and the user can use it as a profile picture or receive instructions to print it out as a craft item. For example, it can guide the user on how to create an original sticker using the generated visual data.

[0715] (Application Example 2)

[0716] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal".

[0717] In modern commercial facilities, providing personalized product recommendations that respond to customer emotions contributes to an improved customer experience. However, conventional systems have struggled to analyze customer emotions in real time and generate visual information based on them. This has prevented product recommendations that meet customer needs, hindering improvements in customer satisfaction.

[0718] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0719] In this invention, the server includes means for receiving multiple inputs of characteristic information from a user, means for generating abstract visual information based on said input, means for providing the user with a method for creating an activity item best suited to the generated result, means for analyzing the user's emotions, means for generating visual information based on said emotion analysis means, and means for outputting the generated visual information to a display device. This enables personalized product suggestions that respond to the customer's emotions.

[0720] "Characteristic information" refers to information provided by users that describes the characteristics of a character or individual.

[0721] "Visual information" refers to abstract images and monograms that are generated based on user input and emotions.

[0722] "Activity-enhancing items" are items that are suggested based on the generated visual information and are intended to support the user's activities.

[0723] "Emotion analysis methods" are technologies that analyze a user's facial expressions, tone of voice, and other factors to determine the user's emotions.

[0724] A "display device" is a device that visually presents generated visual information to the user.

[0725] The system for carrying out this invention receives user characteristic information as input and generates abstract visual information based on it. The system is equipped with emotion analysis means for analyzing the user's emotions, thereby analyzing the user's facial expressions and tone of voice to determine their emotions. For emotion analysis, a camera and microphone mounted on smart glasses are used to acquire data in real time.

[0726] The server generates visual information using a generative AI model based on data obtained from emotion analysis. This visual information is personalized according to the user's emotions; for example, if the user is expressing joy, a bright-toned image is generated. The generated visual information is displayed on the smart glasses' display and in-store displays to provide personalized product suggestions to the user.

[0727] As a concrete example, when a user visits a store, the smart glasses detect the user's smile and generate a bright, abstract image. This image is then displayed on the screen as the background for recommended products. An example of a prompt would be, "Generate a bright, abstract image that matches the smiling customer."

[0728] The flow of a specific process in Application Example 2 will be explained using Figure 20.

[0729] Step 1:

[0730] The user wears smart glasses and walks around the store. The camera and microphone built into the smart glasses capture the user's facial expressions and voice tone in real time. This provides input data for analyzing the user's emotions.

[0731] Step 2:

[0732] The device transmits captured facial and voice data to an emotion analysis system. The emotion analysis system analyzes this data to determine the user's emotions. For example, it might determine that the user is expressing joy based on a smile and a cheerful tone of voice. This analysis result is then output.

[0733] Step 3:

[0734] The server receives emotion data obtained from the emotion analysis device and inputs it into the generative AI model. The generative AI model generates abstract visual information based on the user's emotions. For example, a bright-toned image is generated for the emotion of joy. This visual information is then output.

[0735] Step 4:

[0736] The server transmits the generated visual information to the smart glasses' display. The device displays the visual information on the display and provides personalized product suggestions to the user. This allows the user to visually see products that match their mood.

[0737] (Example 3)

[0738] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal".

[0739] Conventional systems struggled to generate personalized visual data tailored to individual user emotions and preferences, resulting in an inability to provide activity items that resonated with users' feelings. Furthermore, a lack of specific instructions on how to utilize the generated visual data made it difficult for users to effectively use it.

[0740] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0741] In this invention, the server includes means for receiving multiple inputs of characteristic information from the user, means for generating abstract visual data based on said input, means for providing the user with a method for creating activity items best suited to the generation results, means for analyzing the user's emotions, and means for adjusting the visual data based on the results of said emotion analysis. This makes it possible to generate personalized visual data that corresponds to the user's emotions and preferences, and to provide specific activity items that utilize that data.

[0742] "Feature information" refers to information about the attributes and colors of characters or objects that the user inputs.

[0743] "Visual data" refers to digital data such as abstract images and monograms that are generated based on user input.

[0744] "Activity items" are specific objects or works that users can create based on the generated visual data.

[0745] "Emotion analysis means" refers to a function that analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back into the system.

[0746] "Digital art" refers to an image format that outputs generated visual data in a digital format and can be used on a communication network.

[0747] "Handcrafted art" refers to decorative items and works of art that are created by hand based on generated visual data.

[0748] This invention begins with the user inputting characteristic information through a terminal. This characteristic information includes information about the character's attributes and colors. The terminal transmits this information to a server. The server uses emotion analysis means to analyze the user's emotions from their facial expressions, voice tone, text input, etc. The results of this analysis classify the user's emotions into categories such as "joy" or "sadness" and feed this information back to the server.

[0749] The server uses a generative AI model to generate abstract visual data based on the user's input and the results of sentiment analysis. This visual data is adjusted in terms of color tone and design according to the user's emotions. For example, if the user inputs "I like blue" and the emotion is analyzed as "joy," the server will generate visual data based on bright blue.

[0750] Based on the generated visual data, the server provides the user with instructions on how to create activity items. This includes specific step-by-step instructions and a list of necessary materials. For example, it can provide instructions on how to create dot art using the generated visual data.

[0751] As a concrete example, if a user inputs "I want to create a monogram of a character who likes the color blue," the server generates an abstract monogram based on the color blue and provides instructions for creating dot art using that monogram. An example of a prompt to the generating AI model could be, "Generate a monogram of a character based on the color blue and tell me the steps to create dot art." The flow of specific processing in Example 3 will be explained using Figure 21.

[0752] Step 1:

[0753] The user inputs information about the character's characteristics and colors through the terminal. The terminal sends this input information to the server. The input information includes the character's attributes and the idol's assigned color. The server receives this information and prepares for the next processing step.

[0754] Step 2:

[0755] The server analyzes the user's emotions using emotion analysis tools. The inputs used are the user's facial expressions, voice tone, and text input. The emotion analysis tools analyze this data and classify the user's emotions into categories such as "joy" or "sadness." The analysis results are fed back to the server and used to generate visual data.

[0756] Step 3:

[0757] The server generates abstract visual data using a generative AI model based on user input and sentiment analysis results. Feature information and sentiment analysis results are used as input. The generative AI model processes this data to output visual data with colors and designs that correspond to the user's emotions. For example, if the user inputs "I like blue" and the emotion is analyzed as "joy," visual data based on bright blue will be generated.

[0758] Step 4:

[0759] The server provides the user with instructions on how to create activity items based on the generated visual data. The generated visual data is used as input. Based on this data, the server creates specific step-by-step instructions and a list of necessary materials, and sends them to the terminal. For example, it provides instructions on how to create dot art using the generated visual data.

[0760] Step 5:

[0761] The device displays instructions to the user on how to create activity items received from the server. The user can then create activity items based on the generated visual data by following the displayed instructions. This allows the user to create personalized items that reflect their individual emotions and preferences.

[0762] (Application Example 3)

[0763] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 as the "terminal".

[0764] Traditional methods for creating merchandise for fans of specific interests have presented challenges, including the difficulty of personalizing items to reflect user emotions and individual preferences, and the cumbersome process from creation to actual purchase. Furthermore, color adjustments based on user emotions and the provision of customized products in virtual stores have not been adequately addressed.

[0765] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[0766] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and the idol's assigned color; means for generating abstract images and monograms based on said input; means for providing the user with the most suitable method for creating fan merchandise based on the generated results; means for analyzing the user's emotions and adjusting the color tone of the generated images and monograms based on the results; and means for providing customized products in a virtual store using the generated images and monograms. This enables the creation of personalized fan merchandise that matches the user's emotions and preferences, and facilitates smooth purchases in the virtual store.

[0767] A "user" refers to an individual who uses the system to create items related to their favorite idol or celebrity.

[0768] "Character characteristics" refers to the attributes and personality traits of a character that users consider important when creating merchandise for their favorite characters.

[0769] "An idol's assigned color" refers to a color associated with a particular idol and is an important element in fan activities.

[0770] An "abstract image" refers to a visual design that lacks specific shapes or patterns and is expressed through combinations of colors and shapes.

[0771] A "monogram" refers to a design created by combining letters or symbols, and is used to symbolize an individual or brand.

[0772] "Fan activity items" refer to items created by users to support their favorite characters or idols.

[0773] "Emotional analysis" refers to the process of reading a user's emotions from their facial expressions, tone of voice, text input, etc., and feeding that information back into the system.

[0774] "Adjusting the color tone" refers to changing the color scheme of the generated images or monograms according to the user's emotions.

[0775] A "virtual store" refers to a virtual store that sells goods on the internet, providing a platform where users can purchase products online.

[0776] A "customized product" refers to a product that is individually designed based on the user's input and preferences.

[0777] The system for carrying out this invention includes a user terminal and a server. The user terminal is a device such as a smartphone or smart glasses, and provides an interface for receiving input from the user. The user inputs character characteristics and the idol's assigned color, and also provides information to express emotions.

[0778] The server receives input data from the user and analyzes the user's emotions using an emotion engine. This analysis uses emotion analysis software such as the Microsoft Azure Emotion API. Based on the analysis results, a generative AI model (e.g., OpenAI's DALL-E) is used to generate abstract images or monograms that correspond to the user's emotions and input.

[0779] The generated images and monograms are sent to the virtual store platform, allowing users to select and purchase customized products. The virtual store has an API for offering products online and enables users to customize products using the generated designs.

[0780] For example, if a user enters "a character who likes the color blue" and expresses joy, the server will generate a bright blue abstract image and suggest T-shirt designs using that image in a virtual store.

[0781] Examples of prompts for a generative AI model include the following:

[0782] "Create an abstract image with bright blue tones based on the user's favorite character traits and joyful emotion."

[0783] In this way, users can easily create unique fan-related items that reflect their emotions and preferences, and purchase them in virtual stores.

[0784] The flow of the specific processing in Application Example 3 will be explained using Figure 22.

[0785] Step 1:

[0786] Users input character characteristics and the idol's assigned color using a terminal. The entered data is sent to the server through the terminal's interface. The input data includes character attributes and color information in text format.

[0787] Step 2:

[0788] The server analyzes the received input data and uses an emotion engine to analyze the user's emotions. Specifically, it uses the Microsoft Azure Emotion API to identify emotions from the user's facial expressions, tone of voice, and text input. The analysis results output the user's emotional state (e.g., joy, sadness).

[0789] Step 3:

[0790] The server generates abstract images and monograms using a generative AI model based on analyzed sentiment data and user input data. By using models such as OpenAI's DALL-E and inputting prompt text into the generative AI model, images with color tones corresponding to the user's emotions are output.

[0791] Step 4:

[0792] The generated images and monograms are sent from the server to the virtual store platform. The virtual store offers the designs received via the API as product customization options. Users can access the virtual store through their devices and select and purchase products using the generated designs.

[0793] Step 5:

[0794] The user completes the purchase process at the virtual store and orders customized products. The order information is processed by the virtual store's system, and a confirmation email is sent to the user. The products are delivered to the specified shipping address.

[0795] In this way, it becomes possible to create and purchase personalized fan-related items based on user input and emotions.

[0796] (Other examples)

[0797] Since this is the same as the specific processing described in the other embodiments of the first embodiment above, the explanation will be omitted.

[0798] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[0799] The data generation model 58 is a form of so-called generative AI (Artificial Intelligence). One example of the data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0800] Other examples of generative AI include Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) are some examples.

[0801] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and the specific processing may also be performed by the smart glasses 214.

[0802] [Third Embodiment]

[0803] Figure 5 shows an example of the configuration of the data processing system 310 according to the third embodiment.

[0804] As shown in Figure 5, the data processing system 310 includes a data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[0805] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0806] The headset terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a display 343. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and display 343 are also connected to the bus 52.

[0807] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[0808] Camera 42 includes an optical system such as a lens, aperture, and shutter, and a CMOS (Complementary This is a small digital camera equipped with an image sensor such as a metal-oxide-semiconductor (METRO) image sensor or a CCD (Charge Coupled Device) image sensor, which captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[0809] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[0810] Figure 6 shows an example of the main functions of the data processing device 12 and the headset terminal 314. As shown in Figure 6, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[0811] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0812] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0813] In the headset terminal 314, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[0814] Next, the identification process performed by the identification processing unit 290 of the data processing device 12 will be described.

[0815] "Example of form 1"

[0816] The system of this invention receives information about character characteristics and the idol's assigned color from the user through a user interface. This interface may include text input fields, color selection tools, etc. For example, the user inputs information such as "Character characteristics: cat ears, assigned color: pink".

[0817] "Example of form 2"

[0818] Next, the system generates abstract images or monograms based on the information it receives. This generation process is carried out using preset templates and algorithms. For example, a monogram combining the features of cat ears with the color pink is generated.

[0819] "Example of form 3"

[0820] Furthermore, the system provides users with instructions on how to create merchandise related to their favorite idols, based on the generated images and monograms. This can include specific step-by-step instructions and lists of necessary materials. For example, it may provide instructions on how to create a dot art icon using the generated monogram, or how to create embroidered art and frame it.

[0821] The following describes the processing flow for each example of the form.

[0822] "Example of form 1"

[0823] Step 1: Receive information about the character's characteristics and the idol's assigned color from the user through the user interface. This interface can include text input fields, color selection tools, etc. For example, the user might input information such as "Character characteristics: cat ears, assigned color: pink".

[0824] Step 2: Based on the received information, the system's internal algorithms generate abstract images or monograms. This generation process uses preset templates and algorithms. For example, a monogram combining cat ears with the color pink is generated.

[0825] Step 3: Provide users with instructions on how to create fan merchandise based on the generated images and monograms. This can include specific step-by-step instructions and a list of necessary materials. For example, instructions could be provided on how to create a dot art icon using the generated monogram, or how to create embroidery art and frame it.

[0826] (Example 1)

[0827] Next, we will describe Embodiment 1 of Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0828] Conventional information processing systems have struggled to efficiently generate and provide relevant content based on feature and color information entered by users. Furthermore, there has been a lack of means to provide the generated content in a format that users can easily utilize.

[0829] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[0830] In this invention, the server includes means for receiving multiple inputs of feature information and color information from a user via an information processing device, means for generating relevant content using a generative model based on the inputs, and means for providing the generated content to the user. This makes it possible to efficiently generate relevant content based on information input by the user and provide it in a form that the user can easily utilize.

[0831] An "information processing device" is a device that receives input from users and processes the data.

[0832] A "user" is an individual or group that operates the system and inputs information.

[0833] "Feature information" refers to information that indicates the characteristics and attributes of characters and items.

[0834] "Color information" refers to information about specific colors or color combinations.

[0835] A "generative model" is an algorithm or program that generates relevant content based on input information.

[0836] "Content" refers to the visual or text-based output created by a generative model.

[0837] A "communication network" is the infrastructure used to send and receive information.

[0838] A "profile picture" is a visual representation used to identify an individual or group on a communication network.

[0839] "Decorative items" are items used to physically or digitally display generated content.

[0840] "Display instructions" are guidelines on how to arrange or use the generated content.

[0841] This invention is a system that receives feature information and color information from a user via an information processing device, generates related content using a generation AI model, and provides it to the user. Specific embodiments of this system are shown below.

[0842] The user accesses the system's user interface using a terminal. This interface includes text input fields and color selection tools, which the user uses to input character characteristics and color information. For example, the user might enter "Character characteristics: cat ears, assigned color: pink."

[0843] The server receives and analyzes information sent from the user's terminal. This analysis may utilize natural language processing techniques. Specifically, it tokenizes the text entered by the user and extracts keywords as needed. The analyzed data is then converted into a format suitable for generative AI models.

[0844] The server calls a generative AI model based on the analyzed data. Here, a model specialized in natural language processing is used as a general generative AI model. The server generates a prompt and inputs it into the model. For example, it creates a prompt such as, "Generate an illustration of a character with cat ears wearing a pink outfit."

[0845] The generative AI model generates relevant content based on the input prompts. The server receives the generated content and sends it to the user's device. The user can then view this content on their device screen, specifically displaying generated illustrations or stories.

[0846] This system allows users to visualize their ideas in a concrete form or enjoy them as a story. An example of a prompt would be, "Please create a short story featuring a blue robot character."

[0847] The flow of the specific processing in Example 1 will be explained using Figure 11.

[0848] Step 1:

[0849] The user accesses the system's user interface using a terminal. The user enters character characteristics and color information using text input fields and color selection tools. For example, they might enter "Character characteristics: cat ears, assigned color: pink." This input becomes the data sent to the system.

[0850] Step 2:

[0851] The server receives input data sent from the user's terminal. The server analyzes the received data, tokenizes the text using natural language processing techniques, and extracts keywords. This analysis converts the data into a format suitable for the generative AI model. The analyzed data then becomes the input for the next processing step.

[0852] Step 3:

[0853] The server calls a generative AI model based on the analyzed data. The server generates a prompt and inputs it into the model. For example, it might create a prompt such as, "Generate an illustration of a character with cat ears wearing a pink outfit." This prompt becomes the input to the generative AI model.

[0854] Step 4:

[0855] The generative AI model generates relevant content based on the input prompts. The generated content is returned to the server. This output becomes the content provided to the user.

[0856] Step 5:

[0857] The server receives the generated content and sends it to the user's device. The user can then view this content on their device screen. Specifically, the generated illustrations and stories are displayed. This allows the user to visualize their ideas in a concrete form.

[0858] (Application Example 1)

[0859] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0860] In modern content generation using information processing devices, there is a need for systems that allow users to easily generate and enjoy visual content tailored to their preferences. However, conventional systems have struggled to generate and distribute content intuitively and quickly based on user input. Furthermore, there has been a lack of means for sharing the generated content with other users.

[0861] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[0862] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and assigned colors, means for generating visual content using a generative AI model, and means for distributing the generated visual content to the user's information processing device. This allows the user to easily generate visual content based on their preferences and enjoy it visually through the information processing device. It also makes it easy to share the generated content with other users.

[0863] A "user" is the entity that operates the information processing device and inputs character characteristics and assigned colors.

[0864] "Character characteristics" refer to information about the character's appearance and personality that the user inputs.

[0865] "Assigned color" refers to a specific color associated with a character or idol, as entered by the user.

[0866] "Means for receiving input" refers to interfaces or devices for obtaining information from users.

[0867] A "generative AI model" is an artificial intelligence technology used to generate visual content based on user input.

[0868] "Visual content" refers to visually represented data such as illustrations and animations created by generative AI models.

[0869] An "information processing device" is an electronic device used to receive and display visual content.

[0870] "Means of distribution" refers to communication technologies used to transmit generated visual content to a user's information processing device.

[0871] "Sharing instructions" refer to information that shows how to share the generated visual content with other users, including instructions and procedures.

[0872] The system for carrying out this invention consists of a user, a server, and an information processing device. The user inputs character characteristics and assigned colors using the information processing device. The information processing device is equipped with an interface that accepts input from the user, thereby allowing the user to input information intuitively.

[0873] The server generates visual content using a generative AI model based on input information received from the user. The generative AI model receives the input character characteristics and assigned colors as prompts and generates visual content such as illustrations and animations based on that. This process utilizes artificial intelligence technologies such as the OpenAI API.

[0874] The generated visual content is delivered from the server to the information processing device. The information processing device visually displays the received visual content on a display device, allowing the user to enjoy it. The information processing device can also provide instructions for sharing the generated content with other users.

[0875] For example, if a user inputs "cat ears" and "pink," the server sends a prompt to the AI ​​model saying, "Create an illustration of a pink character with cat ears." The visual content generated based on this prompt is delivered to the information processing device, and the user can enjoy it visually.

[0876] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[0877] Step 1:

[0878] The user inputs character characteristics and assigned colors through the information processing device's interface. The input information is then transmitted to the information processing device in text format.

[0879] Step 2:

[0880] The information processing device sends the input information received from the user to the server. The server analyzes the received information and generates prompt statements suitable for the AI ​​model. These prompt statements include specific instructions based on the user's input.

[0881] Step 3:

[0882] The server sends the generated prompt text to the generative AI model. The generative AI model receives the prompt text as input and generates visual content. The generative AI model performs data calculations based on the input features and colors and outputs illustrations or animations.

[0883] Step 4:

[0884] The server delivers the visual content obtained from the generated AI model to the information processing device. The information processing device displays the received content on a display device, allowing the user to enjoy it visually.

[0885] Step 5:

[0886] The information processing device provides the user with instructions for sharing the generated visual content with other users. The user can then share the content by following the provided instructions.

[0887] (Example 2)

[0888] Next, we will describe Example 2 of the morphological example. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0889] Conventional image generation systems have struggled to effectively analyze user input and generate abstract visual representations that align with the user's intent. Furthermore, there has been a lack of means to provide the generated visual representations in a format easily usable by the user. This has limited the generation and utilization of customized visual representations tailored to user needs.

[0890] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[0891] In this invention, the server includes means for receiving characteristic information from a user, means for analyzing the characteristic information and converting it into a format suitable for a generative artificial intelligence model, and means for generating an abstract visual representation using the generative artificial intelligence model based on the converted information. This makes it possible to generate a customized visual representation based on user input and provide it in a format that can be easily used by the user.

[0892] A "user" is an entity that uses the system to input characteristic information and requests the generation of a visual representation.

[0893] "Feature information" refers to information that includes specific elements and attributes that the user inputs and wants to be reflected in the generated visual representation.

[0894] A "generative artificial intelligence model" is a model that uses machine learning algorithms to generate visual representations based on input information.

[0895] "Visual representation" refers to a visual output, such as an abstract image or monogram, generated based on user input.

[0896] A "server" is a computer system that receives input from users and performs information analysis, transformation, and generation of visual representations.

[0897] A "terminal" is a device that a user uses to access a system and receive visual representations.

[0898] This invention is a system that generates abstract visual representations based on feature information entered by the user. The user accesses the system using a terminal and inputs the features of the visual representation they want to generate as prompt text. For example, they can input a specific request such as, "Please generate a monogram that combines the features of cat ears with the color pink."

[0899] The server receives prompt messages sent by the user and analyzes them using natural language processing techniques. This analysis extracts keywords and features from the prompt messages and converts them into a format suitable for generative AI models. Generative AI models used include machine learning algorithms such as Stable Diffusion and DALL-E.

[0900] The server inputs the transformed information into a generating AI model, which then generates a visual representation based on the user's request. The generated visual representation is sent to the user's device, where the user can review it and save or share it as needed.

[0901] This system allows users to easily generate customized visual representations and use them for a variety of purposes.

[0902] The flow of the specific processing in Example 2 will be explained using Figure 13.

[0903] Step 1:

[0904] The user accesses the system using a terminal and inputs the features of the visual representation they want to generate as prompt statements. For example, they might input a specific request such as, "Please generate a monogram that combines the features of cat ears with the color pink." These prompt statements become the input to the system.

[0905] Step 2:

[0906] The server receives prompt messages sent by the user. Natural language processing techniques are used to analyze the received prompt messages. Specifically, keywords such as "cat ears" and "pink" are extracted from the prompt messages and converted into a format suitable for the generative AI model. This converted information becomes the input for the next process.

[0907] Step 3:

[0908] The server inputs the transformed information into a generative AI model. Examples of generative AI models used include Stable Diffusion and DALL-E. The model performs data calculations based on the input information and generates a visual representation that matches the user's requirements. This generated visual representation becomes the output for the next process.

[0909] Step 4:

[0910] The server sends the generated visual representation to the user's device. The user's device displays the received visual representation for the user to review. The user can download the generated visual representation or use it for other purposes. This provides a customized visual representation based on the user's requests.

[0911] (Application Example 2)

[0912] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0913] The modern advertising industry demands the rapid and effective generation of visually appealing content. However, traditional methods require design expertise and time, making it difficult to efficiently create visual content for advertising. To solve this problem, a system is needed that allows users to easily generate and utilize visual content for advertising.

[0914] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[0915] In this invention, the server includes means for receiving information from a user, means for generating abstract visual content based on said information, and means for providing the generated visual content for advertising purposes. This enables users to quickly generate and use visual content for advertising without requiring specialized knowledge.

[0916] "Means for receiving information from users" refers to the interface through which the system acquires data and keywords entered by the user.

[0917] "Means for generating abstract visual content" refers to algorithms and processes for generating visually represented content based on received information.

[0918] "Means for providing generated visual content for advertising purposes" refers to a function for providing users with generated visual content in a format that can be used as an advertising medium.

[0919] "Means of inputting prompts into the generating AI model" refers to the process of creating and inputting text that provides appropriate instructions to the generating AI model based on keywords specified by the user.

[0920] "Means for previewing generated visual content" refers to a function that displays the generated content so that the user can check it.

[0921] The system for carrying out this invention provides a process for generating visual content for advertising using a device such as a smartphone or smart glasses. The user can input keywords through the device's interface. These keywords form the basis of prompt sentences input to the generating AI model.

[0922] The server converts keywords received from the user into prompt sentences and inputs them into a generative AI model. Examples of such generative AI models include DALL-E and Stable Diffusion. The generative AI model then generates abstract visual content based on the prompt sentences.

[0923] The generated visual content can be previewed on the device, allowing users to review its contents. Users can save or share the generated content for advertising purposes. For example, if a user enters "summer sale" as a keyword, the prompt will be "a bright, colorful abstract image themed around a summer sale." This prompt can be input into the AI ​​generation model, and the generated image can be used for advertising.

[0924] This system allows users to quickly and efficiently generate and utilize visual content for advertising without requiring specialized design knowledge.

[0925] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[0926] Step 1:

[0927] The user enters keywords through the terminal's interface. The entered keywords are sent to the server as basic data for generating visual content for advertising.

[0928] Step 2:

[0929] The server generates a prompt based on the received keyword. This prompt is an instruction to be input into the generating AI model. For example, if the keyword is "summer sale," the prompt will be "a bright, colorful abstract image with a summer sale theme."

[0930] Step 3:

[0931] The server inputs the generated prompt text into the generative AI model. DALL-E and Stable Diffusion are used as the generative AI model. The model performs data calculations based on the prompt text and generates abstract visual content.

[0932] Step 4:

[0933] The generated visual content is sent from the server to the terminal. The terminal displays a preview of the received visual content to the user. The user can review this preview and request modifications or regeneration as needed.

[0934] Step 5:

[0935] If a user is satisfied with the generated visual content, their device will save or share that content for advertising purposes. This allows for the rapid deployment of advertising campaigns.

[0936] (Example 3)

[0937] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0938] Conventional information processing systems made it difficult for users to generate visual information based on specific characteristic information and then obtain specific methods and necessary material information for manufacturing items using that information. This resulted in a challenge in that users could not efficiently manufacture items according to their own preferences.

[0939] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[0940] In this invention, the server includes means for receiving characteristic information input from a user, means for generating visual information using a generative model based on the characteristic information, and means for providing a method for manufacturing an article based on the generated visual information. This makes it possible for users to easily obtain specific methods and necessary material information for efficiently manufacturing articles according to their preferences.

[0941] An "information processing device" is a device used for inputting, processing, and outputting data, and includes devices such as computers and servers.

[0942] "User" refers to an individual or group that operates an information processing device and utilizes specific functions or services.

[0943] "Feature information" refers to information that indicates specific attributes or conditions entered by the user, and is data used to generate visual information.

[0944] A "generative model" refers to an algorithm or program that generates visual information based on input feature information.

[0945] "Visual information" refers to visually recognizable data such as images and monograms generated by generative models.

[0946] "Items" refer to specific items or products that are created based on visual information.

[0947] "Manufacturing method" refers to information that describes the specific steps and processes for manufacturing an item.

[0948] "Material information" refers to information about the materials and tools necessary for the manufacture of an item.

[0949] A "communication network" is the infrastructure for sending and receiving digital data, and includes the internet and local networks.

[0950] "Handicrafts" refer to crafts and works of art that are produced by hand.

[0951] "Ornaments" refer to items that are created based on visual information and used for decorative purposes.

[0952] This invention is a system that uses an information processing device to allow a user to input specific characteristic information, generate visual information based on that information, and further provides specific methods and material information for manufacturing an item based on that visual information.

[0953] The server provides an interface for receiving feature information from the user. The user uses a terminal to input a prompt, such as "Generate a monogram of a blue bird." This prompt is sent to a generative AI model, and the server uses this model to generate visual information. A common generative algorithm is used as the generative AI model.

[0954] The generated visual information is analyzed by a server, and methods for producing the items are devised. For example, a procedure is provided to convert the generated monogram into a dot art icon using image processing software such as Adobe Photoshop. If embroidery art is to be created, the required types and quantities of embroidery thread and fabric are listed.

[0955] The user receives production method and material information provided by the server and confirms it through the terminal. This allows the user to efficiently produce items according to their preferences. For example, if the user enters the prompt "Generate a blue bird monogram," the server generates a monogram with a blue bird motif and provides instructions for producing dot art or embroidery art based on it. The flow of a specific process in Example 3 will be explained using Figure 15.

[0956] Step 1:

[0957] The user enters prompt messages using a terminal. For example, they might enter specific instructions such as "Generate a monogram of a blue bird." This input is then sent to the server.

[0958] Step 2:

[0959] The server analyzes the received prompt and sends instructions to the generative AI model. The generative AI model generates visual information based on the prompt. In this process, the AI ​​model performs data calculations based on the input feature information to generate image data. The generated visual information is returned to the server.

[0960] Step 3:

[0961] The server devises a method for producing the item based on the generated visual information. Specifically, it uses image processing software to create procedures for converting the visual information into dot art or embroidery art. This process analyzes the visual information and determines how to process it.

[0962] Step 4:

[0963] The server lists the material information required to create an item. For example, in the case of embroidery art, it specifically lists the required embroidery thread colors and fabric types. This information is necessary for the user to create the item.

[0964] Step 5:

[0965] The server sends the generated visual information, manufacturing method, and material information to the user's terminal. The user receives this information and verifies it through the terminal. This allows the user to manufacture the item based on the provided information.

[0966] (Application Example 3)

[0967] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[0968] There is a need for a system that allows users to easily create custom items tailored to their preferences, thereby enhancing their in-store experience. However, conventional systems have difficulty providing specific creation procedures based on the user's selected design, and have not been able to provide real-time customization procedures using generative AI models.

[0969] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[0970] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and the idol's assigned color, means for generating abstract images or monograms based on said input, and means for providing the user with a method for creating the most suitable fan activity item based on the generated result. This makes it possible to provide a real-time procedure for creating custom items using a generation AI model based on the design selected by the user, thereby improving the customer experience in physical stores.

[0971] A "user" is an individual who wishes to create custom items by using the system to input character characteristics and the idol's assigned color.

[0972] "Character characteristics" refer to information about attributes and traits associated with a specific character, as entered by the user.

[0973] "Idol's assigned color" refers to the color associated with a specific idol, and is information entered by the user.

[0974] An "abstract image" is a visual representation that does not have a specific shape or design, and is generated based on user input.

[0975] A "monogram" is a design that combines letters and symbols, generated based on user input.

[0976] "Fan-related items" are custom items related to the characters or idols that users support.

[0977] A "generative AI model" is an artificial intelligence model used to generate images or monograms based on user input.

[0978] A "prompt statement" is an instruction given to a generative AI model to obtain a specific output.

[0979] An "in-store information processing device" is an electronic device installed in a physical store and used to provide users with instructions for creating custom items.

[0980] The system for implementing this invention provides users with an experience of creating custom items in a physical store. The system is implemented using an information processing device (e.g., a tablet device) installed in the store. Users input character characteristics and the idol's assigned color through the device. Based on this input, the server generates abstract images or monograms.

[0981] The generated images and monograms are created using a generative AI model. The server sends prompts to the generative AI model to obtain instructions for creating a custom item based on the design selected by the user. An example of a prompt is, "Please tell me how to create dot art using a cat monogram. Please also list the materials needed."

[0982] The server displays the generated instructions on the terminal and provides them to the user. This allows the user to see the steps for creating a custom item in real time and understand the necessary materials. For example, if the user selects "Cat Monogram," the server generates "Instructions for Creating Dot Art Using a Cat Monogram" and lists the necessary materials (e.g., canvas, paint, brushes).

[0983] This system will enhance the in-store experience for users and allow them to easily create custom items tailored to their preferences.

[0984] The flow of the specific processing in Application Example 3 will be explained using Figure 16.

[0985] Step 1:

[0986] Users use terminals in the store to input character characteristics and the idol's assigned color. The entered information is then sent from the terminal to the server.

[0987] Step 2:

[0988] The server creates and sends prompt messages to the generating AI model based on the user's input information. These prompt messages include instructions for creating a custom item based on the design selected by the user.

[0989] Step 3:

[0990] The generative AI model processes prompts received from the server and generates instructions for creating a custom item based on user input. These instructions are then returned to the server.

[0991] Step 4:

[0992] The server receives the creation instructions returned from the generated AI model and converts them into a user-friendly format. During this process, it also processes the data, including a list of necessary materials.

[0993] Step 5:

[0994] The server sends the processed instructions and material list to the terminal. The terminal displays this information to the user in real time.

[0995] Step 6:

[0996] Users review the creation instructions and material list displayed on their device and prepare to create their custom items at a physical store.

[0997] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[0998] "Example of form 1"

[0999] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[1000] "Example of form 2"

[1001] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[1002] "Example of form 3"

[1003] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[1004] The following describes the processing flow for each example of the form.

[1005] "Example of form 1"

[1006] Step 1: Accept input from users regarding character characteristics and the idol's assigned color.

[1007] Step 2: Generate abstract images or monograms based on the input.

[1008] Step 3: Provide the user with instructions on how to create the most suitable fan activity item based on the generated results.

[1009] Step 4: Activate the emotion engine to recognize the user's emotions.

[1010] Step 5: The emotion engine analyzes the user's emotions from their facial expressions, tone of voice, text input, etc.

[1011] Step 6: The emotion engine feeds the analysis results back into the system.

[1012] Step 7: The system adjusts the generation of abstract images and monograms based on feedback from the emotion engine.

[1013] (Example 1)

[1014] Next, we will describe Embodiment 1 of Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1015] Conventional systems struggled to generate personalized visual data tailored to individual user emotions and preferences, resulting in an inability to suggest appropriate items based on user sentiment. Furthermore, there was a need for a system that could output the generated visual data in various formats to meet diverse user needs.

[1016] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1017] In this invention, the server includes means for receiving multiple inputs of characteristic information and color information from the user, means for generating abstract visual data using a generative model based on said input, and means for analyzing the user's emotions and adjusting the color tone of the visual data based on the analysis results. This makes it possible to generate personalized visual data that corresponds to the user's emotions and preferences, and to suggest appropriate items.

[1018] "Characteristic information" refers to information that indicates the characteristics and attributes of a character or idol, as entered by the user.

[1019] "Color information" refers to information that users input regarding the assigned color of a character or idol.

[1020] A "generative model" refers to an algorithm or program that generates abstract visual data based on input information.

[1021] "Visual data" refers to digital data such as abstract images and monograms created by generative models.

[1022] "Emotional analysis" is the process of reading a user's emotions from their facial expressions, tone of voice, text input, etc., and reflecting the results in the system.

[1023] "Adjusting the color tone" means changing the hue and brightness of the generated visual data based on the results of the user's sentiment analysis.

[1024] "How to create an item" refers to a method of providing users with the steps and instructions to actually create an item based on the generated visual data.

[1025] The following system is constructed as an embodiment of this invention.

[1026] The server receives feature information and color information from the user through the user interface. This interface includes text input fields and a color selection tool, allowing the user to enter information such as "Character features: cat ears, assigned color: pink."

[1027] After receiving input from the user, the device generates abstract visual data using a generative AI model. This generative AI model includes an algorithm that generates visual data based on the input feature information and color information. Furthermore, the device analyzes the user's emotions using an emotion engine. The emotion engine reads emotions from the user's facial expressions, tone of voice, and text input, and feeds the results back into the system.

[1028] Based on the generated visual data, users are provided with instructions on how to create the most suitable item. For example, a specific example such as "Generate a bright pink monogram for a cat-eared character" can be used as a prompt to input into the generating AI model. This enables the creation of personalized items that reflect the user's emotions and preferences.

[1029] This system can provide a more personalized experience by adjusting the color tone of visual data according to the user's emotions. The generated visual data is output as digital art and provided in a format usable as a profile picture on communication networks. Instructions are also provided for outputting it as handcrafted art and displaying it as a decorative item.

[1030] The flow of the specific processing in Example 1 will be explained using Figure 17.

[1031] Step 1:

[1032] Users input characteristic and color information through the user interface. Specifically, they enter information such as "Character characteristics: cat ears, assigned color: pink" into a text input field. This input is sent to the server and becomes the basis data for the next processing step.

[1033] Step 2:

[1034] The server generates abstract visual data using a generative AI model based on the received feature and color information. The input information is passed to the generative AI model as prompts to generate visual data. In this process, the algorithm processes the data based on the input features and colors, and outputs the visual data.

[1035] Step 3:

[1036] The device receives the generated visual data and uses an emotion engine to analyze the user's emotions. The emotion engine analyzes the user's facial expressions, tone of voice, and text input, and adjusts the color tone of the visual data based on the results. For example, if the user is showing emotion (joy), the color tone of the visual data will be adjusted to be brighter.

[1037] Step 4:

[1038] Based on the adjusted visual data, users are provided with instructions on how to create the optimal item. The device outputs the generated visual data as digital art, providing it in a format usable as a profile picture on a communication network. It also provides instructions for outputting it as handcrafted art and displaying it as a decorative item. This allows users to create personalized items.

[1039] (Application Example 1)

[1040] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1041] Modern consumers demand personalized products and services that cater to their individual preferences and emotions. However, traditional brick-and-mortar stores struggle to offer products that reflect customers' emotions and individual preferences, making it difficult to improve the customer experience. Furthermore, there is a lack of effective systems for providing product recommendations based on user emotions.

[1042] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1043] In this invention, the server includes means for receiving multiple inputs of character characteristics and colors from the user, means for generating abstract visual information based on said input, means for providing the user with a method for creating cheering activity items that are best suited to the generated results, means for analyzing the user's emotions and adjusting the color tone and design of the generated visual information based on the analysis results, and means for making product suggestions that correspond to the user's emotions. This makes it possible to make personalized product suggestions that correspond to the customer's emotions and individual preferences in physical stores, thereby improving the customer experience.

[1044] A "user" is an individual who uses the system to input character characteristics and colors, and receives personalized product recommendations.

[1045] "Character characteristics" refer to information about attributes and traits associated with a specific character, as entered by the user.

[1046] "Color" refers to information about specific colors associated with characters or idols that users input.

[1047] "Abstract visual information" refers to images or designs that are generated based on user input, and which do not have a concrete form but are visually recognizable.

[1048] "Support activity items" are items used by users when engaging in activities related to their favorite idols or idols, and are created based on generated visual information.

[1049] "Emotional analysis" is the process of reading a user's emotions from their facial expressions, tone of voice, text input, etc., and feeding the results back into the system.

[1050] "Product suggestion" refers to the act of a system presenting appropriate products or services to a user based on their emotions and preferences.

[1051] The system for implementing this invention begins with the user inputting character features and colors using a device such as a smartphone or smart glasses. The device receives this information through a user interface and sends it to a server. Based on the received information, the server generates abstract visual information using a generative AI model. This generation uses the OpenAI DALL-E model.

[1052] The server further analyzes the user's emotions using Google Cloud's Natural Language API. Based on the analysis results, it adjusts the color tone and design of the generated visual information. For example, if the user is expressing joy, the server will generate visual information with brighter colors.

[1053] The generated visual information is sent to the terminal and presented to the user. Based on this information, the user can create items for their support activities. The server also provides product suggestions tailored to the user's emotions, improving the in-store purchasing experience.

[1054] For example, if a user enters "Character characteristics: cat ears, assigned color: pink" and expresses joy, the server will suggest bright pink cat ear-related products. An example of a prompt in this case would be, "Generate an image with bright colors based on cat ears, pink, and joy."

[1055] In this way, personalized product suggestions tailored to the user's emotions and preferences become possible, improving the customer experience in physical stores.

[1056] The flow of a specific process in Application Example 1 will be explained using Figure 18.

[1057] Step 1:

[1058] Users input character features and colors using their smartphones or smart glasses. The entered information is sent to the server through the device's user interface. The input data is in text format and specifically expresses the user's preferences.

[1059] Step 2:

[1060] The server analyzes the user's input data and inputs it as a prompt to the generative AI model. The generative AI model used here is OpenAI's DALL-E. The prompt is structured like this: "Generate an image with cat ears, pink color, and a bright color scheme based on the emotion of joy." The server generates abstract visual information based on this prompt.

[1061] Step 3:

[1062] The server uses Google Cloud's Natural Language API to analyze the user's emotions. It analyzes the user's input data and audio and facial expression data obtained from the device to identify the user's feelings. The analysis results are used to adjust the color tone and design of the generated visual information.

[1063] Step 4:

[1064] The server transmits the generated visual information to the terminal. The terminal displays the visual information to the user and assists in creating items for cheering activities. Based on the displayed visual information, the user can then make purchases at physical stores.

[1065] Step 5:

[1066] The server provides product recommendations based on the user's emotions. Based on analyzed emotional data, it suggests the most suitable products and services for the user. This allows users to enjoy a personalized purchasing experience.

[1067] (Example 2)

[1068] Next, we will describe Example 2 of the morphological example. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1069] Conventional systems have struggled to generate visual data that reflects users' emotions and individual characteristics, resulting in insufficient creation of personalized items that reflect users' individuality and feelings. Therefore, there is a need for a system that can easily create personalized items that reflect users' emotions and individuality.

[1070] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1071] In this invention, the server includes means for receiving multiple inputs of characteristic information and color information from the user, means for performing sentiment analysis based on the inputs, and means for generating abstract visual data based on the results of the sentiment analysis. This makes it possible to create personalized items that correspond to the user's emotions and personality.

[1072] "Feature information" refers to information that describes the characteristics of characters or items entered by the user.

[1073] "Color information" refers to information about colors entered by the user, indicating specific colors or color combinations.

[1074] "Emotion analysis" is the process of identifying and analyzing emotions from a user's input, facial expressions, tone of voice, and other factors.

[1075] "Visual data" refers to data that is visually represented, such as abstract images or monograms.

[1076] "Personalized items" are items that are personalized based on the user's characteristics and emotions.

[1077] A "communication network" is a network used to send and receive digital data, and includes the internet.

[1078] A "profile picture" is an image used to identify a user on a communication network.

[1079] "Handicrafts" are crafts made by hand, and include embroidery, carving, and other similar activities.

[1080] A "support structure" is a structure used to hold items for display.

[1081] This invention begins with the user inputting feature information and color information using a terminal. The terminal is equipped with an interface that accepts text input and voice input. The information entered by the user is transmitted to a server via a communication network.

[1082] The server performs sentiment analysis based on the received information. This sentiment analysis utilizes a sentiment engine that analyzes the user's facial expressions, voice tone, and text content. This sentiment engine identifies the user's emotions and provides guidelines for generating visual data based on the results.

[1083] A generative AI model is used to generate visual data. The server inputs user characteristic information, color information, and sentiment analysis results as prompts into the generative AI model, generating abstract visual data. This visual data is personalized according to the user's personality and emotions.

[1084] The generated visual data is output as digital art and provided in a format usable as a profile picture on a communication network. It can also be output as a handcrafted item, with instructions provided for displaying it in a support structure.

[1085] As a concrete example, if a user inputs "a character with blue hair" and "the idol's assigned color is red," and the emotion engine analyzes this to indicate the emotion of "excitement," the server will input the prompts "blue hair," "red," and "excitement" into the generating AI model, and generate visual data of a blue-haired character with a bright red base. This visual data is then provided as digital art that reflects the user's personality.

[1086] The flow of the specific processing in Example 2 will be explained using Figure 19.

[1087] Step 1:

[1088] The user inputs feature information and color information using a device. Input can be in text or voice, and the device has an interface to accept this. For example, the user might input "cat ears" and "pink." The input information is then sent to the server via a communication network.

[1089] Step 2:

[1090] The server performs sentiment analysis based on the information it receives. Input includes user text and audio data. The server uses a sentiment engine to analyze the user's emotions. For example, if the text says "happy," the server identifies the emotion as "joy." This analysis result guides the generation of visual data in the next step.

[1091] Step 3:

[1092] The server generates visual data using a generative AI model based on the results of sentiment analysis and user input. Input includes feature information, color information, and the results of sentiment analysis. The server inputs these as prompts into the generative AI model to generate abstract visual data. For example, if the prompts are "cat ears," "pink," and "joy," the server will generate visual data of a pink cat with brightly colored cat ears.

[1093] Step 4:

[1094] The server provides the user with generated visual data. The output includes visual data in digital art format. The server transmits this data to the terminal via a communication network, and the user can use it as a profile picture or receive instructions to print it out as a craft item. For example, it can guide the user on how to create an original sticker using the generated visual data.

[1095] (Application Example 2)

[1096] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1097] In modern commercial facilities, providing personalized product recommendations that respond to customer emotions contributes to an improved customer experience. However, conventional systems have struggled to analyze customer emotions in real time and generate visual information based on them. This has prevented product recommendations that meet customer needs, hindering improvements in customer satisfaction.

[1098] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1099] In this invention, the server includes means for receiving multiple inputs of characteristic information from a user, means for generating abstract visual information based on said input, means for providing the user with a method for creating an activity item best suited to the generated result, means for analyzing the user's emotions, means for generating visual information based on said emotion analysis means, and means for outputting the generated visual information to a display device. This enables personalized product suggestions that respond to the customer's emotions.

[1100] "Characteristic information" refers to information provided by users that describes the characteristics of a character or individual.

[1101] "Visual information" refers to abstract images and monograms that are generated based on user input and emotions.

[1102] "Activity-enhancing items" are items that are suggested based on the generated visual information and are intended to support the user's activities.

[1103] "Emotion analysis methods" are technologies that analyze a user's facial expressions, tone of voice, and other factors to determine the user's emotions.

[1104] A "display device" is a device that visually presents generated visual information to the user.

[1105] The system for carrying out this invention receives user characteristic information as input and generates abstract visual information based on it. The system is equipped with emotion analysis means for analyzing the user's emotions, thereby analyzing the user's facial expressions and tone of voice to determine their emotions. For emotion analysis, a camera and microphone mounted on smart glasses are used to acquire data in real time.

[1106] The server generates visual information using a generative AI model based on data obtained from emotion analysis. This visual information is personalized according to the user's emotions; for example, if the user is expressing joy, a bright-toned image is generated. The generated visual information is displayed on the smart glasses' display and in-store displays to provide personalized product suggestions to the user.

[1107] As a concrete example, when a user visits a store, the smart glasses detect the user's smile and generate a bright, abstract image. This image is then displayed on the screen as the background for recommended products. An example of a prompt would be, "Generate a bright, abstract image that matches the smiling customer."

[1108] The flow of a specific process in Application Example 2 will be explained using Figure 20.

[1109] Step 1:

[1110] The user wears smart glasses and walks around the store. The camera and microphone built into the smart glasses capture the user's facial expressions and voice tone in real time. This provides input data for analyzing the user's emotions.

[1111] Step 2:

[1112] The device transmits captured facial and voice data to an emotion analysis system. The emotion analysis system analyzes this data to determine the user's emotions. For example, it might determine that the user is expressing joy based on a smile and a cheerful tone of voice. This analysis result is then output.

[1113] Step 3:

[1114] The server receives emotion data obtained from the emotion analysis device and inputs it into the generative AI model. The generative AI model generates abstract visual information based on the user's emotions. For example, a bright-toned image is generated for the emotion of joy. This visual information is then output.

[1115] Step 4:

[1116] The server transmits the generated visual information to the smart glasses' display. The device displays the visual information on the display and provides personalized product suggestions to the user. This allows the user to visually see products that match their mood.

[1117] (Example 3)

[1118] Next, we will describe Embodiment 3 of Embodiment Example 3. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1119] Conventional systems struggled to generate personalized visual data tailored to individual user emotions and preferences, resulting in an inability to provide activity items that resonated with users' feelings. Furthermore, a lack of specific instructions on how to utilize the generated visual data made it difficult for users to effectively use it.

[1120] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[1121] In this invention, the server includes means for receiving multiple inputs of characteristic information from the user, means for generating abstract visual data based on said input, means for providing the user with a method for creating activity items best suited to the generation results, means for analyzing the user's emotions, and means for adjusting the visual data based on the results of said emotion analysis. This makes it possible to generate personalized visual data that corresponds to the user's emotions and preferences, and to provide specific activity items that utilize that data.

[1122] "Feature information" refers to information about the attributes and colors of characters or objects that the user inputs.

[1123] "Visual data" refers to digital data such as abstract images and monograms that are generated based on user input.

[1124] "Activity items" are specific objects or works that users can create based on the generated visual data.

[1125] "Emotion analysis means" refers to a function that analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back into the system.

[1126] "Digital art" refers to an image format that outputs generated visual data in a digital format and can be used on a communication network.

[1127] "Handcrafted art" refers to decorative items and works of art that are created by hand based on generated visual data.

[1128] This invention begins with the user inputting characteristic information through a terminal. This characteristic information includes information about the character's attributes and colors. The terminal transmits this information to a server. The server uses emotion analysis means to analyze the user's emotions from their facial expressions, voice tone, text input, etc. The results of this analysis classify the user's emotions into categories such as "joy" or "sadness" and feed this information back to the server.

[1129] The server uses a generative AI model to generate abstract visual data based on the user's input and the results of sentiment analysis. This visual data is adjusted in terms of color tone and design according to the user's emotions. For example, if the user inputs "I like blue" and the emotion is analyzed as "joy," the server will generate visual data based on bright blue.

[1130] Based on the generated visual data, the server provides the user with instructions on how to create activity items. This includes specific step-by-step instructions and a list of necessary materials. For example, it can provide instructions on how to create dot art using the generated visual data.

[1131] As a concrete example, if a user inputs "I want to create a monogram of a character who likes the color blue," the server generates an abstract monogram based on the color blue and provides instructions for creating dot art using that monogram. An example of a prompt to the generating AI model could be, "Generate a monogram of a character based on the color blue and tell me the steps to create dot art." The flow of specific processing in Example 3 will be explained using Figure 21.

[1132] Step 1:

[1133] The user inputs information about the character's characteristics and colors through the terminal. The terminal sends this input information to the server. The input information includes the character's attributes and the idol's assigned color. The server receives this information and prepares for the next processing step.

[1134] Step 2:

[1135] The server analyzes the user's emotions using emotion analysis tools. The inputs used are the user's facial expressions, voice tone, and text input. The emotion analysis tools analyze this data and classify the user's emotions into categories such as "joy" or "sadness." The analysis results are fed back to the server and used to generate visual data.

[1136] Step 3:

[1137] The server generates abstract visual data using a generative AI model based on user input and sentiment analysis results. Feature information and sentiment analysis results are used as input. The generative AI model processes this data to output visual data with colors and designs that correspond to the user's emotions. For example, if the user inputs "I like blue" and the emotion is analyzed as "joy," visual data based on bright blue will be generated.

[1138] Step 4:

[1139] The server provides the user with instructions on how to create activity items based on the generated visual data. The generated visual data is used as input. Based on this data, the server creates specific step-by-step instructions and a list of necessary materials, and sends them to the terminal. For example, it provides instructions on how to create dot art using the generated visual data.

[1140] Step 5:

[1141] The device displays instructions to the user on how to create activity items received from the server. The user can then create activity items based on the generated visual data by following the displayed instructions. This allows the user to create personalized items that reflect their individual emotions and preferences.

[1142] (Application Example 3)

[1143] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server," and the headset-type terminal 314 will be referred to as the "terminal."

[1144] Traditional methods for creating merchandise for fans of specific interests have presented challenges, including the difficulty of personalizing items to reflect user emotions and individual preferences, and the cumbersome process from creation to actual purchase. Furthermore, color adjustments based on user emotions and the provision of customized products in virtual stores have not been adequately addressed.

[1145] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[1146] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and the idol's assigned color; means for generating abstract images and monograms based on said input; means for providing the user with the most suitable method for creating fan merchandise based on the generated results; means for analyzing the user's emotions and adjusting the color tone of the generated images and monograms based on the results; and means for providing customized products in a virtual store using the generated images and monograms. This enables the creation of personalized fan merchandise that matches the user's emotions and preferences, and facilitates smooth purchases in the virtual store.

[1147] A "user" refers to an individual who uses the system to create items related to their favorite idol or celebrity.

[1148] "Character characteristics" refers to the attributes and personality traits of a character that users consider important when creating merchandise for their favorite characters.

[1149] "An idol's assigned color" refers to a color associated with a particular idol and is an important element in fan activities.

[1150] An "abstract image" refers to a visual design that lacks specific shapes or patterns and is expressed through combinations of colors and shapes.

[1151] A "monogram" refers to a design created by combining letters or symbols, and is used to symbolize an individual or brand.

[1152] "Fan activity items" refer to items created by users to support their favorite characters or idols.

[1153] "Emotional analysis" refers to the process of reading a user's emotions from their facial expressions, tone of voice, text input, etc., and feeding that information back into the system.

[1154] "Adjusting the color tone" refers to changing the color scheme of the generated images or monograms according to the user's emotions.

[1155] A "virtual store" refers to a virtual store that sells goods on the internet, providing a platform where users can purchase products online.

[1156] A "customized product" refers to a product that is individually designed based on the user's input and preferences.

[1157] The system for carrying out this invention includes a user terminal and a server. The user terminal is a device such as a smartphone or smart glasses, and provides an interface for receiving input from the user. The user inputs character characteristics and the idol's assigned color, and also provides information to express emotions.

[1158] The server receives input data from the user and analyzes the user's emotions using an emotion engine. This analysis uses emotion analysis software such as the Microsoft Azure Emotion API. Based on the analysis results, a generative AI model (e.g., OpenAI's DALL-E) is used to generate abstract images or monograms that correspond to the user's emotions and input.

[1159] The generated images and monograms are sent to the virtual store platform, allowing users to select and purchase customized products. The virtual store has an API for offering products online and enables users to customize products using the generated designs.

[1160] For example, if a user enters "a character who likes the color blue" and expresses joy, the server will generate a bright blue abstract image and suggest T-shirt designs using that image in a virtual store.

[1161] Examples of prompts for a generative AI model include the following:

[1162] "Create an abstract image with bright blue tones based on the user's favorite character traits and joyful emotion."

[1163] In this way, users can easily create unique fan-related items that reflect their emotions and preferences, and purchase them in virtual stores.

[1164] The flow of the specific processing in Application Example 3 will be explained using Figure 22.

[1165] Step 1:

[1166] Users input character characteristics and the idol's assigned color using a terminal. The entered data is sent to the server through the terminal's interface. The input data includes character attributes and color information in text format.

[1167] Step 2:

[1168] The server analyzes the received input data and uses an emotion engine to analyze the user's emotions. Specifically, it uses the Microsoft Azure Emotion API to identify emotions from the user's facial expressions, tone of voice, and text input. The analysis results output the user's emotional state (e.g., joy, sadness).

[1169] Step 3:

[1170] The server generates abstract images and monograms using a generative AI model based on analyzed sentiment data and user input data. By using models such as OpenAI's DALL-E and inputting prompt text into the generative AI model, images with color tones corresponding to the user's emotions are output.

[1171] Step 4:

[1172] The generated images and monograms are sent from the server to the virtual store platform. The virtual store offers the designs received via the API as product customization options. Users can access the virtual store through their devices and select and purchase products using the generated designs.

[1173] Step 5:

[1174] The user completes the purchase process at the virtual store and orders customized products. The order information is processed by the virtual store's system, and a confirmation email is sent to the user. The products are delivered to the specified shipping address.

[1175] In this way, it becomes possible to create and purchase personalized fan-related items based on user input and emotions.

[1176] (Other examples)

[1177] Since this is the same as the specific processing described in the other embodiments of the first embodiment above, the explanation will be omitted.

[1178] The specific processing unit 290 transmits the result of the specific processing to the headset terminal 314. In the headset terminal 314, the control unit 46A causes the speaker 240 and display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating user input for the result of the specific processing. The control unit 46A transmits the audio data indicating user input acquired by the microphone 238 to the data processing unit 12. In the data processing unit 12, the specific processing unit 290 acquires the audio data.

[1179] The data generation model 58 is a form of so-called generative AI (Artificial Intelligence). One example of the data generation model 58 is ChatGPT (Internet Search).<URL: https: / / openai.com / blog / chatgpt> Examples of generative AI include the following. The data generation model 58 is obtained by performing deep learning on a neural network. The data generation model 58 is input with prompts containing instructions, and with inference data such as audio data representing speech, text data representing text, and image data representing images. The data generation model 58 infers from the input inference data according to the instructions indicated by the prompts, and outputs the inference results in data formats such as audio data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1180] Other examples of generative AI include Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) are some examples.

[1181] In the above embodiment, an example was given in which specific processing is performed by the data processing device 12, but the technology of this disclosure is not limited thereto, and specific processing may also be performed by the headset terminal 314.

[1182] [Fourth Embodiment]

[1183] Figure 7 shows an example of the configuration of the data processing system 410 according to the fourth embodiment.

[1184] As shown in Figure 7, the data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1185] The data processing device 12 comprises a computer 22, a database 24, and a communication interface 26. The computer 22 is an example of a "computer" related to the technology of this disclosure. The computer 22 comprises a processor 28, RAM 30, and storage 32. The processor 28, RAM 30, and storage 32 are connected to a bus 34. The database 24 and the communication interface 26 are also connected to the bus 34. The communication interface 26 is connected to a network 54. An example of the network 54 is a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1186] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication interface 44, and a controlled object 443. The computer 36 includes a processor 46, RAM 48, and storage 50. The processor 46, RAM 48, and storage 50 are connected to a bus 52. The microphone 238, speaker 240, camera 42, and controlled object 443 are also connected to the bus 52.

[1187] The microphone 238 receives voice signals from the user 20 and receives instructions from the user 20. The microphone 238 captures the voice signals from the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio according to the instructions from the processor 46.

[1188] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an image sensor such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the area around the user 20 (for example, an imaging range defined by a field of view equivalent to the width of a typical healthy person's field of vision).

[1189] Communication interface 44 is connected to network 54. Communication interfaces 44 and 26 are responsible for the exchange of various information between processor 46 and processor 28 via network 54. The exchange of various information between processor 46 and processor 28 using communication interfaces 44 and 26 is performed in a secure manner.

[1190] The controlled object 443 includes a display device, LEDs in the eyes, and motors that drive the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the robot 414's emotions can be expressed by controlling these motors. Furthermore, the robot 414's facial expressions can also be expressed by controlling the illumination state of the LEDs in its eyes.

[1191] Figure 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Figure 8, the data processing device 12 performs specific processing using the processor 28. The storage 32 stores the specific processing program 56.

[1192] The specific processing program 56 is an example of a "program" relating to the technology of this disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1193] The storage 32 stores the data generation model 58 and the emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1194] In robot 414, the processor 46 performs the reception output processing. The storage 50 stores the reception output program 60. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output processing is realized by the processor 46 operating as a control unit 46A according to the reception output program 60 executed on the RAM 48.

[1195] Next, the identification process performed by the identification processing unit 290 of the data processing device 12 will be described.

[1196] "Example of form 1"

[1197] The system of this invention receives information about character characteristics and the idol's assigned color from the user through a user interface. This interface may include text input fields, color selection tools, etc. For example, the user inputs information such as "Character characteristics: cat ears, assigned color: pink".

[1198] "Example of form 2"

[1199] Next, the system generates abstract images or monograms based on the information it receives. This generation process is carried out using preset templates and algorithms. For example, a monogram combining the features of cat ears with the color pink is generated.

[1200] "Example of form 3"

[1201] Furthermore, the system provides users with instructions on how to create merchandise related to their favorite idols, based on the generated images and monograms. This can include specific step-by-step instructions and lists of necessary materials. For example, it may provide instructions on how to create a dot art icon using the generated monogram, or how to create embroidered art and frame it.

[1202] The following describes the processing flow for each example of the form.

[1203] "Example of form 1"

[1204] Step 1: Receive information about the character's characteristics and the idol's assigned color from the user through the user interface. This interface can include text input fields, color selection tools, etc. For example, the user might input information such as "Character characteristics: cat ears, assigned color: pink".

[1205] Step 2: Based on the received information, the system's internal algorithms generate abstract images or monograms. This generation process uses preset templates and algorithms. For example, a monogram combining cat ears with the color pink is generated.

[1206] Step 3: Provide users with instructions on how to create fan merchandise based on the generated images and monograms. This can include specific step-by-step instructions and a list of necessary materials. For example, instructions could be provided on how to create a dot art icon using the generated monogram, or how to create embroidery art and frame it.

[1207] (Example 1)

[1208] Next, we will describe Embodiment 1 of Example Form 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1209] Conventional information processing systems have struggled to efficiently generate and provide relevant content based on feature and color information entered by users. Furthermore, there has been a lack of means to provide the generated content in a format that users can easily utilize.

[1210] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1211] In this invention, the server includes means for receiving multiple inputs of feature information and color information from a user via an information processing device, means for generating relevant content using a generative model based on the inputs, and means for providing the generated content to the user. This makes it possible to efficiently generate relevant content based on information input by the user and provide it in a form that the user can easily utilize.

[1212] An "information processing device" is a device that receives input from users and processes the data.

[1213] A "user" is an individual or group that operates the system and inputs information.

[1214] "Feature information" refers to information that indicates the characteristics and attributes of characters and items.

[1215] "Color information" refers to information about specific colors or color combinations.

[1216] A "generative model" is an algorithm or program that generates relevant content based on input information.

[1217] "Content" refers to the visual or text-based output created by a generative model.

[1218] A "communication network" is the infrastructure used to send and receive information.

[1219] A "profile picture" is a visual representation used to identify an individual or group on a communication network.

[1220] "Decorative items" are items used to physically or digitally display generated content.

[1221] "Display instructions" are guidelines on how to arrange or use the generated content.

[1222] This invention is a system that receives feature information and color information from a user via an information processing device, generates related content using a generation AI model, and provides it to the user. Specific embodiments of this system are shown below.

[1223] The user accesses the system's user interface using a terminal. This interface includes text input fields and color selection tools, which the user uses to input character characteristics and color information. For example, the user might enter "Character characteristics: cat ears, assigned color: pink."

[1224] The server receives and analyzes information sent from the user's terminal. This analysis may utilize natural language processing techniques. Specifically, it tokenizes the text entered by the user and extracts keywords as needed. The analyzed data is then converted into a format suitable for generative AI models.

[1225] The server calls a generative AI model based on the analyzed data. Here, a model specialized in natural language processing is used as a general generative AI model. The server generates a prompt and inputs it into the model. For example, it creates a prompt such as, "Generate an illustration of a character with cat ears wearing a pink outfit."

[1226] The generative AI model generates relevant content based on the input prompts. The server receives the generated content and sends it to the user's device. The user can then view this content on their device screen, specifically displaying generated illustrations or stories.

[1227] This system allows users to visualize their ideas in a concrete form or enjoy them as a story. An example of a prompt would be, "Please create a short story featuring a blue robot character."

[1228] The flow of the specific processing in Example 1 will be explained using Figure 11.

[1229] Step 1:

[1230] The user accesses the system's user interface using a terminal. The user enters character characteristics and color information using text input fields and color selection tools. For example, they might enter "Character characteristics: cat ears, assigned color: pink." This input becomes the data sent to the system.

[1231] Step 2:

[1232] The server receives input data sent from the user's terminal. The server analyzes the received data, tokenizes the text using natural language processing techniques, and extracts keywords. This analysis converts the data into a format suitable for the generative AI model. The analyzed data then becomes the input for the next processing step.

[1233] Step 3:

[1234] The server calls a generative AI model based on the analyzed data. The server generates a prompt and inputs it into the model. For example, it might create a prompt such as, "Generate an illustration of a character with cat ears wearing a pink outfit." This prompt becomes the input to the generative AI model.

[1235] Step 4:

[1236] The generative AI model generates relevant content based on the input prompts. The generated content is returned to the server. This output becomes the content provided to the user.

[1237] Step 5:

[1238] The server receives the generated content and sends it to the user's device. The user can then view this content on their device screen. Specifically, the generated illustrations and stories are displayed. This allows the user to visualize their ideas in a concrete form.

[1239] (Application Example 1)

[1240] Next, we will describe Application Example 1 of Form Example 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1241] In modern content generation using information processing devices, there is a need for systems that allow users to easily generate and enjoy visual content tailored to their preferences. However, conventional systems have struggled to generate and distribute content intuitively and quickly based on user input. Furthermore, there has been a lack of means for sharing the generated content with other users.

[1242] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 1 is realized by the following means.

[1243] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and assigned colors, means for generating visual content using a generative AI model, and means for distributing the generated visual content to the user's information processing device. This allows the user to easily generate visual content based on their preferences and enjoy it visually through the information processing device. It also makes it easy to share the generated content with other users.

[1244] A "user" is the entity that operates the information processing device and inputs character characteristics and assigned colors.

[1245] "Character characteristics" refer to information about the character's appearance and personality that the user inputs.

[1246] "Assigned color" refers to a specific color associated with a character or idol, as entered by the user.

[1247] "Means for receiving input" refers to interfaces or devices for obtaining information from users.

[1248] A "generative AI model" is an artificial intelligence technology used to generate visual content based on user input.

[1249] "Visual content" refers to visually represented data such as illustrations and animations created by generative AI models.

[1250] An "information processing device" is an electronic device used to receive and display visual content.

[1251] "Means of distribution" refers to communication technologies used to transmit generated visual content to a user's information processing device.

[1252] "Sharing instructions" refer to information that shows how to share the generated visual content with other users, including instructions and procedures.

[1253] The system for carrying out this invention consists of a user, a server, and an information processing device. The user inputs character characteristics and assigned colors using the information processing device. The information processing device is equipped with an interface that accepts input from the user, thereby allowing the user to input information intuitively.

[1254] The server generates visual content using a generative AI model based on input information received from the user. The generative AI model receives the input character characteristics and assigned colors as prompts and generates visual content such as illustrations and animations based on that. This process utilizes artificial intelligence technologies such as the OpenAI API.

[1255] The generated visual content is delivered from the server to the information processing device. The information processing device visually displays the received visual content on a display device, allowing the user to enjoy it. The information processing device can also provide instructions for sharing the generated content with other users.

[1256] For example, if a user inputs "cat ears" and "pink," the server sends a prompt to the AI ​​model saying, "Create an illustration of a pink character with cat ears." The visual content generated based on this prompt is delivered to the information processing device, and the user can enjoy it visually.

[1257] The flow of a specific process in Application Example 1 will be explained using Figure 12.

[1258] Step 1:

[1259] The user inputs character characteristics and assigned colors through the information processing device's interface. The input information is then transmitted to the information processing device in text format.

[1260] Step 2:

[1261] The information processing device sends the input information received from the user to the server. The server analyzes the received information and generates prompt statements suitable for the AI ​​model. These prompt statements include specific instructions based on the user's input.

[1262] Step 3:

[1263] The server sends the generated prompt text to the generative AI model. The generative AI model receives the prompt text as input and generates visual content. The generative AI model performs data calculations based on the input features and colors and outputs illustrations or animations.

[1264] Step 4:

[1265] The server delivers the visual content obtained from the generated AI model to the information processing device. The information processing device displays the received content on a display device, allowing the user to enjoy it visually.

[1266] Step 5:

[1267] The information processing device provides the user with instructions for sharing the generated visual content with other users. The user can then share the content by following the provided instructions.

[1268] (Example 2)

[1269] Next, we will describe Example 2 of the morphological example. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1270] Conventional image generation systems have struggled to effectively analyze user input and generate abstract visual representations that align with the user's intent. Furthermore, there has been a lack of means to provide the generated visual representations in a format easily usable by the user. This has limited the generation and utilization of customized visual representations tailored to user needs.

[1271] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 2 is realized by the following means.

[1272] In this invention, the server includes means for receiving characteristic information from a user, means for analyzing the characteristic information and converting it into a format suitable for a generative artificial intelligence model, and means for generating an abstract visual representation using the generative artificial intelligence model based on the converted information. This makes it possible to generate a customized visual representation based on user input and provide it in a format that can be easily used by the user.

[1273] A "user" is an entity that uses the system to input characteristic information and requests the generation of a visual representation.

[1274] "Feature information" refers to information that includes specific elements and attributes that the user inputs and wants to be reflected in the generated visual representation.

[1275] A "generative artificial intelligence model" is a model that uses machine learning algorithms to generate visual representations based on input information.

[1276] "Visual representation" refers to a visual output, such as an abstract image or monogram, generated based on user input.

[1277] A "server" is a computer system that receives input from users and performs information analysis, transformation, and generation of visual representations.

[1278] A "terminal" is a device that a user uses to access a system and receive visual representations.

[1279] This invention is a system that generates abstract visual representations based on feature information entered by the user. The user accesses the system using a terminal and inputs the features of the visual representation they want to generate as prompt text. For example, they can input a specific request such as, "Please generate a monogram that combines the features of cat ears with the color pink."

[1280] The server receives prompt messages sent by the user and analyzes them using natural language processing techniques. This analysis extracts keywords and features from the prompt messages and converts them into a format suitable for generative AI models. Generative AI models used include machine learning algorithms such as Stable Diffusion and DALL-E.

[1281] The server inputs the transformed information into a generating AI model, which then generates a visual representation based on the user's request. The generated visual representation is sent to the user's device, where the user can review it and save or share it as needed.

[1282] This system allows users to easily generate customized visual representations and use them for a variety of purposes.

[1283] The flow of the specific processing in Example 2 will be explained using Figure 13.

[1284] Step 1:

[1285] The user accesses the system using a terminal and inputs the features of the visual representation they want to generate as prompt statements. For example, they might input a specific request such as, "Please generate a monogram that combines the features of cat ears with the color pink." These prompt statements become the input to the system.

[1286] Step 2:

[1287] The server receives prompt messages sent by the user. Natural language processing techniques are used to analyze the received prompt messages. Specifically, keywords such as "cat ears" and "pink" are extracted from the prompt messages and converted into a format suitable for the generative AI model. This converted information becomes the input for the next process.

[1288] Step 3:

[1289] The server inputs the transformed information into a generative AI model. Examples of generative AI models used include Stable Diffusion and DALL-E. The model performs data calculations based on the input information and generates a visual representation that matches the user's requirements. This generated visual representation becomes the output for the next process.

[1290] Step 4:

[1291] The server sends the generated visual representation to the user's device. The user's device displays the received visual representation for the user to review. The user can download the generated visual representation or use it for other purposes. This provides a customized visual representation based on the user's requests.

[1292] (Application Example 2)

[1293] Next, we will describe application example 2 of form example 2. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1294] The modern advertising industry demands the rapid and effective generation of visually appealing content. However, traditional methods require design expertise and time, making it difficult to efficiently create visual content for advertising. To solve this problem, a system is needed that allows users to easily generate and utilize visual content for advertising.

[1295] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means.

[1296] In this invention, the server includes means for receiving information from a user, means for generating abstract visual content based on said information, and means for providing the generated visual content for advertising purposes. This enables users to quickly generate and use visual content for advertising without requiring specialized knowledge.

[1297] "Means for receiving information from users" refers to the interface through which the system acquires data and keywords entered by the user.

[1298] "Means for generating abstract visual content" refers to algorithms and processes for generating visually represented content based on received information.

[1299] "Means for providing generated visual content for advertising purposes" refers to a function for providing users with generated visual content in a format that can be used as an advertising medium.

[1300] "Means of inputting prompts into the generating AI model" refers to the process of creating and inputting text that provides appropriate instructions to the generating AI model based on keywords specified by the user.

[1301] "Means for previewing generated visual content" refers to a function that displays the generated content so that the user can check it.

[1302] The system for carrying out this invention provides a process for generating visual content for advertising using a device such as a smartphone or smart glasses. The user can input keywords through the device's interface. These keywords form the basis of prompt sentences input to the generating AI model.

[1303] The server converts keywords received from the user into prompt sentences and inputs them into a generative AI model. Examples of such generative AI models include DALL-E and Stable Diffusion. The generative AI model then generates abstract visual content based on the prompt sentences.

[1304] The generated visual content can be previewed on the device, allowing users to review its contents. Users can save or share the generated content for advertising purposes. For example, if a user enters "summer sale" as a keyword, the prompt will be "a bright, colorful abstract image themed around a summer sale." This prompt can be input into the AI ​​generation model, and the generated image can be used for advertising.

[1305] This system allows users to quickly and efficiently generate and utilize visual content for advertising without requiring specialized design knowledge.

[1306] The flow of a specific process in Application Example 2 will be explained using Figure 14.

[1307] Step 1:

[1308] The user enters keywords through the terminal's interface. The entered keywords are sent to the server as basic data for generating visual content for advertising.

[1309] Step 2:

[1310] The server generates a prompt based on the received keyword. This prompt is an instruction to be input into the generating AI model. For example, if the keyword is "summer sale," the prompt will be "a bright, colorful abstract image with a summer sale theme."

[1311] Step 3:

[1312] The server inputs the generated prompt text into the generative AI model. DALL-E and Stable Diffusion are used as the generative AI model. The model performs data calculations based on the prompt text and generates abstract visual content.

[1313] Step 4:

[1314] The generated visual content is sent from the server to the terminal. The terminal displays a preview of the received visual content to the user. The user can review this preview and request modifications or regeneration as needed.

[1315] Step 5:

[1316] If a user is satisfied with the generated visual content, their device will save or share that content for advertising purposes. This allows for the rapid deployment of advertising campaigns.

[1317] (Example 3)

[1318] Next, we will describe Embodiment 3 of Example 3. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1319] Conventional information processing systems made it difficult for users to generate visual information based on specific characteristic information and then obtain specific methods and necessary material information for manufacturing items using that information. This resulted in a challenge in that users could not efficiently manufacture items according to their own preferences.

[1320] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 3 is realized by the following means.

[1321] In this invention, the server includes means for receiving characteristic information input from a user, means for generating visual information using a generative model based on the characteristic information, and means for providing a method for manufacturing an article based on the generated visual information. This makes it possible for users to easily obtain specific methods and necessary material information for efficiently manufacturing articles according to their preferences.

[1322] An "information processing device" is a device used for inputting, processing, and outputting data, and includes devices such as computers and servers.

[1323] "User" refers to an individual or group that operates an information processing device and utilizes specific functions or services.

[1324] "Feature information" refers to information that indicates specific attributes or conditions entered by the user, and is data used to generate visual information.

[1325] A "generative model" refers to an algorithm or program that generates visual information based on input feature information.

[1326] "Visual information" refers to visually recognizable data such as images and monograms generated by generative models.

[1327] "Items" refer to specific items or products that are created based on visual information.

[1328] "Manufacturing method" refers to information that describes the specific steps and processes for manufacturing an item.

[1329] "Material information" refers to information about the materials and tools necessary for the manufacture of an item.

[1330] A "communication network" is the infrastructure for sending and receiving digital data, and includes the internet and local networks.

[1331] "Handicrafts" refer to crafts and works of art that are produced by hand.

[1332] "Ornaments" refer to items that are created based on visual information and used for decorative purposes.

[1333] This invention is a system that uses an information processing device to allow a user to input specific characteristic information, generate visual information based on that information, and further provides specific methods and material information for manufacturing an item based on that visual information.

[1334] The server provides an interface for receiving feature information from the user. The user uses a terminal to input a prompt, such as "Generate a monogram of a blue bird." This prompt is sent to a generative AI model, and the server uses this model to generate visual information. A common generative algorithm is used as the generative AI model.

[1335] The generated visual information is analyzed by a server, and methods for producing the items are devised. For example, a procedure is provided to convert the generated monogram into a dot art icon using image processing software such as Adobe Photoshop. If embroidery art is to be created, the required types and quantities of embroidery thread and fabric are listed.

[1336] The user receives production method and material information provided by the server and confirms it through the terminal. This allows the user to efficiently produce items according to their preferences. For example, if the user enters the prompt "Generate a blue bird monogram," the server generates a monogram with a blue bird motif and provides instructions for producing dot art or embroidery art based on it. The flow of a specific process in Example 3 will be explained using Figure 15.

[1337] Step 1:

[1338] The user enters prompt messages using a terminal. For example, they might enter specific instructions such as "Generate a monogram of a blue bird." This input is then sent to the server.

[1339] Step 2:

[1340] The server analyzes the received prompt and sends instructions to the generative AI model. The generative AI model generates visual information based on the prompt. In this process, the AI ​​model performs data calculations based on the input feature information to generate image data. The generated visual information is returned to the server.

[1341] Step 3:

[1342] The server devises a method for producing the item based on the generated visual information. Specifically, it uses image processing software to create procedures for converting the visual information into dot art or embroidery art. This process analyzes the visual information and determines how to process it.

[1343] Step 4:

[1344] The server lists the material information required to create an item. For example, in the case of embroidery art, it specifically lists the required embroidery thread colors and fabric types. This information is necessary for the user to create the item.

[1345] Step 5:

[1346] The server sends the generated visual information, manufacturing method, and material information to the user's terminal. The user receives this information and verifies it through the terminal. This allows the user to manufacture the item based on the provided information.

[1347] (Application Example 3)

[1348] Next, we will describe application example 3 of form example 3. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1349] There is a need for a system that allows users to easily create custom items tailored to their preferences, thereby enhancing their in-store experience. However, conventional systems have difficulty providing specific creation procedures based on the user's selected design, and have not been able to provide real-time customization procedures using generative AI models.

[1350] The specific processing performed by the specific processing unit 290 of the data processing device 12 in Application Example 3 is realized by the following means.

[1351] In this invention, the server includes means for receiving multiple inputs from the user regarding character characteristics and the idol's assigned color, means for generating abstract images or monograms based on said input, and means for providing the user with a method for creating the most suitable fan activity item based on the generated result. This makes it possible to provide a real-time procedure for creating custom items using a generation AI model based on the design selected by the user, thereby improving the customer experience in physical stores.

[1352] A "user" is an individual who wishes to create custom items by using the system to input character characteristics and the idol's assigned color.

[1353] "Character characteristics" refer to information about attributes and traits associated with a specific character, as entered by the user.

[1354] "Idol's assigned color" refers to the color associated with a specific idol, and is information entered by the user.

[1355] An "abstract image" is a visual representation that does not have a specific shape or design, and is generated based on user input.

[1356] A "monogram" is a design that combines letters and symbols, generated based on user input.

[1357] "Fan-related items" are custom items related to the characters or idols that users support.

[1358] A "generative AI model" is an artificial intelligence model used to generate images or monograms based on user input.

[1359] A "prompt statement" is an instruction given to a generative AI model to obtain a specific output.

[1360] An "in-store information processing device" is an electronic device installed in a physical store and used to provide users with instructions for creating custom items.

[1361] The system for implementing this invention provides users with an experience of creating custom items in a physical store. The system is implemented using an information processing device (e.g., a tablet device) installed in the store. Users input character characteristics and the idol's assigned color through the device. Based on this input, the server generates abstract images or monograms.

[1362] The generated images and monograms are created using a generative AI model. The server sends prompts to the generative AI model to obtain instructions for creating a custom item based on the design selected by the user. An example of a prompt is, "Please tell me how to create dot art using a cat monogram. Please also list the materials needed."

[1363] The server displays the generated instructions on the terminal and provides them to the user. This allows the user to see the steps for creating a custom item in real time and understand the necessary materials. For example, if the user selects "Cat Monogram," the server generates "Instructions for Creating Dot Art Using a Cat Monogram" and lists the necessary materials (e.g., canvas, paint, brushes).

[1364] This system will enhance the in-store experience for users and allow them to easily create custom items tailored to their preferences.

[1365] The flow of the specific processing in Application Example 3 will be explained using Figure 16.

[1366] Step 1:

[1367] Users use terminals in the store to input character characteristics and the idol's assigned color. The entered information is then sent from the terminal to the server.

[1368] Step 2:

[1369] The server creates and sends prompt messages to the generating AI model based on the user's input information. These prompt messages include instructions for creating a custom item based on the design selected by the user.

[1370] Step 3:

[1371] The generative AI model processes prompts received from the server and generates instructions for creating a custom item based on user input. These instructions are then returned to the server.

[1372] Step 4:

[1373] The server receives the creation instructions returned from the generated AI model and converts them into a user-friendly format. During this process, it also processes the data, including a list of necessary materials.

[1374] Step 5:

[1375] The server sends the processed instructions and material list to the terminal. The terminal displays this information to the user in real time.

[1376] Step 6:

[1377] Users review the creation instructions and material list displayed on their device and prepare to create their custom items at a physical store.

[1378] Furthermore, an emotion engine that estimates the user's emotions may be incorporated. That is, the identification processing unit 290 may use the emotion identification model 59 to estimate the user's emotions and perform identification processing using the user's emotions.

[1379] "Example of form 1"

[1380] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[1381] "Example of form 2"

[1382] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[1383] "Example of form 3"

[1384] One embodiment of the present invention provides a system that includes means for receiving input from the user regarding character characteristics and the idol's assigned color, means for generating abstract images and monograms based on said input, and means for providing the user with instructions on how to create the most suitable fan activity item based on the generated result. Furthermore, an emotion engine that recognizes the user's emotions is incorporated. This emotion engine analyzes the user's emotions from facial expressions, tone of voice, text input, etc., and feeds the results back to the system. For example, if the user is showing emotion joy, the emotion engine conveys that information to the system, and the system generates an abstract image or monogram in bright colors. Conversely, if the user is showing emotion sadness, the system generates an abstract image or monogram in dark colors. This makes it possible to create personalized fan activity items that correspond to the user's emotions.

[1385] The following describes the processing flow for each example of the form.

[1386] "Example of form 1"

[1387] Step 1: Accept input from users regarding character characteristics and the idol's assigned color.

[1388] Step 2: Generate abstract images or monograms based on the input.

[1389] Step 3: Provide the user with instructions on how to create the most suitable fan activity item based on the generated results.

[1390] Step 4: Activate the emotion engine to recognize the user's emotions.

[1391] Step 5: The emotion engine analyzes the user's emotions from their facial expressions, tone of voice, text input, etc.

[1392] Step 6: The emotion engine feeds the analysis results back into the system.

[1393] Step 7: The system adjusts the generation of abstract images and monograms based on feedback from the emotion engine.

[1394] (Example 1)

[1395] Next, we will describe Embodiment 1 of Example Form 1. In the following description, the data processing device 12 will be referred to as the "server" and the robot 414 as the "terminal".

[1396] Conventional systems struggled to generate personalized visual data tailored to individual user emotions and preferences, resulting in an inability to suggest appropriate items based on user sentiment. Furthermore, there was a need for a system that could output the generated visual data in various formats to meet diverse user needs.

[1397] The identification process performed by the identification processing unit 290 of the data processing device 12 in Example 1 is realized by the following means.

[1398] In this invention, the server includes means for receiving multiple inputs of characteristic information and color information from the user, means for generating abstract visual data using a generative model based on said input, and means for analyzing the user's emotions and adjusting the color tone of the visual data based on the analysis resu...

Claims

1. Equipped with a processor, The aforementioned processor, We accept input from users, including information about character characteristics related to colors or the assigned color of an idol. By analyzing users' emotions in real time and acquiring emotional data, Based on the received information and the acquired emotion data, a prompt is created to instruct the generating AI model to generate an abstract image or monogram having a color tone based on the information and the emotion data. The generated prompt is input to the generating AI model. The aforementioned processor, The information is received via an information processing device installed in the physical store. The AI ​​model is given prompts to generate a procedure for creating a fan activity item using the generated abstract image or monogram, and a list of necessary materials. The creation procedure and the list of materials output from the generated AI model are displayed in real time on the information processing device. system.

2. The aforementioned processor, The generated abstract image or monogram is output as dot art. Provided in a format that can be used as an icon for social media. The system according to claim 1.

Images