System

Abstract

A system is provided.SOLUTION: A system comprising: means for presenting a plurality of user-selectable design themes and components; means for generating a design based on the user-selected design themes and components; means for displaying a preview of the generated design to the user; means for receiving and regenerating approval or modification instructions from the user; means for calculating and paying a patent fee to protect the intellectual property; and means for providing the finally generated design to the user.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The technology of the present disclosure relates to a system. [Background technology]

[0002] Patent document 1 discloses a persona chatbot control method performed by at least one processor, the method including the steps of receiving a user utterance, adding the user utterance to a prompt including an instruction sentence related to a description of the chatbot character, encoding the prompt, and inputting the encoded prompt into a language model to generate a chatbot utterance in response to the user utterance. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Publication No. 2022-180282 Summary of the Invention [Problem to be solved by the invention]

[0004] Demand for personalized designs is on the rise in the modern design industry. Many users want to create their own designs, but due to a lack of design knowledge and technology, this is currently difficult for users without specialized skills. In addition, companies that hold intellectual property rights are concerned about copyright infringement due to AI-generated images. For this reason, there is a need to provide an environment that allows users to easily create personalized designs, as well as a mechanism to protect intellectual property rights. [Means for solving the problem]

[0005] The present invention provides a means for presenting a user with multiple design themes and components to select from and generating a design based on the user's selection. It also includes a means for displaying a preview of the generated design to the user, receiving approval or correction instructions from the user, and regenerating the design. It also includes a means for calculating and paying patent fees to protect intellectual property rights. The final generated design is provided to the user, thereby achieving a system that achieves both individualized design and intellectual property protection. This system allows users without specialized skills to easily create individualized designs while ensuring intellectual property rights protection.

[0006] A "design theme" is an element that determines the overall style and visual direction of a design.

[0007] "Components" refer to the individual parts and materials that make up a design, specifically elements such as backgrounds, buttons, headers, and text.

[0008] "User" means an individual or entity that utilizes the System to create designs and selects, modifies, and ultimately approves designs.

[0009] A "preview" is a temporary display that allows the user to check the generated design.

[0010] "AI algorithms" are artificial intelligence techniques for automatically and generatively creating designs based on user choices.

[0011] "Royalties" are monetary considerations paid for materials or technology used to protect intellectual property rights.

[0012] "Intellectual Property" refers to copyright, patents, trademarks and other legal rights relating to materials and technology used in a Design.

[0013] A "session ID" is an identifier that temporarily stores a user's login information and manages access to the system.

[0014] "Design generation" is the process by which an AI algorithm creates a new design based on user selections.

[0015] "Regeneration" is the process by which an AI algorithm recreates a design based on corrections provided by the user.

[0016] The "temporary storage directory" is a storage area for temporarily storing the generated designs and previews.

[0017] "Download Link" means the URL on the web where the user can obtain the final design. [Brief explanation of the drawings]

[0018] [Figure 1] 1 is a conceptual diagram showing an example of the configuration of a data processing system according to a first embodiment. [Figure 2] 1 is a conceptual diagram showing an example of main functions of a data processing device and a smart device according to a first embodiment. [Figure 3] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a second embodiment. [Figure 4] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and smart glasses according to a second embodiment. [Figure 5] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a third embodiment. [Figure 6] FIG. 11 is a conceptual diagram showing an example of main functions of a data processing device and a headset-type terminal according to a third embodiment. [Figure 7] FIG. 10 is a conceptual diagram showing an example of the configuration of a data processing system according to a fourth embodiment. [Figure 8] FIG. 10 is a conceptual diagram showing an example of main functions of a data processing device and a robot according to a fourth embodiment. [Figure 9] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 10] 1 shows an emotion map onto which multiple emotions are mapped. [Figure 11] FIG. 3 is a sequence diagram showing a processing flow of the data processing system according to the first embodiment. [Figure 12] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 1. [Figure 13] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system according to the second embodiment when an emotion engine is combined. [Figure 14] FIG. 10 is a sequence diagram showing the flow of processing in the data processing system in Application Example 2 when an emotion engine is combined. DETAILED DESCRIPTION OF THE INVENTION

[0019] An example of an embodiment of a system according to the technology of the present disclosure will be described below with reference to the accompanying drawings.

[0020] First, the terms used in the following description will be explained.

[0021] In the following embodiments, a coded processor (hereinafter simply referred to as a "processor") may be a single arithmetic device or a combination of multiple arithmetic devices. Furthermore, a processor may be a single type of arithmetic device or a combination of multiple types of arithmetic devices. Examples of arithmetic devices include a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), a GPGPU (General-Purpose computing on Graphics Processing Units), and an APU (Accelerated Processing Unit).

[0022] In the following embodiments, a coded RAM (Random Access Memory) is a memory in which information is temporarily stored and is used as a working memory by a processor.

[0023] In the following embodiments, the coded storage is one or more non-volatile storage devices that store various programs, various parameters, etc. Examples of non-volatile storage devices include flash memory (SSD (Solid State Drive)), magnetic disks (e.g., hard disks), and magnetic tapes.

[0024] In the following embodiments, a communication I / F (Interface) with a symbol is an interface including a communication processor, an antenna, etc. The communication I / F controls communication between multiple computers. Examples of communication standards applied to the communication I / F include wireless communication standards including 5G (5th Generation Mobile Communication System), Wi-Fi (registered trademark), Bluetooth (registered trademark), etc.

[0025] In the following embodiments, "A and / or B" is synonymous with "at least one of A and B." In other words, "A and / or B" means that it may be only A, only B, or a combination of A and B. Furthermore, in this specification, the same concept as "A and / or B" is also applied when three or more things are expressed connected by "and / or."

[0026] [First embodiment]

[0027] FIG. 1 shows an example of the configuration of a data processing system 10 according to the first embodiment.

[0028] 1, a data processing system 10 includes a data processing device 12 and a smart device 14. An example of the data processing device 12 is a server.

[0029] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0030] The smart device 14 includes a computer 36, a reception device 38, an output device 40, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The reception device 38, the output device 40, and the camera 42 are also connected to the bus 52.

[0031] The reception device 38 includes a touch panel 38A, a microphone 38B, and the like, and receives user input. The touch panel 38A detects contact with an indicator (for example, a pen or a finger) to receive user input by the touch of the indicator. The microphone 38B detects the user's voice to receive user input by voice. The control unit 46A transmits data indicating the user input received by the touch panel 38A and the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the data indicating the user input.

[0032] The output device 40 includes a display 40A and a speaker 40B, and presents data to the user 20 by outputting the data in a form of expression that the user 20 can perceive (for example, audio and / or text). The display 40A displays visible information such as text and images in accordance with instructions from the processor 46. The speaker 40B outputs audio in accordance with instructions from the processor 46. The camera 42 is a compact digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor.

[0033] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 control the exchange of various information between the processor 46 and the processor 28 via the network 54.

[0034] FIG. 2 shows an example of the main functions of the data processing device 12 and the smart device 14.

[0035] 2, in the data processing device 12, a specific process is performed by the processor 28. A specific processing program 56 is stored in the storage 32. The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific process is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0036] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0037] In the smart device 14, the processor 46 performs the reception output process. The storage 50 stores a reception output program 60. The reception output program 60 is used in conjunction with the specific processing program 56 by the data processing system 10. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0038] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0039] The present invention is a system that presents multiple design themes and components for users to choose from and generates designs based on the user's selection. This system is particularly characterized by its ability to allow users without specialized skills to easily create personalized designs. Furthermore, a system for calculating and paying patent fees to protect intellectual property rights allows users to use the designs with peace of mind.

[0040] System program processing flow

[0041] Login process

[0042] When a user accesses the platform and enters their user ID and password on the login page, the device sends this information to the server. The server compares the received authentication information with the database, and if it matches, the server allows the user to log in and generates a session ID and sends it to the device. This allows the user to log in.

[0043] Selecting a design theme and components

[0044] The server then retrieves a list of available design themes and components from the database and sends it to the user's device after they have logged in. The user selects the desired design theme and components, and the selection is sent from the device to the server. An example scenario is when a user selects the "vintage" theme and "pastel blue."

[0045] Design Generation and Preview

[0046] The server inputs the user's selected theme and components into an AI algorithm to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can then review the preview and approve or modify it.

[0047] Design Approval and Revision

[0048] If the user checks the preview and makes any corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves.

[0049] Intellectual Property Protection

[0050] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[0051] Specific examples

[0052] For example, let's say a user wants a vintage design for their website. In this example, we'll look at the process from logging in to getting the final design:

[0053] 1. The user enters their ID and password to log in.

[0054] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[0055] 3. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[0056] 4. The user checks the preview and suggests making the button darker.

[0057] 5. The server sends the regenerated design to the device and displays an updated preview to the user.

[0058] 6. The user approves the final design.

[0059] 7. The server calculates and pays the patent fees.

[0060] 8. The server sends a download link to your device to provide the final design file.

[0061] 9. User clicks on the download link to get the final design file.

[0062] This allows users to easily create their own personalized designs and use them with intellectual property rights protected.

[0063] The processing flow will be explained below.

[0064] Step 1:

[0065] A user accesses the platform and enters their user ID and password on the login page.

[0066] Step 2:

[0067] The terminal sends the entered user ID and password to the server.

[0068] Step 3:

[0069] The server verifies the authentication information received against the database, and if it matches, it authenticates and generates a session ID.

[0070] Step 4:

[0071] The server sends a successful login response including the session ID to the terminal.

[0072] Step 5:

[0073] The terminal displays a login success screen to the user.

[0074] Step 6:

[0075] After the user logs in, they are taken to a design theme and component selection page.

[0076] Step 7:

[0077] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[0078] Step 8:

[0079] The device will display a list of design themes and components.

[0080] Step 9:

[0081] The user selects the desired design theme (e.g., vintage) and components (e.g., pastel blue as the main color).

[0082] Step 10:

[0083] The terminal transmits the user's selected design theme and components to the server.

[0084] Step 11:

[0085] The server inputs the user's selected theme and component data into the AI ​​algorithm.

[0086] Step 12:

[0087] The server generates the design using an AI algorithm and stores it in a temporary directory.

[0088] Step 13:

[0089] The server generates a preview URL for the generated design and sends it to the device.

[0090] Step 14:

[0091] The device receives the preview URL and displays it to the user.

[0092] Step 15:

[0093] The user checks the preview and approves or requests corrections.

[0094] Step 16:

[0095] The terminal transmits the user's correction instructions to the server.

[0096] Step 17:

[0097] The server receives the correction instructions and regenerates the design using the AI ​​algorithm.

[0098] Step 18:

[0099] The server saves the regenerated design back to the temporary directory and generates an updated preview URL.

[0100] Step 19:

[0101] The server sends the updated preview URL to the device.

[0102] Step 20:

[0103] The device displays the updated preview to the user.

[0104] Step 21:

[0105] The user approves the final design.

[0106] Step 22:

[0107] The terminal sends the authorization information to the server.

[0108] Step 23:

[0109] The server calculates royalties for the generated design.

[0110] Step 24:

[0111] The server pays patent royalties through the payment system of the company that owns the intellectual property.

[0112] Step 25:

[0113] Once the server confirms payment, it will generate a download link for the final design files.

[0114] Step 26:

[0115] The server sends a download link to the device.

[0116] Step 27:

[0117] The device displays the download link to the user.

[0118] Step 28:

[0119] The user clicks the download link to download the final design file.

[0120] Step 29:

[0121] The device sends a download request to the server.

[0122] Step 30:

[0123] The server provides the final design files in response to download requests.

[0124] Step 31:

[0125] The device receives the file and stores it in the user's local storage.

[0126] Example 1

[0127] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0128] Conventional design generation systems have the drawback of being difficult for average users to use because they require specialized skills and advanced operations. Furthermore, intellectual property rights protection is insufficient, raising the risk of illegal use of the designs. Furthermore, the design generation and revision process is complex and time-consuming, resulting in a lack of efficiency.

[0129] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0130] In this invention, the server includes a means for presenting multiple design themes and components that a user can select, a means for generating a prompt sentence based on the design themes and components selected by the user and inputting the prompt sentence into a generative AI model, a means for generating a preview URL of the generated design and displaying it to the user, a means for receiving approval or correction instructions from the user and regenerating the preview URL, a means for calculating and paying patent fees to protect intellectual property, and a means for providing the final generated design to the user. This allows users without specialized skills to easily generate and safely use personalized designs.

[0131] A "user" is an entity that uses the system to select and create designs.

[0132] A "design theme" is an element that indicates the style and atmosphere of a design that can be selected by the user.

[0133] "Components" are elements that represent specific parts of a design, such as color or layout.

[0134] A "prompt sentence" is text generated to be input into a generative AI model, with its content determined based on user selections.

[0135] A "generative AI model" is an artificial intelligence algorithm that generates custom designs based on input prompts.

[0136] The "preview URL" is an address that indicates a temporary link for displaying the generated design to the user.

[0137] "Approval" is the act of the user reviewing the presented design and finally accepting it with satisfaction.

[0138] "Modification instructions" are specific instructions provided by a user to request changes or adjustments to a design.

[0139] A "temporary storage directory" is a storage area within the server where generated designs are temporarily stored.

[0140] The "final design file" is a file that shows the completed design that the user has finally approved.

[0141] A "session ID" is an identifier generated after a user logs in and is used to manage user access.

[0142] "Royalties" are fees representing the protection and exploitation of intellectual property rights associated with the creation and use of a design.

[0143] "Intellectual property protection" refers to a set of procedures to protect the intellectual property rights of the created design from infringement.

[0144] This invention is a system that presents multiple design themes and components that a user can choose from and generates a design based on the user's selection. This system is particularly characterized by its ability to allow users without specialized skills to easily create personalized designs. Furthermore, a system for calculating and paying patent fees to protect intellectual property rights allows users to use the designs with peace of mind.

[0145] This system is configured as follows: The servers include a web server and a database server. The web server uses common web server software such as Apache, and the database server uses a relational database such as MySQL. The generative AI model can use a large-scale language model such as GPT-3.

[0146] Login process

[0147] A user accesses the platform and enters their user ID and password on the login page. This information is sent from the terminal to the server. The server checks the received authentication information against the database, and if it matches, the user is allowed to log in and generates a session ID. The session ID is sent to the terminal, and the user is logged in.

[0148] Selecting a design theme and components

[0149] When a user logs in, the server retrieves a list of available design themes and components from the database and sends them to the terminal. The user selects the desired design theme and component from the list. For example, if the user selects the "vintage" theme and "pastel blue," the terminal sends the selection to the server.

[0150] Design Generation and Preview

[0151] The server generates a prompt based on the user's selection and inputs it into the generative AI model. An example prompt is "A design with a vintage-style pastel blue as the main color." The generative AI model generates a custom design based on the prompt. The generated design is saved in a temporary directory on the server, and a preview URL is created. This preview URL is sent to the device, where the preview is displayed to the user.

[0152] Design Approval and Revision

[0153] If the user checks the preview and inputs correction instructions, such as "make the button color darker," the device sends the instructions to the server. The server again uses an AI algorithm to adjust and regenerate the design. The regenerated design is saved on the server, and an updated preview URL is sent to the device. The user checks the preview again and approves or makes further corrections as necessary. This process is repeated until the user finally approves.

[0154] Intellectual Property Protection

[0155] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties, which are then paid to the intellectual property owner. Once payment is confirmed, the server prepares the final design file and generates a downloadable link, which is sent to the device, allowing the user to download the final design file.

[0156] This allows users to easily create and safely use personalized designs without requiring specialized skills.

[0157] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0158] Step 1:

[0159] The user accesses the login page and enters their user ID and password.

[0160] Input: User ID, Password

[0161] Output: Credentials sent

[0162] Specific operation: The user accesses the login page on a browser and enters the user ID and password in the appropriate input form.

[0163] Step 2:

[0164] The terminal sends the entered user ID and password to the server.

[0165] Input: User ID, Password

[0166] Output: Authentication request sent

[0167] Specific operation: The browser on the device generates an HTTP request and sends data including the user ID and password to the server.

[0168] Step 3:

[0169] The server checks the authentication information against the database, and if it matches, allows login and generates a session ID.

[0170] Input: User ID, Password

[0171] Output: Session ID

[0172] Specific operation: The authentication information is matched with the user information in the database on the server, and if authentication is successful, the session manager generates a new session ID.

[0173] Step 4:

[0174] The server sends the session ID to the terminal, and the user is logged in.

[0175] Input: Session ID

[0176] Output: Session ID to be sent, login status confirmation

[0177] Specific operation: The server returns the session ID to the terminal as an HTTP response, the session ID is saved on the terminal, and the user's login state is maintained.

[0178] Step 5:

[0179] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[0180] Input: None (logged-in user session)

[0181] Output: List of design themes and components

[0182] Specific operation: The server executes a database query to obtain a list of available design themes (e.g., "vintage", "modern") and components (e.g., "pastel blue", "red") and sends it to the device in JSON format, for example.

[0183] Step 6:

[0184] The user selects the desired design theme and component from the displayed list, and the terminal transmits the selection to the server.

[0185] Input: Design theme, component selection

[0186] Output: Selections sent

[0187] Specific operation: The user selects the desired design theme and components using a selection form on the browser, and the terminal sends an HTTP request containing the selection information to the server.

[0188] Step 7:

[0189] The server generates prompt sentences based on the user's selections and inputs them into the generative AI model.

[0190] Input: Design theme, components

[0191] Output: Generated prompt statement

[0192] Specific operation: Based on the user's selection information, the server-side script generates a prompt statement such as "A design with a vintage-style pastel blue as the main color" and inputs it into the generative AI model.

[0193] Step 8:

[0194] A generative AI model generates a custom design based on the input prompt.

[0195] Input: prompt statement

[0196] Output: Generated design

[0197] Specific operation: The generative AI model analyzes the prompt and generates a corresponding design.

[0198] Step 9:

[0199] The server saves the generated design in a temporary directory and generates a preview URL.

[0200] Input: Generated Design

[0201] Output: Preview URL

[0202] Specific operation: The generated design file is saved in a temporary directory on the server, and a URL for accessing the file is generated.

[0203] Step 10:

[0204] The server sends the preview URL to the device, and the device displays the preview to the user.

[0205] Input: Preview URL

[0206] Output: Preview displayed

[0207] Specific operation: The server sends the preview URL to the terminal, and the URL is displayed to the user via the terminal's browser.

[0208] Step 11:

[0209] The user checks the preview and, if any corrections are necessary, inputs correction instructions, and the terminal transmits the instructions to the server.

[0210] Input: Correction instructions

[0211] Output: Correction instructions sent

[0212] Specific operation: The user checks the preview on the browser and enters correction instructions such as "make the button color darker," and the device sends an HTTP request including these instructions to the server.

[0213] Step 12:

[0214] The server then uses the AI ​​algorithm to adjust and regenerate the design based on the correction instructions.

[0215] Input: Correction instructions

[0216] Output: Regenerated design

[0217] Specific operation: The server-side script analyzes the correction instructions, generates a new prompt based on them, and instructs the generative AI model to regenerate the design.

[0218] Step 13:

[0219] The server saves the regenerated design and sends an updated preview URL to your device.

[0220] Input: Regenerated design

[0221] Output: Updated preview URL

[0222] Specific operation: The regenerated design file is saved in a temporary directory on the server, and a new preview URL is generated and sent to the device.

[0223] Step 14:

[0224] The device displays the updated preview to the user, and the process repeats until the user approves.

[0225] Input: Updated preview URL

[0226] Output: Update preview displayed, final approval

[0227] What happens: The device displays a new preview URL in the browser, and the user checks the preview again and enters further corrections if necessary. This process is repeated until the user finally approves.

[0228] Step 15:

[0229] Once the user finally approves the design, the server compiles information on all materials used and calculates royalties.

[0230] Input: Final Approval

[0231] Output: Patent royalty calculation information

[0232] Specific operation: The server collects data on the materials used and calculates the patent fees through an algorithm that calculates patent fees.

[0233] Step 16:

[0234] The server pays the patent fees to the intellectual property owner, and once payment is confirmed, prepares the final design files and generates a download link.

[0235] Input: Patent fee calculation information

[0236] Output: Download link

[0237] Specific operation: The patent fee is paid on the server side, and after payment is confirmed, the final design file is saved and a download link is generated.

[0238] Step 17:

[0239] The server sends a download link to the device, and the user downloads the final design file.

[0240] Input: Download link

[0241] Output: Final design files

[0242] Specific operation: The server sends a download link to the terminal as an HTTP response, and the user clicks the link to download the final design file.

[0243] (Application example 1)

[0244] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0245] While there are systems that generate designs based on multiple user-selectable design themes and components, few systems offer the ability to preview and modify designs in real time on a smart device. In particular, systems that can be intuitively operated using devices such as smart glasses are still under development. Another challenge is smoothly integrating the design generation process with intellectual property protection and royalty calculation and payment.

[0246] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0247] In this invention, the server includes means for presenting a plurality of design themes and components that a user can select, means for generating a design based on the design themes and components selected by the user, means for displaying a preview of the generated design to the user, means for receiving approval or modification instructions from the user and regenerating the design, means for calculating and paying patent fees to protect intellectual property, means for providing the final generated design to the user, and means for previewing and modifying the design in real time on a smart device. This enables users without specialized skills to intuitively generate and modify designs using a smart device and easily obtain designs with protected intellectual property rights.

[0248] "User" refers to a user who uses the system to select design themes and components and obtain the final design.

[0249] A "design theme" refers to a basic style or concept among multiple designs that a user can choose from.

[0250] "Components" refers to specific design parts, colors, fonts, backgrounds, and other elements used based on the design theme.

[0251] "Generative AI Model" refers to the artificial intelligence algorithms used to generate custom designs based on user-selected design themes and component information.

[0252] "Smart device" refers to a smartphone, smart glasses, head-mounted display, or similar sophisticated electronic device.

[0253] "Preview" refers to a temporary display of a design generated based on the user's selected theme and components.

[0254] "Approval or modification instructions" refers to the act of the user confirming the design content or instructing changes after checking the preview.

[0255] "Royalties" refers to the cost of intellectual property protection for all materials used in designs generated by the System.

[0256] "Session ID" refers to a unique identifier generated for a user to access a system after logging in.

[0257] This invention is a system that presents multiple design themes and components that a user can select using a smart device, generates a custom design based on the selection, and allows preview and modification in real time.

[0258] First, when a user accesses the platform and enters their user ID and password on the login page, the device sends this information to the server. The server checks the authentication information against the database, and if it matches, the user is allowed to log in, and generates a session ID and sends it to the device. This allows the user to log in.

[0259] The server then retrieves a list of available design themes and components from the database and sends them to the user's device after they have logged in. The user selects these using smart glasses or other smart devices, and the device sends the selection to the server. For example, consider a scenario in which a user selects a "vintage" theme and a "pastel blue" color.

[0260] The server inputs the user's selected theme and components into the generative AI model to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can view the preview with smart glasses and approve or modify it.

[0261] If the user checks the preview and makes corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the generative AI model, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves it.

[0262] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[0263] The system uses the following hardware and software:

[0264] Smart devices: smart glasses, smartphones, etc.

[0265] AI algorithms: Generative AI models (e.g., DALL-E and Midjourney)

[0266] Database: Managing user information and design materials

[0267] For example, consider the following prompt:

[0268] Theme: Vintage

[0269] Elements: Pastel blue background, Gothic font, retro icons

[0270] Fix Request: Make the button darker

[0271] In this way, we have created a system that allows users to intuitively create and modify designs using a smart device without having specialized skills, and easily obtain designs with protected intellectual property rights.

[0272] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0273] Step 1:

[0274] A user accesses the design platform and enters their user ID and password on the login page. The entered authentication information is sent from the terminal to the server.

[0275] Input: User ID, Password

[0276] Data calculation: The server checks the received authentication information against a database.

[0277] Output: Authentication result, session ID (if authentication is successful)

[0278] Step 2:

[0279] The server checks the user ID and password against the database, and if they match, allows the user to log in. If the login is successful, a session ID is generated and sent to the terminal.

[0280] Input: User ID, Password

[0281] Data calculation: Verification of authentication information, generation of session ID

[0282] Output: Session ID

[0283] Step 3:

[0284] The server retrieves a list of available design themes and components from a database and transmits it to the terminal of the user who has completed login.

[0285] Input: Session ID

[0286] Data operations: Obtaining a list of design themes and components

[0287] Output: List of design themes and components

[0288] Step 4:

[0289] The user selects the presented design theme and components using smart glasses or other smart devices, and the selection is sent from the device to the server.

[0290] Input: User selected design theme, components

[0291] Data Calculation: Collection of Selections

[0292] Output:Selection

[0293] Step 5:

[0294] The server inputs the user's selected theme and components into the generative AI model to generate a design. The generated design is saved in a temporary directory and a preview URL is generated.

[0295] Input:Selection

[0296] Data calculation: Generate design using generative AI model, save design to temporary storage location, generate preview URL

[0297] Output: Preview URL

[0298] Step 6:

[0299] The server sends the preview URL to the user's device, which then displays the preview to the user, who then checks the preview using smart glasses.

[0300] Input: Preview URL

[0301] Data calculation: Send preview URL, display preview

[0302] Output: Preview

[0303] Step 7:

[0304] The user checks the preview and either approves or requests corrections, which are then sent from the terminal to the server.

[0305] Input: Correction instructions

[0306] Data calculation: collection of corrections

[0307] Output: Correction details

[0308] Step 8:

[0309] The server adjusts the design using the regenerative AI model based on the correction instructions, saves the regenerated design, and sends an updated preview URL to the device.

[0310] Input: Correction details

[0311] Data calculation: Regenerate design using AI model, save regenerated design to temporary storage location, generate updated preview URL

[0312] Output: Update preview URL

[0313] Step 9:

[0314] The device will then display the updated preview URL to the user, and this process will continue until the user finally approves.

[0315] Input: Update Preview URL

[0316] Data calculation: Preview display

[0317] Output:Update Preview

[0318] Step 10:

[0319] Once the user approves the final design, the server aggregates information on all materials used, calculates the royalties, pays the royalties to the intellectual property owner, and once payment is confirmed, generates a download link for the final design file and sends it to the user's device.

[0320] Input: Final design approval, information on materials used

[0321] Data calculation: royalty calculation, payment processing, download link generation

[0322] Output: Download link for the final design file

[0323] Step 11:

[0324] The user obtains the final design file from the download link via their device.

[0325] Input: Download link

[0326] Data Calculation: File Download

[0327] Output: Final design files

[0328] This allows users to intuitively customize designs using their smart devices and easily obtain designs with intellectual property rights protected.

[0329] Furthermore, an emotion engine that estimates the user's emotion may be combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59 and perform identification processing using the user's emotion.

[0330] This invention is a system that presents multiple design themes and components for users to choose from and generates designs based on the user's selection. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the design generation process responds to the user's emotions. This allows users without specialized skills to easily create personalized designs while protecting intellectual property rights.

[0331] System program processing flow

[0332] Login process

[0333] The user accesses the platform and enters their user ID and password on the login page. The device sends this information to the server. The server compares the received authentication information with the database, and if it matches, performs authentication and generates a session ID. The server sends a login success response including the session ID to the device. The device displays a login success screen to the user.

[0334] Selecting a design theme and components

[0335] After logging in, the server retrieves a list of available design themes and components from the database and sends it to the user's terminal. The terminal displays the list of design themes and components, and the user selects the desired design theme and component. The selection is then sent from the terminal to the server.

[0336] How the Emotional Engine Works

[0337] The emotion engine recognizes the user's emotions in real time. Emotional data is periodically sent to the server. The server analyzes this emotional data and suggests design themes and components based on the user's emotions. For example, if the user is operating the app with a relaxed emotion, a theme with a calm color scheme will be suggested.

[0338] Design Generation and Preview

[0339] The server inputs the user's selected theme and components, as well as data obtained from the emotion engine, into an AI algorithm to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can then check the preview and approve or make corrections.

[0340] Design Approval and Revision

[0341] If the user checks the preview and makes any corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves.

[0342] Intellectual Property Protection

[0343] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[0344] Specific examples

[0345] For example, let's say a user wants a new vintage design for their website. The following example shows the process from logging in to getting the final design:

[0346] 1. The user enters their ID and password to log in.

[0347] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[0348] 3. The emotion engine recognizes the user's calm emotions and makes appropriate design suggestions.

[0349] 4. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[0350] 5. The user checks the preview and suggests making the button darker.

[0351] 6. The server sends the regenerated design to the device and displays an updated preview to the user.

[0352] 7. The user approves the final design.

[0353] 8. The server calculates and pays the patent fees.

[0354] 9. The server sends a download link to your device to provide the final design file.

[0355] 10. User clicks on the download link to get the final design file.

[0356] Through this system, users can easily create designs that best suit their emotions and use them with their intellectual property protected.

[0357] The processing flow will be explained below.

[0358] Step 1:

[0359] A user accesses the platform and enters their user ID and password on the login page.

[0360] Step 2:

[0361] The terminal sends the entered user ID and password to the server.

[0362] Step 3:

[0363] The server verifies the authentication information received against the database, and if it matches, it authenticates and generates a session ID.

[0364] Step 4:

[0365] The server sends a successful login response including the session ID to the terminal.

[0366] Step 5:

[0367] The terminal displays a login success screen to the user.

[0368] Step 6:

[0369] After the user logs in, they are taken to a design theme and component selection page.

[0370] Step 7:

[0371] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[0372] Step 8:

[0373] The device will display a list of design themes and components.

[0374] Step 9:

[0375] The user selects the desired design theme and components.

[0376] Step 10:

[0377] The terminal transmits the user's selected design theme and components to the server.

[0378] Step 11:

[0379] The server that receives the selection information starts the emotion engine.

[0380] Step 12:

[0381] The emotion engine collects and analyzes emotional data in real time from the user's camera and microphone.

[0382] Step 13:

[0383] The emotion engine transmits the recognized emotion data to the server.

[0384] Step 14:

[0385] The server receives the emotion data and adjusts the design theme and components accordingly, proposing them to the user. For example, if the emotion is calm, it will suggest a color scheme with a relaxing effect.

[0386] Step 15:

[0387] The terminal displays the proposal sent from the server to the user.

[0388] Step 16:

[0389] The user reviews the proposed themes and components and makes selections or modifications as necessary.

[0390] Step 17:

[0391] The device sends the selection to the server.

[0392] Step 18:

[0393] The server inputs the user's selections and emotional data into an AI algorithm to generate a custom design.

[0394] Step 19:

[0395] The server saves the generated design in a temporary directory and generates a preview URL.

[0396] Step 20:

[0397] The server sends the preview URL to the device.

[0398] Step 21:

[0399] The device receives the preview URL and displays it to the user.

[0400] Step 22:

[0401] The user checks the preview and approves or requests corrections.

[0402] Step 23:

[0403] The terminal transmits the user's correction instructions to the server.

[0404] Step 24:

[0405] The server receives the correction instructions and regenerates the design using the AI ​​algorithm.

[0406] Step 25:

[0407] The server saves the regenerated design back to the temporary directory and generates an updated preview URL.

[0408] Step 26:

[0409] The server sends the updated preview URL to the device.

[0410] Step 27:

[0411] The device displays the updated preview to the user.

[0412] Step 28:

[0413] The user approves the final design.

[0414] Step 29:

[0415] The terminal sends the authorization information to the server.

[0416] Step 30:

[0417] The server calculates royalties for the generated design.

[0418] Step 31:

[0419] The server pays patent royalties through the payment system of the company that owns the intellectual property.

[0420] Step 32:

[0421] Once the server confirms payment, it will generate a download link for the final design files.

[0422] Step 33:

[0423] The server sends a download link to the device.

[0424] Step 34:

[0425] The device displays the download link to the user.

[0426] Step 35:

[0427] The user clicks the download link to download the final design file.

[0428] Step 36:

[0429] The device sends a download request to the server.

[0430] Step 37:

[0431] The server provides the final design files in response to download requests.

[0432] Step 38:

[0433] The device receives the file and stores it in the user's local storage.

[0434] Example 2

[0435] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0436] The present invention aims to provide a design generation system that allows even users without specialized knowledge to easily create personalized designs by proposing and generating designs based on the user's choices and emotions. Another objective is to provide a system that automatically calculates patent fees for intellectual property protection and accurately pays them to intellectual property rights holders.

[0437] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0438] In this invention, the server includes means for presenting a plurality of design themes and components selectable by the user, means for generating a design based on the design themes and components selected by the user, means for displaying a preview of the generated design to the user, means for recognizing the user's emotions in real time and suggesting design themes and components based on the recognized emotions, means for calculating and paying patent fees to protect intellectual property, and means for providing the generated design to the user. This enables the proposal and generation of designs according to the user's emotions, enabling even users without specialized knowledge to easily create personalized designs while ensuring the protection of intellectual property rights.

[0439] "User" means a person or company that logs in to use the System to generate Designs.

[0440] A "design theme" refers to a particular style or concept that a user can choose from, and is one of several options presented within the system.

[0441] "Components" refer to individual parts or materials related to a design theme that users can select and incorporate into their designs.

[0442] "Preview" refers to a preliminary representation of the generated design, provided for user review and modification.

[0443] An "emotion engine" refers to software or algorithms that recognize a user's facial expressions and voice and analyze their emotions in real time.

[0444] "AI algorithm" refers to a computational model or process that uses artificial intelligence to generate or modify designs.

[0445] "Royalties" refers to fees paid to intellectual property owners for materials or technology used.

[0446] "Session ID" refers to a unique identifier generated after a user logs in and is used to maintain the validity of the session.

[0447] "Intellectual property" refers to a legal concept that protects ownership and rights to designs, technology, materials, etc.

[0448] This invention is a system that provides users with multiple design themes and components to choose from, and uses an emotion engine to generate designs that reflect the user's emotions. This system uses a server and terminals as hardware, and an emotion engine and AI algorithms as software.

[0449] First, a user accesses the system from a terminal and enters their user ID and password on the login page. The terminal sends this information to the server, which then checks it against the database to perform the authentication process. If the authentication is successful, the server generates a session ID and sends it to the terminal. The terminal then displays a login success screen to the user.

[0450] When a user logs in, the server retrieves a list of available design themes and components from the database and sends it to the terminal. The terminal displays the list to the user, who selects the desired design theme and components. This information is then sent from the terminal to the server.

[0451] The emotion engine then analyzes the user's facial expressions and voice in real time to recognize their emotions. This emotion data is periodically sent to the server, which then analyzes the emotion data and suggests design themes and components based on the user's emotions. For example, if the user is feeling relaxed, a theme with a calm color scheme will be suggested.

[0452] The server inputs the design themes and components selected by the user, as well as data obtained from the emotion engine, into an AI algorithm to generate a design. The generated design is saved in a temporary directory, and a preview URL is generated. This URL is sent from the server to the device, which displays the preview to the user. The user can check the preview and make corrections as necessary.

[0453] If the user checks the preview and makes any corrections, the information is sent from the device to the server. The server then uses the AI ​​algorithm to adjust and regenerate the design. The regenerated design is saved and an updated preview URL is sent to the device. This process is repeated until the user finally approves the design.

[0454] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and upon confirmation, the final design file is provided. The server then generates a download link for the file and sends it to the user's device. The user can use this link to download the final design file.

[0455] Specific examples

[0456] For example, if a user wants a new vintage design for their website, they can use the system in the following way:

[0457] 1. The user enters their ID and password to log in.

[0458] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[0459] 3. The emotion engine recognizes the user's calm emotions and makes appropriate design suggestions.

[0460] 4. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[0461] 5. The user checks the preview and suggests making the button darker.

[0462] 6. The server sends the regenerated design to the device and displays an updated preview to the user.

[0463] 7. The user approves the final design.

[0464] 8. The server calculates and pays the patent fees.

[0465] 9. The server sends a download link to your device to provide the final design file.

[0466] 10. User clicks on the download link to get the final design file.

[0467] Example prompt sentence:

[0468] "I want to create a vintage design for my website. The main color is pastel blue, and I want the design to have a relaxed feel."

[0469] Using this system, users can easily create designs that best suit their emotions and use them while their intellectual property is protected.

[0470] The flow of the identification process in the second embodiment will be described with reference to FIG.

[0471] Step 1:

[0472] The user accesses the login page and enters their user ID and password.

[0473] Input: User ID, Password

[0474] The terminal transmits the input information to the server.

[0475] The server checks the received information against its database and, if there is a match, performs authentication.

[0476] Output: Session ID

[0477] Specific operation: If authentication is successful, the server generates a session ID and sends a login success response including the session ID to the terminal. The terminal then displays a login success screen to the user.

[0478] Step 2:

[0479] The server retrieves a list of available design themes and components from a database.

[0480] Input: Database query

[0481] Output: List of design themes and components

[0482] Specific operation: The server sends the acquired information to the terminal, and the terminal displays the list to the user.

[0483] Step 3:

[0484] The user selects the desired design theme and components.

[0485] Input: Design theme and component selection

[0486] The terminal transmits the selection to the server.

[0487] Output: Selected design theme and component information

[0488] Specific operation: The terminal transmits the information selected by the user to the server, and the server receives the information.

[0489] Step 4:

[0490] The emotion engine recognizes the user's facial expressions and voice in real time and analyzes their emotions.

[0491] Input: User's facial expressions, voice

[0492] Output: Emotion data

[0493] Specific operation: The emotion engine uses data obtained from the camera and microphone to recognize the user's emotional state and transmits that data to the server.

[0494] Step 5:

[0495] The server analyzes the emotional data and suggests design themes and components based on the user's emotions.

[0496] Input: User emotion data, selected design theme and component information

[0497] Output: Proposed design themes and components

[0498] Specific operation: For example, if the user is relaxed, the server will suggest a theme with a calm color scheme. This information will be sent to the device, and the device will display the suggestion to the user.

[0499] Step 6:

[0500] The server inputs the design theme and components selected by the user, as well as data obtained from the emotion engine, into an AI algorithm to generate a design.

[0501] Input: Selected design theme and components, emotion data

[0502] Output: Generated design

[0503] Specific operation: The server uses an AI algorithm to generate a design, saves the design in a temporary storage directory, generates a preview URL and sends it to the device, and the device displays the preview to the user.

[0504] Step 7:

[0505] The user checks the preview and gives instructions for corrections if necessary.

[0506] Input: Correction instructions

[0507] The terminal sends the modifications to the server.

[0508] What happens: The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device, which then displays the preview again to the user. This process repeats until the user finally approves the design.

[0509] Step 8:

[0510] The user approves the final design.

[0511] Input: Final Approval

[0512] The server compiles information on all materials used and calculates royalties.

[0513] Output: Calculated patent fee

[0514] Specific operation: The server pays the patent fee to the intellectual property owner and, once confirmation is received, prepares the final design file.

[0515] Step 9:

[0516] The server generates a download link to provide the final design file and sends it to the terminal.

[0517] Output: Download link

[0518] What happens: The user uses this link to download the final design file.

[0519] (Application example 2)

[0520] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart device 14 will be referred to as a "terminal."

[0521] Traditionally, users have been required to have specialized skills when creating designs, making it difficult for users without advanced knowledge to easily generate satisfactory designs. It has also been difficult to realize dynamic design changes based on the user's emotions or personalized design suggestions incorporating emotion recognition. Furthermore, design generation without consideration for intellectual property protection has led to problems such as unpaid patent fees.

[0522] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for presenting multiple design themes and components selectable by the user, means for generating a design based on the design themes and components selected by the user, means for recognizing the user's emotions using an emotion engine and suggesting design themes and components based on the emotion data, means for displaying a preview of the generated design to the user, means for receiving approval or correction instructions from the user and regenerating the design, means for calculating and paying patent fees to protect intellectual property, means for providing the final generated design to the user, means for dynamically changing the virtual store environment in response to the user's emotions, and means for operating a design generation AI model using prompt sentences. This enables even users without specialized knowledge to easily generate personalized designs, enables dynamic design suggestions in response to the user's emotions, and enables safe design generation that takes intellectual property protection into consideration.

[0523] "User" refers to the entity that uses the system, selects the design theme and components, and provides emotion data.

[0524] A "design theme" is a group of elements that determine the overall style and atmosphere of a design.

[0525] "Components" are the specific parts and materials that make up a design, including colors, layouts, images, etc.

[0526] The "emotion engine" is a system that analyzes the user's facial expressions and biometric data to recognize their current emotional state.

[0527] A "design generation AI model" is an artificial intelligence algorithm that generates designs based on input design themes, components, and emotional data.

[0528] A "virtual store" is a virtual store space built in a digital environment, where users can access the store from remote locations and have a shopping experience.

[0529] A "prompt sentence" is a predefined input text that provides operational instructions to a design generation AI model.

[0530] "Intellectual property" refers to the right to legal protection for inventions and designs, and includes patents, trademarks, copyrights, etc.

[0531] "Preview" is a function that provides a temporary visual display of the generated design to the user and allows the user to confirm or receive instructions for correction.

[0532] "Patent royalties" are legal fees incurred for the use of intellectual property and are paid to the intellectual property owner.

[0533] The present invention provides a system for generating designs based on a user's emotions. This system presents multiple design themes and components that the user can select from, and generates a design based on the selected design theme and components. The system also includes a function for recognizing the user's emotions using an emotion engine and suggesting design themes and components based on the emotion data.

[0534] System configuration

[0535] The system consists of the following main components:

[0536] A means for presenting design themes and components: The server retrieves multiple design themes and components from a database and displays them on the user's terminal.

[0537] Design generation means: A generative AI model is used to generate a design based on the design theme and components selected by the user.

[0538] Emotion engine: Software that uses hardware such as a camera to analyze the user's facial expressions and recognize their emotions. In particular, it uses OpenCV and dlib.

[0539] Design preview means: A preview of the generated design is displayed to the user in real time.

[0540] Approval and correction procedure: Receives approval or correction instructions from the user and performs regeneration.

[0541] Intellectual property protection measures: Information on materials used is compiled, and patent fees are calculated and paid to intellectual property owners.

[0542] Virtual store environment change method: Using smart glasses or a head-mounted display, the virtual store environment is dynamically changed based on the user's emotions.

[0543] Processing flow

[0544] The specific processing flow of the present invention will be shown below.

[0545] 1. Selecting the design theme and components

[0546] The server presents design themes and components to the user's terminal, which are dynamically retrieved from a database. The user selects the desired design theme and components.

[0547] 2. The workings of the emotional engine

[0548] The emotion engine analyzes the user's facial expressions through the user's camera device and recognizes emotions. It uses OpenCV and dlib to detect faces and sends the recognized emotion data to the server. For example, if the user is relaxed, the emotion score will be analyzed as "calm color scheme."

[0549] 3. Design generation and preview

[0550] The server provides a prompt to the generative AI model based on the design theme and components selected by the user, as well as emotional data. The prompt (e.g., "calm color scheme") is input into the generative AI model, which then generates a design. The generated design is temporarily saved, and a preview URL is generated. The user can view the preview on their device.

[0551] 4. Design Approval and Modifications

[0552] After checking the preview, users can approve it or make corrections such as "darkening the color of the button." This information is sent to the server, which then regenerates the design using the generative AI model.

[0553] 5. Intellectual Property Protection and Delivery of Final Design

[0554] Once the user finally approves the design, the server aggregates all the materials used, calculates and pays royalties to the intellectual property owners, and then generates a download link for the final design file to be provided to the user.

[0555] Specific examples

[0556] For example, if a user visits a virtual store and is recognized as being relaxed by the emotion engine, the server will input a "calm color scheme" theme as a prompt into the AI ​​model to generate a virtual store with a relaxing design. The user can check the design through smart glasses or a head-mounted display and give instructions for corrections as necessary.

[0557] Example prompt sentence:

[0558] "Gentle color scheme"

[0559] "Bright color scheme"

[0560] "Subtle color scheme"

[0561] This allows even non-expert users to easily generate personalized designs, enabling dynamic design suggestions based on the user's emotions. It also takes intellectual property protection into consideration, avoiding issues such as unpaid patent fees.

[0562] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[0563] Step 1:

[0564] The server retrieves design themes and components from the database and presents them to the terminal. The user selects the desired design theme and components. This causes the user's selection data to be sent from the terminal to the server. The input is the design theme and components from the database, and the output is the user's selection data.

[0565] Step 2:

[0566] The emotion engine analyzes the user's facial expressions through the camera device and recognizes emotions. The server receives the emotion data from the emotion engine. Specifically, the device captures the user's facial expressions and performs face detection using OpenCV and dlib. The input is an image of the user's facial expression, and the output is emotion data (e.g., relaxed, excited).

[0567] Step 3:

[0568] The server provides a prompt to the generative AI model based on the user's selected design theme and components, as well as emotional data. The input is the design theme, components, and emotional data, and the output is a prompt (e.g., "calm color scheme"). The server inputs the prompt to the generative AI model and generates an optimal design. The output is the generated design.

[0569] Step 4:

[0570] The server generates a preview URL for the generated design and sends it to the device. The input is the generated design, and the output is the preview URL. The user can check the preview through the device and approve or make corrections.

[0571] Step 5:

[0572] The user checks the preview and sends approval or correction instructions to the server. Specifically, the user inputs instructions such as "make the button color darker." The input is the user's correction instructions, and the output is instruction data for regeneration.

[0573] Step 6:

[0574] The server regenerates the design using the generative AI model. The input is the correction instruction data and the original design data, and the output is the regenerated design. The regenerated design is sent from the server to the device again as a preview URL. The user checks the preview again and finally approves it or sends instructions for further corrections.

[0575] Step 7:

[0576] The server compiles information on all materials used, calculates patent fees, and pays them to intellectual property owners. The input is the final generated design and information on materials used, and the output is the patent fee calculation results. Once the patent fee has been paid, the server generates a download link to provide the final design file and sends it to the terminal. The user obtains the final design file via the download link.

[0577] These processing steps allow users to easily create personalized designs without specialized design knowledge, and receive optimal design proposals based on their emotions. Furthermore, safe design generation is realized with consideration for intellectual property protection.

[0578] The specific processing unit 290 transmits the result of the specific processing to the smart device 14. In the smart device 14, the control unit 46A causes the output device 40 to output the result of the specific processing. The microphone 38B acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 38B to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[0579] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[0580] In the above embodiment, an example in which the specific process is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific process may be performed by the smart device 14.

[0581] [Second embodiment]

[0582] FIG. 3 shows an example of the configuration of a data processing system 210 according to the second embodiment.

[0583] 3, the data processing system 210 includes the data processing device 12 and smart glasses 214. An example of the data processing device 12 is a server.

[0584] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[0585] The smart glasses 214 include a computer 36, a microphone 238, a speaker 240, a camera 42, and a communication I / F 44. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, and the camera 42 are also connected to the bus 52.

[0586] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[0587] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[0588] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[0589] Fig. 4 shows an example of the main functions of the data processing device 12 and the smart glasses 214. As shown in Fig. 4, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[0590] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[0591] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[0592] In the smart glasses 214, the reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[0593] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the smart glasses 214 will be referred to as the "terminal."

[0594] The present invention is a system that presents multiple design themes and components for users to choose from and generates designs based on the user's selection. This system is particularly characterized by its ability to allow users without specialized skills to easily create personalized designs. Furthermore, a system for calculating and paying patent fees to protect intellectual property rights allows users to use the designs with peace of mind.

[0595] System program processing flow

[0596] Login process

[0597] When a user accesses the platform and enters their user ID and password on the login page, the device sends this information to the server. The server compares the received authentication information with the database, and if it matches, the server allows the user to log in and generates a session ID and sends it to the device. This allows the user to log in.

[0598] Selecting a design theme and components

[0599] The server then retrieves a list of available design themes and components from the database and sends it to the user's device after they have logged in. The user selects the desired design theme and components, and the selection is sent from the device to the server. An example scenario is when a user selects the "vintage" theme and "pastel blue."

[0600] Design Generation and Preview

[0601] The server inputs the user's selected theme and components into an AI algorithm to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can then review the preview and approve or modify it.

[0602] Design Approval and Revision

[0603] If the user checks the preview and makes any corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves.

[0604] Intellectual Property Protection

[0605] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[0606] Specific examples

[0607] For example, let's say a user wants a vintage design for their website. In this example, we'll look at the process from logging in to getting the final design:

[0608] 1. The user enters their ID and password to log in.

[0609] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[0610] 3. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[0611] 4. The user checks the preview and suggests making the button darker.

[0612] 5. The server sends the regenerated design to the device and displays an updated preview to the user.

[0613] 6. The user approves the final design.

[0614] 7. The server calculates and pays the patent fees.

[0615] 8. The server sends a download link to your device to provide the final design file.

[0616] 9. User clicks on the download link to get the final design file.

[0617] This allows users to easily create their own personalized designs and use them with intellectual property rights protected.

[0618] The processing flow will be explained below.

[0619] Step 1:

[0620] A user accesses the platform and enters their user ID and password on the login page.

[0621] Step 2:

[0622] The terminal sends the entered user ID and password to the server.

[0623] Step 3:

[0624] The server verifies the authentication information received against the database, and if it matches, it authenticates and generates a session ID.

[0625] Step 4:

[0626] The server sends a successful login response including the session ID to the terminal.

[0627] Step 5:

[0628] The terminal displays a login success screen to the user.

[0629] Step 6:

[0630] After the user logs in, they are taken to a design theme and component selection page.

[0631] Step 7:

[0632] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[0633] Step 8:

[0634] The device will display a list of design themes and components.

[0635] Step 9:

[0636] The user selects the desired design theme (e.g., vintage) and components (e.g., pastel blue as the main color).

[0637] Step 10:

[0638] The terminal transmits the user's selected design theme and components to the server.

[0639] Step 11:

[0640] The server inputs the user's selected theme and component data into the AI ​​algorithm.

[0641] Step 12:

[0642] The server generates the design using an AI algorithm and stores it in a temporary directory.

[0643] Step 13:

[0644] The server generates a preview URL for the generated design and sends it to the device.

[0645] Step 14:

[0646] The device receives the preview URL and displays it to the user.

[0647] Step 15:

[0648] The user checks the preview and approves or requests corrections.

[0649] Step 16:

[0650] The terminal transmits the user's correction instructions to the server.

[0651] Step 17:

[0652] The server receives the correction instructions and regenerates the design using the AI ​​algorithm.

[0653] Step 18:

[0654] The server saves the regenerated design back to the temporary directory and generates an updated preview URL.

[0655] Step 19:

[0656] The server sends the updated preview URL to the device.

[0657] Step 20:

[0658] The device displays the updated preview to the user.

[0659] Step 21:

[0660] The user approves the final design.

[0661] Step 22:

[0662] The terminal sends the authorization information to the server.

[0663] Step 23:

[0664] The server calculates royalties for the generated design.

[0665] Step 24:

[0666] The server pays patent royalties through the payment system of the company that owns the intellectual property.

[0667] Step 25:

[0668] Once the server confirms payment, it will generate a download link for the final design files.

[0669] Step 26:

[0670] The server sends a download link to the device.

[0671] Step 27:

[0672] The device displays the download link to the user.

[0673] Step 28:

[0674] The user clicks the download link to download the final design file.

[0675] Step 29:

[0676] The device sends a download request to the server.

[0677] Step 30:

[0678] The server provides the final design files in response to download requests.

[0679] Step 31:

[0680] The device receives the file and stores it in the user's local storage.

[0681] Example 1

[0682] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0683] Conventional design generation systems have the drawback of being difficult for average users to use because they require specialized skills and advanced operations. Furthermore, intellectual property rights protection is insufficient, raising the risk of illegal use of the designs. Furthermore, the design generation and revision process is complex and time-consuming, resulting in a lack of efficiency.

[0684] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[0685] In this invention, the server includes a means for presenting multiple design themes and components that a user can select, a means for generating a prompt sentence based on the design themes and components selected by the user and inputting the prompt sentence into a generative AI model, a means for generating a preview URL of the generated design and displaying it to the user, a means for receiving approval or correction instructions from the user and regenerating the preview URL, a means for calculating and paying patent fees to protect intellectual property, and a means for providing the final generated design to the user. This allows users without specialized skills to easily generate and safely use personalized designs.

[0686] A "user" is an entity that uses the system to select and create designs.

[0687] A "design theme" is an element that indicates the style and atmosphere of a design that can be selected by the user.

[0688] "Components" are elements that represent specific parts of a design, such as color or layout.

[0689] A "prompt sentence" is text generated to be input into a generative AI model, with its content determined based on user selections.

[0690] A "generative AI model" is an artificial intelligence algorithm that generates custom designs based on input prompts.

[0691] The "preview URL" is an address that indicates a temporary link for displaying the generated design to the user.

[0692] "Approval" is the act of the user reviewing the presented design and finally accepting it with satisfaction.

[0693] "Modification instructions" are specific instructions provided by a user to request changes or adjustments to a design.

[0694] A "temporary storage directory" is a storage area within the server where generated designs are temporarily stored.

[0695] The "final design file" is a file that shows the completed design that the user has finally approved.

[0696] A "session ID" is an identifier generated after a user logs in and is used to manage user access.

[0697] "Royalties" are fees representing the protection and exploitation of intellectual property rights associated with the creation and use of a design.

[0698] "Intellectual property protection" refers to a set of procedures to protect the intellectual property rights of the created design from infringement.

[0699] This invention is a system that presents multiple design themes and components that a user can choose from and generates a design based on the user's selection. This system is particularly characterized by its ability to allow users without specialized skills to easily create personalized designs. Furthermore, a system for calculating and paying patent fees to protect intellectual property rights allows users to use the designs with peace of mind.

[0700] This system is configured as follows: The servers include a web server and a database server. The web server uses common web server software such as Apache, and the database server uses a relational database such as MySQL. The generative AI model can use a large-scale language model such as GPT-3.

[0701] Login process

[0702] A user accesses the platform and enters their user ID and password on the login page. This information is sent from the terminal to the server. The server checks the received authentication information against the database, and if it matches, the user is allowed to log in and generates a session ID. The session ID is sent to the terminal, and the user is logged in.

[0703] Selecting a design theme and components

[0704] When a user logs in, the server retrieves a list of available design themes and components from the database and sends them to the terminal. The user selects the desired design theme and component from the list. For example, if the user selects the "vintage" theme and "pastel blue," the terminal sends the selection to the server.

[0705] Design Generation and Preview

[0706] The server generates a prompt based on the user's selection and inputs it into the generative AI model. An example prompt is "A design with a vintage-style pastel blue as the main color." The generative AI model generates a custom design based on the prompt. The generated design is saved in a temporary directory on the server, and a preview URL is created. This preview URL is sent to the device, where the preview is displayed to the user.

[0707] Design Approval and Revision

[0708] If the user checks the preview and inputs correction instructions, such as "make the button color darker," the device sends the instructions to the server. The server again uses an AI algorithm to adjust and regenerate the design. The regenerated design is saved on the server, and an updated preview URL is sent to the device. The user checks the preview again and approves or makes further corrections as necessary. This process is repeated until the user finally approves.

[0709] Intellectual Property Protection

[0710] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties, which are then paid to the intellectual property owner. Once payment is confirmed, the server prepares the final design file and generates a downloadable link, which is sent to the device, allowing the user to download the final design file.

[0711] This allows users to easily create and safely use personalized designs without requiring specialized skills.

[0712] The flow of the identification process in the first embodiment will be described with reference to FIG.

[0713] Step 1:

[0714] The user accesses the login page and enters their user ID and password.

[0715] Input: User ID, Password

[0716] Output: Credentials sent

[0717] Specific operation: The user accesses the login page on a browser and enters the user ID and password in the appropriate input form.

[0718] Step 2:

[0719] The terminal sends the entered user ID and password to the server.

[0720] Input: User ID, Password

[0721] Output: Authentication request sent

[0722] Specific operation: The browser on the device generates an HTTP request and sends data including the user ID and password to the server.

[0723] Step 3:

[0724] The server checks the authentication information against the database, and if it matches, allows login and generates a session ID.

[0725] Input: User ID, Password

[0726] Output: Session ID

[0727] Specific operation: The authentication information is matched with the user information in the database on the server, and if authentication is successful, the session manager generates a new session ID.

[0728] Step 4:

[0729] The server sends the session ID to the terminal, and the user is logged in.

[0730] Input: Session ID

[0731] Output: Session ID to be sent, login status confirmation

[0732] Specific operation: The server returns the session ID to the terminal as an HTTP response, the session ID is saved on the terminal, and the user's login state is maintained.

[0733] Step 5:

[0734] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[0735] Input: None (logged-in user session)

[0736] Output: List of design themes and components

[0737] Specific operation: The server executes a database query to obtain a list of available design themes (e.g., "vintage", "modern") and components (e.g., "pastel blue", "red") and sends it to the device in JSON format, for example.

[0738] Step 6:

[0739] The user selects the desired design theme and component from the displayed list, and the terminal transmits the selection to the server.

[0740] Input: Design theme, component selection

[0741] Output: Selections sent

[0742] Specific operation: The user selects the desired design theme and components using a selection form on the browser, and the terminal sends an HTTP request containing the selection information to the server.

[0743] Step 7:

[0744] The server generates prompt sentences based on the user's selections and inputs them into the generative AI model.

[0745] Input: Design theme, components

[0746] Output: Generated prompt statement

[0747] Specific operation: Based on the user's selection information, the server-side script generates a prompt statement such as "A design with a vintage-style pastel blue as the main color" and inputs it into the generative AI model.

[0748] Step 8:

[0749] A generative AI model generates a custom design based on the input prompt.

[0750] Input: prompt statement

[0751] Output: Generated design

[0752] Specific operation: The generative AI model analyzes the prompt and generates a corresponding design.

[0753] Step 9:

[0754] The server saves the generated design in a temporary directory and generates a preview URL.

[0755] Input: Generated Design

[0756] Output: Preview URL

[0757] Specific operation: The generated design file is saved in a temporary directory on the server, and a URL for accessing the file is generated.

[0758] Step 10:

[0759] The server sends the preview URL to the device, and the device displays the preview to the user.

[0760] Input: Preview URL

[0761] Output: Preview displayed

[0762] Specific operation: The server sends the preview URL to the terminal, and the URL is displayed to the user via the terminal's browser.

[0763] Step 11:

[0764] The user checks the preview and, if any corrections are necessary, inputs correction instructions, and the terminal transmits the instructions to the server.

[0765] Input: Correction instructions

[0766] Output: Correction instructions sent

[0767] Specific operation: The user checks the preview on the browser and enters correction instructions such as "make the button color darker," and the device sends an HTTP request including these instructions to the server.

[0768] Step 12:

[0769] The server then uses the AI ​​algorithm to adjust and regenerate the design based on the correction instructions.

[0770] Input: Correction instructions

[0771] Output: Regenerated design

[0772] Specific operation: The server-side script analyzes the correction instructions, generates a new prompt based on them, and instructs the generative AI model to regenerate the design.

[0773] Step 13:

[0774] The server saves the regenerated design and sends an updated preview URL to your device.

[0775] Input: Regenerated design

[0776] Output: Updated preview URL

[0777] Specific operation: The regenerated design file is saved in a temporary directory on the server, and a new preview URL is generated and sent to the device.

[0778] Step 14:

[0779] The device displays the updated preview to the user, and the process repeats until the user approves.

[0780] Input: Updated preview URL

[0781] Output: Update preview displayed, final approval

[0782] What happens: The device displays a new preview URL in the browser, and the user checks the preview again and enters further corrections if necessary. This process is repeated until the user finally approves.

[0783] Step 15:

[0784] Once the user finally approves the design, the server compiles information on all materials used and calculates royalties.

[0785] Input: Final Approval

[0786] Output: Patent royalty calculation information

[0787] Specific operation: The server collects data on the materials used and calculates the patent fees through an algorithm that calculates patent fees.

[0788] Step 16:

[0789] The server pays the patent fees to the intellectual property owner, and once payment is confirmed, prepares the final design files and generates a download link.

[0790] Input: Patent fee calculation information

[0791] Output: Download link

[0792] Specific operation: The patent fee is paid on the server side, and after payment is confirmed, the final design file is saved and a download link is generated.

[0793] Step 17:

[0794] The server sends a download link to the device, and the user downloads the final design file.

[0795] Input: Download link

[0796] Output: Final design files

[0797] Specific operation: The server sends a download link to the terminal as an HTTP response, and the user clicks the link to download the final design file.

[0798] (Application example 1)

[0799] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0800] While there are systems that generate designs based on multiple user-selectable design themes and components, few systems offer the ability to preview and modify designs in real time on a smart device. In particular, systems that can be intuitively operated using devices such as smart glasses are still under development. Another challenge is smoothly integrating the design generation process with intellectual property protection and royalty calculation and payment.

[0801] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[0802] In this invention, the server includes means for presenting a plurality of design themes and components that a user can select, means for generating a design based on the design themes and components selected by the user, means for displaying a preview of the generated design to the user, means for receiving approval or modification instructions from the user and regenerating the design, means for calculating and paying patent fees to protect intellectual property, means for providing the final generated design to the user, and means for previewing and modifying the design in real time on a smart device. This enables users without specialized skills to intuitively generate and modify designs using a smart device and easily obtain designs with protected intellectual property rights.

[0803] "User" refers to a user who uses the system to select design themes and components and obtain the final design.

[0804] A "design theme" refers to a basic style or concept among multiple designs that a user can choose from.

[0805] "Components" refers to specific design parts, colors, fonts, backgrounds, and other elements used based on the design theme.

[0806] "Generative AI Model" refers to the artificial intelligence algorithms used to generate custom designs based on user-selected design themes and component information.

[0807] "Smart device" refers to a smartphone, smart glasses, head-mounted display, or similar sophisticated electronic device.

[0808] "Preview" refers to a temporary display of a design generated based on the user's selected theme and components.

[0809] "Approval or modification instructions" refers to the act of the user confirming the design content or instructing changes after checking the preview.

[0810] "Royalties" refers to the cost of intellectual property protection for all materials used in designs generated by the System.

[0811] "Session ID" refers to a unique identifier generated for a user to access a system after logging in.

[0812] This invention is a system that presents multiple design themes and components that a user can select using a smart device, generates a custom design based on the selection, and allows preview and modification in real time.

[0813] First, when a user accesses the platform and enters their user ID and password on the login page, the device sends this information to the server. The server checks the authentication information against the database, and if it matches, the user is allowed to log in, and generates a session ID and sends it to the device. This allows the user to log in.

[0814] The server then retrieves a list of available design themes and components from the database and sends them to the user's device after they have logged in. The user selects these using smart glasses or other smart devices, and the device sends the selection to the server. For example, consider a scenario in which a user selects a "vintage" theme and a "pastel blue" color.

[0815] The server inputs the user's selected theme and components into the generative AI model to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can view the preview with smart glasses and approve or modify it.

[0816] If the user checks the preview and makes corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the generative AI model, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves it.

[0817] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[0818] The system uses the following hardware and software:

[0819] Smart devices: smart glasses, smartphones, etc.

[0820] AI algorithms: Generative AI models (e.g., DALL-E and Midjourney)

[0821] Database: Managing user information and design materials

[0822] For example, consider the following prompt:

[0823] Theme: Vintage

[0824] Elements: Pastel blue background, Gothic font, retro icons

[0825] Fix Request: Make the button darker

[0826] In this way, we have created a system that allows users to intuitively create and modify designs using a smart device without having specialized skills, and easily obtain designs with protected intellectual property rights.

[0827] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[0828] Step 1:

[0829] A user accesses the design platform and enters their user ID and password on the login page. The entered authentication information is sent from the terminal to the server.

[0830] Input: User ID, Password

[0831] Data calculation: The server checks the received authentication information against a database.

[0832] Output: Authentication result, session ID (if authentication is successful)

[0833] Step 2:

[0834] The server checks the user ID and password against the database, and if they match, allows the user to log in. If the login is successful, a session ID is generated and sent to the terminal.

[0835] Input: User ID, Password

[0836] Data calculation: Verification of authentication information, generation of session ID

[0837] Output: Session ID

[0838] Step 3:

[0839] The server retrieves a list of available design themes and components from a database and transmits it to the terminal of the user who has completed login.

[0840] Input: Session ID

[0841] Data operations: Obtaining a list of design themes and components

[0842] Output: List of design themes and components

[0843] Step 4:

[0844] The user selects the presented design theme and components using smart glasses or other smart devices, and the selection is sent from the device to the server.

[0845] Input: User selected design theme, components

[0846] Data Calculation: Collection of Selections

[0847] Output:Selection

[0848] Step 5:

[0849] The server inputs the user's selected theme and components into the generative AI model to generate a design. The generated design is saved in a temporary directory and a preview URL is generated.

[0850] Input:Selection

[0851] Data calculation: Generate design using generative AI model, save design to temporary storage location, generate preview URL

[0852] Output: Preview URL

[0853] Step 6:

[0854] The server sends the preview URL to the user's device, which then displays the preview to the user, who then checks the preview using smart glasses.

[0855] Input: Preview URL

[0856] Data calculation: Send preview URL, display preview

[0857] Output: Preview

[0858] Step 7:

[0859] The user checks the preview and either approves or requests corrections, which are then sent from the terminal to the server.

[0860] Input: Correction instructions

[0861] Data calculation: collection of corrections

[0862] Output: Correction details

[0863] Step 8:

[0864] The server adjusts the design using the regenerative AI model based on the correction instructions, saves the regenerated design, and sends an updated preview URL to the device.

[0865] Input: Correction details

[0866] Data calculation: Regenerate design using AI model, save regenerated design to temporary storage location, generate updated preview URL

[0867] Output: Update preview URL

[0868] Step 9:

[0869] The device will then display the updated preview URL to the user, and this process will continue until the user finally approves.

[0870] Input: Update Preview URL

[0871] Data calculation: Preview display

[0872] Output:Update Preview

[0873] Step 10:

[0874] Once the user approves the final design, the server aggregates information on all materials used, calculates the royalties, pays the royalties to the intellectual property owner, and once payment is confirmed, generates a download link for the final design file and sends it to the user's device.

[0875] Input: Final design approval, information on materials used

[0876] Data calculation: royalty calculation, payment processing, download link generation

[0877] Output: Download link for the final design file

[0878] Step 11:

[0879] The user obtains the final design file from the download link via their device.

[0880] Input: Download link

[0881] Data Calculation: File Download

[0882] Output: Final design files

[0883] This allows users to intuitively customize designs using their smart devices and easily obtain designs with intellectual property rights protected.

[0884] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[0885] This invention is a system that presents multiple design themes and components for users to choose from and generates designs based on the user's selection. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the design generation process responds to the user's emotions. This allows users without specialized skills to easily create personalized designs while protecting intellectual property rights.

[0886] System program processing flow

[0887] Login process

[0888] The user accesses the platform and enters their user ID and password on the login page. The device sends this information to the server. The server compares the received authentication information with the database, and if it matches, performs authentication and generates a session ID. The server sends a login success response including the session ID to the device. The device displays a login success screen to the user.

[0889] Selecting a design theme and components

[0890] After logging in, the server retrieves a list of available design themes and components from the database and sends it to the user's terminal. The terminal displays the list of design themes and components, and the user selects the desired design theme and component. The selection is then sent from the terminal to the server.

[0891] How the Emotional Engine Works

[0892] The emotion engine recognizes the user's emotions in real time. Emotional data is periodically sent to the server. The server analyzes this emotional data and suggests design themes and components based on the user's emotions. For example, if the user is operating the app with a relaxed emotion, a theme with a calm color scheme will be suggested.

[0893] Design Generation and Preview

[0894] The server inputs the user's selected theme and components, as well as data obtained from the emotion engine, into an AI algorithm to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can then check the preview and approve or make corrections.

[0895] Design Approval and Revision

[0896] If the user checks the preview and makes any corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves.

[0897] Intellectual Property Protection

[0898] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[0899] Specific examples

[0900] For example, let's say a user wants a new vintage design for their website. The following example shows the process from logging in to getting the final design:

[0901] 1. The user enters their ID and password to log in.

[0902] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[0903] 3. The emotion engine recognizes the user's calm emotions and makes appropriate design suggestions.

[0904] 4. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[0905] 5. The user checks the preview and suggests making the button darker.

[0906] 6. The server sends the regenerated design to the device and displays an updated preview to the user.

[0907] 7. The user approves the final design.

[0908] 8. The server calculates and pays the patent fees.

[0909] 9. The server sends a download link to your device to provide the final design file.

[0910] 10. User clicks on the download link to get the final design file.

[0911] Through this system, users can easily create designs that best suit their emotions and use them with their intellectual property protected.

[0912] The processing flow will be explained below.

[0913] Step 1:

[0914] A user accesses the platform and enters their user ID and password on the login page.

[0915] Step 2:

[0916] The terminal sends the entered user ID and password to the server.

[0917] Step 3:

[0918] The server verifies the authentication information received against the database, and if it matches, it authenticates and generates a session ID.

[0919] Step 4:

[0920] The server sends a successful login response including the session ID to the terminal.

[0921] Step 5:

[0922] The terminal displays a login success screen to the user.

[0923] Step 6:

[0924] After the user logs in, they are taken to a design theme and component selection page.

[0925] Step 7:

[0926] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[0927] Step 8:

[0928] The device will display a list of design themes and components.

[0929] Step 9:

[0930] The user selects the desired design theme and components.

[0931] Step 10:

[0932] The terminal transmits the user's selected design theme and components to the server.

[0933] Step 11:

[0934] The server that receives the selection information starts the emotion engine.

[0935] Step 12:

[0936] The emotion engine collects and analyzes emotional data in real time from the user's camera and microphone.

[0937] Step 13:

[0938] The emotion engine transmits the recognized emotion data to the server.

[0939] Step 14:

[0940] The server receives the emotion data and adjusts the design theme and components accordingly, proposing them to the user. For example, if the emotion is calm, it will suggest a color scheme with a relaxing effect.

[0941] Step 15:

[0942] The terminal displays the proposal sent from the server to the user.

[0943] Step 16:

[0944] The user reviews the proposed themes and components and makes selections or modifications as necessary.

[0945] Step 17:

[0946] The device sends the selection to the server.

[0947] Step 18:

[0948] The server inputs the user's selections and emotional data into an AI algorithm to generate a custom design.

[0949] Step 19:

[0950] The server saves the generated design in a temporary directory and generates a preview URL.

[0951] Step 20:

[0952] The server sends the preview URL to the device.

[0953] Step 21:

[0954] The device receives the preview URL and displays it to the user.

[0955] Step 22:

[0956] The user checks the preview and approves or requests corrections.

[0957] Step 23:

[0958] The terminal transmits the user's correction instructions to the server.

[0959] Step 24:

[0960] The server receives the correction instructions and regenerates the design using the AI ​​algorithm.

[0961] Step 25:

[0962] The server saves the regenerated design back to the temporary directory and generates an updated preview URL.

[0963] Step 26:

[0964] The server sends the updated preview URL to the device.

[0965] Step 27:

[0966] The device displays the updated preview to the user.

[0967] Step 28:

[0968] The user approves the final design.

[0969] Step 29:

[0970] The terminal sends the authorization information to the server.

[0971] Step 30:

[0972] The server calculates royalties for the generated design.

[0973] Step 31:

[0974] The server pays patent royalties through the payment system of the company that owns the intellectual property.

[0975] Step 32:

[0976] Once the server confirms payment, it will generate a download link for the final design files.

[0977] Step 33:

[0978] The server sends a download link to the device.

[0979] Step 34:

[0980] The device displays the download link to the user.

[0981] Step 35:

[0982] The user clicks the download link to download the final design file.

[0983] Step 36:

[0984] The device sends a download request to the server.

[0985] Step 37:

[0986] The server provides the final design files in response to download requests.

[0987] Step 38:

[0988] The device receives the file and stores it in the user's local storage.

[0989] Example 2

[0990] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[0991] The present invention aims to provide a design generation system that allows even users without specialized knowledge to easily create personalized designs by proposing and generating designs based on the user's choices and emotions. Another objective is to provide a system that automatically calculates patent fees for intellectual property protection and accurately pays them to intellectual property rights holders.

[0992] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[0993] In this invention, the server includes means for presenting a plurality of design themes and components selectable by the user, means for generating a design based on the design themes and components selected by the user, means for displaying a preview of the generated design to the user, means for recognizing the user's emotions in real time and suggesting design themes and components based on the recognized emotions, means for calculating and paying patent fees to protect intellectual property, and means for providing the generated design to the user. This enables the proposal and generation of designs according to the user's emotions, enabling even users without specialized knowledge to easily create personalized designs while ensuring the protection of intellectual property rights.

[0994] "User" means a person or company that logs in to use the System to generate Designs.

[0995] A "design theme" refers to a particular style or concept that a user can choose from, and is one of several options presented within the system.

[0996] "Components" refer to individual parts or materials related to a design theme that users can select and incorporate into their designs.

[0997] "Preview" refers to a preliminary representation of the generated design, provided for user review and modification.

[0998] An "emotion engine" refers to software or algorithms that recognize a user's facial expressions and voice and analyze their emotions in real time.

[0999] "AI algorithm" refers to a computational model or process that uses artificial intelligence to generate or modify designs.

[1000] "Royalties" refers to fees paid to intellectual property owners for materials or technology used.

[1001] "Session ID" refers to a unique identifier generated after a user logs in and is used to maintain the validity of the session.

[1002] "Intellectual property" refers to a legal concept that protects ownership and rights to designs, technology, materials, etc.

[1003] This invention is a system that provides users with multiple design themes and components to choose from, and uses an emotion engine to generate designs that reflect the user's emotions. This system uses a server and terminals as hardware, and an emotion engine and AI algorithms as software.

[1004] First, a user accesses the system from a terminal and enters their user ID and password on the login page. The terminal sends this information to the server, which then checks it against the database to perform the authentication process. If the authentication is successful, the server generates a session ID and sends it to the terminal. The terminal then displays a login success screen to the user.

[1005] When a user logs in, the server retrieves a list of available design themes and components from the database and sends it to the terminal. The terminal displays the list to the user, who selects the desired design theme and components. This information is then sent from the terminal to the server.

[1006] The emotion engine then analyzes the user's facial expressions and voice in real time to recognize their emotions. This emotion data is periodically sent to the server, which then analyzes the emotion data and suggests design themes and components based on the user's emotions. For example, if the user is feeling relaxed, a theme with a calm color scheme will be suggested.

[1007] The server inputs the design themes and components selected by the user, as well as data obtained from the emotion engine, into an AI algorithm to generate a design. The generated design is saved in a temporary directory, and a preview URL is generated. This URL is sent from the server to the device, which displays the preview to the user. The user can check the preview and make corrections as necessary.

[1008] If the user checks the preview and makes any corrections, the information is sent from the device to the server. The server then uses the AI ​​algorithm to adjust and regenerate the design. The regenerated design is saved and an updated preview URL is sent to the device. This process is repeated until the user finally approves the design.

[1009] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and upon confirmation, the final design file is provided. The server then generates a download link for the file and sends it to the user's device. The user can use this link to download the final design file.

[1010] Specific examples

[1011] For example, if a user wants a new vintage design for their website, they can use the system in the following way:

[1012] 1. The user enters their ID and password to log in.

[1013] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[1014] 3. The emotion engine recognizes the user's calm emotions and makes appropriate design suggestions.

[1015] 4. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[1016] 5. The user checks the preview and suggests making the button darker.

[1017] 6. The server sends the regenerated design to the device and displays an updated preview to the user.

[1018] 7. The user approves the final design.

[1019] 8. The server calculates and pays the patent fees.

[1020] 9. The server sends a download link to your device to provide the final design file.

[1021] 10. User clicks on the download link to get the final design file.

[1022] Example prompt sentence:

[1023] "I want to create a vintage design for my website. The main color is pastel blue, and I want the design to have a relaxed feel."

[1024] Using this system, users can easily create designs that best suit their emotions and use them while their intellectual property is protected.

[1025] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1026] Step 1:

[1027] The user accesses the login page and enters their user ID and password.

[1028] Input: User ID, Password

[1029] The terminal transmits the input information to the server.

[1030] The server checks the received information against its database and, if there is a match, performs authentication.

[1031] Output: Session ID

[1032] Specific operation: If authentication is successful, the server generates a session ID and sends a login success response including the session ID to the terminal. The terminal then displays a login success screen to the user.

[1033] Step 2:

[1034] The server retrieves a list of available design themes and components from a database.

[1035] Input: Database query

[1036] Output: List of design themes and components

[1037] Specific operation: The server sends the acquired information to the terminal, and the terminal displays the list to the user.

[1038] Step 3:

[1039] The user selects the desired design theme and components.

[1040] Input: Design theme and component selection

[1041] The terminal transmits the selection to the server.

[1042] Output: Selected design theme and component information

[1043] Specific operation: The terminal transmits the information selected by the user to the server, and the server receives the information.

[1044] Step 4:

[1045] The emotion engine recognizes the user's facial expressions and voice in real time and analyzes their emotions.

[1046] Input: User's facial expressions, voice

[1047] Output: Emotion data

[1048] Specific operation: The emotion engine uses data obtained from the camera and microphone to recognize the user's emotional state and transmits that data to the server.

[1049] Step 5:

[1050] The server analyzes the emotional data and suggests design themes and components based on the user's emotions.

[1051] Input: User emotion data, selected design theme and component information

[1052] Output: Proposed design themes and components

[1053] Specific operation: For example, if the user is relaxed, the server will suggest a theme with a calm color scheme. This information will be sent to the device, and the device will display the suggestion to the user.

[1054] Step 6:

[1055] The server inputs the design theme and components selected by the user, as well as data obtained from the emotion engine, into an AI algorithm to generate a design.

[1056] Input: Selected design theme and components, emotion data

[1057] Output: Generated design

[1058] Specific operation: The server uses an AI algorithm to generate a design, saves the design in a temporary storage directory, generates a preview URL and sends it to the device, and the device displays the preview to the user.

[1059] Step 7:

[1060] The user checks the preview and gives instructions for corrections if necessary.

[1061] Input: Correction instructions

[1062] The terminal sends the modifications to the server.

[1063] What happens: The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device, which then displays the preview again to the user. This process repeats until the user finally approves the design.

[1064] Step 8:

[1065] The user approves the final design.

[1066] Input: Final Approval

[1067] The server compiles information on all materials used and calculates royalties.

[1068] Output: Calculated patent fee

[1069] Specific operation: The server pays the patent fee to the intellectual property owner and, once confirmation is received, prepares the final design file.

[1070] Step 9:

[1071] The server generates a download link to provide the final design file and sends it to the terminal.

[1072] Output: Download link

[1073] What happens: The user uses this link to download the final design file.

[1074] (Application example 2)

[1075] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the smart glasses 214 will be referred to as a "terminal."

[1076] Traditionally, users have been required to have specialized skills when creating designs, making it difficult for users without advanced knowledge to easily generate satisfactory designs. It has also been difficult to realize dynamic design changes based on the user's emotions or personalized design suggestions incorporating emotion recognition. Furthermore, design generation without consideration for intellectual property protection has led to problems such as unpaid patent fees.

[1077] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for presenting multiple design themes and components selectable by the user, means for generating a design based on the design themes and components selected by the user, means for recognizing the user's emotions using an emotion engine and suggesting design themes and components based on the emotion data, means for displaying a preview of the generated design to the user, means for receiving approval or correction instructions from the user and regenerating the design, means for calculating and paying patent fees to protect intellectual property, means for providing the final generated design to the user, means for dynamically changing the virtual store environment in response to the user's emotions, and means for operating a design generation AI model using prompt sentences. This enables even users without specialized knowledge to easily generate personalized designs, enables dynamic design suggestions in response to the user's emotions, and enables safe design generation that takes intellectual property protection into consideration.

[1078] "User" refers to the entity that uses the system, selects the design theme and components, and provides emotion data.

[1079] A "design theme" is a group of elements that determine the overall style and atmosphere of a design.

[1080] "Components" are the specific parts and materials that make up a design, including colors, layouts, images, etc.

[1081] The "emotion engine" is a system that analyzes the user's facial expressions and biometric data to recognize their current emotional state.

[1082] A "design generation AI model" is an artificial intelligence algorithm that generates designs based on input design themes, components, and emotional data.

[1083] A "virtual store" is a virtual store space built in a digital environment, where users can access the store from remote locations and have a shopping experience.

[1084] A "prompt sentence" is a predefined input text that provides operational instructions to a design generation AI model.

[1085] "Intellectual property" refers to the right to legal protection for inventions and designs, and includes patents, trademarks, copyrights, etc.

[1086] "Preview" is a function that provides a temporary visual display of the generated design to the user and allows the user to confirm or receive instructions for correction.

[1087] "Patent royalties" are legal fees incurred for the use of intellectual property and are paid to the intellectual property owner.

[1088] The present invention provides a system for generating designs based on a user's emotions. This system presents multiple design themes and components that the user can select from, and generates a design based on the selected design theme and components. The system also includes a function for recognizing the user's emotions using an emotion engine and suggesting design themes and components based on the emotion data.

[1089] System configuration

[1090] The system consists of the following main components:

[1091] A means for presenting design themes and components: The server retrieves multiple design themes and components from a database and displays them on the user's terminal.

[1092] Design generation means: A generative AI model is used to generate a design based on the design theme and components selected by the user.

[1093] Emotion engine: Software that uses hardware such as a camera to analyze the user's facial expressions and recognize their emotions. In particular, it uses OpenCV and dlib.

[1094] Design preview means: A preview of the generated design is displayed to the user in real time.

[1095] Approval and correction procedure: Receives approval or correction instructions from the user and performs regeneration.

[1096] Intellectual property protection measures: Information on materials used is compiled, and patent fees are calculated and paid to intellectual property owners.

[1097] Virtual store environment change method: Using smart glasses or a head-mounted display, the virtual store environment is dynamically changed based on the user's emotions.

[1098] Processing flow

[1099] The specific processing flow of the present invention will be shown below.

[1100] 1. Selecting the design theme and components

[1101] The server presents design themes and components to the user's terminal, which are dynamically retrieved from a database. The user selects the desired design theme and components.

[1102] 2. The workings of the emotional engine

[1103] The emotion engine analyzes the user's facial expressions through the user's camera device and recognizes emotions. It uses OpenCV and dlib to detect faces and sends the recognized emotion data to the server. For example, if the user is relaxed, the emotion score will be analyzed as "calm color scheme."

[1104] 3. Design generation and preview

[1105] The server provides a prompt to the generative AI model based on the design theme and components selected by the user, as well as emotional data. The prompt (e.g., "calm color scheme") is input into the generative AI model, which then generates a design. The generated design is temporarily saved, and a preview URL is generated. The user can view the preview on their device.

[1106] 4. Design Approval and Modifications

[1107] After checking the preview, users can approve it or make corrections such as "darkening the color of the button." This information is sent to the server, which then regenerates the design using the generative AI model.

[1108] 5. Intellectual Property Protection and Delivery of Final Design

[1109] Once the user finally approves the design, the server aggregates all the materials used, calculates and pays royalties to the intellectual property owners, and then generates a download link for the final design file to be provided to the user.

[1110] Specific examples

[1111] For example, if a user visits a virtual store and is recognized as being relaxed by the emotion engine, the server will input a "calm color scheme" theme as a prompt into the AI ​​model to generate a virtual store with a relaxing design. The user can check the design through smart glasses or a head-mounted display and give instructions for corrections as necessary.

[1112] Example prompt sentence:

[1113] "Gentle color scheme"

[1114] "Bright color scheme"

[1115] "Subtle color scheme"

[1116] This allows even non-expert users to easily generate personalized designs, enabling dynamic design suggestions based on the user's emotions. It also takes intellectual property protection into consideration, avoiding issues such as unpaid patent fees.

[1117] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1118] Step 1:

[1119] The server retrieves design themes and components from the database and presents them to the terminal. The user selects the desired design theme and components. This causes the user's selection data to be sent from the terminal to the server. The input is the design theme and components from the database, and the output is the user's selection data.

[1120] Step 2:

[1121] The emotion engine analyzes the user's facial expressions through the camera device and recognizes emotions. The server receives the emotion data from the emotion engine. Specifically, the device captures the user's facial expressions and performs face detection using OpenCV and dlib. The input is an image of the user's facial expression, and the output is emotion data (e.g., relaxed, excited).

[1122] Step 3:

[1123] The server provides a prompt to the generative AI model based on the user's selected design theme and components, as well as emotional data. The input is the design theme, components, and emotional data, and the output is a prompt (e.g., "calm color scheme"). The server inputs the prompt to the generative AI model and generates an optimal design. The output is the generated design.

[1124] Step 4:

[1125] The server generates a preview URL for the generated design and sends it to the device. The input is the generated design, and the output is the preview URL. The user can check the preview through the device and approve or make corrections.

[1126] Step 5:

[1127] The user checks the preview and sends approval or correction instructions to the server. Specifically, the user inputs instructions such as "make the button color darker." The input is the user's correction instructions, and the output is instruction data for regeneration.

[1128] Step 6:

[1129] The server regenerates the design using the generative AI model. The input is the correction instruction data and the original design data, and the output is the regenerated design. The regenerated design is sent from the server to the device again as a preview URL. The user checks the preview again and finally approves it or sends instructions for further corrections.

[1130] Step 7:

[1131] The server compiles information on all materials used, calculates patent fees, and pays them to intellectual property owners. The input is the final generated design and information on materials used, and the output is the patent fee calculation results. Once the patent fee has been paid, the server generates a download link to provide the final design file and sends it to the terminal. The user obtains the final design file via the download link.

[1132] These processing steps allow users to easily create personalized designs without specialized design knowledge, and receive optimal design proposals based on their emotions. Furthermore, safe design generation is realized with consideration for intellectual property protection.

[1133] The specific processing unit 290 transmits the result of the specific processing to the smart glasses 214. In the smart glasses 214, the control unit 46A causes the speaker 240 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1134] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1135] In the above embodiment, an example in which the specific processing is performed by the data processing device 12 has been given, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the smart glasses 214.

[1136] [Third embodiment]

[1137] FIG. 5 shows an example of the configuration of a data processing system 310 according to the third embodiment.

[1138] 5, the data processing system 310 includes the data processing device 12 and a headset terminal 314. An example of the data processing device 12 is a server.

[1139] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1140] The headset type terminal 314 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a display 343. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the display 343 are also connected to the bus 52.

[1141] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1142] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1143] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1144] Fig. 6 shows an example of the main functions of the data processing device 12 and the headset type terminal 314. As shown in Fig. 6, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1145] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1146] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1147] In the headset type terminal 314, a reception output process is performed by the processor 46. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1148] Next, a description will be given of the identification process performed by the identification processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as the "server" and the headset type terminal 314 will be referred to as the "terminal."

[1149] The present invention is a system that presents multiple design themes and components for users to choose from and generates designs based on the user's selection. This system is particularly characterized by its ability to allow users without specialized skills to easily create personalized designs. Furthermore, a system for calculating and paying patent fees to protect intellectual property rights allows users to use the designs with peace of mind.

[1150] System program processing flow

[1151] Login process

[1152] When a user accesses the platform and enters their user ID and password on the login page, the device sends this information to the server. The server compares the received authentication information with the database, and if it matches, the server allows the user to log in and generates a session ID and sends it to the device. This allows the user to log in.

[1153] Selecting a design theme and components

[1154] The server then retrieves a list of available design themes and components from the database and sends it to the user's device after they have logged in. The user selects the desired design theme and components, and the selection is sent from the device to the server. An example scenario is when a user selects the "vintage" theme and "pastel blue."

[1155] Design Generation and Preview

[1156] The server inputs the user's selected theme and components into an AI algorithm to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can then review the preview and approve or modify it.

[1157] Design Approval and Revision

[1158] If the user checks the preview and makes any corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves.

[1159] Intellectual Property Protection

[1160] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[1161] Specific examples

[1162] For example, let's say a user wants a vintage design for their website. In this example, we'll look at the process from logging in to getting the final design:

[1163] 1. The user enters their ID and password to log in.

[1164] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[1165] 3. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[1166] 4. The user checks the preview and suggests making the button darker.

[1167] 5. The server sends the regenerated design to the device and displays an updated preview to the user.

[1168] 6. The user approves the final design.

[1169] 7. The server calculates and pays the patent fees.

[1170] 8. The server sends a download link to your device to provide the final design file.

[1171] 9. User clicks on the download link to get the final design file.

[1172] This allows users to easily create their own personalized designs and use them with intellectual property rights protected.

[1173] The processing flow will be explained below.

[1174] Step 1:

[1175] A user accesses the platform and enters their user ID and password on the login page.

[1176] Step 2:

[1177] The terminal sends the entered user ID and password to the server.

[1178] Step 3:

[1179] The server verifies the authentication information received against the database, and if it matches, it authenticates and generates a session ID.

[1180] Step 4:

[1181] The server sends a successful login response including the session ID to the terminal.

[1182] Step 5:

[1183] The terminal displays a login success screen to the user.

[1184] Step 6:

[1185] After the user logs in, they are taken to a design theme and component selection page.

[1186] Step 7:

[1187] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[1188] Step 8:

[1189] The device will display a list of design themes and components.

[1190] Step 9:

[1191] The user selects the desired design theme (e.g., vintage) and components (e.g., pastel blue as the main color).

[1192] Step 10:

[1193] The terminal transmits the user's selected design theme and components to the server.

[1194] Step 11:

[1195] The server inputs the user's selected theme and component data into the AI ​​algorithm.

[1196] Step 12:

[1197] The server generates the design using an AI algorithm and stores it in a temporary directory.

[1198] Step 13:

[1199] The server generates a preview URL for the generated design and sends it to the device.

[1200] Step 14:

[1201] The device receives the preview URL and displays it to the user.

[1202] Step 15:

[1203] The user checks the preview and approves or requests corrections.

[1204] Step 16:

[1205] The terminal transmits the user's correction instructions to the server.

[1206] Step 17:

[1207] The server receives the correction instructions and regenerates the design using the AI ​​algorithm.

[1208] Step 18:

[1209] The server saves the regenerated design back to the temporary directory and generates an updated preview URL.

[1210] Step 19:

[1211] The server sends the updated preview URL to the device.

[1212] Step 20:

[1213] The device displays the updated preview to the user.

[1214] Step 21:

[1215] The user approves the final design.

[1216] Step 22:

[1217] The terminal sends the authorization information to the server.

[1218] Step 23:

[1219] The server calculates royalties for the generated design.

[1220] Step 24:

[1221] The server pays patent royalties through the payment system of the company that owns the intellectual property.

[1222] Step 25:

[1223] Once the server confirms payment, it will generate a download link for the final design files.

[1224] Step 26:

[1225] The server sends a download link to the device.

[1226] Step 27:

[1227] The device displays the download link to the user.

[1228] Step 28:

[1229] The user clicks the download link to download the final design file.

[1230] Step 29:

[1231] The device sends a download request to the server.

[1232] Step 30:

[1233] The server provides the final design files in response to download requests.

[1234] Step 31:

[1235] The device receives the file and stores it in the user's local storage.

[1236] Example 1

[1237] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1238] Conventional design generation systems have the drawback of being difficult for average users to use because they require specialized skills and advanced operations. Furthermore, intellectual property rights protection is insufficient, raising the risk of illegal use of the designs. Furthermore, the design generation and revision process is complex and time-consuming, resulting in a lack of efficiency.

[1239] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1240] In this invention, the server includes a means for presenting multiple design themes and components that a user can select, a means for generating a prompt sentence based on the design themes and components selected by the user and inputting the prompt sentence into a generative AI model, a means for generating a preview URL of the generated design and displaying it to the user, a means for receiving approval or correction instructions from the user and regenerating the preview URL, a means for calculating and paying patent fees to protect intellectual property, and a means for providing the final generated design to the user. This allows users without specialized skills to easily generate and safely use personalized designs.

[1241] A "user" is an entity that uses the system to select and create designs.

[1242] A "design theme" is an element that indicates the style and atmosphere of a design that can be selected by the user.

[1243] "Components" are elements that represent specific parts of a design, such as color or layout.

[1244] A "prompt sentence" is text generated to be input into a generative AI model, with its content determined based on user selections.

[1245] A "generative AI model" is an artificial intelligence algorithm that generates custom designs based on input prompts.

[1246] The "preview URL" is an address that indicates a temporary link for displaying the generated design to the user.

[1247] "Approval" is the act of the user reviewing the presented design and finally accepting it with satisfaction.

[1248] "Modification instructions" are specific instructions provided by a user to request changes or adjustments to a design.

[1249] A "temporary storage directory" is a storage area within the server where generated designs are temporarily stored.

[1250] The "final design file" is a file that shows the completed design that the user has finally approved.

[1251] A "session ID" is an identifier generated after a user logs in and is used to manage user access.

[1252] "Royalties" are fees representing the protection and exploitation of intellectual property rights associated with the creation and use of a design.

[1253] "Intellectual property protection" refers to a set of procedures to protect the intellectual property rights of the created design from infringement.

[1254] This invention is a system that presents multiple design themes and components that a user can choose from and generates a design based on the user's selection. This system is particularly characterized by its ability to allow users without specialized skills to easily create personalized designs. Furthermore, a system for calculating and paying patent fees to protect intellectual property rights allows users to use the designs with peace of mind.

[1255] This system is configured as follows: The servers include a web server and a database server. The web server uses common web server software such as Apache, and the database server uses a relational database such as MySQL. The generative AI model can use a large-scale language model such as GPT-3.

[1256] Login process

[1257] A user accesses the platform and enters their user ID and password on the login page. This information is sent from the terminal to the server. The server checks the received authentication information against the database, and if it matches, the user is allowed to log in and generates a session ID. The session ID is sent to the terminal, and the user is logged in.

[1258] Selecting a design theme and components

[1259] When a user logs in, the server retrieves a list of available design themes and components from the database and sends them to the terminal. The user selects the desired design theme and component from the list. For example, if the user selects the "vintage" theme and "pastel blue," the terminal sends the selection to the server.

[1260] Design Generation and Preview

[1261] The server generates a prompt based on the user's selection and inputs it into the generative AI model. An example prompt is "A design with a vintage-style pastel blue as the main color." The generative AI model generates a custom design based on the prompt. The generated design is saved in a temporary directory on the server, and a preview URL is created. This preview URL is sent to the device, where the preview is displayed to the user.

[1262] Design Approval and Revision

[1263] If the user checks the preview and inputs correction instructions, such as "make the button color darker," the device sends the instructions to the server. The server again uses an AI algorithm to adjust and regenerate the design. The regenerated design is saved on the server, and an updated preview URL is sent to the device. The user checks the preview again and approves or makes further corrections as necessary. This process is repeated until the user finally approves.

[1264] Intellectual Property Protection

[1265] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties, which are then paid to the intellectual property owner. Once payment is confirmed, the server prepares the final design file and generates a downloadable link, which is sent to the device, allowing the user to download the final design file.

[1266] This allows users to easily create and safely use personalized designs without requiring specialized skills.

[1267] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1268] Step 1:

[1269] The user accesses the login page and enters their user ID and password.

[1270] Input: User ID, Password

[1271] Output: Credentials sent

[1272] Specific operation: The user accesses the login page on a browser and enters the user ID and password in the appropriate input form.

[1273] Step 2:

[1274] The terminal sends the entered user ID and password to the server.

[1275] Input: User ID, Password

[1276] Output: Authentication request sent

[1277] Specific operation: The browser on the device generates an HTTP request and sends data including the user ID and password to the server.

[1278] Step 3:

[1279] The server checks the authentication information against the database, and if it matches, allows login and generates a session ID.

[1280] Input: User ID, Password

[1281] Output: Session ID

[1282] Specific operation: The authentication information is matched with the user information in the database on the server, and if authentication is successful, the session manager generates a new session ID.

[1283] Step 4:

[1284] The server sends the session ID to the terminal, and the user is logged in.

[1285] Input: Session ID

[1286] Output: Session ID to be sent, login status confirmation

[1287] Specific operation: The server returns the session ID to the terminal as an HTTP response, the session ID is saved on the terminal, and the user's login state is maintained.

[1288] Step 5:

[1289] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[1290] Input: None (logged-in user session)

[1291] Output: List of design themes and components

[1292] Specific operation: The server executes a database query to obtain a list of available design themes (e.g., "vintage", "modern") and components (e.g., "pastel blue", "red") and sends it to the device in JSON format, for example.

[1293] Step 6:

[1294] The user selects the desired design theme and component from the displayed list, and the terminal transmits the selection to the server.

[1295] Input: Design theme, component selection

[1296] Output: Selections sent

[1297] Specific operation: The user selects the desired design theme and components using a selection form on the browser, and the terminal sends an HTTP request containing the selection information to the server.

[1298] Step 7:

[1299] The server generates prompt sentences based on the user's selections and inputs them into the generative AI model.

[1300] Input: Design theme, components

[1301] Output: Generated prompt statement

[1302] Specific operation: Based on the user's selection information, the server-side script generates a prompt statement such as "A design with a vintage-style pastel blue as the main color" and inputs it into the generative AI model.

[1303] Step 8:

[1304] A generative AI model generates a custom design based on the input prompt.

[1305] Input: prompt statement

[1306] Output: Generated design

[1307] Specific operation: The generative AI model analyzes the prompt and generates a corresponding design.

[1308] Step 9:

[1309] The server saves the generated design in a temporary directory and generates a preview URL.

[1310] Input: Generated Design

[1311] Output: Preview URL

[1312] Specific operation: The generated design file is saved in a temporary directory on the server, and a URL for accessing the file is generated.

[1313] Step 10:

[1314] The server sends the preview URL to the device, and the device displays the preview to the user.

[1315] Input: Preview URL

[1316] Output: Preview displayed

[1317] Specific operation: The server sends the preview URL to the terminal, and the URL is displayed to the user via the terminal's browser.

[1318] Step 11:

[1319] The user checks the preview and, if any corrections are necessary, inputs correction instructions, and the terminal transmits the instructions to the server.

[1320] Input: Correction instructions

[1321] Output: Correction instructions sent

[1322] Specific operation: The user checks the preview on the browser and enters correction instructions such as "make the button color darker," and the device sends an HTTP request including these instructions to the server.

[1323] Step 12:

[1324] The server then uses the AI ​​algorithm to adjust and regenerate the design based on the correction instructions.

[1325] Input: Correction instructions

[1326] Output: Regenerated design

[1327] Specific operation: The server-side script analyzes the correction instructions, generates a new prompt based on them, and instructs the generative AI model to regenerate the design.

[1328] Step 13:

[1329] The server saves the regenerated design and sends an updated preview URL to your device.

[1330] Input: Regenerated design

[1331] Output: Updated preview URL

[1332] Specific operation: The regenerated design file is saved in a temporary directory on the server, and a new preview URL is generated and sent to the device.

[1333] Step 14:

[1334] The device displays the updated preview to the user, and the process repeats until the user approves.

[1335] Input: Updated preview URL

[1336] Output: Update preview displayed, final approval

[1337] What happens: The device displays a new preview URL in the browser, and the user checks the preview again and enters further corrections if necessary. This process is repeated until the user finally approves.

[1338] Step 15:

[1339] Once the user finally approves the design, the server compiles information on all materials used and calculates royalties.

[1340] Input: Final Approval

[1341] Output: Patent royalty calculation information

[1342] Specific operation: The server collects data on the materials used and calculates the patent fees through an algorithm that calculates patent fees.

[1343] Step 16:

[1344] The server pays the patent fees to the intellectual property owner, and once payment is confirmed, prepares the final design files and generates a download link.

[1345] Input: Patent fee calculation information

[1346] Output: Download link

[1347] Specific operation: The patent fee is paid on the server side, and after payment is confirmed, the final design file is saved and a download link is generated.

[1348] Step 17:

[1349] The server sends a download link to the device, and the user downloads the final design file.

[1350] Input: Download link

[1351] Output: Final design files

[1352] Specific operation: The server sends a download link to the terminal as an HTTP response, and the user clicks the link to download the final design file.

[1353] (Application example 1)

[1354] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1355] While there are systems that generate designs based on multiple user-selectable design themes and components, few systems offer the ability to preview and modify designs in real time on a smart device. In particular, systems that can be intuitively operated using devices such as smart glasses are still under development. Another challenge is smoothly integrating the design generation process with intellectual property protection and royalty calculation and payment.

[1356] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1357] In this invention, the server includes means for presenting a plurality of design themes and components that a user can select, means for generating a design based on the design themes and components selected by the user, means for displaying a preview of the generated design to the user, means for receiving approval or modification instructions from the user and regenerating the design, means for calculating and paying patent fees to protect intellectual property, means for providing the final generated design to the user, and means for previewing and modifying the design in real time on a smart device. This enables users without specialized skills to intuitively generate and modify designs using a smart device and easily obtain designs with protected intellectual property rights.

[1358] "User" refers to a user who uses the system to select design themes and components and obtain the final design.

[1359] A "design theme" refers to a basic style or concept among multiple designs that a user can choose from.

[1360] "Components" refers to specific design parts, colors, fonts, backgrounds, and other elements used based on the design theme.

[1361] "Generative AI Model" refers to the artificial intelligence algorithms used to generate custom designs based on user-selected design themes and component information.

[1362] "Smart device" refers to a smartphone, smart glasses, head-mounted display, or similar sophisticated electronic device.

[1363] "Preview" refers to a temporary display of a design generated based on the user's selected theme and components.

[1364] "Approval or modification instructions" refers to the act of the user confirming the design content or instructing changes after checking the preview.

[1365] "Royalties" refers to the cost of intellectual property protection for all materials used in designs generated by the System.

[1366] "Session ID" refers to a unique identifier generated for a user to access a system after logging in.

[1367] This invention is a system that presents multiple design themes and components that a user can select using a smart device, generates a custom design based on the selection, and allows preview and modification in real time.

[1368] First, when a user accesses the platform and enters their user ID and password on the login page, the device sends this information to the server. The server checks the authentication information against the database, and if it matches, the user is allowed to log in, and generates a session ID and sends it to the device. This allows the user to log in.

[1369] The server then retrieves a list of available design themes and components from the database and sends them to the user's device after they have logged in. The user selects these using smart glasses or other smart devices, and the device sends the selection to the server. For example, consider a scenario in which a user selects a "vintage" theme and a "pastel blue" color.

[1370] The server inputs the user's selected theme and components into the generative AI model to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can view the preview with smart glasses and approve or modify it.

[1371] If the user checks the preview and makes corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the generative AI model, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves it.

[1372] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[1373] The system uses the following hardware and software:

[1374] Smart devices: smart glasses, smartphones, etc.

[1375] AI algorithms: Generative AI models (e.g., DALL-E and Midjourney)

[1376] Database: Managing user information and design materials

[1377] For example, consider the following prompt:

[1378] Theme: Vintage

[1379] Elements: Pastel blue background, Gothic font, retro icons

[1380] Fix Request: Make the button darker

[1381] In this way, we have created a system that allows users to intuitively create and modify designs using a smart device without having specialized skills, and easily obtain designs with protected intellectual property rights.

[1382] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1383] Step 1:

[1384] A user accesses the design platform and enters their user ID and password on the login page. The entered authentication information is sent from the terminal to the server.

[1385] Input: User ID, Password

[1386] Data calculation: The server checks the received authentication information against a database.

[1387] Output: Authentication result, session ID (if authentication is successful)

[1388] Step 2:

[1389] The server checks the user ID and password against the database, and if they match, allows the user to log in. If the login is successful, a session ID is generated and sent to the terminal.

[1390] Input: User ID, Password

[1391] Data calculation: Verification of authentication information, generation of session ID

[1392] Output: Session ID

[1393] Step 3:

[1394] The server retrieves a list of available design themes and components from a database and transmits it to the terminal of the user who has completed login.

[1395] Input: Session ID

[1396] Data operations: Obtaining a list of design themes and components

[1397] Output: List of design themes and components

[1398] Step 4:

[1399] The user selects the presented design theme and components using smart glasses or other smart devices, and the selection is sent from the device to the server.

[1400] Input: User selected design theme, components

[1401] Data Calculation: Collection of Selections

[1402] Output:Selection

[1403] Step 5:

[1404] The server inputs the user's selected theme and components into the generative AI model to generate a design. The generated design is saved in a temporary directory and a preview URL is generated.

[1405] Input:Selection

[1406] Data calculation: Generate design using generative AI model, save design to temporary storage location, generate preview URL

[1407] Output: Preview URL

[1408] Step 6:

[1409] The server sends the preview URL to the user's device, which then displays the preview to the user, who then checks the preview using smart glasses.

[1410] Input: Preview URL

[1411] Data calculation: Send preview URL, display preview

[1412] Output: Preview

[1413] Step 7:

[1414] The user checks the preview and either approves or requests corrections, which are then sent from the terminal to the server.

[1415] Input: Correction instructions

[1416] Data calculation: collection of corrections

[1417] Output: Correction details

[1418] Step 8:

[1419] The server adjusts the design using the regenerative AI model based on the correction instructions, saves the regenerated design, and sends an updated preview URL to the device.

[1420] Input: Correction details

[1421] Data calculation: Regenerate design using AI model, save regenerated design to temporary storage location, generate updated preview URL

[1422] Output: Update preview URL

[1423] Step 9:

[1424] The device will then display the updated preview URL to the user, and this process will continue until the user finally approves.

[1425] Input: Update Preview URL

[1426] Data calculation: Preview display

[1427] Output:Update Preview

[1428] Step 10:

[1429] Once the user approves the final design, the server aggregates information on all materials used, calculates the royalties, pays the royalties to the intellectual property owner, and once payment is confirmed, generates a download link for the final design file and sends it to the user's device.

[1430] Input: Final design approval, information on materials used

[1431] Data calculation: royalty calculation, payment processing, download link generation

[1432] Output: Download link for the final design file

[1433] Step 11:

[1434] The user obtains the final design file from the download link via their device.

[1435] Input: Download link

[1436] Data Calculation: File Download

[1437] Output: Final design files

[1438] This allows users to intuitively customize designs using their smart devices and easily obtain designs with intellectual property rights protected.

[1439] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1440] This invention is a system that presents multiple design themes and components for users to choose from and generates designs based on the user's selection. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the design generation process responds to the user's emotions. This allows users without specialized skills to easily create personalized designs while protecting intellectual property rights.

[1441] System program processing flow

[1442] Login process

[1443] The user accesses the platform and enters their user ID and password on the login page. The device sends this information to the server. The server compares the received authentication information with the database, and if it matches, performs authentication and generates a session ID. The server sends a login success response including the session ID to the device. The device displays a login success screen to the user.

[1444] Selecting a design theme and components

[1445] After logging in, the server retrieves a list of available design themes and components from the database and sends it to the user's terminal. The terminal displays the list of design themes and components, and the user selects the desired design theme and component. The selection is then sent from the terminal to the server.

[1446] How the Emotional Engine Works

[1447] The emotion engine recognizes the user's emotions in real time. Emotional data is periodically sent to the server. The server analyzes this emotional data and suggests design themes and components based on the user's emotions. For example, if the user is operating the app with a relaxed emotion, a theme with a calm color scheme will be suggested.

[1448] Design Generation and Preview

[1449] The server inputs the user's selected theme and components, as well as data obtained from the emotion engine, into an AI algorithm to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can then check the preview and approve or make corrections.

[1450] Design Approval and Revision

[1451] If the user checks the preview and makes any corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves.

[1452] Intellectual Property Protection

[1453] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[1454] Specific examples

[1455] For example, let's say a user wants a new vintage design for their website. The following example shows the process from logging in to getting the final design:

[1456] 1. The user enters their ID and password to log in.

[1457] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[1458] 3. The emotion engine recognizes the user's calm emotions and makes appropriate design suggestions.

[1459] 4. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[1460] 5. The user checks the preview and suggests making the button darker.

[1461] 6. The server sends the regenerated design to the device and displays an updated preview to the user.

[1462] 7. The user approves the final design.

[1463] 8. The server calculates and pays the patent fees.

[1464] 9. The server sends a download link to your device to provide the final design file.

[1465] 10. User clicks on the download link to get the final design file.

[1466] Through this system, users can easily create designs that best suit their emotions and use them with their intellectual property protected.

[1467] The processing flow will be explained below.

[1468] Step 1:

[1469] A user accesses the platform and enters their user ID and password on the login page.

[1470] Step 2:

[1471] The terminal sends the entered user ID and password to the server.

[1472] Step 3:

[1473] The server verifies the authentication information received against the database, and if it matches, it authenticates and generates a session ID.

[1474] Step 4:

[1475] The server sends a successful login response including the session ID to the terminal.

[1476] Step 5:

[1477] The terminal displays a login success screen to the user.

[1478] Step 6:

[1479] After the user logs in, they are taken to a design theme and component selection page.

[1480] Step 7:

[1481] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[1482] Step 8:

[1483] The device will display a list of design themes and components.

[1484] Step 9:

[1485] The user selects the desired design theme and components.

[1486] Step 10:

[1487] The terminal transmits the user's selected design theme and components to the server.

[1488] Step 11:

[1489] The server that receives the selection information starts the emotion engine.

[1490] Step 12:

[1491] The emotion engine collects and analyzes emotional data in real time from the user's camera and microphone.

[1492] Step 13:

[1493] The emotion engine transmits the recognized emotion data to the server.

[1494] Step 14:

[1495] The server receives the emotion data and adjusts the design theme and components accordingly, proposing them to the user. For example, if the emotion is calm, it will suggest a color scheme with a relaxing effect.

[1496] Step 15:

[1497] The terminal displays the proposal sent from the server to the user.

[1498] Step 16:

[1499] The user reviews the proposed themes and components and makes selections or modifications as necessary.

[1500] Step 17:

[1501] The device sends the selection to the server.

[1502] Step 18:

[1503] The server inputs the user's selections and emotional data into an AI algorithm to generate a custom design.

[1504] Step 19:

[1505] The server saves the generated design in a temporary directory and generates a preview URL.

[1506] Step 20:

[1507] The server sends the preview URL to the device.

[1508] Step 21:

[1509] The device receives the preview URL and displays it to the user.

[1510] Step 22:

[1511] The user checks the preview and approves or requests corrections.

[1512] Step 23:

[1513] The terminal transmits the user's correction instructions to the server.

[1514] Step 24:

[1515] The server receives the correction instructions and regenerates the design using the AI ​​algorithm.

[1516] Step 25:

[1517] The server saves the regenerated design back to the temporary directory and generates an updated preview URL.

[1518] Step 26:

[1519] The server sends the updated preview URL to the device.

[1520] Step 27:

[1521] The device displays the updated preview to the user.

[1522] Step 28:

[1523] The user approves the final design.

[1524] Step 29:

[1525] The terminal sends the authorization information to the server.

[1526] Step 30:

[1527] The server calculates royalties for the generated design.

[1528] Step 31:

[1529] The server pays patent royalties through the payment system of the company that owns the intellectual property.

[1530] Step 32:

[1531] Once the server confirms payment, it will generate a download link for the final design files.

[1532] Step 33:

[1533] The server sends a download link to the device.

[1534] Step 34:

[1535] The device displays the download link to the user.

[1536] Step 35:

[1537] The user clicks the download link to download the final design file.

[1538] Step 36:

[1539] The device sends a download request to the server.

[1540] Step 37:

[1541] The server provides the final design files in response to download requests.

[1542] Step 38:

[1543] The device receives the file and stores it in the user's local storage.

[1544] Example 2

[1545] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1546] The present invention aims to provide a design generation system that allows even users without specialized knowledge to easily create personalized designs by proposing and generating designs based on the user's choices and emotions. Another objective is to provide a system that automatically calculates patent fees for intellectual property protection and accurately pays them to intellectual property rights holders.

[1547] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[1548] In this invention, the server includes means for presenting a plurality of design themes and components selectable by the user, means for generating a design based on the design themes and components selected by the user, means for displaying a preview of the generated design to the user, means for recognizing the user's emotions in real time and suggesting design themes and components based on the recognized emotions, means for calculating and paying patent fees to protect intellectual property, and means for providing the generated design to the user. This enables the proposal and generation of designs according to the user's emotions, enabling even users without specialized knowledge to easily create personalized designs while ensuring the protection of intellectual property rights.

[1549] "User" means a person or company that logs in to use the System to generate Designs.

[1550] A "design theme" refers to a particular style or concept that a user can choose from, and is one of several options presented within the system.

[1551] "Components" refer to individual parts or materials related to a design theme that users can select and incorporate into their designs.

[1552] "Preview" refers to a preliminary representation of the generated design, provided for user review and modification.

[1553] An "emotion engine" refers to software or algorithms that recognize a user's facial expressions and voice and analyze their emotions in real time.

[1554] "AI algorithm" refers to a computational model or process that uses artificial intelligence to generate or modify designs.

[1555] "Royalties" refers to fees paid to intellectual property owners for materials or technology used.

[1556] "Session ID" refers to a unique identifier generated after a user logs in and is used to maintain the validity of the session.

[1557] "Intellectual property" refers to a legal concept that protects ownership and rights to designs, technology, materials, etc.

[1558] This invention is a system that provides users with multiple design themes and components to choose from, and uses an emotion engine to generate designs that reflect the user's emotions. This system uses a server and terminals as hardware, and an emotion engine and AI algorithms as software.

[1559] First, a user accesses the system from a terminal and enters their user ID and password on the login page. The terminal sends this information to the server, which then checks it against the database to perform the authentication process. If the authentication is successful, the server generates a session ID and sends it to the terminal. The terminal then displays a login success screen to the user.

[1560] When a user logs in, the server retrieves a list of available design themes and components from the database and sends it to the terminal. The terminal displays the list to the user, who selects the desired design theme and components. This information is then sent from the terminal to the server.

[1561] The emotion engine then analyzes the user's facial expressions and voice in real time to recognize their emotions. This emotion data is periodically sent to the server, which then analyzes the emotion data and suggests design themes and components based on the user's emotions. For example, if the user is feeling relaxed, a theme with a calm color scheme will be suggested.

[1562] The server inputs the design themes and components selected by the user, as well as data obtained from the emotion engine, into an AI algorithm to generate a design. The generated design is saved in a temporary directory, and a preview URL is generated. This URL is sent from the server to the device, which displays the preview to the user. The user can check the preview and make corrections as necessary.

[1563] If the user checks the preview and makes any corrections, the information is sent from the device to the server. The server then uses the AI ​​algorithm to adjust and regenerate the design. The regenerated design is saved and an updated preview URL is sent to the device. This process is repeated until the user finally approves the design.

[1564] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and upon confirmation, the final design file is provided. The server then generates a download link for the file and sends it to the user's device. The user can use this link to download the final design file.

[1565] Specific examples

[1566] For example, if a user wants a new vintage design for their website, they can use the system in the following way:

[1567] 1. The user enters their ID and password to log in.

[1568] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[1569] 3. The emotion engine recognizes the user's calm emotions and makes appropriate design suggestions.

[1570] 4. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[1571] 5. The user checks the preview and suggests making the button darker.

[1572] 6. The server sends the regenerated design to the device and displays an updated preview to the user.

[1573] 7. The user approves the final design.

[1574] 8. The server calculates and pays the patent fees.

[1575] 9. The server sends a download link to your device to provide the final design file.

[1576] 10. User clicks on the download link to get the final design file.

[1577] Example prompt sentence:

[1578] "I want to create a vintage design for my website. The main color is pastel blue, and I want the design to have a relaxed feel."

[1579] Using this system, users can easily create designs that best suit their emotions and use them while their intellectual property is protected.

[1580] The flow of the identification process in the second embodiment will be described with reference to FIG.

[1581] Step 1:

[1582] The user accesses the login page and enters their user ID and password.

[1583] Input: User ID, Password

[1584] The terminal transmits the input information to the server.

[1585] The server checks the received information against its database and, if there is a match, performs authentication.

[1586] Output: Session ID

[1587] Specific operation: If authentication is successful, the server generates a session ID and sends a login success response including the session ID to the terminal. The terminal then displays a login success screen to the user.

[1588] Step 2:

[1589] The server retrieves a list of available design themes and components from a database.

[1590] Input: Database query

[1591] Output: List of design themes and components

[1592] Specific operation: The server sends the acquired information to the terminal, and the terminal displays the list to the user.

[1593] Step 3:

[1594] The user selects the desired design theme and components.

[1595] Input: Design theme and component selection

[1596] The terminal transmits the selection to the server.

[1597] Output: Selected design theme and component information

[1598] Specific operation: The terminal transmits the information selected by the user to the server, and the server receives the information.

[1599] Step 4:

[1600] The emotion engine recognizes the user's facial expressions and voice in real time and analyzes their emotions.

[1601] Input: User's facial expressions, voice

[1602] Output: Emotion data

[1603] Specific operation: The emotion engine uses data obtained from the camera and microphone to recognize the user's emotional state and transmits that data to the server.

[1604] Step 5:

[1605] The server analyzes the emotional data and suggests design themes and components based on the user's emotions.

[1606] Input: User emotion data, selected design theme and component information

[1607] Output: Proposed design themes and components

[1608] Specific operation: For example, if the user is relaxed, the server will suggest a theme with a calm color scheme. This information will be sent to the device, and the device will display the suggestion to the user.

[1609] Step 6:

[1610] The server inputs the design theme and components selected by the user, as well as data obtained from the emotion engine, into an AI algorithm to generate a design.

[1611] Input: Selected design theme and components, emotion data

[1612] Output: Generated design

[1613] Specific operation: The server uses an AI algorithm to generate a design, saves the design in a temporary storage directory, generates a preview URL and sends it to the device, and the device displays the preview to the user.

[1614] Step 7:

[1615] The user checks the preview and gives instructions for corrections if necessary.

[1616] Input: Correction instructions

[1617] The terminal sends the modifications to the server.

[1618] What happens: The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device, which then displays the preview again to the user. This process repeats until the user finally approves the design.

[1619] Step 8:

[1620] The user approves the final design.

[1621] Input: Final Approval

[1622] The server compiles information on all materials used and calculates royalties.

[1623] Output: Calculated patent fee

[1624] Specific operation: The server pays the patent fee to the intellectual property owner and, once confirmation is received, prepares the final design file.

[1625] Step 9:

[1626] The server generates a download link to provide the final design file and sends it to the terminal.

[1627] Output: Download link

[1628] What happens: The user uses this link to download the final design file.

[1629] (Application example 2)

[1630] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the headset type terminal 314 will be referred to as a "terminal."

[1631] Traditionally, users have been required to have specialized skills when creating designs, making it difficult for users without advanced knowledge to easily generate satisfactory designs. It has also been difficult to realize dynamic design changes based on the user's emotions or personalized design suggestions incorporating emotion recognition. Furthermore, design generation without consideration for intellectual property protection has led to problems such as unpaid patent fees.

[1632] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for presenting multiple design themes and components selectable by the user, means for generating a design based on the design themes and components selected by the user, means for recognizing the user's emotions using an emotion engine and suggesting design themes and components based on the emotion data, means for displaying a preview of the generated design to the user, means for receiving approval or correction instructions from the user and regenerating the design, means for calculating and paying patent fees to protect intellectual property, means for providing the final generated design to the user, means for dynamically changing the virtual store environment in response to the user's emotions, and means for operating a design generation AI model using prompt sentences. This enables even users without specialized knowledge to easily generate personalized designs, enables dynamic design suggestions in response to the user's emotions, and enables safe design generation that takes intellectual property protection into consideration.

[1633] "User" refers to the entity that uses the system, selects the design theme and components, and provides emotion data.

[1634] A "design theme" is a group of elements that determine the overall style and atmosphere of a design.

[1635] "Components" are the specific parts and materials that make up a design, including colors, layouts, images, etc.

[1636] The "emotion engine" is a system that analyzes the user's facial expressions and biometric data to recognize their current emotional state.

[1637] A "design generation AI model" is an artificial intelligence algorithm that generates designs based on input design themes, components, and emotional data.

[1638] A "virtual store" is a virtual store space built in a digital environment, where users can access the store from remote locations and have a shopping experience.

[1639] A "prompt sentence" is a predefined input text that provides operational instructions to a design generation AI model.

[1640] "Intellectual property" refers to the right to legal protection for inventions and designs, and includes patents, trademarks, copyrights, etc.

[1641] "Preview" is a function that provides a temporary visual display of the generated design to the user and allows the user to confirm or receive instructions for correction.

[1642] "Patent royalties" are legal fees incurred for the use of intellectual property and are paid to the intellectual property owner.

[1643] The present invention provides a system for generating designs based on a user's emotions. This system presents multiple design themes and components that the user can select from, and generates a design based on the selected design theme and components. The system also includes a function for recognizing the user's emotions using an emotion engine and suggesting design themes and components based on the emotion data.

[1644] System configuration

[1645] The system consists of the following main components:

[1646] A means for presenting design themes and components: The server retrieves multiple design themes and components from a database and displays them on the user's terminal.

[1647] Design generation means: A generative AI model is used to generate a design based on the design theme and components selected by the user.

[1648] Emotion engine: Software that uses hardware such as a camera to analyze the user's facial expressions and recognize their emotions. In particular, it uses OpenCV and dlib.

[1649] Design preview means: A preview of the generated design is displayed to the user in real time.

[1650] Approval and correction procedure: Receives approval or correction instructions from the user and performs regeneration.

[1651] Intellectual property protection measures: Information on materials used is compiled, and patent fees are calculated and paid to intellectual property owners.

[1652] Virtual store environment change method: Using smart glasses or a head-mounted display, the virtual store environment is dynamically changed based on the user's emotions.

[1653] Processing flow

[1654] The specific processing flow of the present invention will be shown below.

[1655] 1. Selecting the design theme and components

[1656] The server presents design themes and components to the user's terminal, which are dynamically retrieved from a database. The user selects the desired design theme and components.

[1657] 2. The workings of the emotional engine

[1658] The emotion engine analyzes the user's facial expressions through the user's camera device and recognizes emotions. It uses OpenCV and dlib to detect faces and sends the recognized emotion data to the server. For example, if the user is relaxed, the emotion score will be analyzed as "calm color scheme."

[1659] 3. Design generation and preview

[1660] The server provides a prompt to the generative AI model based on the design theme and components selected by the user, as well as emotional data. The prompt (e.g., "calm color scheme") is input into the generative AI model, which then generates a design. The generated design is temporarily saved, and a preview URL is generated. The user can view the preview on their device.

[1661] 4. Design Approval and Modifications

[1662] After checking the preview, users can approve it or make corrections such as "darkening the color of the button." This information is sent to the server, which then regenerates the design using the generative AI model.

[1663] 5. Intellectual Property Protection and Delivery of Final Design

[1664] Once the user finally approves the design, the server aggregates all the materials used, calculates and pays royalties to the intellectual property owners, and then generates a download link for the final design file to be provided to the user.

[1665] Specific examples

[1666] For example, if a user visits a virtual store and is recognized as being relaxed by the emotion engine, the server will input a "calm color scheme" theme as a prompt into the AI ​​model to generate a virtual store with a relaxing design. The user can check the design through smart glasses or a head-mounted display and give instructions for corrections as necessary.

[1667] Example prompt sentence:

[1668] "Gentle color scheme"

[1669] "Bright color scheme"

[1670] "Subtle color scheme"

[1671] This allows even non-expert users to easily generate personalized designs, enabling dynamic design suggestions based on the user's emotions. It also takes intellectual property protection into consideration, avoiding issues such as unpaid patent fees.

[1672] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[1673] Step 1:

[1674] The server retrieves design themes and components from the database and presents them to the terminal. The user selects the desired design theme and components. This causes the user's selection data to be sent from the terminal to the server. The input is the design theme and components from the database, and the output is the user's selection data.

[1675] Step 2:

[1676] The emotion engine analyzes the user's facial expressions through the camera device and recognizes emotions. The server receives the emotion data from the emotion engine. Specifically, the device captures the user's facial expressions and performs face detection using OpenCV and dlib. The input is an image of the user's facial expression, and the output is emotion data (e.g., relaxed, excited).

[1677] Step 3:

[1678] The server provides a prompt to the generative AI model based on the user's selected design theme and components, as well as emotional data. The input is the design theme, components, and emotional data, and the output is a prompt (e.g., "calm color scheme"). The server inputs the prompt to the generative AI model and generates an optimal design. The output is the generated design.

[1679] Step 4:

[1680] The server generates a preview URL for the generated design and sends it to the device. The input is the generated design, and the output is the preview URL. The user can check the preview through the device and approve or make corrections.

[1681] Step 5:

[1682] The user checks the preview and sends approval or correction instructions to the server. Specifically, the user inputs instructions such as "make the button color darker." The input is the user's correction instructions, and the output is instruction data for regeneration.

[1683] Step 6:

[1684] The server regenerates the design using the generative AI model. The input is the correction instruction data and the original design data, and the output is the regenerated design. The regenerated design is sent from the server to the device again as a preview URL. The user checks the preview again and finally approves it or sends instructions for further corrections.

[1685] Step 7:

[1686] The server compiles information on all materials used, calculates patent fees, and pays them to intellectual property owners. The input is the final generated design and information on materials used, and the output is the patent fee calculation results. Once the patent fee has been paid, the server generates a download link to provide the final design file and sends it to the terminal. The user obtains the final design file via the download link.

[1687] These processing steps allow users to easily create personalized designs without specialized design knowledge, and receive optimal design proposals based on their emotions. Furthermore, safe design generation is realized with consideration for intellectual property protection.

[1688] The specific processing unit 290 transmits the result of the specific processing to the headset type terminal 314. In the headset type terminal 314, the control unit 46A causes the speaker 240 and the display 343 to output the result of the specific processing. The microphone 238 acquires audio indicating a user input regarding the result of the specific processing. The control unit 46A transmits audio data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the audio data.

[1689] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[1690] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the headset type terminal 314.

[1691] [Fourth embodiment]

[1692] FIG. 7 shows an example of the configuration of a data processing system 410 according to the fourth embodiment.

[1693] 7, a data processing system 410 includes a data processing device 12 and a robot 414. An example of the data processing device 12 is a server.

[1694] The data processing device 12 includes a computer 22, a database 24, and a communication I / F 26. The computer 22 is an example of a "computer" according to the technology of the present disclosure. The computer 22 includes a processor 28, a RAM 30, and a storage 32. The processor 28, the RAM 30, and the storage 32 are connected to a bus 34. The database 24 and the communication I / F 26 are also connected to the bus 34. The communication I / F 26 is connected to a network 54. Examples of the network 54 include a WAN (Wide Area Network) and / or a LAN (Local Area Network).

[1695] The robot 414 includes a computer 36, a microphone 238, a speaker 240, a camera 42, a communication I / F 44, and a control target 443. The computer 36 includes a processor 46, a RAM 48, and a storage 50. The processor 46, the RAM 48, and the storage 50 are connected to a bus 52. The microphone 238, the speaker 240, the camera 42, and the control target 443 are also connected to the bus 52.

[1696] The microphone 238 receives instructions and the like from the user 20 by receiving voice uttered by the user 20. The microphone 238 captures the voice uttered by the user 20, converts the captured voice into audio data, and outputs it to the processor 46. The speaker 240 outputs audio in accordance with instructions from the processor 46.

[1697] Camera 42 is a small digital camera equipped with an optical system including a lens, aperture, and shutter, and an imaging element such as a CMOS (Complementary Metal-Oxide-Semiconductor) image sensor or a CCD (Charge Coupled Device) image sensor, and captures images of the surroundings of user 20 (for example, an imaging range defined by an angle of view equivalent to the field of vision of a typical healthy person).

[1698] The communication I / F 44 is connected to a network 54. The communication I / Fs 44 and 26 are responsible for the exchange of various information between the processor 46 and the processor 28 via the network 54. The exchange of various information between the processor 46 and the processor 28 using the communication I / Fs 44 and 26 is carried out in a secure state.

[1699] The control object 443 includes a display device, LEDs in the eyes, and motors for driving the arms, hands, and feet. The posture and gestures of the robot 414 are controlled by controlling the motors of the arms, hands, and feet. Some of the emotions of the robot 414 can be expressed by controlling these motors. In addition, the facial expressions of the robot 414 can also be expressed by controlling the light emission state of the LEDs in the eyes of the robot 414.

[1700] Fig. 8 shows an example of the main functions of the data processing device 12 and the robot 414. As shown in Fig. 8, in the data processing device 12, a specific process is performed by the processor 28. A specific process program 56 is stored in the storage 32.

[1701] The specific processing program 56 is an example of a "program" according to the technology of the present disclosure. The processor 28 reads the specific processing program 56 from the storage 32 and executes the read specific processing program 56 on the RAM 30. The specific processing is realized by the processor 28 operating as a specific processing unit 290 in accordance with the specific processing program 56 executed on the RAM 30.

[1702] The storage 32 stores a data generation model 58 and an emotion identification model 59. The data generation model 58 and the emotion identification model 59 are used by the identification processing unit 290.

[1703] In the robot 414, the processor 46 performs the reception output process. A reception output program 60 is stored in the storage 50. The processor 46 reads the reception output program 60 from the storage 50 and executes the read reception output program 60 on the RAM 48. The reception output process is realized by the processor 46 operating as the control unit 46A in accordance with the reception output program 60 executed on the RAM 48.

[1704] Next, a description will be given of the specific processing performed by the specific processing unit 290 of the data processing device 12. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1705] The present invention is a system that presents multiple design themes and components for users to choose from and generates designs based on the user's selection. This system is particularly characterized by its ability to allow users without specialized skills to easily create personalized designs. Furthermore, a system for calculating and paying patent fees to protect intellectual property rights allows users to use the designs with peace of mind.

[1706] System program processing flow

[1707] Login process

[1708] When a user accesses the platform and enters their user ID and password on the login page, the device sends this information to the server. The server compares the received authentication information with the database, and if it matches, the server allows the user to log in and generates a session ID and sends it to the device. This allows the user to log in.

[1709] Selecting a design theme and components

[1710] The server then retrieves a list of available design themes and components from the database and sends it to the user's device after they have logged in. The user selects the desired design theme and components, and the selection is sent from the device to the server. An example scenario is when a user selects the "vintage" theme and "pastel blue."

[1711] Design Generation and Preview

[1712] The server inputs the user's selected theme and components into an AI algorithm to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can then review the preview and approve or modify it.

[1713] Design Approval and Revision

[1714] If the user checks the preview and makes any corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves.

[1715] Intellectual Property Protection

[1716] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[1717] Specific examples

[1718] For example, let's say a user wants a vintage design for their website. In this example, we'll look at the process from logging in to getting the final design:

[1719] 1. The user enters their ID and password to log in.

[1720] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[1721] 3. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[1722] 4. The user checks the preview and suggests making the button darker.

[1723] 5. The server sends the regenerated design to the device and displays an updated preview to the user.

[1724] 6. The user approves the final design.

[1725] 7. The server calculates and pays the patent fees.

[1726] 8. The server sends a download link to your device to provide the final design file.

[1727] 9. User clicks on the download link to get the final design file.

[1728] This allows users to easily create their own personalized designs and use them with intellectual property rights protected.

[1729] The processing flow will be explained below.

[1730] Step 1:

[1731] A user accesses the platform and enters their user ID and password on the login page.

[1732] Step 2:

[1733] The terminal sends the entered user ID and password to the server.

[1734] Step 3:

[1735] The server verifies the authentication information received against the database, and if it matches, it authenticates and generates a session ID.

[1736] Step 4:

[1737] The server sends a successful login response including the session ID to the terminal.

[1738] Step 5:

[1739] The terminal displays a login success screen to the user.

[1740] Step 6:

[1741] After the user logs in, they are taken to a design theme and component selection page.

[1742] Step 7:

[1743] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[1744] Step 8:

[1745] The device will display a list of design themes and components.

[1746] Step 9:

[1747] The user selects the desired design theme (e.g., vintage) and components (e.g., pastel blue as the main color).

[1748] Step 10:

[1749] The terminal transmits the user's selected design theme and components to the server.

[1750] Step 11:

[1751] The server inputs the user's selected theme and component data into the AI ​​algorithm.

[1752] Step 12:

[1753] The server generates the design using an AI algorithm and stores it in a temporary directory.

[1754] Step 13:

[1755] The server generates a preview URL for the generated design and sends it to the device.

[1756] Step 14:

[1757] The device receives the preview URL and displays it to the user.

[1758] Step 15:

[1759] The user checks the preview and approves or requests corrections.

[1760] Step 16:

[1761] The terminal transmits the user's correction instructions to the server.

[1762] Step 17:

[1763] The server receives the correction instructions and regenerates the design using the AI ​​algorithm.

[1764] Step 18:

[1765] The server saves the regenerated design back to the temporary directory and generates an updated preview URL.

[1766] Step 19:

[1767] The server sends the updated preview URL to the device.

[1768] Step 20:

[1769] The device displays the updated preview to the user.

[1770] Step 21:

[1771] The user approves the final design.

[1772] Step 22:

[1773] The terminal sends the authorization information to the server.

[1774] Step 23:

[1775] The server calculates royalties for the generated design.

[1776] Step 24:

[1777] The server pays patent royalties through the payment system of the company that owns the intellectual property.

[1778] Step 25:

[1779] Once the server confirms payment, it will generate a download link for the final design files.

[1780] Step 26:

[1781] The server sends a download link to the device.

[1782] Step 27:

[1783] The device displays the download link to the user.

[1784] Step 28:

[1785] The user clicks the download link to download the final design file.

[1786] Step 29:

[1787] The device sends a download request to the server.

[1788] Step 30:

[1789] The server provides the final design files in response to download requests.

[1790] Step 31:

[1791] The device receives the file and stores it in the user's local storage.

[1792] Example 1

[1793] Next, a description will be given of Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1794] Conventional design generation systems have the drawback of being difficult for average users to use because they require specialized skills and advanced operations. Furthermore, intellectual property rights protection is insufficient, raising the risk of illegal use of the designs. Furthermore, the design generation and revision process is complex and time-consuming, resulting in a lack of efficiency.

[1795] The specific processing by the specific processing unit 290 of the data processing device 12 in the first embodiment is realized by the following means.

[1796] In this invention, the server includes a means for presenting multiple design themes and components that a user can select, a means for generating a prompt sentence based on the design themes and components selected by the user and inputting the prompt sentence into a generative AI model, a means for generating a preview URL of the generated design and displaying it to the user, a means for receiving approval or correction instructions from the user and regenerating the preview URL, a means for calculating and paying patent fees to protect intellectual property, and a means for providing the final generated design to the user. This allows users without specialized skills to easily generate and safely use personalized designs.

[1797] A "user" is an entity that uses the system to select and create designs.

[1798] A "design theme" is an element that indicates the style and atmosphere of a design that can be selected by the user.

[1799] "Components" are elements that represent specific parts of a design, such as color or layout.

[1800] A "prompt sentence" is text generated to be input into a generative AI model, with its content determined based on user selections.

[1801] A "generative AI model" is an artificial intelligence algorithm that generates custom designs based on input prompts.

[1802] The "preview URL" is an address that indicates a temporary link for displaying the generated design to the user.

[1803] "Approval" is the act of the user reviewing the presented design and finally accepting it with satisfaction.

[1804] "Modification instructions" are specific instructions provided by a user to request changes or adjustments to a design.

[1805] A "temporary storage directory" is a storage area within the server where generated designs are temporarily stored.

[1806] The "final design file" is a file that shows the completed design that the user has finally approved.

[1807] A "session ID" is an identifier generated after a user logs in and is used to manage user access.

[1808] "Royalties" are fees representing the protection and exploitation of intellectual property rights associated with the creation and use of a design.

[1809] "Intellectual property protection" refers to a set of procedures to protect the intellectual property rights of the created design from infringement.

[1810] This invention is a system that presents multiple design themes and components that a user can choose from and generates a design based on the user's selection. This system is particularly characterized by its ability to allow users without specialized skills to easily create personalized designs. Furthermore, a system for calculating and paying patent fees to protect intellectual property rights allows users to use the designs with peace of mind.

[1811] This system is configured as follows: The servers include a web server and a database server. The web server uses common web server software such as Apache, and the database server uses a relational database such as MySQL. The generative AI model can use a large-scale language model such as GPT-3.

[1812] Login process

[1813] A user accesses the platform and enters their user ID and password on the login page. This information is sent from the terminal to the server. The server checks the received authentication information against the database, and if it matches, the user is allowed to log in and generates a session ID. The session ID is sent to the terminal, and the user is logged in.

[1814] Selecting a design theme and components

[1815] When a user logs in, the server retrieves a list of available design themes and components from the database and sends them to the terminal. The user selects the desired design theme and component from the list. For example, if the user selects the "vintage" theme and "pastel blue," the terminal sends the selection to the server.

[1816] Design Generation and Preview

[1817] The server generates a prompt based on the user's selection and inputs it into the generative AI model. An example prompt is "A design with a vintage-style pastel blue as the main color." The generative AI model generates a custom design based on the prompt. The generated design is saved in a temporary directory on the server, and a preview URL is created. This preview URL is sent to the device, where the preview is displayed to the user.

[1818] Design Approval and Revision

[1819] If the user checks the preview and inputs correction instructions, such as "make the button color darker," the device sends the instructions to the server. The server again uses an AI algorithm to adjust and regenerate the design. The regenerated design is saved on the server, and an updated preview URL is sent to the device. The user checks the preview again and approves or makes further corrections as necessary. This process is repeated until the user finally approves.

[1820] Intellectual Property Protection

[1821] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties, which are then paid to the intellectual property owner. Once payment is confirmed, the server prepares the final design file and generates a downloadable link, which is sent to the device, allowing the user to download the final design file.

[1822] This allows users to easily create and safely use personalized designs without requiring specialized skills.

[1823] The flow of the identification process in the first embodiment will be described with reference to FIG.

[1824] Step 1:

[1825] The user accesses the login page and enters their user ID and password.

[1826] Input: User ID, Password

[1827] Output: Credentials sent

[1828] Specific operation: The user accesses the login page on a browser and enters the user ID and password in the appropriate input form.

[1829] Step 2:

[1830] The terminal sends the entered user ID and password to the server.

[1831] Input: User ID, Password

[1832] Output: Authentication request sent

[1833] Specific operation: The browser on the device generates an HTTP request and sends data including the user ID and password to the server.

[1834] Step 3:

[1835] The server checks the authentication information against the database, and if it matches, allows login and generates a session ID.

[1836] Input: User ID, Password

[1837] Output: Session ID

[1838] Specific operation: The authentication information is matched with the user information in the database on the server, and if authentication is successful, the session manager generates a new session ID.

[1839] Step 4:

[1840] The server sends the session ID to the terminal, and the user is logged in.

[1841] Input: Session ID

[1842] Output: Session ID to be sent, login status confirmation

[1843] Specific operation: The server returns the session ID to the terminal as an HTTP response, the session ID is saved on the terminal, and the user's login state is maintained.

[1844] Step 5:

[1845] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[1846] Input: None (logged-in user session)

[1847] Output: List of design themes and components

[1848] Specific operation: The server executes a database query to obtain a list of available design themes (e.g., "vintage", "modern") and components (e.g., "pastel blue", "red") and sends it to the device in JSON format, for example.

[1849] Step 6:

[1850] The user selects the desired design theme and component from the displayed list, and the terminal transmits the selection to the server.

[1851] Input: Design theme, component selection

[1852] Output: Selections sent

[1853] Specific operation: The user selects the desired design theme and components using a selection form on the browser, and the terminal sends an HTTP request containing the selection information to the server.

[1854] Step 7:

[1855] The server generates prompt sentences based on the user's selections and inputs them into the generative AI model.

[1856] Input: Design theme, components

[1857] Output: Generated prompt statement

[1858] Specific operation: Based on the user's selection information, the server-side script generates a prompt statement such as "A design with a vintage-style pastel blue as the main color" and inputs it into the generative AI model.

[1859] Step 8:

[1860] A generative AI model generates a custom design based on the input prompt.

[1861] Input: prompt statement

[1862] Output: Generated design

[1863] Specific operation: The generative AI model analyzes the prompt and generates a corresponding design.

[1864] Step 9:

[1865] The server saves the generated design in a temporary directory and generates a preview URL.

[1866] Input: Generated Design

[1867] Output: Preview URL

[1868] Specific operation: The generated design file is saved in a temporary directory on the server, and a URL for accessing the file is generated.

[1869] Step 10:

[1870] The server sends the preview URL to the device, and the device displays the preview to the user.

[1871] Input: Preview URL

[1872] Output: Preview displayed

[1873] Specific operation: The server sends the preview URL to the terminal, and the URL is displayed to the user via the terminal's browser.

[1874] Step 11:

[1875] The user checks the preview and, if any corrections are necessary, inputs correction instructions, and the terminal transmits the instructions to the server.

[1876] Input: Correction instructions

[1877] Output: Correction instructions sent

[1878] Specific operation: The user checks the preview on the browser and enters correction instructions such as "make the button color darker," and the device sends an HTTP request including these instructions to the server.

[1879] Step 12:

[1880] The server then uses the AI ​​algorithm to adjust and regenerate the design based on the correction instructions.

[1881] Input: Correction instructions

[1882] Output: Regenerated design

[1883] Specific operation: The server-side script analyzes the correction instructions, generates a new prompt based on them, and instructs the generative AI model to regenerate the design.

[1884] Step 13:

[1885] The server saves the regenerated design and sends an updated preview URL to your device.

[1886] Input: Regenerated design

[1887] Output: Updated preview URL

[1888] Specific operation: The regenerated design file is saved in a temporary directory on the server, and a new preview URL is generated and sent to the device.

[1889] Step 14:

[1890] The device displays the updated preview to the user, and the process repeats until the user approves.

[1891] Input: Updated preview URL

[1892] Output: Update preview displayed, final approval

[1893] What happens: The device displays a new preview URL in the browser, and the user checks the preview again and enters further corrections if necessary. This process is repeated until the user finally approves.

[1894] Step 15:

[1895] Once the user finally approves the design, the server compiles information on all materials used and calculates royalties.

[1896] Input: Final Approval

[1897] Output: Patent royalty calculation information

[1898] Specific operation: The server collects data on the materials used and calculates the patent fees through an algorithm that calculates patent fees.

[1899] Step 16:

[1900] The server pays the patent fees to the intellectual property owner, and once payment is confirmed, prepares the final design files and generates a download link.

[1901] Input: Patent fee calculation information

[1902] Output: Download link

[1903] Specific operation: The patent fee is paid on the server side, and after payment is confirmed, the final design file is saved and a download link is generated.

[1904] Step 17:

[1905] The server sends a download link to the device, and the user downloads the final design file.

[1906] Input: Download link

[1907] Output: Final design files

[1908] Specific operation: The server sends a download link to the terminal as an HTTP response, and the user clicks the link to download the final design file.

[1909] (Application example 1)

[1910] Next, a description will be given of Application Example 1. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[1911] While there are systems that generate designs based on multiple user-selectable design themes and components, few systems offer the ability to preview and modify designs in real time on a smart device. In particular, systems that can be intuitively operated using devices such as smart glasses are still under development. Another challenge is smoothly integrating the design generation process with intellectual property protection and royalty calculation and payment.

[1912] The specific processing by the specific processing unit 290 of the data processing device 12 in the application example 1 is realized by the following means.

[1913] In this invention, the server includes means for presenting a plurality of design themes and components that a user can select, means for generating a design based on the design themes and components selected by the user, means for displaying a preview of the generated design to the user, means for receiving approval or modification instructions from the user and regenerating the design, means for calculating and paying patent fees to protect intellectual property, means for providing the final generated design to the user, and means for previewing and modifying the design in real time on a smart device. This enables users without specialized skills to intuitively generate and modify designs using a smart device and easily obtain designs with protected intellectual property rights.

[1914] "User" refers to a user who uses the system to select design themes and components and obtain the final design.

[1915] A "design theme" refers to a basic style or concept among multiple designs that a user can choose from.

[1916] "Components" refers to specific design parts, colors, fonts, backgrounds, and other elements used based on the design theme.

[1917] "Generative AI Model" refers to the artificial intelligence algorithms used to generate custom designs based on user-selected design themes and component information.

[1918] "Smart device" refers to a smartphone, smart glasses, head-mounted display, or similar sophisticated electronic device.

[1919] "Preview" refers to a temporary display of a design generated based on the user's selected theme and components.

[1920] "Approval or modification instructions" refers to the act of the user confirming the design content or instructing changes after checking the preview.

[1921] "Royalties" refers to the cost of intellectual property protection for all materials used in designs generated by the System.

[1922] "Session ID" refers to a unique identifier generated for a user to access a system after logging in.

[1923] This invention is a system that presents multiple design themes and components that a user can select using a smart device, generates a custom design based on the selection, and allows preview and modification in real time.

[1924] First, when a user accesses the platform and enters their user ID and password on the login page, the device sends this information to the server. The server checks the authentication information against the database, and if it matches, the user is allowed to log in, and generates a session ID and sends it to the device. This allows the user to log in.

[1925] The server then retrieves a list of available design themes and components from the database and sends them to the user's device after they have logged in. The user selects these using smart glasses or other smart devices, and the device sends the selection to the server. For example, consider a scenario in which a user selects a "vintage" theme and a "pastel blue" color.

[1926] The server inputs the user's selected theme and components into the generative AI model to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can view the preview with smart glasses and approve or modify it.

[1927] If the user checks the preview and makes corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the generative AI model, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves it.

[1928] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[1929] The system uses the following hardware and software:

[1930] Smart devices: smart glasses, smartphones, etc.

[1931] AI algorithms: Generative AI models (e.g., DALL-E and Midjourney)

[1932] Database: Managing user information and design materials

[1933] For example, consider the following prompt:

[1934] Theme: Vintage

[1935] Elements: Pastel blue background, Gothic font, retro icons

[1936] Fix Request: Make the button darker

[1937] In this way, we have created a system that allows users to intuitively create and modify designs using a smart device without having specialized skills, and easily obtain designs with protected intellectual property rights.

[1938] The flow of the specific processing in the application example 1 will be described with reference to FIG.

[1939] Step 1:

[1940] A user accesses the design platform and enters their user ID and password on the login page. The entered authentication information is sent from the terminal to the server.

[1941] Input: User ID, Password

[1942] Data calculation: The server checks the received authentication information against a database.

[1943] Output: Authentication result, session ID (if authentication is successful)

[1944] Step 2:

[1945] The server checks the user ID and password against the database, and if they match, allows the user to log in. If the login is successful, a session ID is generated and sent to the terminal.

[1946] Input: User ID, Password

[1947] Data calculation: Verification of authentication information, generation of session ID

[1948] Output: Session ID

[1949] Step 3:

[1950] The server retrieves a list of available design themes and components from a database and transmits it to the terminal of the user who has completed login.

[1951] Input: Session ID

[1952] Data operations: Obtaining a list of design themes and components

[1953] Output: List of design themes and components

[1954] Step 4:

[1955] The user selects the presented design theme and components using smart glasses or other smart devices, and the selection is sent from the device to the server.

[1956] Input: User selected design theme, components

[1957] Data Calculation: Collection of Selections

[1958] Output:Selection

[1959] Step 5:

[1960] The server inputs the user's selected theme and components into the generative AI model to generate a design. The generated design is saved in a temporary directory and a preview URL is generated.

[1961] Input:Selection

[1962] Data calculation: Generate design using generative AI model, save design to temporary storage location, generate preview URL

[1963] Output: Preview URL

[1964] Step 6:

[1965] The server sends the preview URL to the user's device, which then displays the preview to the user, who then checks the preview using smart glasses.

[1966] Input: Preview URL

[1967] Data calculation: Send preview URL, display preview

[1968] Output: Preview

[1969] Step 7:

[1970] The user checks the preview and either approves or requests corrections, which are then sent from the terminal to the server.

[1971] Input: Correction instructions

[1972] Data calculation: collection of corrections

[1973] Output: Correction details

[1974] Step 8:

[1975] The server adjusts the design using the regenerative AI model based on the correction instructions, saves the regenerated design, and sends an updated preview URL to the device.

[1976] Input: Correction details

[1977] Data calculation: Regenerate design using AI model, save regenerated design to temporary storage location, generate updated preview URL

[1978] Output: Update preview URL

[1979] Step 9:

[1980] The device will then display the updated preview URL to the user, and this process will continue until the user finally approves.

[1981] Input: Update Preview URL

[1982] Data calculation: Preview display

[1983] Output:Update Preview

[1984] Step 10:

[1985] Once the user approves the final design, the server aggregates information on all materials used, calculates the royalties, pays the royalties to the intellectual property owner, and once payment is confirmed, generates a download link for the final design file and sends it to the user's device.

[1986] Input: Final design approval, information on materials used

[1987] Data calculation: royalty calculation, payment processing, download link generation

[1988] Output: Download link for the final design file

[1989] Step 11:

[1990] The user obtains the final design file from the download link via their device.

[1991] Input: Download link

[1992] Data Calculation: File Download

[1993] Output: Final design files

[1994] This allows users to intuitively customize designs using their smart devices and easily obtain designs with intellectual property rights protected.

[1995] Furthermore, an emotion engine that estimates the user's emotion may be further combined. That is, the identification processing unit 290 may estimate the user's emotion using the emotion identification model 59, and perform identification processing using the user's emotion.

[1996] This invention is a system that presents multiple design themes and components for users to choose from and generates designs based on the user's selection. Furthermore, by combining it with an emotion engine that recognizes the user's emotions, the design generation process responds to the user's emotions. This allows users without specialized skills to easily create personalized designs while protecting intellectual property rights.

[1997] System program processing flow

[1998] Login process

[1999] The user accesses the platform and enters their user ID and password on the login page. The device sends this information to the server. The server compares the received authentication information with the database, and if it matches, performs authentication and generates a session ID. The server sends a login success response including the session ID to the device. The device displays a login success screen to the user.

[2000] Selecting a design theme and components

[2001] After logging in, the server retrieves a list of available design themes and components from the database and sends it to the user's terminal. The terminal displays the list of design themes and components, and the user selects the desired design theme and component. The selection is then sent from the terminal to the server.

[2002] How the Emotional Engine Works

[2003] The emotion engine recognizes the user's emotions in real time. Emotional data is periodically sent to the server. The server analyzes this emotional data and suggests design themes and components based on the user's emotions. For example, if the user is operating the app with a relaxed emotion, a theme with a calm color scheme will be suggested.

[2004] Design Generation and Preview

[2005] The server inputs the user's selected theme and components, as well as data obtained from the emotion engine, into an AI algorithm to generate a design. The generated design is saved in a temporary directory and a preview URL is generated. The server sends this URL to the device, which displays the preview to the user. The user can then check the preview and approve or make corrections.

[2006] Design Approval and Revision

[2007] If the user checks the preview and makes any corrections, such as making the button color darker, the information is sent to the server via the device. The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device. The device then displays the preview again to the user. This process is repeated until the user finally approves.

[2008] Intellectual Property Protection

[2009] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and once payment is confirmed, the final design file is provided to the user. The server then generates a download link for the file and sends it to the user's device. The user can then download the final design file via this link.

[2010] Specific examples

[2011] For example, let's say a user wants a new vintage design for their website. The following example shows the process from logging in to getting the final design:

[2012] 1. The user enters their ID and password to log in.

[2013] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[2014] 3. The emotion engine recognizes the user's calm emotions and makes appropriate design suggestions.

[2015] 4. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[2016] 5. The user checks the preview and suggests making the button darker.

[2017] 6. The server sends the regenerated design to the device and displays an updated preview to the user.

[2018] 7. The user approves the final design.

[2019] 8. The server calculates and pays the patent fees.

[2020] 9. The server sends a download link to your device to provide the final design file.

[2021] 10. User clicks on the download link to get the final design file.

[2022] Through this system, users can easily create designs that best suit their emotions and use them with their intellectual property protected.

[2023] The processing flow will be explained below.

[2024] Step 1:

[2025] A user accesses the platform and enters their user ID and password on the login page.

[2026] Step 2:

[2027] The terminal sends the entered user ID and password to the server.

[2028] Step 3:

[2029] The server verifies the authentication information received against the database, and if it matches, it authenticates and generates a session ID.

[2030] Step 4:

[2031] The server sends a successful login response including the session ID to the terminal.

[2032] Step 5:

[2033] The terminal displays a login success screen to the user.

[2034] Step 6:

[2035] After the user logs in, they are taken to a design theme and component selection page.

[2036] Step 7:

[2037] The server retrieves a list of available design themes and components from a database and transmits it to the terminal.

[2038] Step 8:

[2039] The device will display a list of design themes and components.

[2040] Step 9:

[2041] The user selects the desired design theme and components.

[2042] Step 10:

[2043] The terminal transmits the user's selected design theme and components to the server.

[2044] Step 11:

[2045] The server that receives the selection information starts the emotion engine.

[2046] Step 12:

[2047] The emotion engine collects and analyzes emotional data in real time from the user's camera and microphone.

[2048] Step 13:

[2049] The emotion engine transmits the recognized emotion data to the server.

[2050] Step 14:

[2051] The server receives the emotion data and adjusts the design theme and components accordingly, proposing them to the user. For example, if the emotion is calm, it will suggest a color scheme with a relaxing effect.

[2052] Step 15:

[2053] The terminal displays the proposal sent from the server to the user.

[2054] Step 16:

[2055] The user reviews the proposed themes and components and makes selections or modifications as necessary.

[2056] Step 17:

[2057] The device sends the selection to the server.

[2058] Step 18:

[2059] The server inputs the user's selections and emotional data into an AI algorithm to generate a custom design.

[2060] Step 19:

[2061] The server saves the generated design in a temporary directory and generates a preview URL.

[2062] Step 20:

[2063] The server sends the preview URL to the device.

[2064] Step 21:

[2065] The device receives the preview URL and displays it to the user.

[2066] Step 22:

[2067] The user checks the preview and approves or requests corrections.

[2068] Step 23:

[2069] The terminal transmits the user's correction instructions to the server.

[2070] Step 24:

[2071] The server receives the correction instructions and regenerates the design using the AI ​​algorithm.

[2072] Step 25:

[2073] The server saves the regenerated design back to the temporary directory and generates an updated preview URL.

[2074] Step 26:

[2075] The server sends the updated preview URL to the device.

[2076] Step 27:

[2077] The device displays the updated preview to the user.

[2078] Step 28:

[2079] The user approves the final design.

[2080] Step 29:

[2081] The terminal sends the authorization information to the server.

[2082] Step 30:

[2083] The server calculates royalties for the generated design.

[2084] Step 31:

[2085] The server pays patent royalties through the payment system of the company that owns the intellectual property.

[2086] Step 32:

[2087] Once the server confirms payment, it will generate a download link for the final design files.

[2088] Step 33:

[2089] The server sends a download link to the device.

[2090] Step 34:

[2091] The device displays the download link to the user.

[2092] Step 35:

[2093] The user clicks the download link to download the final design file.

[2094] Step 36:

[2095] The device sends a download request to the server.

[2096] Step 37:

[2097] The server provides the final design files in response to download requests.

[2098] Step 38:

[2099] The device receives the file and stores it in the user's local storage.

[2100] Example 2

[2101] Next, a description will be given of Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2102] The present invention aims to provide a design generation system that allows even users without specialized knowledge to easily create personalized designs by proposing and generating designs based on the user's choices and emotions. Another objective is to provide a system that automatically calculates patent fees for intellectual property protection and accurately pays them to intellectual property rights holders.

[2103] The specific processing by the specific processing unit 290 of the data processing device 12 in the second embodiment is realized by the following means.

[2104] In this invention, the server includes means for presenting a plurality of design themes and components selectable by the user, means for generating a design based on the design themes and components selected by the user, means for displaying a preview of the generated design to the user, means for recognizing the user's emotions in real time and suggesting design themes and components based on the recognized emotions, means for calculating and paying patent fees to protect intellectual property, and means for providing the generated design to the user. This enables the proposal and generation of designs according to the user's emotions, enabling even users without specialized knowledge to easily create personalized designs while ensuring the protection of intellectual property rights.

[2105] "User" means a person or company that logs in to use the System to generate Designs.

[2106] A "design theme" refers to a particular style or concept that a user can choose from, and is one of several options presented within the system.

[2107] "Components" refer to individual parts or materials related to a design theme that users can select and incorporate into their designs.

[2108] "Preview" refers to a preliminary representation of the generated design, provided for user review and modification.

[2109] An "emotion engine" refers to software or algorithms that recognize a user's facial expressions and voice and analyze their emotions in real time.

[2110] "AI algorithm" refers to a computational model or process that uses artificial intelligence to generate or modify designs.

[2111] "Royalties" refers to fees paid to intellectual property owners for materials or technology used.

[2112] "Session ID" refers to a unique identifier generated after a user logs in and is used to maintain the validity of the session.

[2113] "Intellectual property" refers to a legal concept that protects ownership and rights to designs, technology, materials, etc.

[2114] This invention is a system that provides users with multiple design themes and components to choose from, and uses an emotion engine to generate designs that reflect the user's emotions. This system uses a server and terminals as hardware, and an emotion engine and AI algorithms as software.

[2115] First, a user accesses the system from a terminal and enters their user ID and password on the login page. The terminal sends this information to the server, which then checks it against the database to perform the authentication process. If the authentication is successful, the server generates a session ID and sends it to the terminal. The terminal then displays a login success screen to the user.

[2116] When a user logs in, the server retrieves a list of available design themes and components from the database and sends it to the terminal. The terminal displays the list to the user, who selects the desired design theme and components. This information is then sent from the terminal to the server.

[2117] The emotion engine then analyzes the user's facial expressions and voice in real time to recognize their emotions. This emotion data is periodically sent to the server, which then analyzes the emotion data and suggests design themes and components based on the user's emotions. For example, if the user is feeling relaxed, a theme with a calm color scheme will be suggested.

[2118] The server inputs the design themes and components selected by the user, as well as data obtained from the emotion engine, into an AI algorithm to generate a design. The generated design is saved in a temporary directory, and a preview URL is generated. This URL is sent from the server to the device, which displays the preview to the user. The user can check the preview and make corrections as necessary.

[2119] If the user checks the preview and makes any corrections, the information is sent from the device to the server. The server then uses the AI ​​algorithm to adjust and regenerate the design. The regenerated design is saved and an updated preview URL is sent to the device. This process is repeated until the user finally approves the design.

[2120] Once the final design is approved by the user, the server aggregates information on all materials used and calculates royalties. The server then pays royalties to the intellectual property owner, and upon confirmation, the final design file is provided. The server then generates a download link for the file and sends it to the user's device. The user can use this link to download the final design file.

[2121] Specific examples

[2122] For example, if a user wants a new vintage design for their website, they can use the system in the following way:

[2123] 1. The user enters their ID and password to log in.

[2124] 2. The server displays the design theme (vintage) and components (pastel blue main color), and the user selects them.

[2125] 3. The emotion engine recognizes the user's calm emotions and makes appropriate design suggestions.

[2126] 4. The server uses an AI algorithm to generate a vintage-inspired pastel blue design and sends a preview URL to your device.

[2127] 5. The user checks the preview and suggests making the button darker.

[2128] 6. The server sends the regenerated design to the device and displays an updated preview to the user.

[2129] 7. The user approves the final design.

[2130] 8. The server calculates and pays the patent fees.

[2131] 9. The server sends a download link to your device to provide the final design file.

[2132] 10. User clicks on the download link to get the final design file.

[2133] Example prompt sentence:

[2134] "I want to create a vintage design for my website. The main color is pastel blue, and I want the design to have a relaxed feel."

[2135] Using this system, users can easily create designs that best suit their emotions and use them while their intellectual property is protected.

[2136] The flow of the identification process in the second embodiment will be described with reference to FIG.

[2137] Step 1:

[2138] The user accesses the login page and enters their user ID and password.

[2139] Input: User ID, Password

[2140] The terminal transmits the input information to the server.

[2141] The server checks the received information against its database and, if there is a match, performs authentication.

[2142] Output: Session ID

[2143] Specific operation: If authentication is successful, the server generates a session ID and sends a login success response including the session ID to the terminal. The terminal then displays a login success screen to the user.

[2144] Step 2:

[2145] The server retrieves a list of available design themes and components from a database.

[2146] Input: Database query

[2147] Output: List of design themes and components

[2148] Specific operation: The server sends the acquired information to the terminal, and the terminal displays the list to the user.

[2149] Step 3:

[2150] The user selects the desired design theme and components.

[2151] Input: Design theme and component selection

[2152] The terminal transmits the selection to the server.

[2153] Output: Selected design theme and component information

[2154] Specific operation: The terminal transmits the information selected by the user to the server, and the server receives the information.

[2155] Step 4:

[2156] The emotion engine recognizes the user's facial expressions and voice in real time and analyzes their emotions.

[2157] Input: User's facial expressions, voice

[2158] Output: Emotion data

[2159] Specific operation: The emotion engine uses data obtained from the camera and microphone to recognize the user's emotional state and transmits that data to the server.

[2160] Step 5:

[2161] The server analyzes the emotional data and suggests design themes and components based on the user's emotions.

[2162] Input: User emotion data, selected design theme and component information

[2163] Output: Proposed design themes and components

[2164] Specific operation: For example, if the user is relaxed, the server will suggest a theme with a calm color scheme. This information will be sent to the device, and the device will display the suggestion to the user.

[2165] Step 6:

[2166] The server inputs the design theme and components selected by the user, as well as data obtained from the emotion engine, into an AI algorithm to generate a design.

[2167] Input: Selected design theme and components, emotion data

[2168] Output: Generated design

[2169] Specific operation: The server uses an AI algorithm to generate a design, saves the design in a temporary storage directory, generates a preview URL and sends it to the device, and the device displays the preview to the user.

[2170] Step 7:

[2171] The user checks the preview and gives instructions for corrections if necessary.

[2172] Input: Correction instructions

[2173] The terminal sends the modifications to the server.

[2174] What happens: The server again adjusts the design using the AI ​​algorithm, saves the regenerated design, and sends an updated preview URL to the device, which then displays the preview again to the user. This process repeats until the user finally approves the design.

[2175] Step 8:

[2176] The user approves the final design.

[2177] Input: Final Approval

[2178] The server compiles information on all materials used and calculates royalties.

[2179] Output: Calculated patent fee

[2180] Specific operation: The server pays the patent fee to the intellectual property owner and, once confirmation is received, prepares the final design file.

[2181] Step 9:

[2182] The server generates a download link to provide the final design file and sends it to the terminal.

[2183] Output: Download link

[2184] What happens: The user uses this link to download the final design file.

[2185] (Application example 2)

[2186] Next, a description will be given of Application Example 2. In the following description, the data processing device 12 will be referred to as a "server" and the robot 414 will be referred to as a "terminal."

[2187] Traditionally, users have been required to have specialized skills when creating designs, making it difficult for users without advanced knowledge to easily generate satisfactory designs. It has also been difficult to realize dynamic design changes based on the user's emotions or personalized design suggestions incorporating emotion recognition. Furthermore, design generation without consideration for intellectual property protection has led to problems such as unpaid patent fees.

[2188] The specification processing by the specification processing unit 290 of the data processing device 12 in Application Example 2 is realized by the following means. In this invention, the server includes means for presenting multiple design themes and components selectable by the user, means for generating a design based on the design themes and components selected by the user, means for recognizing the user's emotions using an emotion engine and suggesting design themes and components based on the emotion data, means for displaying a preview of the generated design to the user, means for receiving approval or correction instructions from the user and regenerating the design, means for calculating and paying patent fees to protect intellectual property, means for providing the final generated design to the user, means for dynamically changing the virtual store environment in response to the user's emotions, and means for operating a design generation AI model using prompt sentences. This enables even users without specialized knowledge to easily generate personalized designs, enables dynamic design suggestions in response to the user's emotions, and enables safe design generation that takes intellectual property protection into consideration.

[2189] "User" refers to the entity that uses the system, selects the design theme and components, and provides emotion data.

[2190] A "design theme" is a group of elements that determine the overall style and atmosphere of a design.

[2191] "Components" are the specific parts and materials that make up a design, including colors, layouts, images, etc.

[2192] The "emotion engine" is a system that analyzes the user's facial expressions and biometric data to recognize their current emotional state.

[2193] A "design generation AI model" is an artificial intelligence algorithm that generates designs based on input design themes, components, and emotional data.

[2194] A "virtual store" is a virtual store space built in a digital environment, where users can access the store from remote locations and have a shopping experience.

[2195] A "prompt sentence" is a predefined input text that provides operational instructions to a design generation AI model.

[2196] "Intellectual property" refers to the right to legal protection for inventions and designs, and includes patents, trademarks, copyrights, etc.

[2197] "Preview" is a function that provides a temporary visual display of the generated design to the user and allows the user to confirm or receive instructions for correction.

[2198] "Patent royalties" are legal fees incurred for the use of intellectual property and are paid to the intellectual property owner.

[2199] The present invention provides a system for generating designs based on a user's emotions. This system presents multiple design themes and components that the user can select from, and generates a design based on the selected design theme and components. The system also includes a function for recognizing the user's emotions using an emotion engine and suggesting design themes and components based on the emotion data.

[2200] System configuration

[2201] The system consists of the following main components:

[2202] A means for presenting design themes and components: The server retrieves multiple design themes and components from a database and displays them on the user's terminal.

[2203] Design generation means: A generative AI model is used to generate a design based on the design theme and components selected by the user.

[2204] Emotion engine: Software that uses hardware such as a camera to analyze the user's facial expressions and recognize their emotions. In particular, it uses OpenCV and dlib.

[2205] Design preview means: A preview of the generated design is displayed to the user in real time.

[2206] Approval and correction procedure: Receives approval or correction instructions from the user and performs regeneration.

[2207] Intellectual property protection measures: Information on materials used is compiled, and patent fees are calculated and paid to intellectual property owners.

[2208] Virtual store environment change method: Using smart glasses or a head-mounted display, the virtual store environment is dynamically changed based on the user's emotions.

[2209] Processing flow

[2210] The specific processing flow of the present invention will be shown below.

[2211] 1. Selecting the design theme and components

[2212] The server presents design themes and components to the user's terminal, which are dynamically retrieved from a database. The user selects the desired design theme and components.

[2213] 2. The workings of the emotional engine

[2214] The emotion engine analyzes the user's facial expressions through the user's camera device and recognizes emotions. It uses OpenCV and dlib to detect faces and sends the recognized emotion data to the server. For example, if the user is relaxed, the emotion score will be analyzed as "calm color scheme."

[2215] 3. Design generation and preview

[2216] The server provides a prompt to the generative AI model based on the design theme and components selected by the user, as well as emotional data. The prompt (e.g., "calm color scheme") is input into the generative AI model, which then generates a design. The generated design is temporarily saved, and a preview URL is generated. The user can view the preview on their device.

[2217] 4. Design Approval and Modifications

[2218] After checking the preview, users can approve it or make corrections such as "darkening the color of the button." This information is sent to the server, which then regenerates the design using the generative AI model.

[2219] 5. Intellectual Property Protection and Delivery of Final Design

[2220] Once the user finally approves the design, the server aggregates all the materials used, calculates and pays royalties to the intellectual property owners, and then generates a download link for the final design file to be provided to the user.

[2221] Specific examples

[2222] For example, if a user visits a virtual store and is recognized as being relaxed by the emotion engine, the server will input a "calm color scheme" theme as a prompt into the AI ​​model to generate a virtual store with a relaxing design. The user can check the design through smart glasses or a head-mounted display and give instructions for corrections as necessary.

[2223] Example prompt sentence:

[2224] "Gentle color scheme"

[2225] "Bright color scheme"

[2226] "Subtle color scheme"

[2227] This allows even non-expert users to easily generate personalized designs, enabling dynamic design suggestions based on the user's emotions. It also takes intellectual property protection into consideration, avoiding issues such as unpaid patent fees.

[2228] The flow of the specific processing in the application example 2 will be described with reference to FIG.

[2229] Step 1:

[2230] The server retrieves design themes and components from the database and presents them to the terminal. The user selects the desired design theme and components. This causes the user's selection data to be sent from the terminal to the server. The input is the design theme and components from the database, and the output is the user's selection data.

[2231] Step 2:

[2232] The emotion engine analyzes the user's facial expressions through the camera device and recognizes emotions. The server receives the emotion data from the emotion engine. Specifically, the device captures the user's facial expressions and performs face detection using OpenCV and dlib. The input is an image of the user's facial expression, and the output is emotion data (e.g., relaxed, excited).

[2233] Step 3:

[2234] The server provides a prompt to the generative AI model based on the user's selected design theme and components, as well as emotional data. The input is the design theme, components, and emotional data, and the output is a prompt (e.g., "calm color scheme"). The server inputs the prompt to the generative AI model and generates an optimal design. The output is the generated design.

[2235] Step 4:

[2236] The server generates a preview URL for the generated design and sends it to the device. The input is the generated design, and the output is the preview URL. The user can check the preview through the device and approve or make corrections.

[2237] Step 5:

[2238] The user checks the preview and sends approval or correction instructions to the server. Specifically, the user inputs instructions such as "make the button color darker." The input is the user's correction instructions, and the output is instruction data for regeneration.

[2239] Step 6:

[2240] The server regenerates the design using the generative AI model. The input is the correction instruction data and the original design data, and the output is the regenerated design. The regenerated design is sent from the server to the device again as a preview URL. The user checks the preview again and finally approves it or sends instructions for further corrections.

[2241] Step 7:

[2242] The server compiles information on all materials used, calculates patent fees, and pays them to intellectual property owners. The input is the final generated design and information on materials used, and the output is the patent fee calculation results. Once the patent fee has been paid, the server generates a download link to provide the final design file and sends it to the terminal. The user obtains the final design file via the download link.

[2243] These processing steps allow users to easily create personalized designs without specialized design knowledge, and receive optimal design proposals based on their emotions. Furthermore, safe design generation is realized with consideration for intellectual property protection.

[2244] The specific processing unit 290 transmits the result of the specific processing to the robot 414. In the robot 414, the control unit 46A causes the speaker 240 and the control target 443 to output the result of the specific processing. The microphone 238 acquires voice indicating a user input regarding the result of the specific processing. The control unit 46A transmits voice data indicating the user input acquired by the microphone 238 to the data processing device 12. In the data processing device 12, the specific processing unit 290 acquires the voice data.

[2245] The data generation model 58 is a so-called generative AI (Artificial Intelligence). An example of the data generation model 58 is ChatGPT (Internet Search<URL: https: / / openai.com / blog / chatgpt> ), Gemini (Internet search <url: https: gemini.google.com ?hl="ja">) and other generation AIs. The data generation model 58 is obtained by performing deep learning on a neural network. A prompt including an instruction is input to the data generation model 58, and inference data such as voice data indicating voice, text data indicating text, and image data indicating an image is also input. The data generation model 58 performs inference on the input inference data in accordance with the instruction indicated by the prompt, and outputs the inference result in a data format such as voice data and text data. Here, inference refers to, for example, analysis, classification, prediction, and / or summarization.

[2246] In the above embodiment, an example was given in which the specific processing is performed by the data processing device 12, but the technology of the present disclosure is not limited to this, and the specific processing may be performed by the robot 414.

[2247] The emotion identification model 59 as an emotion engine may determine the user's emotion according to a specific mapping. Specifically, the emotion identification model 59 may determine the user's emotion according to an emotion map (see FIG. 9), which is a specific mapping. Similarly, the emotion identification model 59 may determine the robot's emotion, and the identification processing unit 290 may perform identification processing using the robot's emotion.

[2248] FIG. 9 illustrates an emotion map 400 on which multiple emotions are mapped. In the emotion map 400, emotions are arranged in concentric circles radiating from the center. Emotions closer to the center of the concentric circles are more primitive. Emotions representing states and behaviors arising from a state of mind are arranged on the outer edges of the concentric circles. The concept of emotion includes both affect and mental states. Emotions generally generated from reactions occurring in the brain are arranged on the left side of the concentric circles. Emotions generally induced by situational judgment are arranged on the right side of the concentric circles. Emotions generally generated from reactions occurring in the brain and induced by situational judgment are arranged on the upper and lower sides of the concentric circles. Furthermore, the emotion of "pleasure" is arranged on the upper side of the concentric circles, and the emotion of "discomfort" is arranged on the lower side. In this way, in the emotion map 400, multiple emotions are mapped based on the structure by which emotions are generated, and emotions that tend to occur simultaneously are mapped close to each other.

[2249] These emotions are distributed in the 3 o'clock direction on emotion map 400, and typically fluctuate between relief and anxiety. In the right half of emotion map 400, situational awareness dominates over internal sensations, resulting in a sense of calm.

[2250] The inside of emotion map 400 represents what is going on in the mind, and the outside of emotion map 400 represents behavior, so the further you go outside emotion map 400, the more visible the emotions become (the more they are expressed in behavior).

[2251] Human emotions are based on various balances, such as posture and blood sugar levels. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. Emotions can also be created for robots, automobiles, and motorcycles, based on various balances, such as posture and remaining battery life. When these balances deviate from the ideal, a state of discomfort is indicated, and when they approach the ideal, a state of pleasure is indicated. An emotion map can be generated, for example, based on Dr. Mitsuyoshi's emotion map (Research on Voice Emotion Recognition and Emotional Brain Physiological Signal Analysis Systems, Tokushima University, Doctoral Dissertation: https: / / ci.nii.ac.jp / naid / 500000375379). The left half of the emotion map lists emotions belonging to the "reaction" domain, where sensation is dominant. The right half of the emotion map lists emotions belonging to the "situation" domain, where situational awareness is dominant.

[2252] The emotion map defines two emotions that promote learning. One is a negative emotion on the situation side, around the middle of "repentance" or "reflection." In other words, this occurs when the robot experiences negative emotions such as "I never want to feel this way again" or "I don't want to be scolded again." The other is a positive emotion on the response side, around "desire." In other words, this occurs when the robot experiences positive feelings such as "I want more" or "I want to know more."

[2253] The emotion identification model 59 inputs user input into a pre-trained neural network, obtains emotion values ​​indicating each emotion shown in the emotion map 400, and determines the user's emotion. This neural network is pre-trained based on multiple pieces of training data that are combinations of user input and emotion values ​​indicating each emotion shown in the emotion map 400. Furthermore, this neural network is trained so that emotions that are located close to each other have similar values, as in the emotion map 900 shown in FIG. 10. FIG. 10 shows an example in which multiple emotions, "relieved," "calm," and "reassuring," have similar emotion values.

[2254] The system according to the present disclosure has been described above mainly with respect to the functions of the data processing device 12, but the system according to the present disclosure is not necessarily implemented on a server. The system according to the present disclosure may be implemented as a general information processing system. The present disclosure may be implemented, for example, as a software program running on a personal computer or an application running on a smartphone, etc. The method according to the present disclosure may be provided to users in the form of SaaS (Software as a Service).

[2255] In the above embodiment, an example was given in which the specific processing is performed by one computer 22, but the technology of the present disclosure is not limited to this, and the specific processing may be distributed and performed by a plurality of computers including the computer 22. For example, the data generation model 58 may be provided in an external device of the data processing device 12, and data may be generated in the external device in accordance with input data.

[2256] In the above embodiment, an example in which the specific processing program 56 is stored in the storage 32 has been described, but the technology of the present disclosure is not limited to this. For example, the specific processing program 56 may be stored in a portable, computer-readable, non-transitory storage medium such as a USB (Universal Serial Bus) memory. The specific processing program 56 stored in the non-transitory storage medium is installed in the computer 22 of the data processing device 12. The processor 28 executes the specific processing in accordance with the specific processing program 56.

[2257] Alternatively, the specific processing program 56 may be stored in a storage device such as a server connected to the data processing device 12 via the network 54, and the specific processing program 56 may be downloaded and installed on the computer 22 in response to a request from the data processing device 12.

[2258] It is not necessary to store all of the specific processing program 56 in a storage device such as a server connected to the data processing device 12 via the network 54, or to store all of the specific processing program 56 in the storage 32; only a portion of the specific processing program 56 may be stored.

[2259] The hardware resource for executing a specific process can be any of the following processors: An example of a processor is a CPU, which is a general-purpose processor that functions as a hardware resource for executing a specific process by executing software, i.e., a program. Another example of a processor is a dedicated electrical circuit, such as an FPGA (Field-Programmable Gate Array), a PLD (Programmable Logic Device), or an ASIC (Application Specific Integrated Circuit), which is a processor with a circuit configuration designed specifically for executing a specific process. Each processor has built-in or connected memory, and each processor uses the memory to execute the specific process.

[2260] The hardware resource that executes the specific processing may be configured with one of these various processors, or may be configured with a combination of two or more processors of the same or different types (for example, a combination of multiple FPGAs, or a combination of a CPU and an FPGA). Also, the hardware resource that executes the specific processing may be a single processor.

[2261] As an example of a system configured with a single processor, first, one processor is configured by combining one or more CPUs and software, and this processor functions as a hardware resource that executes a specific process. Second, there is a system that uses a processor that realizes the functions of an entire system including multiple hardware resources that execute a specific process on a single IC chip, as typified by SoC (System-on-a-chip). In this way, a specific process is realized using one or more of the above-mentioned various processors as hardware resources.

[2262] Furthermore, the hardware structure of these various processors can be, more specifically, an electric circuit that combines circuit elements such as semiconductor devices. The specific processing described above is merely an example. Therefore, it goes without saying that unnecessary steps may be deleted, new steps may be added, or the processing order may be rearranged, without departing from the spirit of the invention.

[2263] The above-described description and illustrations are a detailed explanation of the parts related to the technology of the present disclosure and are merely an example of the technology of the present disclosure. For example, the above description of the configuration, functions, actions, and effects is an explanation of an example of the configuration, functions, actions, and effects of the parts related to the technology of the present disclosure. Therefore, it goes without saying that unnecessary parts may be deleted, new elements may be added, or replacements may be made to the above-described description and illustrations within the scope of the gist of the technology of the present disclosure. Furthermore, to avoid confusion and facilitate understanding of the parts related to the technology of the present disclosure, the above-described description and illustrations omit explanations of common technical knowledge that do not require particular explanation to enable the implementation of the technology of the present disclosure.

[2264] All publications, patent applications, and technical standards mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication, patent application, or technical standard was specifically and individually indicated to be incorporated by reference.

[2265] The following is further disclosed regarding the above embodiment.

[2266] (Claim 1)

[2267] means for presenting a plurality of design themes and components from which a user can select;

[2268] means for generating a design based on a user-selected design theme and components;

[2269] means for displaying a preview of the generated design to the user;

[2270] means for receiving and regenerating approval or correction instructions from the user;

[2271] a means of calculating and paying royalties to protect intellectual property;

[2272] The system includes a means for providing the final generated design to a user.

[2273] (Claim 2)

[2274] a means for authenticating a user's login information;

[2275] 10. The system of claim 1, further comprising means for generating a session ID accessible to a user after login.

[2276] (Claim 3)

[2277] A means for inputting user-selected design themes and component information into the AI ​​algorithm;

[2278] 10. The system of claim 1, further comprising means for generating a custom design using an AI algorithm.

[2279] "Example 1"

[2280] (Claim 1)

[2281] means for presenting a plurality of design themes and components from which a user can select;

[2282] A means for generating prompt sentences based on the design theme and components selected by the user and inputting the prompt sentences to the generative AI model;

[2283] means for generating and displaying a preview URL of the generated design to the user;

[2284] means for receiving and regenerating approval or correction instructions from the user;

[2285] a means of calculating and paying royalties to protect intellectual property;

[2286] The system includes a means for providing the final generated design to a user.

[2287] (Claim 2)

[2288] a means for authenticating a user's login information;

[2289] 10. The system of claim 1, further comprising means for generating a session ID accessible to a user after login.

[2290] (Claim 3)

[2291] A means for inputting user-selected design themes and component information into the AI ​​algorithm;

[2292] 10. The system of claim 1, further comprising means for generating a custom design using an AI algorithm.

[2293] "Application Example 1"

[2294] (Claim 1)

[2295] means for presenting a plurality of design themes and components from which a user can select;

[2296] means for generating a design based on a user-selected design theme and components;

[2297] means for displaying a preview of the generated design to the user;

[2298] means for receiving and regenerating approval or correction instructions from the user;

[2299] a means of calculating and paying royalties to protect intellectual property;

[2300] a means for providing the final generated design to a user;

[2301] A system that includes a means to preview and modify designs in real time on a smart device.

[2302] (Claim 2)

[2303] a means for authenticating a user's login information;

[2304] 10. The system of claim 1, further comprising means for generating a session ID accessible to a user after login.

[2305] (Claim 3)

[2306] A means for inputting information about a design theme and components selected by a user into a generative AI model;

[2307] 10. The system of claim 1, further comprising means for generating a custom design using a generative AI model.

[2308] "Example 2: Combining Emotion Engines"

[2309] (Claim 1)

[2310] means for presenting a plurality of design themes and components from which a user can select;

[2311] means for generating a design based on a user-selected design theme and components;

[2312] means for displaying a preview of the generated design to the user;

[2313] A means for recognizing a user's emotions in real time and proposing design themes and components based on the recognized emotions;

[2314] means for receiving and regenerating approval or correction instructions from the user;

[2315] a means of calculating and paying royalties to protect intellectual property;

[2316] A means of delivering the final generated design to users

[2317] A system including:

[2318] (Claim 2)

[2319] a means for authenti...

Claims

1. means for presenting a plurality of design themes and components from which a user can select; means for generating a design based on a user-selected design theme and components; means for displaying a preview of the generated design to the user; means for receiving and regenerating approval or correction instructions from the user; a means of calculating and paying royalties to protect intellectual property; The system includes a means for providing the final generated design to a user.

2. a means for authenticating a user's login information; 2. The system of claim 1, further comprising means for generating a session ID accessible to a user after login.

3. A means for inputting user-selected design themes and component information into the AI ​​algorithm; 10. The system of claim 1, further comprising means for generating custom designs using AI algorithms.

Images